A Novel Framework for Enhanced Flat Object Manipulation through Reinforcement Learning and Mixed Reality Integration

Abstract

This paper addresses the challenge of flat object manipulation without conventional sensors and specialized grippers, introducing a novel HRI framework utilizing mixed reality (MR) technology via an MR headset (MRH) and deep reinforcement learning (DRL) technique. The results showed that our framework can reach a success rate of 99.5 % in manipulation tasks.