Augmented reality for enhancing tele-robotic system with force feedback

摘要

AbstractIn the teleoperation, the force feedback is indispensable, which can enhance the sense of presence of the operator and help the operator accomplish tasks comfortably. The time delay is one of the main challenges that influence the stability of the teleoperation systems, which leads to the discontinuous operation. Thus building a local virtual model in the master side is an effective way to solve this problem. In this paper, a new method is presented to reconstruct the virtual model of the remote object. The virtual model can estimate the real-time force feedback to the operator and eliminate the effects of the time delay. Then the tele-robotic system based on augmented reality technology is set up in our laboratory. In the tele-robotic system, the dynamic parameters including damping and stiffness of the virtual model are constantly updated by utilizing the positions and forces information from sensors of the remote robot site. Finally, the effectiveness of the proposed method and the correctness of the visual model parameters are verified by two experiments.Highlights？We presented a method to correctly reconstruct the virtual model of the remote object.？Our method applies haptic augmented reality technology to the operator site rather than the remote robot site.？Our method can bring the real-time force feedback to the operator without the effects of the time delay.？The average relative error between the contact force of the real and the virtual environment is1.85±0.85%.]]>