DEVICE FOR INTEGRATING GESTURE RECOGNITION AND ULTRASONIC TACTILE FEEDBACK AND METHOD AND USE THEREOF

摘要

Provided in the invention is a device and method for integrating gesture recognition and ultrasonic tactile feedback. The device integrates functional units comprising a camera, an illumination unit and an ultrasonic nozzle assembly inside gloves, feeds back the hand operation in real time, achieves accurate recognition and tracing to the hand actions of a user and converts tactile information fed back into forces or force moments directly acting the hands of the user, so that an operator can produce a real touch feeling in a virtual environment, and meanwhile touch feeling at multiple angle and strengths can be also simulated, the gesture recognition speed and accuracy are improved, and the fidelity and immersion degree of virtual reality experience are increased. The invention also relates to use of the device for integrating gesture recognition and ultrasonic tactile feedback in virtual reality, augmented reality and mixed reality.