VR Hand shape matching VR sign language education system using gesture recognition technology

摘要

The present invention relates to a hand shape matching VR sign language education system using gesture recognition technology, and a base station to which a camera for tracking the shape and position of a hand is attached; and VR HMD worn by the user; and A control unit that tracks the user and the user's hand using a hand tracking algorithm in the HMD, and conducts learning according to the learning guide of a 3D object related to education displayed through the HMD; The present invention improves immersion and learning effects through virtual reality seen through VR by using VR devices using gesture recognition technology, and stimulates visual elements to show the results of user actions as visual events. will receive an impactful education, and increase the learning effect by simulating a simple conversation that can be done in sign language, starting with basic sign language words, In addition, the user can directly operate sign language and conduct an evaluation by means of the sign language education system using VR. It has a remarkable effect in that it is possible to communicate proficiently, to practice and learn accurately, and to learn sign language in an easy and fun way for the deaf who does not know sign language or ordinary people who want to learn sign language.