AUGMENTED REALITY HUMAN-COMPUTER INTERACTION DEVICE AND A CONTROL METHOD BASED ON GAZE TRACKING

摘要

The invention particularly relates to an augmented reality human-computer interaction device and a control method based on gaze tracking, belonging to the field of gaze tracking and embedded devices. The device comprises: an eyeglass frame, a left interaction system, and a right interaction system. Each system comprises a miniature eye tracking camera, an optical waveguide AR lens, an embedded processor, a drive control board, and a wire management slot. The method comprises: 1) establishing an eye movement interaction system; 2) training a convolutional neural network; 3) processing data of collected images; and 4) performing eye movement recognition. The present invention improves the method for obtaining valid information and the efficiency thereof, and enables gaze-based interaction which can augment voice-based or gesture-based operations. That is, gaze-based interaction can be employed when the sources of these other two methods are occupied.