Communication Board and Visual PerceptionTraining Contents with Gaze Tracking for Augmentative and Alternative Communication(AAC)

摘要

This study proposed an gaze tracking system which detects the pupil and the center point of the glints from near-infrared camera images and, in order to use this system, implemented visual perception training contents and augmentative and alternative communication software. The center of the pupil and the center of two glint points of the eye images used for gaze tracking were extracted by using a model with four kinds of simple features. After using the calculated distance between the two centers to locate the relative position of the eye-gaze on the monitor, the x and y coordinates of the screen were mapped to match the gaze and the mouse pointer. The visual perception training contents for using the developed gaze tracking system consists of such components as visual acuity, eye movement speed, visual reaction rate, and visual concentration. Furthermore, software was implemented to enable an alternative means of communication to be used by symbols which convey the meaning of vocabulary being used in spoken language.