Teaching Assistant System used Eye Tracking Device Based on Gaze Estimation by Neural Network and Intention Recognition by Fuzzy Inference

摘要

Intention recognition can use multiple factors as inputs such as gestures, face images and eye gaze position. On the other hand，eye tracking technology，with its special advantages of applying to Human-Computer Interaction (HCI)，can be utilized to develop assistant systems for people with mobility difficulties. In this paper, we propose gaze estimation position information as input of fuzzy inference to achieve intention recognition based on object recongition and construct an assistant system by using humanoid robot. Our approach is divided into three parts: user's gaze estimation, intention recognition and behavior execution. In gaze estimation part, differing from the previous studies, neural network has been used as the decision making unit, and then gaze position on computer screen is estimated. In intention recognition part, user intention is recognized by using gaze frequency and continuous gaze staying time as input of fuzzy inference after an initial intention region set has been found. At last, by using an autonomous humanoid robot, experiments are performed based on the result of intention recognition. after confirmed by user, the robot was controlled with and assistant task for user precisely.