Identifying facial gestures to emulate a mouse: Control application in a web browser

摘要

Computer interfaces continue using mouse and keyboard, although the form of human interaction is based primarily on exchange of audiovisual messages generated by the voice and body gestures in general. Because of the importance of gestures in human communication and the possibility for people with limited mobility of the upper limbs, this research focuses on the development of an interface to emulate the mouse and keyboard through facial gestures and head movement. The system was developed to interact with a web browser by processing and analysis of images provided by a webcam. The interface allows typing for text searching, move the mouse, click by closing one eye, open and navigate between tabs, vertical scroll, zoom, back and leave. Tests show a moving speed of cursor 411 px/s and a write speed of 3.5 characters/s, correct activation of right and left clicks 94% and 92% respectively. Finally, the survey showed a high user satisfaction while browsing on Internet.