Visual Interface from Uncalibrated Cameras for Uncalibrated Displays

摘要

A contact-type interface (such as a mouse or a keyboard) is usually used on personal computers. However, this is not convenient if the operator has to use his or her hands for another operation, or if his or her hands are disabled. To deal with such cases, this paper proposes a visual interface in which the mouse pointer on the computer display is controlled by the movement of the operator's eyes via a camera image. Conventional visual interfaces require tedious calibrations of the camera and system. The proposed visual interface works accurately without any calibration. In the proposed system, the gaze point on the display screen can be reliably calculated from the user's projected image by using protective bases and affine bases and the movement of the user's viewing direction. Control of the mouse pointer by means of the proposed system has been successfully tested. The usefulness of the proposed method has been confirmed.