The Research on Binocular Vision Based Real-Time Object Indication Recognition Method

摘要

In order to achieve a non-contact interactive operation in particular conditions such as high-temperature, high-voltage conditions and space capsules, a real-time indicated object recognition method is proposed in this paper. It combines eye-finger moving information to estimate the object position. Multi-camera is used to get images containing fingertips and eyes, and binocular vision principle is utilized to estimate the 3D position of fingertips and eyes. According to physiological characteristic, when people indicate objects, the line linking the center of his two eyes and fingertip will pass the object point. So after capturing eyes and fingertips in video stream images with feature point extracting algorithm, a model from 2D image coordination to object scene coordination which can be expressed as a projeclive translation with multi-view restriction is presented. Using this model, 3D position of eyes and fingertips can be estimated from 2D positions in images, and the line linking the center of a person's two eyes and his fingertip is obtained. Intersecting this line and the plane which the object stand on it produces the object point which is the point indicated by the person's finger. This method estimates the absolute position of the object, which means it needn't users to provide any initial benchmark information. Finally, this method is tested by a practical indicated object recognition system with error analysis of camera calibration and image processing result.