PROJECTION ENHANCEMENT-ORIENTED GESTURE INTERACTION METHOD BASED ON MACHINE VISION

摘要

A projection enhancement-oriented gesture interaction method based on machine vision, comprising the following steps: step 1, performing joint calibration on a projector and a camera; step 2, opening a camera to collect a gesture-free image; step 3, converting the gesture-free image into a background image and preprocessing the background image; step 4, eliminating background information of the current image by using a frame difference method to obtain a gesture image, and then performing edge contour detection on the gesture information by utilizing a Canny operator to obtain a gesture contour; step 5, traversing the obtained gesture contour to obtain fingertip point coordinates; step 6, performing position and time determination on the fingertip point coordinates, and then transmitting the determination result to a computer; and step 7, analyzing the determination result, and the computer then executing a corresponding operation. According to the method, on an assembly site, an assembly worker can realize interaction only by a simple gesture without wearing equipment, so that natural interaction is truly realized, and the practicability of the system is improved.