Real Time Hand Gesture Recognition System for Dynamic Applications

摘要

Virtual environments have always been considered as a means for more visceral and efficient humancomputer interaction by a diversified range of applications. The spectrum of applications includes analysisof complex scientific data, medical training, military simulation, phobia therapy and virtual prototyping.Evolution of ubiquitous computing, current user interaction approaches with keyboard, mouse and pen arenot sufficient for the still widening spectrum of Human computer interaction. Gloves and sensor basedtrackers are unwieldy, constraining and uncomfortable to use. Due to the limitation of these devices theuseable command set based diligences is also limited. Direct use of hands as an input device is aninnovative method for providing natural Human Computer Interaction which has its inheritance from textbasedinterfaces through 2D graphical-based interfaces, multimedia-supported interfaces, to full-fledgedmulti-participant Virtual Environment (VE) systems. Conceiving a future era of human-computerinteraction with the implementations of 3D application where the user may be able to move and rotateobjects simply by moving and rotating his hand - all without help of any input device.The research effort centralizes on the efforts of implementing an application that employs computer visionalgorithms and gesture recognition techniques which in turn results in developing a low cost interfacedevice for interacting with objects in virtual environment using hand gestures. The prototype architectureof the application comprises of a central computational module that applies the camshift technique fortracking of hands and its gestures. Haar like technique has been utilized as a classifier that is creditworthyfor locating hand position and classifying gesture. The patterning of gestures has been done for recognitionby mapping the number of defects that is formed in the hand with the assigned gestures. The virtual objectsare produced using Open GL library. This hand gesture recognition technique aims to substitute the use ofmouse for interaction with the virtual objects. This will be useful to promote controlling applications likevirtual games, browsing images etc in virtual environment using hand gestures.