Gesture-Based Control of Spaces and Objects in Augmented

摘要

A multi-modal system integrating computer vision and speech recognition to enable interaction with virtual spaces/objects by natural gestures and speech is described. Computer vision algorithms are employed to measure and interpret hand/finger movement of the user. Our research focuses on detection, tracking, recognition and visual feedback of the hand and finger movements in a cooperative user environment and the integration of gesture and speech recognition for man/machine communication.