Passive hand pose recognition in virtual reality

摘要

In this Poster we present a hand pose recognition interface based on passive tracking: currently four poses can be detected on both hands, using a small marker set, attached on fingers and on the back of the hands. This user interface is designed to support a natural way of interaction with objects in Virtual Reality, permitting users to quickly switch among selection, translation and rotation commands. The interface described here is part of a multimodal platform where sound parameters can be changed without the use of musical instruments or controllers, but through free hand mesh manipulation.