Using motion capturing sensor systems for natural user interface

摘要

This paper describes the design and implementation of a natural sensor-based interface intended for 3D graphics software packages and virtual reality (VR) environments. The interface operates through natural pointing gestures and replaces the conventional pointing devices which are usually used to interact with such software environments. It is implemented on the basis of the motion capturing sensor system (MCSS) Microsoft Kinect for Windows. The prototype integration with the 3D software package Blender as well as implementation details and challenges are discussed.