Gesture-Based Human-Computer-Interaction Using Kinect for Windows Mouse Control and PowerPoint Presentation

摘要

One of the most important research areas in the field of Human-Computer-Interaction (HCI) is gesture recognition as it provides a natural and intuitive way to communicate between people and machines. Gesture-based HCI applications range from computer games to virtual/augmented reality and is recently being explored in other fields. The idea behind this work is to develop and implement a gesture-based HCI system using the recently developed Microsoft Kinect depth sensor to control the Windows Mouse Cursor as well as PowerPoint presentations. The paper can be divided into two major modules namely, hand detection and gesture recognition. For hand detection, the application uses the Kinect for Windows Software Development Kit (SDK) and its skeletal tracking features to detect a user's hand which enables the user to control the Windows mouse cursor. Gesture recognition involves capturing user gestures and interpreting motions or signs that the user performs to simulate different mouse events.