Interactive Hand Gesture-based Assembly for Augmented Reality Applications

摘要

This paper presents an Augmented Reality (AR) assembly system for the interactive assembly of 3D models of technical systems. We use a hand tracking and hand gesture recognition system to detect the interaction of the user. The Microsoft Kinect video camera is the basis. The Kinect observes both hands of a user and the interactions. Thus, a user can select, manipulate, and assemble 3D models of mechanical systems. The paper presents the AR system and the interaction techniques we utilize for the virtual assembly. The interaction techniques have been tested by a group of users. The test results are explained and show that the interaction techniques facilitate an intuitive assembly.