Grasp-Shell vs Gesture-Speech: A Comparison of Direct and Indirect Natural Interaction Techniques in Augmented Reality

摘要

In order for natural interaction in Augmented Reality (AR) tobecome widely adopted, the techniques used need to be shown tosupport precise interaction, and the gestures used proven to beeasy to understand and perform. Recent research has exploredfree-hand gesture interaction with AR interfaces, but there havebeen few formal evaluations conducted with such systems.In this paper we introduce and evaluate two natural interactiontechniques: the free-hand gesture based Grasp-Shell, whichprovides direct physical manipulation of virtual content; and themulti-modal Gesture-Speech, which combines speech and gesturefor indirect natural interaction. These techniques support objectselection, 6 degree of freedom movement, uniform scaling, aswell as physics-based interaction such as pushing and flinging.We conducted a study evaluating and comparing Grasp-Shelland Gesture-Speech for fundamental manipulation tasks. Theresults show that Grasp-Shell outperforms Gesture-Speech in bothefficiency and user preference for translation and rotation tasks,while Gesture-Speech is better for uniform scaling. They could begood complementary interaction methods in a physics-enabledAR environment, as this combination potentially provides bothcontrol and interactivity in one interface. We conclude bydiscussing implications and future directions of this research.