Indirect touch interaction with stereoscopic displays using a two-sided handheld touch device

摘要

We propose an indirect touch 3D interface using a two-sided handheld touch device for interactions with dense datasets on stereoscopic displays. Smartphones have been explored for virtual reality (VR) interaction with their touch and additional sensing capabilities. These capabilities are expanding, and this work explores the possibilities for a smartphone able to sense touch on both sides. To simulate this, two android mobile phones are combined back-to-back. The top touch surface is used for primary or fine interactions (selection/translation/rotation) and the bottom touch surface controls secondary or coarser aspects such as mode control or feature extraction. The two surfaces are programmed to recognize input from a total of 4 digits - two top and two bottom. The four touch areas enable 3D object selection, manipulation, and feature extraction using combinations of simultaneous touches. The users need not perform more complex gesture sequences or shift their focus to the handheld to pick a menu item (for example), unlike typical single-sided approaches.