Marker-Based Finger Gesture Interaction in Mobile Augmented Reality

摘要

This paper proposes a mobile AR application that allows the user toperform 2D interactions with the 3D virtual objects. The user is supposed tohold the mobile with his left hand and interact using the other one. In addition,the user is supposed to attach two colored markers (stickers) to his fingers; bluefor the thumb and green for the index. User studies (experiments) wereconducted to test the different interaction types; translation, scaling and rotation.The application run on a Samsung Note 5 device with Android 7 as OS. Ourresults were based on the performance (completion) time per each task pereach participant in addition to a subjective questionnaire that was answered bythe participants after finishing the user studies. According to the results, it wasfound that this approach had a delay which implies low performance and usersfaced a slight difficulty in accomplishing all tasks, yet this approach proved to beengaging and fun.