RemoAct: Portable Projected Interface with Hand Gesture Interaction | Science Publications

摘要

> RemoAct is a wearable depth sensing andprojection system that enables interaction on many surfaces. It makesinteraction with the environment more intuitive through sharing and sendingdata with surrounding devices by applying certain gestures. This system offersa mobile and intuitive solution for interacting using a projected surface onhabitual flat surfaces. Every user has their public and private areas, wherethe user can create tiles on the fly and share it with others and these publictiles are shown to other users through augmented reality. Interaction is made through hand gestures, finger tracking and handtracking. This gives the user more freedom in movement. Different experiments were conducted tocalculate the accuracy and RemoAct ran against different conventional methodsto compare its accuracy, time and user experience. RemoAct takes less time fortwo users to draw one chart. As the system enables the users to worksimultaneously, it reduces the needed time, short compared to successivedrawing. For gesture recognition, accuracy reached 90-95%. Object recognitionand face identification accuracy varied with the variation of light.