Beatbox music phone: gesture-based interactive mobile phone using a tri-axis accelerometer

摘要

In this paper, we propose gesture-based interaction methods using a tri-axis accelerometer for mobile devices. The algorithms for the gesture recognition and the shaking detection are suggested for gesture interaction. They have been implemented in the commercialized mobile phone (model name: SCH-S310). The mobile phone recognizes digits from 1 to 9 and five symbols written in the air. It detects the shaking motion to initiate commands for the gesture interactive games and musical instrument applications. We used the signals from a tri-axis accelerometer to recognize the gestures directly without trajectory estimation. In the experimental study, we achieved 97.01% of average recognition rate for a set of eleven gestures. The rate is cross validated from a whole data set of 3082 gestures from 100 users. The performance of the shaking detection methods shows that gesture-based interaction can be used as input methods of games and musical instrument applications for entertainment.