An Incremental Learning Based Gesture Recognition System for Consumer Devices Using Edge-Fog Computing

摘要

Gesture based systems are attracting more and more researchers to develop a single point control for consumer devices. Most of the existing works use wearable devices or camera based solutions, thus requiring additional resources. This paper presents an incremental learning based gesture recognition system that uses gyroscope sensor of Edge device (mobile phone) to recognize gesture of user and select the function of consumer device. Accelerometer sensor of the mobile phone is then used to control the magnitude of the selected function. User also gives speech input along with the gesture, which is recognized by the Fog device (laptop) and its result is used by the system for incremental learning. The system is implemented by developing an application on the mobile phone and various experiments are performed for validating the accuracy of the system.