3D gesture-based control system using processing open source software

摘要

The following paper discusses the design and implementation of a 3D gesture-based control system that can substitute any complex human-machine interface with a simpler and more familiar one. This system that can be used by any user disregarding his/her background (age, education, health, language etc.…), making it dependent on nothing more than the movements of the user’s hands, thus allowing them to be free from all hardware while interfacing, and making the system surpass in its simplicity other systems that include held or touched interfaces. It utilizes the Kinect sensor’s image input parts (IR projector and IR camera) for computer vision along with an open source software called Processing for reception and analysis of input data to decision making on what actions and steps to perform, and even for communicating with the database. A MySQL database will be responsible for holding the information of the system and to handle them (adding, deleting, retrieving, etc.…). Even though the system will be designed for a library to display information about the books available in it, however the proposed system design will be broad enough to allow its implementation in many other domains, making people’s lives more efficient and innovative. Implementation steps are listed along with a detailed explanation of how the system works. The simulation results showing the system performance in different environment conditions and some screenshots are also displayed.