A novel untouched interactive multimedia display system with large screen

摘要

The paper presents a novel bare-hand tracking and interactive method for remote operating LTSS, which offers simple, high resolution and robust against occlusion. It is a vision-based system mainly using a projector, a large screen, two ordinary cameras and data processing equipment. The system allows users to interact with the information by pointing large screen directly with their fingertips approximately parallel to ground. We propose a series of computer vision algorithms to fix initial position coordinates mapping, fingertip detection, fingertip tracking, fingertip pose recognition and generate control instructions. Experiments indicate that our approach extremely suit to be embedded into real-time common human-computer interaction systems.