Full Screen Touch Detection for the Virtual Touch Screen

摘要

The authors have proposed a virtual touch screen with a projector and a camera. This provides touch buttons besides the main contents both on the projection surface. The camera monitors user's touch on the buttons. In order to increase a degree of operability equal to touch panels, we present a method that enables touches to be detected at any position within the projected main content, using a depth camera to extract the user's hand and finger about to touch and an RGB camera to detect the user's finger touch on the screen. We also show evaluation results on the touching accuracy and processing speed.