INTERACTIVE SYSTEM BASED ON MULTIMODAL GESTURES AND METHOD USING SINGLE DETECTION SYSTEM

摘要

This document describes a method and system for enabling efficient and complementary natural multimodal management-based interaction with a computerized system that displays visual feedback information on a graphical user interface on an interaction surface. The interaction surface is located within the truncated cone of an imaging device comprising a single detection system. The system uses the only sensing system to detect touch gesture interactions with the interaction surface and three-dimensional non-touch gesture interactions in areas or volumes above the interaction surface performed by the hands of an user. The two types of interaction are contextually associated with an interaction command controlling the computerized system when the gesture has been detected. The system includes a projection system to display the graphical user interface and visual feedback on the interaction surface.