System and method for detecting human gaze and gesture in unconstrained environment

摘要

Systems for gaze and gesture detection in an unconstrained environment include a 360 degree (omnidirectional) camera system, one or more depth sensors, and associated programs, and program instructions for determining the subject of human users' attention in a processor and an unconstrained environment.The illustrated system may identify objects using gaze, gesture detection, and / or speech recognition.The system may generate a saliency map and identify interest areas.A directional vector may be projected on the saliency map in order to discover the location where the interested area intersects.Once the target is identified, the system may identify the object of interest.Diagram