METHOD AND SYSTEM FOR VISION-BASED INTERACTION IN A VIRTUAL ENVIRONMENT

摘要

Method, computer program and system for tracking movement of a subject within a video game. The method includes receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to generate a volumetric three-dimensional representation of the subject, identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to features indicative of movement of the subject relative to the fixed position sensors and the subject, presenting one or more objects as the subject of a video game on one or more three dimensional display screens, and using the plurality of fixed position sensors to track motion of the features of the subject to determine interaction of one or more of the features of the subject and one or more of the one or more objects on one or more of the one or more the three dimensional display screens.