HYBRID HAND TRACKING OF PARTICIPANTS TO CREATE BELIEVABLE DIGITAL AVATARS

摘要

A system is described for providing an enhanced virtual reality experience (VR) for players. The system comprises both fixed and mobile tracking systems, a merged reality processor, and VR engines. A plurality of cameras are mounted over and along a perimeter of a stage. The cameras track the players' movements and generate real-time positional data of each player on the stage. Player-mounted tracking systems produce data tracking movements of the players' arms, hands, and fingers. The merged reality processor compiles a most accurate set of tracking data from the positional data and the tracking data, wherein the merged reality processor detects whether the tracking data is ambiguous. The VR engines use the selected sets of data from the motion tracking system and the head-mounted tracking systems to generate realistic VR representations of the players' arms, hands, and fingers that correspond with the actual position of the players arms, hands, and fingers.