Method and system to present immersion virtual simulations using three-dimensional measurement

摘要

A virtual simulation system generates an image of a virtual control on a display that may be a heads-up-display in a vehicle. The system uses three-dimensional range finding data to determine when a user is sufficiently close to the virtual control to manipulate the virtual control. The user manipulation is sensed non-haptically by the system, which causes the displayed control image to move in response to user manipulation. System output is coupled, linearly or otherwise, to an actual device having a parameter that is adjusted substantially in real-time by user-manipulation of the virtual image. System generated displays can be dynamic and change appearance when a user's hand is in close proximity. displays can disappear until needed, or can include menus and icons to be selected by the user who points towards or touches the virtual images. System generate images can include representation of the user for use in a training or gaming system.