System and method for integrating gaze tracking with virtual reality or augmented reality

摘要

This invention relates to gaze tracking methods and systems integrated with virtual reality (VR) or augmented reality (AR). A system may include one or more cameras for capturing images of a subject's eyes, a display device for displaying a VR or AR image, a first reflecting surface associated with the display device for at least partially reflecting light from the eyes to the one or more cameras and for transmitting the VR or AR image; and a second reflecting surface for at least partially reflecting light from the eyes to the one or more cameras and for receiving the VR or AR image and rendering the VR or AR image to the subject as at least one component of a VR or AR environment. The methods and systems described herein may be used in research, medical, industrial, aerospace, and entertainment applications.