Head-mounted display device with a camera imaging eye microsaccades

摘要

In one embodiment, a head-mounted display device comprises an augmented reality display, a camera positioned to capture images of at least one eye of the user at different times, an ambient light sensor, a speaker, and one or more processors that process the images to determine a change in size of at least one pupil of the user independent of a change in output from the ambient light sensor, determine at least one of an eye microsaccade amplitude, an eye microsaccade frequency, an eye gaze direction, and vergence, and provide a form of audio alert signal or a form of display alert signal when the change in size of at least one pupil indicates constriction or dilation and the eye microsaccade amplitude passes an eye microsaccade amplitude threshold, the eye microsaccade frequency passes an eye microsaccade frequency threshold, the eye gaze direction changes, or the vergence changes.