USER INTERFACE DISCOVERY AND INTERACTION FOR THREE-DIMENSIONAL VIRTUAL ENVIRONMENTS

摘要

Devices, systems, and methods for interacting with a three-dimensional virtual environment, including receiving an input associated with a change in pose of a user's hand; estimating, based on at least the input, a first pose in the virtual environment for an input source associated with the hand; identifying a surface of a virtual object in the virtual environment; rendering a frame depicting elements of the virtual environment, the frame including a pixel rendered for a position on the surface; determining a distance between the position and a virtual input line extending through a position of the first pose and in a direction of the first pose; changing a pixel color rendered for the pixel based on the distance between the position and the virtual input line; and displaying the frame including the pixel with the changed pixel color to the user via a head-mounted display device.