Augmented reality display device with deep learning sensor

摘要

PROBLEM TO BE SOLVED: To provide an augmented reality display device having a suitable deep learning sensor. A head-mounted augmented reality (AR) device transfers different types of sensor data from multiple sensors (eg, an inertial measurement unit, an outward facing camera, a depth sensing camera, an ocular imaging camera, or a microphone). Receive and use different types of sensor data and hydra neural networks (eg, face recognition, visual search, gesture identification, semantic segmentation, object detection, light detection, simultaneous positioning and mapping, relocation). It can include a hardware processor, which is programmed to determine an event out of multiple events. [Selection diagram] FIG. 29.