Live demonstrationen IR-based facial expression tracking sensor for head-mounted displays

摘要

We will present to the audience, for the first time, the operation of an IR-based Facial Expression tracking sensor for Head-Mounted Displays(HMD). The proposed sensor uses lateral propagation characteristics of IR light on human skin. The demo setup consists of VR HMD and laptop computer. All components of sensors including IR LED's and Photo Diodes are adhered to and integrated into the form interface of commercial VR HMD. The laptop displays instantaneous values of each sensor data which incorporate user's facial expressions. The proposed sensor and HMD platform can enable wide variety of interactions in cyberspace for future VR and MR applications.