Multimodal interaction for 2D and 3D environments [virtual reality]

摘要

The allure of immersive technologies is undeniable. Unfortunately, the user's ability to interact with these environments lags behind the impressive visuals. In particular, it's difficult to navigate in unknown visual landscapes, find entities, access information and select entities using six-degrees-of-freedom (6-DOF) devices. We believe multimodal interaction-specifically speech and gesture-will make a major difference in the usability of such environments.