Enhancing Virtual Reality Systems with Smart Wearable Devices

摘要

The proliferation of wearable and smartphone devices with embedded sensors has enabled researchers andudengineers to study and understand user behavior at an extremely high fidelity, particularly for use in industries suchudas entertainment, health, and retail. However, identified user patterns are yet to be integrated into modern systems withudimmersive capabilities, such as VR systems, which still remain constrained by limited application interaction models exposedudto developers. In this paper, we present SmartVR, a platform that allows developers to seamlessly incorporate user behaviorudinto VR apps. We present the high-level architecture of SmartVR, and show how it facilitates communication, dataudacquisition, and context recognition between smart wearable devices and mediator systems (e.g., smartphones, tablets, PCs).udWe demonstrate SmartVR in the context of a VR app for retail stores to show how it can be used to substitute the requirementudof cumbersome input devices (e.g., mouse, keyboard) with more natural means of user-app interaction (e.g., user gestures such as swiping and tapping) to improve user experience.