We provide an effective way to interact with public large display at distance by taking advantages of the multimodal input and output of smart phone. We analyze the characteristics of the large display remote interaction, based on which a smart phone 3D interaction framework is presented; then according to the characteristics of the interaction process, we propose a real time, effective and accurate orientation estimation algorithm by using inertial sensors; in addition, two interaction techniques respectively for 2D and 3D interaction scenarios with large display are designed, and three application prototypes are demonstrated. Experiments revealed the rationality and effectiveness of interacting with large display at distance through smart phone.%利用智能手机的多通道输入和输出功能可为解决大屏幕远距离交互提供了一条有效途径.通过分析大屏幕远距离交互的特点,给出了一个基于智能手机的三维交互框架；针对利用惯性传感器的计算智能手机空间姿态问题,结合交互的特点提出了一种实时、快速、准确地解算手机的空间姿态的算法；基于手机的空间姿态和触摸交互,针对大屏幕交互中二维交互与三维交互分别设计了2类交互技术,并给出3个应用实例.最后通过实验对这3个实例进行了实验评估,结果表明智能手机在大屏幕、远距离交互中是合理与有效.
展开▼
