触控、笔和空间手势的混合输入

摘要

针对单通道输入条件下输入能力受限的问题, 以触控、笔和空间手势为输入通道, 提出混合输入技术, 允许用户通过双手配合的方式完成操作任务. 首先分析了触控、笔和空间手势的性能特点; 然后结合不同复杂程度的实际操作环境, 提出以笔输入为主的10种双通道和三通道混合输入技术. 性能对比的实证研究结果表明, 相比于单通道笔式输入, 双通道并行输入情况下触控+笔的综合性能最优, 双通道二维空间划分下, 触控点击+笔的性能最优; 包含空间手势的混合输入技术错误率最低, 但定性评估结果却最不理想. 相关结论对基于触控、笔和空间手势的混合交互和界面设计具有参考意义.%Aiming at the limited capacity of single input modality, hybrid input techniques with touch, pen and mid-air gestures were proposed. First, the performance of touch, pen and mid-air gestures was investi-gated. Then, 10 hybrid input techniques with 2 or 3 modalities were proposed and investigated according to operation complexity. Results showed that, compared to Single-modality Pen (S-P), Double-modality Paral-lel Touch + Pen (DP-T+P) performed the best in parallel situation. And Double-modality 2-Dimensional Touch Click + Pen (D2D-TC+P) performed the best in 2-dimensional situation. Although subjects committed the fewest mistakes in the hybrid input techniques with mid-air gestures, they gave it the worst subjective evaluation. The discussions and conclusions can be used as reference for hybrid interaction and interface de-sign with touch, pen and mid-air gestures.