Effects of visual and haptic latency on touchscreen interaction: A case study using painting task

摘要

This paper reports a user study on the effects of latency in visual and haptic feedback on touchscreen interaction for a painting task. Our work was motivated by recently emerging multimodal use of touchscreens and electrostatic friction displays with high-quality 3D graphics. We designed and implemented a painting application on a touchscreen that enabled users to paint a 3D sculpture with their finger pad while perceiving haptic feedback through electrovibration. Software-induced latency was varied from 0 to 120 ms for both visual and haptic feedback. Participants' task was to paint on the 3D sculpture as quickly and accurately as possible. For performance assessment, we measured task completion time and execution error. We also obtained subjective responses to four questions (easiness, responsiveness, pleasantness, and the sense of control) related to user experiences. Experiment results indicated that visual latency is critical for both task completion time and task execution error whereas haptic latency is for task execution error, but not for task completion time. Both latencies affected the subjective responses, but visual latency had more apparent effects.