Usability Issues in Multimodal User Interfaces

摘要

This paper aims to guide multimodal user interface design by answering the following two questions: "When is a multi-modal user interface useful?" and "What factors determine if a multimodal user interface is usable?". For the first question, three general cases are given with specific example applications and with support from the multimodal theory of human memory. As to the second question, a three dimensional model of human-computer interaction and five general usability criteria were given first. Specifically important issues relating to usability of multimodal user interfaces are then listed.