Usability evaluation is now considered an essential procedure in developing a spoken language dialogue system (SLDS). This paper proposes a systematic framework for evaluating the usability of SLDSs. The framework consists of what to evaluate and how to evaluate. What to evaluate includes components, evaluation criteria, and usability measures to evaluate various aspects of SLDSs. With respect to how to evaluate, a procedure for developing scenarios and scenario-based evaluation methods are introduced. In addition, a case study, in which the usability an SLDS was evaluated, was conducted to validate the proposed framework. The results of the case study showed successfully the usability level, usability problems, and design implications for further development. The framework proposed in the study can be practically applied to usability evaluation of SLDSs.
展开▼
