Tracking the Effectiveness of Usability Evaluation Methods

摘要

We present a case study that tracks usability problems predicted with sixusability evaluation methods (Claims Analysis, Cognitive Walkthrough, GOMS, Heuristic Evaluation, User Action Notation, and simply reading the specification) through a development process. We assess the methods predictive power by comparing the predictions to the results of user tests. We assess the methods persuasive power by seeing how many problems led to changes in the implemented code. We assess design-change effectiveness by user testing the resulting new versions of the system. We conclude that predictive methods are not as effective as the HCI field would like and discuss directions for future research.