As technology becomes increasingly mobile-focused, usability techniques must evolve to support users inthis next era of computing. Usability testing of mobile applications and websites can be conducted witheither a mobile device, or a desktop emulator that simulates the device’s content and functionality.Emulator testing offers several advantages, such as the capacity to test multiple devices in rapid succession,though device testing may offer more valid data. Although both methods are commonly implemented inmobile usability testing, little research has directly compared the findings generated from each approach.The current study examines whether emulator and device testing produce differences in eye trackingmeasures and established metrics that assess the ISO 9241-11 usability dimensions of effectiveness,efficiency, and satisfaction. Results indicated that mean task completion times and mean fixations per taskwere greater for participants in the emulator condition than for those in the device condition for two of thefourteen tasks tested. A qualitative analysis of potential drivers of these effects is presented, andimplications for substituting device testing with emulator testing are discussed.
展开▼
