Qualitative Data Differences between a Focus Group and Online Forum Hosting a Usability Design Review: A Case Study

摘要

Traditional usability assessment test methods often do not accommodate conventional resource constraintswhich typically result in testing renouncement; thus, new methods are needed. This case study reviews anew test method, the internet forum, and compares data outcomes related to participant participationbetween this forum and the traditional focus group. The same design review was hosted in all groups: twoforum groups (n=28 and 7) and two focus group sessions (n=14 and 10). Data was coded to determinewhat percentage of the users responded to each posed question, how many user conversations occurred andhow many design suggestions were provided. Thus, more participants responded to questions in the forumrather than the focus group but more forum conversations occurred comparatively. However, theseconversations did not inspire more designs suggestions comparatively. Also, forum participants most oftendirectly answered the questions and provided more design suggestions directly related to the questionsposed while focus group participants offered more off-topic responses that provided important richcontextual information (e.g., explanation behind user requirements). Research implications, threats tovalidity and future work are also discussed.