Integrating Usability Evaluations into the Software Development Process:Concepts for, and Experiences from, Remote Usability Testing

摘要

This thesis addresses the integration of usability evaluations into the software development process. Theintegration here is contextualized in terms of how to include usability evaluation as an activity in thesoftware development lifecycle.Even though usability evaluations are considered as relevant and strategic human–computer interaction(HCI) activities in the software development process, there are obstacles that limit the complete, effectiveand efficient integration of this kind of testing into the software development process. Two mainobstacles are the cost of usability evaluations and the software developers' resistance to accepting users’opinions regarding the lack of usability in their software systems.The ‘cost obstacle’ refers to the constraint of conducting usability evaluations in the software process dueto the significant amount of resources required by this type of testing. Some strategies recommend theuse of alternative usability evaluation methods, or an improvement of the usability evaluation process, inorder to overcome this obstacle. The ‘resistance obstacle’ refers to the behavior of software developerswho do not accept users’ opinions regarding their software. In order to overcome the resistance obstacle,some studies suggested involving software developers, alongside users, in the conduction or observationof usability evaluations.In this thesis, I am proposing a comprehensive approach for both obstacles by using a synchronousremote usability testing method called remote synchronous testing. By using this method, the evaluatorsand users are separated while the usability evaluations are conducted. Considering this, my overallresearch question was: How can remote usability testing contribute to resolving the cost and resistanceobstacles by providing an effective and efficient integration of usability evaluations into a softwaredevelopment process? In response to the research question, I conducted two surveys and a series ofempirical studies. Six published paper contributions were produced during the PhD project.My PhD research concluded that the remote synchronous testing method can contribute to resolving bothcost and resistance obstacles. In the case of the cost obstacle, the developers can use the method toconduct complete usability evaluations in less time. In terms of usability problems detected, the methodhas similar results. The developers can integrate usability evaluations into modern software developmentprocesses, as the agile methods, by using an iterative scheme of small tests. The efficiency of the methodrelies on the fact that all the activities in the test process require much less time than at the lab, while stillobtaining similar results. In the case of the resistance obstacle, the remote synchronous testing methodcan provide a practical environment where developers can interact with users in a usability evaluationcontext. By doing this, the developers improve their understanding of usability and this enables anunconscious contagion process of users’ emotions, something which will increase the developers’empathy towards users. The efficiency of the method is grounded in the fact that it allows a remoteinteraction with users, which facilitates the emotional contagion process.