Do Distractions During Web Survey Completion Affect Data Quality? Findings From a Laboratory Experiment

摘要

Web survey respondents are frequently distracted during survey completion, which potentially affects the quality of data they provide. This article reports on results from a laboratory experiment examining how distractions during web survey completion influence data quality. Participants were randomly assigned to experimental groups using a 2 (device type) x 3 (form of distraction) between-subject factorial design. They were asked to complete a web questionnaire on either a PC or a tablet and were allocated to one of the three distraction conditions: (1) the presence of other people in the room who have a loud conversation, (2) the presence of music, or (3) no distraction. The study examines the effect of distraction on various measures of data quality and attentiveness. While participants felt significantly more distracted in the presence of other people or music, the study found no significant effect of distraction for any of the data quality and attentiveness measures. The findings are encouraging for survey practitioners: Even if web respondents listen to music or are in noisy environments, these forms of distraction generally do not seem to affect the quality of responses they provide.