Collecting Data From Physicians Via Web-Based Surveys: Recommendations for Improving Response Rates

摘要

Advances in technology have increased the utility of online data collection strategies. Although this approach to gathering information is widely utilized, limitations do exist. The authors utilized an online methodology during a recent study designed to assess physician knowledge regarding policy and law related to HIV/AIDS, however a sufficient response rate was never attained. In light of this failure a secondary study was conducted (discussed herein) to examine the underlying mechanics behind this deficiency. Focus groups were conducted to understand why physicians failed to participate. Subjects identified lack of survey notification and perceived relevance of the research question to their profession as important factors. Results also indicate that future online surveys should accompany immediate feedback and guaranteed incentives, target specific clinical areas, be short and user-friendly, and announced using a multi-level approach. Although quite useful as a method of data collection, limitations of online data acquisition are many and should be examined thoroughly prior to test administration Introduction For the past decade the Internet has served as a conduit for the global dissemination of information, allowing for the rapid distribution of research data via the World Wide Web. More recently this venue has been exploited for the collection of research data as well. Advances in technology and the omnipresence of both computers and individual access to the Internet have increased the potential effectiveness of online data collection strategies. Benefits of this approach may include increased accuracy of data entry, timely collection of participant responses, and a reduction in costs specific to survey replication. Indeed, the literature offers support for the use of Internet-assisted distribution of information as well as data collection. For example, Tate, Wing, and Winett (1) used the Internet to deliver a behavioral weight loss program where participants received instructional material via electronic mail, submitted online dietary progress reports, and communicated with others through an online bulletin board. Similarly, Baehring, Schulze, Bornstein, & Scherbaum (2) constructed an online assessment tool to assist in the identification of those with undiagnosed non-insulin dependent diabetes mellitus. A web-based approach was also used by Pereira, Bruera and Quan (3) in collecting data from 417 palliative care health professionals regarding their use of the Internet. In terms of online survey efficacy, a number of authors have discussed their successes at obtaining data. In a study regarding the opinions of emergency physicians on the use of emergency ultrasound, Blaivas (4) gathered data via an anonymous online survey from 1,600 physicians yielding a response rate of 63%. In a similar study of emergency medicine residency applicants, data were collected from 138 of a possible 250 subjects, a response rate of 55%. (5) Evidence also exists that online modalities may be as effective at conducting psychological experiments compared to lab-based experiments, lending additional support for the utility of the electronic medium. (6) Other authors have reported similar findings (7).Although the literature discusses the possibility of the anonymous online survey becoming a commonly used tool in research, few authors discuss the deficiencies, biases, and limitations of this methodology especially from a first hand perspective. Like other methods of data collection, bias is an issue to be considered. For example, bias is introduced when data are collected electronically with disregard for those who lack computer skills or technology sufficient to complete the instrument. Error also emerges when computers are used to collect information compared to traditional paper and pencil approaches. To examine this type of bias Yates, Wagner, and Suprenant (8) reported a comparative study in which 63 undergraduate males and females were