Enhancing programme evaluation using the Audience Response System.

摘要

Context and setting Programme evaluation serves many important purposes, which include determining effectiveness, making improvements, documenting success, and measuring outcomes. Most residencies are required to evaluate their programme annually with both faculty staff and residents. Why the idea was necessary In our surgical residency, residents have traditionally been asked to complete a paper-based evaluation of the programme, specifically addressing programme goals and objectives, quality of rotations, quality of teaching, and quality of life as a resident. Evaluations were then collected, data collated manually and results shared with service faculty leaders. The process was aimed at closing the loop in terms of implementing improvements after the review; however, resident involvement was minimal in this part of the process. What was done During resident education conferences in May 2005 and 2006, a formal programme review was held using the Audience Response System (ARS). The ARS is a computer software program, which uses hand-held machines that capture and tabulate question response data. A series of programmatic questions were devised, formatted into a PowerPoint presentation, and individually posed to the residents. Examples of questions were: 1. Do you feel accountable for the patients and their moment-to-moment care on your assigned service? (Yes/No) 2. How satisfied are you with the evaluation methods that the residency uses? (Dissatisfied/Satisfied/Very satisfied) 3. Do you feel the chairman's conference is valuable to your education? (Yes/No) Question response data was immediately visualised by the audience via the ARS. Brief discussion among residents and education faculty members ensued after each question.