360 Degree Feedback: A Novel Format for a Program Evaluation Committee in an Academic Emergency Medicine Residency Program

摘要

Background: The ACGME mandates that residencyprograms maintain a program evaluation committee (PEC) whichevaluates the educational activities of the program annuallyfrom the vantage point of resident and faculty stakeholders.While the traditional PEC structure does not include input fromadministrative, nursing, or ancillary staff, these individualsoften have useful feedback. We sought to enrich our programevaluation process by eliciting 360 degree reviews of educationalexperiences from emergency medicine residents, off-serviceresidents and faculty, nursing staff, administrators, and otherrelevant stakeholders in monthly, rotation-specific reviews. Toour knowledge, this represents a novel approach to the PECand provides the opportunity to explore untapped resources forimproving educational experiences.Educational Objectives:1. Initiate comprehensive, systematic evaluation ofprogram educational experiences in line with functionof PEC2. Collect feedback from key stakeholders, includingnon-traditional sources, in order to identifyactionable, high-yield recommendations forimprovement3. Establish longitudinal tracking of keyrecommendations to ensure implementation ofmeaningful changeCurricular Design: We implemented a comprehensivemulti-source review system in order to expand andaccelerate our program evaluation process. Each month,five reviewers (chief resident, resident, program leader,core faculty, administrator) review a documentation packetand conduct interviews of key stakeholders (includingnon-traditional sources) using reviewer-specific interviewtools. The findings are presented for residency-widediscussion at monthly meetings and then integrated intoa final document highlighting strengths, areas of concern,and proposed improvements. This document is sharedwith the rotation director for feedback before negotiatingfinal recommendations, which are tracked for successfulimplementation on a quarterly basis by the PEC.Impact/Effectiveness: The 360 degree review processuncovers significant opportunities for improvement that aremissed by traditional reviews. The negotiation process andformalized recommendations improve accountability onthe part of rotation directors. Lastly, residents demonstrateimproved understanding and engagement in programevaluation and improvement processes.