Work Performance Ratings: Measurement Test Bed for Validity and Accuracy Research

摘要

The present research effort developed a performance measurement test bed for investigating the work performance measurement process. The medium chosen for the test bed was a management skills assessment center. Eight assessment centers were conducted to generate a domain of dimension behaviors for an in-basket, two role-play, and two leaderless group discussion exercises. The dimensions and scaled behaviors were arranged into behaviorally anchored rating scale and behavioral checklist formats, and used in three validation experiments to rate the videotaped performances of assessment center participants. Exercise content and rating format were found to moderate the construct validity of the dimensions, suggesting that the conception of a performance dimension should be limited in coverage to a particular exercise rather than the entire domain of performance. Target scores were also established for one of the role-play exercises and assessment center experts were provided enhance opportunities to rate videotapes of role-play performance. The ratings demonstrated extremely high validity and interrater agreement, indicating that they could serve as target scores. Keywords: Accuracy, Measurement test bed, Rater training, Rating, Validity, Videotapes, Work performance. (SDW)