Strategy to Produce Realistic, Cost-Effective Measures of Job Performance

摘要

For most military occupational specialties (MOS), the Army lacks objective measures to assess the ability of Soldiers to perform the technical components of their jobs. The objective of this effort was to develop a methodology to produce realistic and cost-effective measures. The authors identified 11 viable types of assessment methods, including computer-based tests and simulations designed to create an engaging, virtual representation of an MOS. Participants in a clustering workshop used this list, descriptions of MOS, and other materials to identify seven groups of MOS. Common to all MOS in a group was their suitability for assessment using a specific type of assessment. The authors developed a two-phased strategy for collecting job analysis information for each group. They provided strategies to reduce the costs of developing and implementing assessment methods, and developed tools to quantify the level of realism in measures. This effort demonstrates that MOS can be grouped into a few clusters for which the same type of assessment method can be used. Following their methodology, it should be possible to create a standard, streamlined approach to job analysis, test design, and test development for each group. Appendixes contain the following: MOS Characteristics, Sample MOS Description, Potential Job Analysis Strategies for use with MOS Clusters, MOS Clusters, Materials for Performing a Preliminary Job Analysis, Assessment Design Guide Template, and Assessment of Realism in Performance Measures.