Weighting Criterion Components to Develop Composite Measures of Job Performance

摘要

Project A is the Army's long-term program to develop a complete personnel system for selecting and classifying all entry-level Army enlisted personnel. During the Concurrent Validation phase, a wide variety of predictor and criterion measures were administered to 9,500 soldiers in various military occupational specialties (MOS). These data were used to refine a model of job performance for entry-level personnel in terms of five basic components: MOS-specific technical skills, general soldiering skills, effort and leadership, personal discipline, and military fitness and bearing. This report describes efforts to develop from these components a composite index of performance to use in determining the validity of the Trial Battery measures for each job. Experiments were conducted to determine the best method(s) of weighting the basic components for an overall composite index; weighting judgements were then gathered from a sample (totaling 712) of officers and noncommissioned officers (NCOs) familiar with each Project A MOS. Analysis of these data showed that both scaling methods tested (direct estimation and conjoint paired-comparison) produced highly reliable construct weights, with the conjoint method slightly favored. There was relatively high agreement, although sometimes different emphasis, between the officer and NCO judging groups. (sdw)