Assessing the Substitutability of Surrogate Measures of Job Performance of Hands-On Work Sample Tests.

摘要

The Air Force developed Hands-On work sample tests to serve as (a) criteria for validation Of the Armed Services Vocational Aptitude Battery (ASVAB) and (b) benchmarks for assessment of less expensive and easier to administer surrogate measures (i.e., interview-format work sample tests, rating forms, job knowledge tests, training school grades). Measures were administered to 1,491 enlisted airmen in eight different jobs. Results indicated that the Hands-On measures were most strongly related to interview tests and job knowledge tests. Factor analyses of performance criteria revealed that technical proficiency was represented by three distinct factors (i.e., self ratings, supervisor ratings, and performance scores), an indication that these criteria measure multiple constructs. None of the surrogates could be considered interchangeable or substitutable for the Hands-On measures. Future work should investigate whether selection and classification decisions and minimum aptitude standards set for selection and classification would differ using Hands-On versus surrogate measures. Job knowledge, Test validation, Performance measures, Work samples.