Determining the Sensitivity of CAT-ASVAB (Computerized Adaptive Testing-Armed Services Vocational Aptitude Battery) Scores to Changes in Item Response Curves with the Medium of Administration

摘要

Within a few years the Department of Defense may begin administering the Armed Services Vocational Aptitude Battery (ASVAB) using computerized adaptive testing (CAT). In CAT, each test item is characterized by an item response curve (IRC), which describes how the probability of correctly answering the item increases with ability. A recent study conducted by the Center for Naval Analyses found that IRCs of many items in the experimental CAT item pool for the ASVAB changed substantially from paper-pencil to CAT administration. This research memorandum examines the effects of these changes on scores of individual examinees.