Investigation of Item-Pair Presentation and Construct Validity of the Navy Computer Adaptive Personality Scales (NCAPS)

摘要

This report documents one of the steps in the development of the Navy Computer Adaptive Personality Scales (NCAPS). NCAPS is a computer-adaptive personality measure that is being developed and validated for use in the selection and classification of Sailors for entry-level Navy enlisted jobs. This is an important component of the Navy's research program to overhaul and improve its enlisted selection and classification process. The Whole Person Assessment program is designed to replace the current classification algorithm with one that is more flexible and accurate and that will allow the Navy to de- emphasize its almost exclusive focus on mental ability by including personality and interest measures in making classification decisions. Collectively, these efforts will transform and modernize enlisted classification by making it applicant-centric while improving job satisfaction and performance, reducing attrition, and increasing continuation behavior. NCAPS uses a cutting-edge technological approach to personality measurement that is designed to mitigate many problems that plague traditional instruments. Specifically, traditional instruments use straight-forward Likert rating scales and generally contain sets of homogeneous items that make them subject to both directed faking and socially desirable responding. To minimize these problems, NCAPS is developing a paired force-choice item format, uses a complex item response theory (IRT) adaptive selection and scoring algorithm, and intersperses item content. The complexity and novelty of the design constraints require a series of interrelated research projects. This report is one in the series and fulfills the need to further explore the adaptive components of NCAPS along with additional construct validity assessment.