Investigation of the Reliability of Knowledge Measures Through Relational Mapping in Joint Military Environments: Knowledge, Models and Tools to Improve the Effectiveness of Naval Distance Learning

摘要

This report describes research conducted by the UCLA National Center for Research on Evaluation, Standards, and Student Testing (CRESST) on the effectiveness of online knowledge mapping as a method to assess high-level understanding of specific military domains and tasks. Using the Human Performance Knowledge Mapping Tool (HPKMT), CRESST assessed individual trainee knowledge and then examined the psychometric properties of knowledge mapping scores to evaluate the suitability of knowledge mapping as an assessment of trainees' understanding of joint mission-essential tasks. Analyses of scoring techniques yielded important information about the quality of the knowledge maps, and the assessments provided valuable information regarding student understanding of course content. The student maps were analyzed using three methods: automated criterion-based (expert) assessment, propositional analysis, and structural mapping analysis.