Measuring Human Performance in Multinational Distributed Events: Lessons learned from the First Warfighter Alliance in a Virtual Environment (Exercise Firstwave)

摘要

The Air Force Research Laboratory (AFRL), Warfighter Readiness Research Division, is conducting research to measure and track warfighter performance of knowledge and skills from and individual level to the command and control (C2) level, within both high-fidelity distributed simulation environments and live training environments. One critical development is a performance measurement system, the Performance Evaluation Tracking System (PETS), which captures data necessary for competency-based assessment and evaluations, end-user performance feedback, simulator technology developer validation, and for researcher and program manager evaluation of training techniques and technologies. PETS is comprised of various components that allow integration into focused benchmark studies, large-scale distributed coalition operations, and live-fly training scenarios. This paper describes the application of PETS during the multinational Warfighter Alliance in a Virtual Environment (First WAVE) coalition simulation event; discuss the lessons learned, the impact of different levels of abstraction and representational levels of correlation in the data, and the challenges facing both researchers and operational personnel for both producting and using performance data and methods.