Distributed Mission Operations Within-Simulator Training Effectiveness Baseline Study. Volume 4. Participant Utility and Effectiveness Opinions and Ratings

摘要

The work in this report focuses on the user acceptance of the Air Force Research Laboratory, Human Effectiveness Directorate, Warfighter Readiness Research Division (AFRL/HEA) Distributed Mission Operations (DMO) training research site which contains four high-fidelity F-16 simulators, an Airborne Warning and Control System (AWACS) simulator, a threat generation system, and a full complement of brief/debrief technologies. The 327 F-16 pilots and the 49 AWACS users based their opinions on experiences obtained during consistent local area network five-day training research syllabi containing over 40 total 4vX scenarios, primarily air-to-air with some air-to- ground. Examining the user ratings for opinions about the DMO environment revealed that across all 58 rated statements, both F-16 and AWACS participants generally like the environment. 'I would recommend this training experience to other pilots/controllers' was rated by all but one of 49 controllers and all but 16 of 327 pilots with the highest rating possible of 'Strongly Agree.' Performing a content analysis on their open-ended responses to what they felt was most beneficial about the environment, F-16 pilots most frequently wrote comments relating to 'realistic qualities,' while AWACS operators most frequently wrote positive comments regarding the 'scenarios.' The second most written comment for both the F-16 and AWACS operators related to positive skill acquisition. Finally, when asked to rate to what extent the Mesa DMO system provides the 45 different F-16 critical air-to-air experiences (defined by the Mission Essential Competency process), the pilots rated that 38 experiences (84%) could be obtained 'to a moderate extent' or higher, more than all seven other environments surveyed.