Development of a Mobile Tool for Dismounted Squad Team Performance Observations

摘要

This paper describes the development, application, and evaluation of a tablet-based Mobile Performance Assessment Tool (MPAT) for observing dismounted squad team performance during a training exercise. The MPAT was used by trained observers to rate US Army squad teamwork and after action review behaviors during two live training test scenarios. A systematic approach leveraging simulation-based training and team assessment design methods was used in its development, including lessons learned from past scenarios in which team observations were tracked and assessed. Evaluation of the MPAT included rater feedback and inter-rater agreement scores. Challenges to reliable assessments encountered within the fast-paced, event driven scenarios are discussed. Conclusions and future research recommendations are presented, including suggestions for utilizing the tool to develop Behaviorally Anchored Rating Scale assessments.