Comparing Naval Decision Support Technologies Using Decision Models, Process Tracing and Error Analysis

摘要

Providing decision support to operators in command and control contexts requires careful assessment of itsrnimpacts on task performance. Here we describe a human-in-the-loop experiment using a naval air defenserntestbed to compare three conditions: 1) a baseline interface (DSSBASE; 2) one that displays the temporalrnproximity of radar aircraft (DSSTEMP); and 3) one which adds a change history panel (DSSCHEX). Threatevaluationrnaccuracy and cognitive models of participants’ judgments did not significantly differ acrossrnconditions. Eye-tracking data showed that DSSTEMP lead to a reduced verification of track attributes.rnConfusion matrices also differed across conditions: DSSTEMP lead to more errors that are “two-categoriesaway”rnwhen erroneously classifying hostile aircraft as non-hostile or uncertain. We conclude that inrnaddition to looking at standard metrics of task accuracy and response times, critical insights can be obtainedrnby assessing how different designs for decision support may alter strategies and cognitive processes.