N-SEEV in SOAS: Predicting Time to Notice for Multi-Modal Cockpit Alerting Events

摘要

This paper presents the current work to extend the N-SEEV model of visual attention to both the auditoryand tactile modalities in support a cockpit adaptive automation system for pilot spatial disorientation.Cockpit countermeasure systems use visual, auditory and tactile modalities to communicate problems to thepilot. The SOAS spatial orientation aiding system uses all three modalities to support a disoriented pilot.The system initiates increasingly intrusive countermeasure as it determines that the probability and severityof a detected disorientation is increasing. N-SEEV has been included within SOAS to support the change tocountermeasure levels based on the prediction of the pilot noticing countermeasure onset. Previous versionsof N-SEEV could predict a time-to-notice for the onset of a visual cockpit countermeasure. In this work, NSEEVis extended to include noticing predictions for both the auditory and tactile modes.