Coordination of Dynamic Visual and Auditory Spatial Percepts and Responsive MotorActions: A Review and Integration of Current Theory and Research

摘要

This review is intended to serve as an integration of current research andthought regarding visual and auditory spatial perception in an effort to consolidate diverse theoretical viewpoints and empirical findings. The aim of this technical report is to derive a unified account of bimodal spatial perception and responsive motor actions. The model of bimodal information processing developed in this report will serve as a basis for defining issues of concern regarding the implementation of bimodal spatial displays that require the individual to integrate dynamic spatial information acquired both aurally and visually. This model draws upon theory and research from ecological and information processing perspectives of auditory and visual perception. The model posits that information regarding the spatial layout and spatial dynamics of the environment is incrementally accrued through multiple modalities including vision and audition to form a common functional representation of spatio-temporal parameters. The key parameters of dynamic spatial position and motion conveyed in this functional representation are subsequently utilized to formulate plans and programs for responsive actions. Currently, a research program examining the process of cross-modal integration of dynamic auditory and visual information is underway. The findings of this research will have important implications for the implementation of 3-D auditory display technology for conveying dynamic spatial information in high visual workload environments.