Evidence from psychophysics and neuroanatomy demonstrates that sound localization of acoustic signals is strongly influenced by their synchrony with visual signals. Thjis effect, known as ventriloquism, is at work when sound coming from the side of your televison feels as if it were coming from the mouth of the actors. Despite this evidence, most perceptual models and systems for automatic sound localization rely on only acoustic information, taking advantage of standard stereo cues. The ventroloquism effect suggests that there is important information about sound location to be found in natural audio-visual (AV) sources, and that this information is encoded n the synchrony between the aduio and video signals.
展开▼
