Audio-visual communication in visual media productions

摘要

Visual media productions generally combine motion picture and sound. Accompanied sound is an integral part of visual productions. This series of empirical studies found that musical elements systematically change the impression made by visual material, and visual elements systematically affect the impression made by music. We also assessed the sensory processing levels involved in different audio-visual interactions and demonstrated the effects of formal and semantic congruency of sound and motion picture on impressions made by visual media. Our findings have implications for effective design of audio-visual materials in new types of visual communication.