In audiovisual music perception, visual information from a musical instrument being played is available prior to the onset of the corresponding audio music and consequently allows a perceiver to form a prediction about the upcoming musical sound. This prediction in audiovisual music perception, compared to auditory music perception, leads to lower N1 and P2 amplitudes and latencies. Although previous research suggests that audiovisual experience, such as musical training, may enhance this prediction, still unclear is to what extent musical experience modifies N1 and P2 amplitudes and latencies. Furthermore, corresponding event-related phase modulations quantified as inter-trial phase coherence (ITPC) have not previously been reported for audiovisual music perception. In the current study, audio video recordings of a keyboard key being played were presented to musicians and non-musicians in audio only (AO), video only (VO), and audiovisual (AV) conditions. With predictive movements from playing the keyboard isolated from AV music perception (AV-VO), results showed that, compared to the AO condition, both groups had a similar decrease in N1 amplitude and latency and P2 amplitude, as well as correspondingly lower ITPC values in the delta, theta, and alpha. However, while musicians showed lower ITPC values in the beta band in AV-VO compared to the AO, non-musicians did not show this pattern. Findings indicate that AV perception may be broadly correlated with auditory perception, and differences between musicians and non-musicians further indicate musical experience to be a specific factor influencing AV perception. Predictive sensory cues to an upcoming sound in AV music perception may involve sensory-motor networks, as well as visual predictory processes, which may be influenced by musical training. This study highlights possible interconnectivity in AV perception as well as potential modulation with experience.
展开▼
