The modulation of synchronization by tuning functions and its effect on multi-sensory perception

摘要

Our brain is wired to handle sensory inputs from multiple modalities such as vision, hearing and touch. Computational models have largely focused on a single sensory channel at a time, most notably vision and audition. Hence there is a gap in our understanding of the mechanisms that govern the integrated processing of information in these channels. One approach that has received attention in the literature is sensory binding achieved through synchronization. We demonstrate that synchronization can be realized through a network of oscillatory elements. We examine factors governing synchronization, specifically the tuning function that determines the sensitivity of the oscillators to phase differences. We develop a computational model that allows the exploration of phenomena studied in cognitive neuroscience, including deficits in synchronization that accompany disorders such as Attention Deficit Hyperactivity Disorder. The width of the tuning function affects the ability of subjects to combine auditory and visual streams of information, where broader tuning functions are associated with poorer performance. We demonstrate that quantitative measures of simulated system performance behave similarly to data gathered by cognitive neuroscience experimentalists. Thus, we produce results that are consistent with findings in cognitive neuroscience and psychology. Our model could serve as a basis to understand the subtle dynamics of processes involved in both normal and abnormal perception. A quantitative approach could help researchers model the effect of different interventions, including drugs such as methylphenidate that promote synchrony.