Fusing functional magnetic resonance image and electrophysiological data during face processing using joint independent component analysis

摘要

The functional magnetic resonance imaging(fMRI)research on face processing have found that the significant activation by face stimuli mainly locailized at the occipital temporal lobe especilly the fusiform gyrus. However, fMRI cannot reflect the face processing as time changes. Event-related potential(ERP)can record electrophysiological changes induced by neuronal activation in time, but spatial information is not well localized. Fusing fMRI and ERP data can perform that how the fMRI activation changes as time move at each ERP time point. Although most of fuse methods perform to analysis by constraint ERP or fMRI data, joint independent component analysis(jICA)method can equally use the ERP and fMRI data and simultaneously examine electrophysiologic and hemodynamic response. In this paper, we use jICA method to analysis two modalities in common data space in order to examine the dynamics of face stimuli response. The results showed that the ERP component N170 response associated with middle occipital gyrus, fusiform gyrus, inferior occipital gyrus, superior temporal gyrus and parahippocampa gyrus for face. Likewise, for non-face, the N170 component was mainly related to parahippocampa gyrus, middle occipital gyrus and inferior occipital gyrus. Further studying on the correlation of the localized ERP response and corresponding average ERP, it was also concluded that the spatial activations related to N170 response induced by face stimulus located in fusiform gyrus, and that induced by non-face stimulus located in parahippocampa gyrus. From the result, fusing fMRI and ERP data by jICA not only provides the time information on fMRI and the spatial source of ERP component, but also reflects spatiotemporal change during face processing.