The Effect of Extra-oral Facial Information on Audiovisual Speech Perception

摘要

An experiment consisting of five blocks was conducted to examine the effect of extra-oral facial information on audiovisual speech perception. Twenty Chinese native speakers were asked to report the syllables they perceived in different conditions: audio-only, video-only, video-only without oral part, audiovisual and audiovisual without oral part. The experimental materials were /pa/, /tsa/, /ta/, /tsa/ and /ka/, which were selected according to places of articulation from front to back. The results showed that even though the extra-oral facial information was not enough to distinguish non-labial consonants, it could have significant effect on auditory speech perception.