AUDIOVISUAL INTEGRATION IN MULTIMEDIA COMMUNICATIONS BASED ON MPEG-4 FACIAL ANIMATION

摘要

Recent progress in audiovisual research shows that joint processing of audio and video provides advantages that are not available when the audio and video are processed independently. The importance of the MPEG-4 standard is in specifying an object-based Audiovisual representation framework, integrating both natural and synthetic content. MPEG-4 includes a facial animation parameters (FAP) set that enables model-based Representation of natural or synthetic talking-head sequences and allows intelligible visual Reproduction of facial expressions, emotions, and speech pronunciations at the receiver.