3D Chinese mouth animation with adaptive encoding

摘要

The paper presents a algorithm of mouth animation with adaptive speech encoding. Firstly, dialog text is encoded and filtered to the mouth code sequence according to the consistency between syllable and mouth, which is useful to determine the mouth type and reduce the frequency of jitter. Secondly, dialog speech is segmented and encoded into several audio clip encode units base on the speech energy distribution and characteristic of mouth code units, which is helpful to improve the accuracy of pronunciation and naturalness of mouth. Finally, the mouth animation is driven by the audio clip encoding unit, which is suitable to reflect the rhythm of pronunciation. The result shows that new algorithm is effective and suitable to generate the Chinese mouth animation.