Kinect驱动的人脸动画合成技术研究

摘要

The technique of 3D human facial animation can be applied in a wide range of fields such as virtual reality, avatar control and so on. This paper proposes a real-time facial animation system based on Kinect. In this system,facial expression parameters are inferred by facial tracking client with Kinect and sent to the facial animation synthesizing server through socket. The server looks up FaceDefTables based on MPEG-4 facial animation standard to control the morphing of 3D face model. 3D facial animations which emulate expressions of the user are then generated in real time. Experimental results show that the method can rebuild quality realistic 3D facial animations in real time. Compared with existing technologies,this system with simple structure is easy to deploy and is also extendibility.%三维人脸动画合成技术可以应用于虚拟现实、角色控制等多个领域。为此，提出一种基于Kinect的人脸动画合成方法。人脸跟踪客户端利用Kinect对用户的脸部表情进行跟踪识别，得到人脸表情动画参数，通过socket发送给人脸动画合成服务器，由人脸动画合成服务器查找基于MPEG-4标准的人脸动画定义表，控制人脸模型的变形，从而实时合成与用户表情相对应的三维人脸动画。实验结果表明，该方法能够在满足实时性要求的条件下合成高质量的三维人脸动画，同现有技术相比，结构简单、容易部署且具有较好的可扩展性。