Automatic face tracking in video sequence with zoom change and face image synthesis by match-moving

摘要

In a special effect of movie creation, a manual match-moving can realize the replacement of the face in film with movie star, however, this process need a creator's experience and long time working. Also in stand-in system of foreign movie, lip synchronization is not achieved and sometimes spoken work is limited by mouth movement. In this paper, the location and angle of face are automatically estimated in video sequence and full face expression or mouth movement are replaced with new one. 3D face template is introduced to realize an accurate face tracking to realize automatic match-moving and stand-in system.