Real-time Facial Animation with Image-based Dynamic Avatars

摘要

We present a novel image-based representation for dynamic 3Drnavatars, which allows effective handling of various hairstyles andrnheadwear, and can generate expressive facial animations with finescalerndetails in real-time. We develop algorithms for creating anrnimage-based avatar from a set of sparsely captured images of arnuser, using an off-the-shelf web camera at home. An optimizationrnmethod is proposed to construct a topologically consistent morphablernmodel that approximates the dynamic hair geometry in therncaptured images. We also design a real-time algorithm for synthesizingrnnovel views of an image-based avatar, so that the avatarrnfollows the facial motions of an arbitrary actor. Compelling resultsrnfrom our pipeline are demonstrated on a variety of cases.