33D VIRTUAL REALITY-BASED APPARATUS AND METHOD TO GENERATE A THREE DIMENSIONAL3D HUMAN FACE MODEL USING IMAGE AND DEPTH DATA

摘要

A device and a method based on a virtual reality generating a three-dimensional (3D) human face model include storage of a 3D face model which is an existing 3D face model or an average shape face model in at least a neutral expression. A point cloud of a face of a first user is generated based on a plurality of color images and depth information of the face of the first user. A first 3D face model of the first user having the neutral expression is generated by a shape-based model fitment on the stored 3D face model. A shape of the first 3D face model is refined based on a difference among the first 3D face model, the shape-based model fitment, and the generated point cloud. A display of the refined first 3D face model is controlled to exhibit a minimum deviation from the shape and appearance of the face of the first user.