33D VIRTUAL REALITY-BASED APPARATUS AND METHOD TO GENERATE A THREE DIMENSIONAL3D HUMAN FACE MODEL USING IMAGE AND DEPTH DATA

摘要

A virtual reality based apparatus and method for generating a 3D human face model includes storing a 3D face model that is an existing 3D face model or an average shape face model at least in a neutral expression. The point cloud of the face of the first user is generated based on the plurality of color images and depth information of the face of the first user. The first 3D face model of the first user with a neutral facial expression is generated by shape based model fit on the stored 3D face model. The shape of the first 3D face model is refined based on the difference between the first 3D face model, shape based model fitment, and the generated point cloud. The display of the refined first 3D face model is controlled to indicate a minimum deviation from the shape and appearance of the face of the first user.