A virtual reality-based apparatus and method to generate a 3D human face model includes, storage of a 3D face model that is an existing 3D face model or a mean-shape face model in at least a neutral expression. A point cloud of the face of the first user is generated based on the plurality of color images and depth information of the face of the first user. A first 3D face model of the first user having neutral expression is generated by a shape-based model-fitment on the stored 3D face model. A shape of the first 3D face model is refined based on a difference between the first 3D face model, the shape-based model-fitment, and the generated point cloud. The display of the refined first 3D face model is controlled to exhibit a minimum deviation from the shape and appearance of the face of the first user.
展开▼