Lighting design for portraits with a virtual light stage

摘要

We propose a software solution which allows the user to design a realistic illumination for a given 2D image of a face. The user paints a few strokes on the image to give clues of desired novel lighting effects. The algorithm produces an image of the face under the best possible realistic illumination, accordingly. It takes advantage of a 3D Morphable Model framework and a state of the art inverse lighting algorithm for faces. As a result, illumination effects such as cast shadows, specular highlights, multidirectional and colored lighting can be applied to the portrait. The algorithm is versatile for uncontrolled imaging conditions; it is invariant to face pose and image saturation, and produces realistic results from a single input image of an unknown face.