Estimation of 3D Model by Shadow Consistency with Semi-Automatically Estimated Light Source for Realistic Relighting

摘要

Shadow, as one of the most common lighting effects, provides powerful constraint between light source, occluder, and surface onto which it is cast. We propose a method to estimate the light source and 3D models for objects which cast shadows from single image with a small amount of user annotations. A model of area light model is used and the light source is estimated by minimizing the per-pixel difference between the input photograph and the diffuse illumination synthesized by the light model. The 3D models of objects are reconstructed by taking the shadow constraint into account. Our system produces realistic diffuse illumination and shadows in real-time while enabling interactive moving the light source and the objects.