Synthesis of Arbitrary Viewpoint Image from Images of Multiple Weakly Calibrated Camera Images Using All in-Focus Rendering Method

摘要

We describe a method that synthesizes a high-quality arbitrary-viewpoint image from multiple weakly-calibrated cameras. We reconstructed the approximate shape of the object reconstructed by the shape from silhouette method on a projective grid space(PGS). However, the distortion is caused in the synthesized image by the difference with the actual object and the approximate shape. In particular, the distortion is caused by a concave region. Our method synthesizes the arbitrary-viewpoint image with a little distortion by revising a depthmap obtained from the approximate shape. The depthmap is revised by using the all in-focus rendering method that makes light field rendering expand. When all camera parameters were uncalibrated, we could not apply this rendering method. Our method enabled applying uncalibrated cameras using the all in-focus rendering method by calculating each camera parameter on the PGS. We demonstrate the effectiveness of the method with arbitrary-viewpoint images and real images that were taken from multiple uncalibrated cameras.