Bayesian based view synthesis for multi-planar structures

摘要

With the rapid development of mobile applications in recent years, there is a strong desire on light weight algorithm for view synthesis using uncalibrated images and limited geometry information. To address this challenge, we propose a Bayesian based view synthesis framework to support the rendering of complex scene with multiple planar structures. In this framework, we integrate image segmentation, reference plane selection and hole filling with a Bayesian formulation to perform view synthesis without using 3D geometry information. More specifically, we partition every reference image into multiple planes, estimate geometric and photometric parameters for each plane, synthesize the novel view by Bayesian modeling using selected reference planes, and refine the rendered image by a hole filling scheme. The entire view synthesis process is executed in an iterative manner to pursue high quality visual results. The experimental results show that the proposed method is able to achieve desired performance with less distortion and higher resolution.