Synthesizing Stereo 3D Views from Focus Cues in Monoscopic 2D Images

摘要

In this paper we propose a monoscopic 2D to stereo 3D conversion system. Our process of producing a stereo 3D system from 2D images requires to estimate a relative depth map of the objects in the image that comprises the real world 3D geometry of the scene initially captured. Subsequently, we map the estimated depth into two perspective image views, left and right, with an artificially synthesized parallax between them. We present a depth estimation method based on measuring focus cues, which consists of a local spatial frequency measurement using multiresolution wavelet analysis and a Lipschitz regularity estimation of significant edges; resulting in a pixel resolution depth map. Based on this relative depth map, the stereo 3D image is synthesized with a method that uses interpolated image row sections to artificially generate parallax in the left and right perspective views, and thus when viewed with a stereo 3D display system induce a sense of stereopsis to the observer.