Light-field-depth-estimation network based on epipolar geometry and image segmentation

摘要

In this paper, we propose a convolutional neural network based on epipolar geometry and image segmentation for light-field depth estimation. Epipolar geometry is utilized to estimate the initial disparity map. Multi-orientation epipolar images are selected as input data, and the convolutional blocks are adopted based on the disparity of different-direction epipolar images. Image segmentation is used to obtain the edge information of the central sub-aperture image. By concatenating the output of the two parts, an accurate depth map could be generated with fast speed. Our method achieves a high rank on most quality assessment metrics in the HCI 4D Light Field Benchmark and also shows effectiveness in estimating accurate depth on real-world light-field images. (C) 2020 Optical Society of America