...
首页> 外文期刊>Journal of visual communication & image representation >TMSO-Net: Texture adaptive multi-scale observation for light field image depth estimation
【24h】

TMSO-Net: Texture adaptive multi-scale observation for light field image depth estimation

机译:TMSO-Net:用于光场图像深度估计的纹理自适应多尺度观测

获取原文
获取原文并翻译 | 示例

摘要

Light field can record the four-dimensional information of light rays, i.e. the position and direction information in which depth information is implied. To improve the depth estimation accuracy, we propose a depth estimation algorithm based on convolutional neural network (CNN). First, a single image super resolution algorithm is adopted to spatially super resolve the sub-aperture images (SAIs). Second, to adapt the texture complexity, the SAIs are partitioned into two regions, i.e., simple texture region and complex texture region, based on the texture analysis of the central SAI. Third, the epipolar plane images (EPIs) in horizontal, vertical, 45 degree diagonal, and 135 degree diagonal directions for both complex and simple texture regions are extracted, and the corresponding EPIs for the simple and complex texture regions are fed into the specified network branches. Finally, a fusion module is designed to generate the depth map. Experimental results show that the quality of the estimated depth maps by the proposed method is better than the state-of-the-art methods in terms of both objective quality and subjective quality. Moreover, the proposed method is more robust to noise.
机译:光场可以记录光线的四维信息,即隐含深度信息的位置和方向信息。为了提高深度估计精度,我们提出了一种基于卷积神经网络(CNN)的深度估计算法。首先,采用单图像超分辨率算法对子孔径图像(SAIs)进行空间超分辨率解析;其次,为了适应纹理复杂度,在中心SAI的纹理分析的基础上,将SAI划分为简单纹理区域和复杂纹理区域两个区域。然后,提取复杂和简单纹理区域的水平、垂直、45度对角线和135度对角线方向的极平面图像(EPI),并将简单和复杂纹理区域对应的EPI送入指定的网络分支。最后,设计融合模块生成深度图。实验结果表明,所提方法的深度图估计质量在客观质量和主观质量方面均优于现有方法。此外,所提方法对噪声的鲁棒性更强。

著录项

获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号