首页> 外文会议>IEEE International Conference on Multimedia and Expo >Unsupervised Monocular Depth Estimation Based on Dual Attention Mechanism and Depth-Aware Loss
【24h】

Unsupervised Monocular Depth Estimation Based on Dual Attention Mechanism and Depth-Aware Loss

机译:基于双重注意机制和深度感知损失的无监督单眼深度估计

获取原文

摘要

Most existing monocular depth estimation approaches are su- pervised, but enough quantities of ground truth depth data are required during training. To cope with this, recent techniques deal with the depth estimation task in an unsupervised man- ner, i.e., replacing the use of depth data with easily obtained stereo images for training. Based on this, we propose a nov- el unsupervised learning architecture, which integrates dual attention mechanism into the framework and designs a depth- aware loss for better depth estimation. Specifically, to en- hance the ability of feature representations, we introduce a d- ual attention module to capture global feature dependencies in spatial and channel dimensions for scene understanding and depth estimation. Meanwhile, we propose a depth-aware loss that fully addresses the occlusion problem in brightness con- stancy assumption, the intrinsic characteristics of depth map, and the left-right consistency problem, respectively. Besides, an adversarial loss is employed to discriminate synthetic or realistic depth maps by training a discriminator so as to pro- duce better results. Extensive experiments on KITTI dataset show that our approach achieves state-of-the-art performance compared with other monocular depth estimation methods.
机译:推荐使用大多数现有的单眼深度估计方法,但是在训练过程中需要足够数量的地面真实深度数据。为了解决这个问题,最近的技术以无人监督的方式处理深度估计任务,即用容易获得的用于训练的立体图像代替深度数据的使用。基于此,我们提出了一种新颖的无监督学习架构,该架构将双重注意力机制集成到框架中,并设计了深度感知损失,以实现更好的深度估计。具体来说,为增强特征表示的能力,我们引入了双关注模块以捕获空间和通道维度中的全局特征依存关系,以进行场景理解和深度估计。同时,我们提出了一种深度感知损失,可以分别解决亮度恒定假设中的遮挡问题,深度图的固有特征以及左右一致性问题。此外,对抗性损失用于通过训练鉴别器来鉴别合成的或现实的深度图,从而产生更好的结果。在KITTI数据集上进行的大量实验表明,与其他单眼深度估计方法相比,我们的方法可实现最先进的性能。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号