首页> 外文期刊>IEEE Transactions on Image Processing >Multi-Domain Image-to-Image Translation via a Unified Circular Framework
【24h】

Multi-Domain Image-to-Image Translation via a Unified Circular Framework

机译:通过统一的圆形框架的多域图像到图像转换

获取原文
获取原文并翻译 | 示例
       

摘要

The image-to-image translation aims to learn the corresponding information between the source and target domains. Several state-of-the-art works have made significant progress based on generative adversarial networks (GANs). However, most existing one-to-one translation methods ignore the correlations among different domain pairs. We argue that there is common information among different domain pairs and it is vital to multiple domain pairs translation. In this paper, we propose a unified circular framework for multiple domain pairs translation, leveraging a shared knowledge module across numerous domains. One selected translation pair can benefit from the complementary information from other pairs, and the sharing knowledge is conducive to mutual learning between domains. Moreover, absolute consistency loss is proposed and applied in the corresponding feature maps to ensure intra-domain consistency. Furthermore, our model can be trained in an end-to-end manner. Extensive experiments demonstrate the effectiveness of our approach on several complex translation scenarios, such as Thermal IR switching, weather changing, and semantic transfer tasks.
机译:图像到图像转换旨在了解源和目标域之间的相应信息。基于生成的对抗性网络(GAN),若干最先进的作品取得了重大进展。但是,大多数现有的一对一的翻译方法忽略不同域对之间的相关性。我们认为,不同的域对之间存在共同的信息,对多个域对翻译至关重要。在本文中,我们提出了一个统一的圆形框架,用于多个域对转换,利用跨越域的共享知识模块。一个选择的翻译对可以从其他对的互补信息中受益,并且共享知识有利于域之间的相互学习。此外,提出了绝对一致性损耗并应用于相应的特征图中,以确保域内的一致性。此外,我们的模型可以以端到端的方式训练。广泛的实验证明了我们对多种复杂翻译方案的方法的有效性,例如热IR切换,天气变化和语义转移任务。

著录项

  • 来源
    《IEEE Transactions on Image Processing》 |2021年第1期|670-684|共15页
  • 作者单位

    National Laboratory of Pattern Recognition Center for Research on Intelligent Perception and Computing Institute of Automation Chinese Academy of Sciences Beijing China;

    National Laboratory of Pattern Recognition Center for Research on Intelligent Perception and Computing Institute of Automation Chinese Academy of Sciences Beijing China;

    National Laboratory of Pattern Recognition Center for Research on Intelligent Perception and Computing Institute of Automation Chinese Academy of Sciences Beijing China;

    National Laboratory of Pattern Recognition Center for Research on Intelligent Perception and Computing Institute of Automation Chinese Academy of Sciences Beijing China;

  • 收录信息
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类
  • 关键词

    Task analysis; Semantics; Visualization; Generative adversarial networks; Generators; Feature extraction; Meteorology;

    机译:任务分析;语义;可视化;生成对抗网络;发电机;特征提取;气象;
  • 入库时间 2022-08-18 22:52:47

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号