【24h】

Towards Affordable Semantic Searching: Zero-Shot Retrieval via Dominant Attributes

机译:对经济实惠的语义搜索:通过占主导地位的零拍摄检索

获取原文

摘要

Instance-level retrieval has become an essential paradigm to index and retrieves images from large-scale databases. Conventional instance search requires at least an example of the query image to retrieve images that contain the same object instance. Existing semantic retrieval can only search semantically-related images, such as those sharing the same category or a set of tags, not the exact instances. Meanwhile, the unrealistic assumption is that all categories or tags are known beforehand. Training models for these semantic concepts highly rely on instance-level attributes or human captions which are expensive to acquire. Given the above challenges, this paper studies the Zero-shot Retrieval problem that aims for instance-level image search using only a few dominant attributes. The contributions are: 1) we utilise automatic word embedding to infer class-level attributes to circumvent expensive human labelling; 2) the inferred class-attributes can be extended into discriminative instance attributes through our proposed Latent Instance Attributes Discovery (LIAD) algorithm; 3) our method is not restricted to complete attribute signatures, query of dominant attributes can also be dealt with. On two benchmarks, CUB and SUN, extensive experiments demonstrate that our method can achieve promising performance for the problem. Moreover, our approach can also benefit conventional ZSL tasks.
机译:实例级检索已成为索引的基本范例和从大规模数据库中检索图像。传统的实例搜索至少需要查询映像的示例来检索包含相同对象实例的映像。现有的语义检索只能搜索语义相关的图像,例如共享相同类别的那些或一组标记,而不是确切的实例。同时,不切实际的假设是所有类别或标签事先已知。这些语义概念的培训模型高度依赖于昂贵的级别属性或人类标题,这是昂贵的。鉴于上述挑战,本文研究了仅使用少数主导属性的零击检索问题,该问题旨在仅使用少数主导属性。贡献是:1)我们利用嵌入自动单词嵌入到推断级别的属性以规避昂贵的人类标签; 2)通过我们提出的潜在实例属性发现(LIAD)算法,可以将推断的类属性扩展到鉴别实例属性; 3)我们的方法不限于完整的属性签名,也可以处理占主导地位的查询。在两个基准,幼崽和阳光下,广泛的实验表明,我们的方法可以实现对问题的有希望的表现。此外,我们的方法也可以使传统的ZSL任务受益。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号