首页> 外文会议>Aisa-Pacific web and web-age information management joint conference on web and big data >Reducing Wrong Labels for Distant Supervision Relation Extraction with Selective Capsule Network
【24h】

Reducing Wrong Labels for Distant Supervision Relation Extraction with Selective Capsule Network

机译:减少用选择性胶囊网络提取远距离监管关系的错误标签

获取原文

摘要

Distant Supervision is a common technique for relation extraction from large amounts of free texts, but introduces wrong labeled sentences at the same time. Existing deep learning approaches mainly rely on CNN-based models. However, they fail to capture spatial patterns due to the inherent drawback of pooling operations and thus lead to suboptirnal performance. In this paper, we propose a novel framework based on Selective Capsule Network for distant supervision relation extraction. Compared with traditional CNN-based models, the involvement of capsule layers in the sentence encoder makes it more powerful in encoding spatial patterns, which is very important in determining the relation expressed in a sentence. To address the wrong labeling problem, we introduce a high-dimensional selection mechanism over multiple instances. It is one generalization of traditional selective attention mechanism and can be seamlessly integrated with the capsule network based encoder. Experimental results on a widely used dataset (NYT) show that our model significantly outperform all the state-of-the-art methods.
机译:远程监管是从大量自由文本中提取关系的常用技术,但同时会引入带有错误标签的句子。现有的深度学习方法主要依赖于基于CNN的模型。但是,由于合并操作的固有缺点,它们无法捕获空间模式,因此导致性能欠佳。在本文中,我们提出了一种基于选择性胶囊网络的新型框架,用于远程监管关系提取。与传统的基于CNN的模型相比,句子编码器中胶囊层的参与使其在空间模式编码方面更强大,这对于确定句子中表达的关系非常重要。为了解决错误的标签问题,我们在多个实例上引入了高维选择机制。它是传统选择性注意机制的一种概括,可以与基于胶囊网络的编码器无缝集成。在广泛使用的数据集(NYT)上的实验结果表明,我们的模型明显优于所有最新方法。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号