首页> 外文会议>European Conference on Artificial Intelligence;Conference on Prestigious Applications of Intelligent Systems >A Shared-Word Sensitive Sequence-to-Sequence Features Extractor for Sentences Matching
【24h】

A Shared-Word Sensitive Sequence-to-Sequence Features Extractor for Sentences Matching

机译:句子的共享词敏感序列到序列功能提取器

获取原文

摘要

Sentences matching is a basic task in Natural Language Processing (NLP). Interaction-based methods, which employ interactions between words of two sentences and construct word-level matching features to classify, are generally used due to their finegrained features. However, they have many invalid interactions that may affect matching precision. In this paper, we limit the objects of interacting to shared words~4 of two sentences. On the one hand, they can reduce invalid interactions. On the other hand, because of the different context semantics, the representation of the same word may be quite different, conversely, the representation difference can also be used to reflect the semantic difference of different contexts. To better extract global features of shared words, we introduce a sequence-to-sequence features extractor to force decoder to learn more contextual information from encoder. We implement the method based on Transformer, with syntactic parsing as additional knowledge. Our proposed method achieved better performance than strong baselines and the experiment results also demonstrate the efficiency of sequence-to-sequence features extractor and significance of the shared words.
机译:句子匹配是自然语言处理(NLP)中的基本任务。基于交互的方法,它采用了两个句子的单词与构建字级匹配特征来分类的相互作用,这通常是由于其精细的特征而使用的。但是,它们有许多可能影响匹配精度的无效交互。在本文中,我们限制了与两个句子共享的共享词语的对象。一方面,它们可以减少无效的相互作用。另一方面,由于不同的上下文语义,相同词的表示可能是完全不同的,相反,表示差异也可以用来反映不同上下文的语义差异。为了更好地提取共享单词的全局功能,我们引入了一个序列到序列的特征提取器来强制解码器从编码器学习更多上下文信息。我们实现了基于变压器的方法,句法解析为额外的知识。我们所提出的方法实现了比强的基线更好的性能,实验结果还展示了序列到序列特征提取器的效率和共同词汇的重要性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号