首页> 外文会议>International conference on computational linguistics >Semantic Relation Classification via Hierarchical Recurrent Neural Network with Attention
【24h】

Semantic Relation Classification via Hierarchical Recurrent Neural Network with Attention

机译:带有注意点的递归神经网络的语义关系分类

获取原文

摘要

Semantic relation classification remains a challenge in natural language processing. In this paper, we introduce a hierarchical recurrent neural network that is capable of extracting information from raw sentences for relation classification. Our model has several distinctive features: (1) Each sentence is divided into three context subsequences according to two annotated nom-inals, which allows the model to encode each context subsequence independently so as to selectively focus as on the important context information; (2) The hierarchical model consists of two recurrent neural networks (RNNs): the first one learns context representations of the three context subsequences respectively, and the second one computes semantic composition of these three representations and produces a sentence representation for the relationship classification of the two nominals. (3) The attention mechanism is adopted in both RNNs to encourage the model to concentrate on the important information when learning the sentence representations. Experimental results on the SemEval-2010 Task 8 dataset demonstrate that our model is comparable to the state-of-the-art without using any hand-crafted features.
机译:语义关系分类在自然语言处理中仍然是一个挑战。在本文中,我们介绍了一种分层递归神经网络,该网络能够从原始句子中提取信息以进行关系分类。我们的模型具有几个鲜明的特征:(1)根据两个带注释的名词将每个句子分为三个上下文子序列,这使模型可以独立地对每个上下文子序列进行编码,从而有选择地将注意力集中在重要的上下文信息上; (2)层次模型由两个递归神经网络(RNN)组成:第一个递归神经网络分别学习这三个上下文子序列的上下文表示,第二个模型计算这三个表示的语义组成并生成句子表示以进行关系分类。这两个名词。 (3)在两个RNN中都采用了注意机制,以鼓励模型在学习句子表示时将注意力集中在重要信息上。 SemEval-2010 Task 8数据集上的实验结果表明,我们的模型在不使用任何手工功能的情况下可与最新技术相媲美。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号