【24h】

Semantics-Reinforced Networks for Question Generation

机译:关于问题生成的语义加强网络

获取原文

摘要

Question Generation (QG) is the task of generating questions from a given document. Its aims to generate relevant and natural questions, answered by a given answer. However, existing approaches for QG usually fail to utilize the rich text structure that could complement the simple word sequence. Meantime, Cross-entropy based training has notorious limitations, such as exposure bias and inconsistency between train and test measurement. To address the issues, we propose a novel Reinforcement Learning (RL) based Semantics-Reinforced architecture, named SiriQG, for QG task. In SiriQG, we propose a hierarchical attention fusion network, for better modeling of both answer information and passage information by integrating explicit syntactic constraints into attention mechanism, and for better understanding the internal structure of the passage and the connection between answer, which makes it better to fuse different levels of granularity (i.e., passages and questions). Last, we also introduce a hybrid evaluator with using a mixed objective that combines both RL loss and cross-entropy loss to ensure the generation of semantically and syntactically question text. To evaluate the performance, we test our SiriQG model on well-known dataset for QG. Extensive experimental results demonstrated that proposed SiriQG can obtained a significant increase in accuracy comparing existing models based on public dataset, and it consistently outperformed all tested baseline models including the state-of-the-arts (SOTA) techniques.
机译:问题生成(QG)是从给定文件生成问题的任务。它的目标是产生相关和自然问题,由给定的答案回答。但是,QG的现有方法通常无法利用丰富的文本结构,这些结构可以补充简单的单词序列。同时,基于交叉熵的培训具有臭名昭着的限制,例如曝光偏差和火车和测试测量之间的不一致。为解决问题,我们提出了一种基于新的加强学习(RL)的语义加强架构,名为Siriqg,用于QG任务。在Siriqg中,我们提出了一种分层关注融合网络,通过将明确的句法约束集成到注意机制,更好地理解段落的内部结构和答案之间的连接,以更好地建模回答信息和通道信息,从而更好地理解答案之间的连接融合不同水平的粒度(即段落和问题)。最后,我们还使用混合目标来介绍一个混合评估器,该混合目标结合了RL丢失和交叉熵损失,以确保发射语义和语法问题。为了评估性能,我们在QG的众所周知的数据集中测试我们的Siriqg模型。广泛的实验结果表明,所提出的Siriqg可以获得基于公共数据集的现有模型的准确性显着提高,并且始终如一地表现出包括最先进(SOTA)技术的所有测试基线模型。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号