首页> 外文会议>European Conference on Artificial Intelligence;Conference on Prestigious Applications of Intelligent Systems >Document and Word Representations Generated by Graph Convolutional Network and BERT for Short Text Classification
【24h】

Document and Word Representations Generated by Graph Convolutional Network and BERT for Short Text Classification

机译:由图表卷积网络和短文本分类生成的文档和字表示

获取原文

摘要

In many studies, the graph convolution neural networks were used to solve different natural language processing (NLP) problems. However, few researches employ graph convolutional network for text classification, especially for short text classification. In this work, a special text graph of the short-text corpus is created, and then a short-text graph convolutional network (STGCN) is developed. Specifically, different topic models for short text are employed, and a short tex-t short-text graph based on the word co-occurrence, document word relations, and text topic information, is developed. The word and sentence representations generated by the STGCN are considered as the classification feature. In addition, a pre-trained word vector obtained by the BERTs hidden layer is employed, which greatly improves the classification effect of our model. The experimental results show that our model outperforms the state-of-the-art models on multiple short text datasets.
机译:在许多研究中,图形卷积神经网络用于解决不同的自然语言处理(NLP)问题。 然而,很少有研究采用图表卷积网络进行文本分类,特别是对于短文本分类。 在这项工作中,创建了短文本语料库的特殊文本图,然后开发了短文本图形卷积网络(STGCN)。 具体地,使用短文本的不同主题模型,并且开发了一种基于单词共同发生,文档词关系和文本主题信息的短TEX-T短文本图。 由STGCN生成的单词和句子表示被视为分类特征。 另外,采用由伯特隐藏层获得的预训练的单词矢量,这大大提高了我们模型的分类效果。 实验结果表明,我们的模型在多个短文本数据集中优于最先进的模型。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号