主题信息的中文多文档自动文摘系统

摘要

多文档自动文摘能够帮助人们自动、快速地获取信息,使用主题模型构建多文档自动文摘系统是一种新的尝试,其中主题模型采用浅层狄利赫雷分配(LDA).该模型是一个多层的产生式概率模型,能够检测文档中的主题分布.使用LDA为多文档集合建模,通过计算句子在不同主题上的概率分布之间的相似度作为句子的重要度,并根据句子重要度进行文摘句的抽取.实验结果表明,该方法所得到的文摘性能优于传统的文摘方法.%Multi-document summarization can help people access to information automatically and fast. Chinese multi-document summarization based on topic model is a new attempt. The LDA(Latent Dirichlet Allocation) model is a multi-level generative probabilistic model, can detect the topic distribution of the document. In the method, it models the document using LDA, then calculates the distance between a sentence and the given multi-documents via their topic probability distributions as the weight of the sentence. The paper extracts sentences according to the weight of the sentence. Experimental results show that the performance is a clear superiority over the traditional method under the proposed evaluation scheme.