Daily clustering for the electronic newspaper based on the analysis of trends

摘要

To classify newspaper articles automatically, the tf*idf method has been used to weight the words in an article. These methods are suitable for fixed databases, but cannot pick up the topic words of articles because the IDF methods give a low value for frequently occurring words. We propose the daily clustering method for electronic daily newspapers. Our method is based on the characteristics of articles and the change of contents. First, we define the weight function of words based on the position in the article and the change rate of content as time passes. Then we calculate the relation between articles, clustering value and the relation between clusters of different days. As a result of experiments, the accuracy of recall and precision rate improved by several percent compared with old methods.