基于互信息的文本特征加权方法

摘要

特征加权是文本分类中的重要环节，通过考察传统的特征选择函数，发现互信息方法在特征加权过程中表现尤为突出。为了提高互信息方法在特征加权时的性能，加入了词频信息、文档频率信息以及类别相关度因子，提出了一种基于改进的互信息特征加权方法。实验结果表明，该方法比传统的特征加权方法具有更好的分类性能。%Feature weighting is an important part of the procedure of text categorization, by examining the traditional feature selection function, it finds that the method of mutual information in feature weighting process performs particularly promi-nent. In order to improve the performance of the method of mutual information in feature weighting, the paper adds the term frequency information, document frequency information and categories correlation factor, and proposes a feature weighted based on mutual information method. The experiments show that this method has better classification perfor-mance than the traditional feature weighting method.