文档分类中的多特征最大值法及其改进方法

摘要

To select more features in document classification to work on less-feature problem of at least one feature (ALOF) method,maximum feature-f text (MFT) and improved maximum feature-f text (IMFT) were proposed.The number of selected features was determined in accordance with the data processing.All documents were analyzed in MFT method to ensure that each document in the training set was represented in the final feature vectors.Whereas IMFT analyzed only the documents with high FEF valued features to select less features,and it therefore reduced the probability of selection of irrelevant features.Three databases of document classification and three evaluation functions were considered in the experiment.Compared with the ALOF method and method of fuzzy correlation clustering (FRC),F1 measurements of the two proposed methods are much higher,and the classification effect is better.Experimental results also show that,the evaluation function has an important influence on the final classification results,and the number of features also affects the final results.%为在每个文档类别中选择更多的特征,解决至少一个特征法(ALOF)的特征不足问题,提出文档特征最大值法(MFT)和改进的文档特征最大值法(IMFT).按照数据处理方式决定选择特征的数量,MFT法解析所有文档,确保训练集中每个文档都用最终特征矢量来表示,IMFT法只分析特征评估函数中特征值高的文档以选择较少的特征,减少选择不相关特征的概率.实验考虑3个文档分类数据库和3个评估函数,实验结果表明,与ALOF法和模糊关联聚类(FRC)法相比,提出的两种方法的F1测度更高,分类效果更好,评估函数对最终的分类结果具有重要影响,不同的特征数会左右最终结果.