中文垃圾邮件过滤系统中的特征提取算法

摘要

针对垃圾邮件过滤,首先对获取的垃圾邮件及合法邮件进行分词,预处理,构建文本矢量,然后用四种常用的特征词提取方法进行矢量降维,再在此基础上,给出了一种综合性的特征词提取算法,即按照各个评估函数的排序结果,取它们交集的前n个特征词作为候选词进行分类测试,仿真比较了各个算法中n对分类结果的影响,从而验证了该算法的有效性.%The paper,aimmed at spam filter,at first separationing,preprocessing and building text vector for the obtained spam mails and legitimate mails,then proccessing vector dimensional reduction using four common key extraction methods,and based on this,presents a comprehensive key extraction algorithm,which takes front n key words of their intersection as a candidate word for classification test according to sort results of each assessment function. Finally,Simulation verifies the effection of "n" on the classification in the algorithm,thus verifying the effectiveness of the proposed algorithm.