ELEM2: A Learning System for More Accurate Classifications

摘要

We present ELEM2, a new method for inducign classification rules from a set of example.s The method employs several new strategies in the induction and classification processes to improve the predictive performance of induced rules. In particular, a new heuristic function for evaluatign attribute-value pairs is propose.d The function is defiend to reflect the degree of relevance of an attribute-value pair to a target concept and leads to selection of the most relevant pairs for formulating rules. Another feature of ELEM2 is that it handles inconsistent trainign data by defining an unlearnable region of a concept based o nthe probability distribution of that concept in the training data. To further deal with imperfect data, ELEM2 makes use of the post-pruning technique to remove unreliable portions of a generated rule. A new rule quality measure is proposed for the purpose of post-pruning. Teh measure is defined according to the relative distribution of a rule with respect to possitive and negative examples. To shwo whether ELEM2 achieves its objective, we report experimental results which compare ELEM2 with C4.5 and CN2 on a number of datasets.