A NOVEL WEIGHTING METHOD FOR ONLINE ENSEMBLE LEARNING WITH THE PRESENCE OF CONCEPT DRIFT

摘要

Ensemble of classifiers is a very popular method for online and incremental learning in non-stationary environment, as it improves the accuracy of single classifiers and is able to recover from drifting concept without explicit drift detection. However, current ensemble weighing methods do not consider the relationship between a test instance and each ensemble member's training domain. As a result, a locally correct ensemble member may be reduced weight unfairly because that its prediction result of an out of domain test instance is wrong. These inaccuracies will increases when there is a significant concept change. In this paper, therefore, we proposed a fuzzy online ensemble weighting method which takes the consideration of the degree of membership of each instance in each ensemble member and a modified majority voting method to improve the ability of ensembles on handling online classification tasks with concept drift.