Multinomial naive Bayesian classifier with generalized Dirichlet priors for high-dimensional imbalanced data

摘要

The data-level approach can be used to balance the class distribution in a data set, while generating synthetic instances in a high-dimensional space is an awful task. Naive Bayesian classifier with multinomial model, called multinomial naive Bayesian classifier, is a popular classification algorithm for high-dimensional data because of its computational efficiency. However, this algorithm generally cannot have a better performance than the other algorithms on high-dimensional imbalanced data. Generalized Dirichlet distribution that is defined on unit simplex can be priors for multinomial naive Bayesian classifier. This study proposes methods to find noninformative generalized Dirichlet priors for multinomial naive Bayesian classifier so that its performance on high-dimensional imbalanced data can be largely improved. The methods are tested on seven high-dimensional imbalanced data sets to demonstrate that the multinomial naive Bayesian classifier with generalized Dirichlet priors can significantly outperform not only the original multinomial naive Bayesian classifier, but also random forest and Ripper algorithm. (C) 2021 Elsevier B.V. All rights reserved.