Sparse L-q-norm least squares support vector machine with feature selection

摘要

Least squares support vector machine (LS-SVM) is a popular hyperplane-based classifier and has attracted many attentions. However, it may suffer from singularity or ill-condition issue for the small sample size (SSS) problem where the sample size is much smaller than the number of features of a data set. Feature selection is an effective way to solve this problem. Motivated by this, in the paper, we propose a sparse L-q-norm least squares support vector machine (L-q-norm LS-SVM) with 0 q 1, where feature selection and prediction are performed simultaneously. Different from traditional LS-SVM, our L-q-norm LS-SVM minimizes the L-q-norm of weight and releases the least squares problem in primal space, resulting in that feature selection can be achieved effectively and small enough number of features can be selected by adjusting the parameters. Furthermore, our L-q-norm LS-SVM can be solved by an efficient iterative algorithm, which is proved to be convergent to a global optimal solution under some assumptions on the sparsity. The effectiveness of the proposed L-q-norm LS-SVM is validated via theoretical analysis as well as some illustrative numerical experiments. (C) 2018 Elsevier Ltd. All rights reserved.