基于Lasso稀疏学习的径向基函数神经网络模型

摘要

传统径向基函数 (RBF) 神经网络模型使用完整的隐含层节点进行模型构建时, 会因缺乏隐含层节点抽取机制而使得受训模型的泛化性能下降, 导致模型更加复杂.为此, 提出一种改进的RBF神经网络模型.通过Lasso稀疏约束对隐含层节点和输出层连接权值进行稀疏表示, 去除冗余和不相关隐含层节点的同时保留重要的隐含层节点, 并使用交叉验证和网格搜索确定收缩参数以优化模型分类性能.实验结果表明, 与现有RBF神经网络模型相比, 该模型具有更低的计算复杂度和更高的分类精度.%The traditional Radial Basis Function (RBF) neural network model uses all hidden layer nodes to construct the model. In this case, the generalization performance of traditional RBF neural network model is degraded because of the lackness of the effective hidden layer nodes extraction mechanism, which will easily leads to more complicated of model.In order to solve this problem, this paper proposes an improved RBF neural network model. It realizes sparse representation of hidden layer nodes and output layer connection weights by Lasso sparse constraint to remove redundant and uncorrelated hidden layer nodes, and retain important hidden layer nodes. The shrinkage parameter are determined by Cross Validation (CV) and grid search, so as to optimize model classification performance. Experimental results show that RBF neural network model based on Lasso sparse learning can not only reduce the calculation complexity of the model, but also improve the classification accuracy compared with existing RBF neural network model.