Research on the Solution of BP Neural Network Training Problem

摘要

BP neural network is a common kind of neural network for recognition and classification, but it is obvious that some difficulties are find during the training process. In this paper, we introduced the basic principle of BP algorithm and propose a parameter adjustment procedure for activation function to speed up convergence and avoid gradient diffusion, and the feasibility of this method is proved by a basic BP neural network with simple structure. We analyzed this parameter's available value through a group of experiments based on simple three-layer BP full connected network. In addition, this activation function parameter adjustment procedure is also used in is suitable for Multilayer BP neural networks.