A transient learning comparison of Rosenblatt, backpropagation, and LMS algorithms for a single-layer perceptron for system identification

摘要

Presents a transient performance comparison of the Rosenblatt (1962), backpropagation, and LMS training algorithms for a single layer perceptron. The perceptron is attempting to identify a specific nonlinear system with Gaussian inputs. A summary of the first and second moment behaviors of the three algorithms is presented. With the criteria of probability of correct classification versus the number of algorithm iterations, the statistical results are used to compare the learning performance of the algorithms for some specific parameter values. By both the theoretical analysis and by Monte Carlo simulations, it is shown that there are no significant learning performance differences among these three algorithms for these parameter selections.