NON-LINEAR DISCRIMINANT FEATURE EXTRACTION USING GENERALIZED BACK-PROPAGATION NETWORK

摘要

This paper extends linear feature extraction techniques to a wide variety of non-linear cases using a modified neural network method. This neural network method was developed by replacing the meansquare criterion with a discriminant criterion J = trace(S_(-1)~m·S_b). A new learning algorithm, the generalized back-propagation (GBP) algorithm, has been proposed to maximize this criterion at the network outputs. Though working in a supervised manner, the proposed learning algorithm requires no training outputs for network learning. Experimental results show that the proposed neural network method works much better than linear discriminant analysis (LDA) in linearly inseparable cases. Compared with the conventional neural network method, i.e. the standard back-propagation network (SBPN), the learning efficiency, the classification performance with limited hidden nodes and the generalization ability of the proposed network method are also more favourable. The proposed neural network method provides a promising alternative to SBPN in non-linear pattern recognition applications.