Evaluation of global and local training techniques over feed-forward neural network architecture spaces for computer-aided medical diagnosis

摘要

In this paper, we investigate the performance of global vs. local techniques applied to the training of neu-ral network classifiers for solving medical diagnosis problems. The presented methodology of the inves-tigation involves systematic and exhaustive evaluation of the classifier performance over a neura network architecture space and with respect to training depth for a particular problem. In this study. the architecture space is defined over feed-forward, fully-connected artificial neural networks (ANNs) which have been widely used in computer-aided decision support systems in medical domain, and for which two popular neural network training methods are explored: conventional backpropagation (BP) and particle swarm optimization (PSO). Both training techniques are compared in terms of classification performance over three medical diagnosis problems (breast cancer, heart disease, and diabetes) from Pro-ben 1 benchmark dataset and computational and architectural analysis are performed for an extensive assessment. The results clearly demonstrate that it is not possible to compare and evaluate the perfor pro-mance of the two algorithms over a single network and with a fixed set of training parameters, as most of the earlier work in this field has been carried out, since training and test classification performances vary significantly and depend directly on the network architecture, the training depth and method used and the available dataset. We, therefore, show that an extensive evaluation method such as the one pro-posed in this paper is basically needed to obtain a reliable and detailed performance assessment, in that, we can conclude that the PSO algorithm has usually a better generalization ability across the architecture space whereas BP can occasionally provide better training and/or test classification performance for some network configurations. Furthermore, we can in general say that the PSO, as a global training algorithm, is capable of achieving minimum test classification errors regardless of the training depth, i.e. shallow or deep, and its average classification performance shows less variations with respect to network architec-ture. In terms of computational complexity, BP is in general superior to PSO for the entire architecture space used.