TRAINING ARTIFICIAL NEURAL NETWORKS BASED ON SYNAPTIC CONNECTIVITY GRAPHS

摘要

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a student neural network. In one aspect, there is provided a method comprising: processing a training input using the student neural network to generate a student neural network output comprising a respective score for each of a plurality of classes; processing the training input using a brain emulation neural network to generate a brain emulation neural network output comprising a respective score for each of the plurality of classes; and adjusting current values of the student neural network parameters using gradients of an objective function that characterizes a similarity between: (i) the student neural network output for the training input, and (ii) the brain emulation neural network output for the training input.