ARTIFICIAL NEURAL NETWORK OPTIMIZATION METHOD AND SYSTEM BASED ON ORTHOGONAL PROJECTION MATRIX, AND APPARATUSES

摘要

The present invention belongs to the field of machine learning and artificial intelligence, particularly relates to an artificial neural network optimization method and system based on an orthogonal projection matrix, and apparatuses, and aims to solve the problem of catastrophic forgetting occurring during continuous learning by an artificial neural network. The method comprises: initializing an artificial neural network, and calculating an orthogonal projection matrix set of each layer of the network; using the orthogonal projection matrix set to update a weight matrix of the artificial neural network, and processing input data of the current task; using a recursive algorithm to calculate a new projection matrix set, and using same to update a weight matrix of an artificial neural network of the next task; and repeating the execution of a recursive operation of a projection matrix and the updating of the weight matrix until the execution of all tasks in a task queue has been completed. The method can be applied to different task spaces, and can also be applied to a specific weight of a local network, and even a specific network. The method is simple in terms of calculation and has significant effects, and prevents the problem of "catastrophic" forgetting of a traditional artificial neural network.