ARTIFICIAL INTELLIGENT SYSTEMS AND METHODS FOR USING A STRUCTURALLY SIMPLER LEARNER MODEL TO MIMIC BEHAVIORS OF A STRUCTURALLY MORE COMPLICATED REFERENCE MODEL

摘要

A method for using a structurally more complicated reference model to train a structurally simpler learner model includes: obtaining a trained reference model at least including N reference blocks and a learner model at least including N learner blocks respectively corresponding to the N reference blocks; training the learner model by conducting an iterative operation; determining whether the learner model is convergent; and in response to that the learner model is convergent, stopping the iterative operation to assign the learner model as a trained learner model. The iterative operation includes inputting a sample data set into the trained reference model and the learner model; for each of the N learner blocks: determining a distance between a learner vector of the learner block and a reference vector of the reference block, and updating parameters in the learner block based on the determined distance.