COMPILER-BASED METHOD FOR FAST CNN PRUNING VIA COMPOSABILITY

摘要

The present disclosure describes various embodiments of methods and systems of training a pruned neural network. One such method comprises defining a plurality of tuning blocks within a neural network, wherein a tuning block is a sequence of consecutive convolutional neural network layers of the neural network; pruning at least one of the plurality of tuning blocks to form at least one pruned tuning block, and pre-training the at least one pruned tuning block to form at least one pre-trained tuning block. The method further comprises assembling the at least one pre-trained tuning block with other ones of the plurality of tuning blocks of the neural network to form a pruned neural network; and training the pruned neural network, wherein the at least one pre-trained tuning block is initialized with weights resulting from the pre-training of the at least one pruned tuning block. Other methods and systems are also provided.