NEURAL NETWORK QUANTIZATION METHOD USING MULTIPLE REFINED QUANTIZED KERNELS FOR CONSTRAINED HARDWARE DEPLOYMENT

摘要

A method of configuring a neural network, trained from a plurality of data samples, comprising: quantizing each layer of the neural network to produce a quantized neural network according to a plurality of respective scaling factors; locating one or more layers of the quantized neural network; computing a modified quantization for the one or more located layers to produce a modified quantized neural network; and adjusting the plurality of scaling factors of the modified quantized neural network by computing a similarity between a plurality of neural network outputs and a plurality of modified quantized neural network outputs.