Machine-learning model structural merging

摘要

Techniques for compacting an ML model by replacing a linear transformation layer and a convolutional layer with a modified convolution layer. Determining the modified convolutional layer may include determining a modified bias and/or a modified filter. In some examples, before merging the layers, an output of the linear transformation layer may be provided as input to the convolution layer (e.g., the linear transformation layer may precede the convolutional layer). The linear transformation lay may include, for example, a batch normalization layer, a pooling layer, and/or the like.