首页> 外国专利> Convolutional neural network pruning method based on feature map sparsification

Convolutional neural network pruning method based on feature map sparsification

机译:基于特征地图稀疏的卷积神经网络修剪方法

摘要

A convolutional neural network pruning method based on feature map sparsification, which relates to how to compress the convolutional neural network to reduce the number of parameters and amount of computation so as to facilitate actual deployment, is provided. In the training process, by adding regularization to the feature map L1 or L2 after the activation layer in the loss function, the corresponding feature map channels have different sparsity. Under a certain pruned ratio, the convolution kernels corresponding to the channels are pruned according to the sparsity of the feature map channels. After fine-tune pruning, the network obtains new accuracy, and the pruned ratio is adjusted according to the change of accuracy before and after pruning. After multiple iterations, the near-optimal pruned ratio is found, and pruning is realized to the maximum extent under the condition that the accuracy does not decrease.
机译:一种基于特征映射稀疏化的卷积神经网络修剪方法,涉及如何压缩卷积神经网络以减少参数数量和计算量,以便于实现实际部署。在训练过程中,通过在损耗函数中的激活层之后向特征映射L1或L2添加正则化,相应的特征图通道具有不同的稀疏性。在某种修剪比率下,根据特征图信道的稀疏性来修剪与通道对应的卷积核。经过微调修剪后,网络获得新的精度,并根据修剪前后的准确性的变化调整修剪比率。在多次迭代之后,发现近最佳修剪比率,并且在准确度不会降低的情况下,将修剪实现在最大程度。

著录项

  • 公开/公告号US11030528B1

    专利类型

  • 公开/公告日2021-06-08

    原文格式PDF

  • 申请/专利权人 ZHEJIANG UNIVERSITY;

    申请/专利号US202017117130

  • 发明设计人 CHENG ZHUO;XINGANG YAN;

    申请日2020-12-10

  • 分类号G06N3/08;G06N3/04;G06K9/62;

  • 国家 US

  • 入库时间 2022-08-24 19:05:23

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号