【24h】

Stochastic Area Pooling for Generic Convolutional Neural Network

机译:通用卷积神经网络的随机区域汇集

获取原文

摘要

This paper proposes a novel SAPNet model that incorporates a stochastic area pooling (SAP) method with a generic stacked T-shaped CNN architecture. In our SAP method, pooling area is randomly transformed and max pooling operation is then conducted on such areas, which are no longer regular identical fixed upright squares. It can be viewed as feature-level augmentation, substantially reducing model parameters while keeping generalization ability of CNN almost unchanged. Furthermore, we present a generic CNN architecture that structurally resembles three stacked T-shaped cubes. In such architecture, the number of kernels in convolutional layer preceding any pooling layer is doubled and all learnable weight layers are combined with batch normalization and dropout with a small ratio. Finally, on CIFAR-10, CIFAR-100, MNIST, and SVHN datasets, the experimental results show that our SAPNet requires fewer parameters than regular CNN models and still achieves superior recognition performances for all the four benchmarks.
机译:本文提出了一种新颖的SAPNET模型,其包括具有通用堆叠的T形CNN架构的随机区域池(SAP)方法。在我们的SAP方法中,池区域是随机变换的,然后在这些区域上进行最大池操作,这些区域不再是常规相同的固定直立正方形。它可以被视为特征级增强,大大减少了模型参数,同时保持CNN的泛化能力几乎不变。此外,我们提出了一种在结构上类似于三个堆叠的T形立方体的通用CNN架构。在这种架构中,在任何汇集层之前的卷积层中的核数是加倍的,并且所有可学习的重量层都与批量归一化和丢弃的比例组合。最后,在CiFar-10,CiFar-100,Mnist和SVHN数据集上,实验结果表明,我们的SAPNET比常规CNN模型需要更少的参数,并且仍然可以为所有四个基准测试实现卓越的识别性能。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号