首页> 外文会议>Design, Automation Test in Europe Conference Exhibition >Energy-Efficient Neural Networks using Approximate Computation Reuse
【24h】

Energy-Efficient Neural Networks using Approximate Computation Reuse

机译:使用近似计算重用的节能神经网络

获取原文

摘要

As a problem-solving method, neural networks have shown broad success for medical applications, speech recognition, and natural language processing. Current hardware implementations of neural networks exhibit high energy consumption due to the intensive computing workloads. This paper proposes a methodology to design an energy-efficient neural network that effectively exploits computation reuse opportunities. To do so, we use Bloom filters (BFs) by tightly integrating them with computation units. BFs store and recall frequently occurring input patterns to reuse computations. We expand the opportunities for computation reuse by storing frequent input patterns specific to a given layer and using approximate pattern matching with hashing for limited data precision. This reconfigurable matching is key to achieving a "controllable approximation" for neural networks. To lower the energy consumption of BFs, we also use low-pow memristor arrays to implement BFs. Our experimental results show that for convolutional neural networks, the BFs enable 47.5% energy saving of multiplication operations, while incurring only 1% accuracy drop. While the actual savings will vary depending upon the extent of approximation and reuse, this paper presents a method for reducing computing workloads and improving energy efficiency.
机译:作为解决问题的方法,神经网络对医疗应用,语音识别和自然语言处理的广泛成功。由于密集的计算工作负载,神经网络的当前硬件实现表现出高能耗。本文提出了一种设计能节能神经网络的方法,有效利用计算重用机会。为此,我们使用Bloom Filters(BFS)用计算单元将它们紧密集成。 BFS存储和召回经常发生的输入模式以重用计算。通过将特定于给定层的频繁输入模式存储以及使用散列进行有限数据精度的哈希来扩展计算重用的机会。这种可重构的匹配是实现神经网络的“可控近似”的关键。为了降低BFS的能量消耗,我们还使用Low-Pow Memristor阵列来实现BFS。我们的实验结果表明,对于卷积神经网络,BFS能够节省47.5%的乘法操作,同时仅产生1%的精度下降。虽然实际节省将根据近似和再利用程度而变化,但是本文提出了一种减少计算工作负载和提高能效的方法。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号