首页> 外文会议>International Joint Conference on Neural Networks >Long-term learning behavior in a recurrent neural network for sound recognition
【24h】

Long-term learning behavior in a recurrent neural network for sound recognition

机译:循环神经网络中的长期学习行为,用于声音识别

获取原文

摘要

In this paper, the long-term learning properties of an artificial neural network model, designed for sound recognition and computational auditory scene analysis in general, are investigated. The model is designed to run for long periods of time (weeks to months) on low-cost hardware, used in a noise monitoring network, and builds upon previous work by the same authors. It consists of three neural layers, connected to each other by feedforward and feedback excitatory connections. It is shown that the different mechanisms that drive auditory attention emerge naturally from the way in which neural activation and intra-layer inhibitory connections are implemented in the model. Training of the artificial neural network is done following the Hebb principle, dictating that "Cells that fire together, wire together", with some important modifications, compared to standard Hebbian learning. As the model is designed to be on-line for extended periods of time, also learning mechanisms need to be adapted to this. The learning needs to be strongly attention- and saliency-driven, in order not to waste available memory space for sounds that are of no interest to the human listener. The model also implements plasticity, in order to deal with new or changing input over time, without catastrophically forgetting what it already learned. On top of that, it is shown that also the implementation of short-term memory plays an important role in the long-term learning properties of the model. The above properties are investigated and demonstrated by training on real urban sound recordings.
机译:本文研究了一般用于声音识别和计算听觉场景分析的人工神经网络模型的长期学习特性。该模型旨在在噪声监视网络中使用的低成本硬件上长时间(几周到几个月)运行,并基于同一作者先前的工作。它由三个神经层组成,它们通过前馈和反馈激励连接相互连接。结果表明,在模型中实现神经激活和层内抑制性连接的方式自然会引起驱动听觉注意的不同机制。人工神经网络的训练是遵循Hebb原理进行的,与标准的Hebbian学习相比,它具有“重要的改进”,它规定了“一起发射,会聚在一起的细胞”。由于模型被设计为长时间在线,因此学习机制也需要对此进行调整。为了避免浪费可用的存储空间来存储听众不感兴趣的声音,学习需要强烈地由注意力和显着性驱动。该模型还实现了可塑性,以便随着时间的推移处理新的或变化的输入,而不会灾难性地忘记已经学到的知识。最重要的是,表明短期记忆的实现在模型的长期学习特性中也起着重要作用。通过对实际城市录音的培训来研究和证明上述属性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号