...
首页> 外文期刊>IEEE Transactions on Neural Networks >Unsupervised query-based learning of neural networks using selective-attention and self-regulation
【24h】

Unsupervised query-based learning of neural networks using selective-attention and self-regulation

机译:使用选择性注意和自我调节的无监督基于查询的神经网络学习

获取原文
获取原文并翻译 | 示例

摘要

Query-based learning (QBL) has been introduced for training a supervised network model with additional queried samples. Experiments demonstrated that the classification accuracy is further increased. Although QBL has been successfully applied to supervised neural networks, it is not suitable for unsupervised learning models without external supervisors. In this paper, an unsupervised QBL (UQBL) algorithm using selective-attention and self-regulation is proposed. Applying the selective-attention, we can ask the network to respond to its goal-directed behavior with self-focus. Since there is no supervisor to verify the self-focus, a compromise is then made to environment-focus with self-regulation. In this paper, we introduce UQBL1 and UQBL2 as two versions of UQBL; both of them can provide fast convergence. Our experiments indicate that the proposed methods are more insensitive to network initialization. They have better generalization performance and can be a significant reduction in their training size.
机译:已引入基于查询的学习(QBL),以训练带有其他查询样本的监督网络模型。实验表明,分类精度进一步提高。尽管QBL已成功应用于有监督的神经网络,但它不适合没有外部监督者的无监督学习模型。提出了一种基于选择性注意和自我调节的无监督QBL算法。应用选择性注意,我们可以要求网络以自我关注的方式响应其目标导向的行为。由于没有监督者来验证自我焦点,因此会通过自我调节来折衷环境焦点。在本文中,我们介绍UQBL1和UQBL2作为UQBL的两个版本。它们都可以提供快速收敛。我们的实验表明,所提出的方法对网络初始化更加不敏感。它们具有更好的泛化性能,并且可以显着减少训练量。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号