首页> 美国卫生研究院文献>Patterns >The overfitted brain: Dreams evolved to assist generalization
【2h】

The overfitted brain: Dreams evolved to assist generalization

机译:过度的大脑:梦想进化以协助泛化

代理获取
本网站仅为用户提供外文OA文献查询和代理获取服务,本网站没有原文。下单后我们将采用程序或人工为您竭诚获取高质量的原文,但由于OA文献来源多样且变更频繁,仍可能出现获取不到、文献不完整或与标题不符等情况,如果获取不到我们将提供退款服务。请知悉。

摘要

Understanding of the evolved biological function of sleep has advanced considerably in the past decade. However, no equivalent understanding of dreams has emerged. Contemporary neuroscientific theories often view dreams as epiphenomena, and many of the proposals for their biological function are contradicted by the phenomenology of dreams themselves. Now, the recent advent of deep neural networks (DNNs) has finally provided the novel conceptual framework within which to understand the evolved function of dreams. Notably, all DNNs face the issue of overfitting as they learn, which is when performance on one dataset increases but the network's performance fails to generalize (often measured by the divergence of performance on training versus testing datasets). This ubiquitous problem in DNNs is often solved by modelers via “noise injections” in the form of noisy or corrupted inputs. The goal of this paper is to argue that the brain faces a similar challenge of overfitting and that nightly dreams evolved to combat the brain's overfitting during its daily learning. That is, dreams are a biological mechanism for increasing generalizability via the creation of corrupted sensory inputs from stochastic activity across the hierarchy of neural structures. Sleep loss, specifically dream loss, leads to an overfitted brain that can still memorize and learn but fails to generalize appropriately. Herein this ”overfitted brain hypothesis” is explicitly developed and then compared and contrasted with existing contemporary neuroscientific theories of dreams. Existing evidence for the hypothesis is surveyed within both neuroscience and deep learning, and a set of testable predictions is put forward that can be pursued both in vivo and in silico.
机译:在过去十年中,了解睡眠的进化生物功能的理解。但是,没有相同的对梦想的理解。当代神经科学理论通常认为梦想成为Epiphenomena,许多提案的生物学功能的建议都被梦想本身的现象学相矛盾。现在,最近深度神经网络(DNN)的出现终于提供了新颖的概念框架,以了解梦想的演变功能。值得注意的是,所有DNN都面临着学习的过度问题的问题,这是一个数据集的性能增加,但网络的性能无法概括(通常通过培训与测试数据集的性能分歧而衡量)。 DNN中的这种无处不在的问题通常由建模者通过“噪声注入”以嘈杂或损坏的输入形式进行解决。本文的目标是争论大脑面临着类似的过度挑战,并且夜间梦想在日常学习期间演变为对抗大脑的过度。也就是说,梦想是通过在神经结构的层次结构上产生来自随机活动的损坏的感官输入来提高普遍性的生物学机制。睡眠损失,特别是梦想损失,导致过度的大脑,仍然可以记住和学习,但不能适当地概括。这里,这种“过度的脑假设”明确地发展,然后与现有的当代神经科学理论进行了比较和对比。假设的现有证据在神经科学和深度学习中进行调查,并提出了一系列可测量的预测,可以在体内和硅中追求。

著录项

  • 期刊名称 Patterns
  • 作者

    Erik Hoel;

  • 作者单位
  • 年(卷),期 2021(2),5
  • 年度 2021
  • 页码 100244
  • 总页数 15
  • 原文格式 PDF
  • 正文语种
  • 中图分类 放射医学;影像诊断学;
  • 关键词

    机译:梦想;深入学习;神经科学;学习;

相似文献

  • 外文文献
  • 中文文献
  • 专利
代理获取

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号