首页> 外文期刊>Journal of Cognitive Neuroscience >Cognitive Control Predicts Use of Model-based Reinforcement Learning
【24h】

Cognitive Control Predicts Use of Model-based Reinforcement Learning

机译:认知控制预测使用基于模型的强化学习

获取原文
获取原文并翻译 | 示例
           

摘要

Accounts of decision-making and its neural substrates have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental work suggest that this classic distinction between behaviorally and neurally dissociable systems for habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning (RL), called model-free and model-based RL, but the cognitive or computational processes by which one system may dominate over the other in the control of behavior is a matter of ongoing investigation. To elucidate this question, we leverage the theoretical framework of cognitive control, demonstrating that individual differences in utilization of goal-related contextual information—in the service of overcoming habitual, stimulus-driven responses—in established cognitive control paradigms predict model-based behavior in a separate, sequential choice task. The behavioral correspondence between cognitive control and model-based RL compellingly suggests that a common set of processes may underpin the two behaviors. In particular, computational mechanisms originally proposed to underlie controlled behavior may be applicable to understanding the interactions between model-based and model-free choice behavior.
机译:长期以来,决策及其神经基础的论述都在控制选择行为中提出了独立的,相互竞争的评估系统。最近的理论和实验工作表明,习惯和目标导向(或更普遍地说,自动和受控)选择的行为和神经可分离系统之间的经典区别可能来自于强化学习(RL)的两种计算策略,称为无模型和无模型。基于模型的RL,但是在行为控制中一个系统可能会主导另一个系统的认知或计算过程仍在进行中。为了阐明这个问题,我们利用认知控制的理论框架,证明在建立的认知控制范例中,在克服与目标有关的上下文信息的利用方面的个体差异(在克服习惯性,刺激驱动的响应的服务中)预测了基于模型的行为。单独的顺序选择任务。认知控制和基于模型的RL之间的行为对应关系令人信服地表明,一组共同的过程可能支持这两种行为。尤其是,最初提出来作为受控行为基础的计算机制可能适用于理解基于模型的选择行为与无模型的选择行为之间的相互作用。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号