Functional MRI study of short-term and long-term prediction of reward using Markov decision problem including spatial information

摘要

Evaluation of both immediate and future outcomes of an action is a critical requirement for intelligent behaviors. Here we performed a functional MRI experiment in which subjects played a computer game that required prediction of both immediate and future rewards. We estimated the time course of reward prediction at different time scales from subjects' performance data. We found topographic maps of different time scales in ventromedial prefrontal cortex and striatum. The result suggests that different cortico-basal ganglia loops are specialized for reward prediction at different time scales.