| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
1Advanced Telecommunication Research Institute Computational Neuroscience Laboratories, Department of Cognitive Neuroscience, Kyoto, Japan; and 2Institute of Neurology, University College London, London, United Kingdom
Submitted 14 April 2005; accepted in final form 26 September 2005
To select appropriate behaviors leading to rewards, the brain needs to learn associations among sensory stimuli, selected behaviors, and rewards. Recent imaging and neural-recording studies have revealed that the dorsal striatum plays an important role in learning such stimulus-action-reward associations. However, the putamen and caudate nucleus are embedded in distinct cortico-striatal loop circuits, predominantly connected to motor-related cerebral cortical areas and frontal association areas, respectively. This difference in their cortical connections suggests that the putamen and caudate nucleus are engaged in different functional aspects of stimulus-action-reward association learning. To determine whether this is the case, we conducted an event-related and computational model–based functional MRI (fMRI) study with a stochastic decision-making task in which a stimulus-action-reward association must be learned. A simple reinforcement learning model not only reproduced the subject's action selections reasonably well but also allowed us to quantitatively estimate each subject's temporal profiles of stimulus-action-reward association and reward-prediction error during learning trials. These two internal representations were used in the fMRI correlation analysis. The results revealed that neural correlates of the stimulus-action-reward association reside in the putamen, whereas a correlation with reward-prediction error was found largely in the caudate nucleus and ventral striatum. These nonuniform spatiotemporal distributions of neural correlates within the dorsal striatum were maintained consistently at various levels of task difficulty, suggesting a functional difference in the dorsal striatum between the putamen and caudate nucleus during stimulus-action-reward association learning.
This article has been cited by other articles:
|
|
 |
|
  S. B. R. E. Brown and K. R. Ridderinkhof Aging and the neuroeconomics of decision making: A review Cogn Affect Behav Neurosci, December 1, 2009; 9(4): 365 - 379. [Abstract] [PDF]
|
|
|
|
 |
|
 Y. Kubota, J. Liu, D. Hu, W. E. DeCoteau, U. T. Eden, A. C. Smith, and A. M. Graybiel Stable Encoding of Task Structure Coexists With Flexible Coding of Task Events in Sensorimotor Striatum J Neurophysiol, October 1, 2009; 102(4): 2142 - 2160. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Pine, B. Seymour, J. P. Roiser, P. Bossaerts, K. J. Friston, H. V. Curran, and R. J. Dolan Encoding of Marginal Utility across Time in the Human Brain J. Neurosci., July 29, 2009; 29(30): 9575 - 9581. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Haruno and M. Kawato Activity in the Superior Temporal Sulcus Highlights Learning Competence in an Interaction Game J. Neurosci., April 8, 2009; 29(14): 4542 - 4547. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Hsu, I. Krajbich, C. Zhao, and C. F. Camerer Neural Response to Reward Anticipation under Risk Is Nonlinear in Probabilities J. Neurosci., February 18, 2009; 29(7): 2231 - 2237. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. U. Forstmann, S. Jahfari, H. S. Scholte, U. Wolfensteller, W. P. M. van den Wildenberg, and K. R. Ridderinkhof Function and Structure of the Right Inferior Frontal Cortex Predict Individual Differences in Response Inhibition: A Model-Based Approach J. Neurosci., September 24, 2008; 28(39): 9790 - 9796. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. M. COX, H. J. AIZENSTEIN, and J. A. FIEZ Striatal outcome processing in healthy aging Cogn Affect Behav Neurosci, September 1, 2008; 8(3): 304 - 317. [Abstract] [PDF]
|
|
|
|
 |
|
 A. Brovelli, N. Laksiri, B. Nazarian, M. Meunier, and D. Boussaoud Understanding the Neural Computations of Arbitrary Visuomotor Learning through fMRI and Associative Learning Theory Cereb Cortex, July 1, 2008; 18(7): 1485 - 1495. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Kawato From 'Understanding the Brain by Creating the Brain' towards manipulative neuroscience Phil Trans R Soc B, June 27, 2008; 363(1500): 2201 - 2214. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. X. COHEN Neurocomputational mechanisms of reinforcement-guided learning in humans: A review Cogn Affect Behav Neurosci, June 1, 2008; 8(2): 113 - 125. [Abstract] [PDF]
|
|
|
|
 |
|
 E. C. Finger, A. A. Marsh, D. G. Mitchell, M. E. Reid, C. Sims, S. Budhani, D. S. Kosson, G. Chen, K. E. Towbin, E. Leibenluft, et al. Abnormal Ventromedial Prefrontal Cortex Function in Children With Psychopathic Traits During Reversal Learning Arch Gen Psychiatry, May 1, 2008; 65(5): 586 - 594. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. Lau and P. W. Glimcher Action and Outcome Encoding in the Primate Caudate Nucleus J. Neurosci., December 26, 2007; 27(52): 14502 - 14514. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. Fliessbach, B. Weber, P. Trautner, T. Dohmen, U. Sunde, C. E. Elger, and A. Falk Social Comparison Affects Reward-Related Brain Activity in the Human Ventral Striatum Science, November 23, 2007; 318(5854): 1305 - 1308. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. W. Balleine, M. R. Delgado, and O. Hikosaka The Role of the Dorsal Striatum in Reward and Decision-Making J. Neurosci., August 1, 2007; 27(31): 8161 - 8165. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Seo and D. Lee Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game J. Neurosci., August 1, 2007; 27(31): 8366 - 8377. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. X Cohen Individual differences and the neural representations of reward expectation and reward prediction error Soc Cogn Affect Neurosci, March 1, 2007; 2(1): 20 - 30. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Nakamura and O. Hikosaka Facilitation of Saccadic Eye Movements by Postsaccadic Electrical Stimulation in the Primate Caudate J. Neurosci., December 13, 2006; 26(50): 12885 - 12895. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. E. Guyer, E. E. Nelson, K. Perez-Edgar, M. G. Hardin, R. Roberson-Nay, C. S. Monk, J. M. Bjork, H. A. Henderson, D. S. Pine, N. A. Fox, et al. Striatal functional alteration in adolescents characterized by early childhood behavioral inhibition. J. Neurosci., June 14, 2006; 26(24): 6399 - 6405. [Abstract] [Full Text] [PDF]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |
