| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH |
|
|
|
|||||||
|
|||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
1 Depatment of Cognitive Neuroscience, ATR Computational Neuroscience Labs., Seika-cho, Kyoto, Japan; Sobell Dept. of Motor Neuroscience, Institute of Neurology, London, United Kingdom
2 Depatment of Cognitive Neuroscience, ATR Computational Neuroscience Labs., Seika-cho, Kyoto, Japan
* To whom correspondence should be addressed. E-mail: mharuno{at}atr.jp.
To select appropriate behaviors leading to rewards, the brain needs to learn associations among sensory stimuli, selected behaviors, and rewards. Recent imaging and neural-recording studies have revealed that the dorsal striatum plays an important role in learning such stimulus-action-reward associations. However, the putamen and caudate nucleus are embedded in distinct cortico-striatal loop circuits, predominantly connected to motor-related cerebral cortical areas and frontal association areas, respectively. This difference in their cortical connections suggests that the putamen and caudate nucleus are engaged in different functional aspects of stimulus-action-reward association learning. To determine whether this is the case, we conducted an event-related and computational-model-based fMRI study with a stochastic decision-making task in which a stimulus-action-reward association must be learned. A simple reinforcement learning model not only reproduced the subject's action selections reasonably well but also allowed us to quantitatively estimate each subject's temporal profiles of stimulus-action-reward association and reward-prediction error during learning trials. These two internal representations were used in the fMRI correlation analysis. The results revealed that neural correlates of the stimulus-action-reward association reside in the putamen, whereas a correlation with reward-prediction error was found largely in the caudate nucleus and ventral striatum. These non-uniform spatiotemporal distributions of neural correlates within the dorsal striatum were maintained consistently at various levels of task difficulty, suggesting a functional difference in the dorsal striatum between the putamen and caudate nucleus during stimulus-action-reward association learning.
This article has been cited by other articles:
|
|
 |
|
  S. B. R. E. Brown and K. R. Ridderinkhof Aging and the neuroeconomics of decision making: A review Cogn Affect Behav Neurosci, December 1, 2009; 9(4): 365 - 379. [Abstract] [PDF]
|
|
|
|
 |
|
 Y. Kubota, J. Liu, D. Hu, W. E. DeCoteau, U. T. Eden, A. C. Smith, and A. M. Graybiel Stable Encoding of Task Structure Coexists With Flexible Coding of Task Events in Sensorimotor Striatum J Neurophysiol, October 1, 2009; 102(4): 2142 - 2160. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Pine, B. Seymour, J. P. Roiser, P. Bossaerts, K. J. Friston, H. V. Curran, and R. J. Dolan Encoding of Marginal Utility across Time in the Human Brain J. Neurosci., July 29, 2009; 29(30): 9575 - 9581. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Haruno and M. Kawato Activity in the Superior Temporal Sulcus Highlights Learning Competence in an Interaction Game J. Neurosci., April 8, 2009; 29(14): 4542 - 4547. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Hsu, I. Krajbich, C. Zhao, and C. F. Camerer Neural Response to Reward Anticipation under Risk Is Nonlinear in Probabilities J. Neurosci., February 18, 2009; 29(7): 2231 - 2237. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. U. Forstmann, S. Jahfari, H. S. Scholte, U. Wolfensteller, W. P. M. van den Wildenberg, and K. R. Ridderinkhof Function and Structure of the Right Inferior Frontal Cortex Predict Individual Differences in Response Inhibition: A Model-Based Approach J. Neurosci., September 24, 2008; 28(39): 9790 - 9796. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. M. COX, H. J. AIZENSTEIN, and J. A. FIEZ Striatal outcome processing in healthy aging Cogn Affect Behav Neurosci, September 1, 2008; 8(3): 304 - 317. [Abstract] [PDF]
|
|
|
|
 |
|
 A. Brovelli, N. Laksiri, B. Nazarian, M. Meunier, and D. Boussaoud Understanding the Neural Computations of Arbitrary Visuomotor Learning through fMRI and Associative Learning Theory Cereb Cortex, July 1, 2008; 18(7): 1485 - 1495. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Kawato From 'Understanding the Brain by Creating the Brain' towards manipulative neuroscience Phil Trans R Soc B, June 27, 2008; 363(1500): 2201 - 2214. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. X. COHEN Neurocomputational mechanisms of reinforcement-guided learning in humans: A review Cogn Affect Behav Neurosci, June 1, 2008; 8(2): 113 - 125. [Abstract] [PDF]
|
|
|
|
 |
|
 E. C. Finger, A. A. Marsh, D. G. Mitchell, M. E. Reid, C. Sims, S. Budhani, D. S. Kosson, G. Chen, K. E. Towbin, E. Leibenluft, et al. Abnormal Ventromedial Prefrontal Cortex Function in Children With Psychopathic Traits During Reversal Learning Arch Gen Psychiatry, May 1, 2008; 65(5): 586 - 594. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. Lau and P. W. Glimcher Action and Outcome Encoding in the Primate Caudate Nucleus J. Neurosci., December 26, 2007; 27(52): 14502 - 14514. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. Fliessbach, B. Weber, P. Trautner, T. Dohmen, U. Sunde, C. E. Elger, and A. Falk Social Comparison Affects Reward-Related Brain Activity in the Human Ventral Striatum Science, November 23, 2007; 318(5854): 1305 - 1308. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. W. Balleine, M. R. Delgado, and O. Hikosaka The Role of the Dorsal Striatum in Reward and Decision-Making J. Neurosci., August 1, 2007; 27(31): 8161 - 8165. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Seo and D. Lee Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game J. Neurosci., August 1, 2007; 27(31): 8366 - 8377. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. X Cohen Individual differences and the neural representations of reward expectation and reward prediction error Soc Cogn Affect Neurosci, March 1, 2007; 2(1): 20 - 30. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Nakamura and O. Hikosaka Facilitation of Saccadic Eye Movements by Postsaccadic Electrical Stimulation in the Primate Caudate J. Neurosci., December 13, 2006; 26(50): 12885 - 12895. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. E. Guyer, E. E. Nelson, K. Perez-Edgar, M. G. Hardin, R. Roberson-Nay, C. S. Monk, J. M. Bjork, H. A. Henderson, D. S. Pine, N. A. Fox, et al. Striatal functional alteration in adolescents characterized by early childhood behavioral inhibition. J. Neurosci., June 14, 2006; 26(24): 6399 - 6405. [Abstract] [Full Text] [PDF]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH |
| Visit Other APS Journals Online |
