|
|
||||||||
REVIEW
1Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, Maryland; and 2Laboratory for Mathematical Neuroscience, RIKEN Brain Science Institute, Saitama, Japan
Submitted 4 April 2005; accepted in final form 23 September 2005
ABSTRACT
Expectation of reward motivates our behaviors and influences our decisions. Indeed, neuronal activity in many brain areas is modulated by expected reward. However, it is still unclear where and how the reward-dependent modulation of neuronal activity occurs and how the reward-modulated signal is transformed into motor outputs. Recent studies suggest an important role of the basal ganglia. Sensorimotor/cognitive activities of neurons in the basal ganglia are strongly modulated by expected reward. Through their abundant outputs to the brain stem motor areas and the thalamocortical circuits, the basal ganglia appear capable of producing body movements based on expected reward. A good behavioral measure to test this hypothesis is saccadic eye movement because its brain stem mechanism has been extensively studied. Studies from our laboratory suggest that the basal ganglia play a key role in guiding the gaze to the location where reward is available. Neurons in the caudate nucleus and the substantia nigra pars reticulata are extremely sensitive to the positional difference in expected reward, which leads to a bias in excitability between the superior colliculi such that the saccade to the to-be-rewarded position occurs more quickly. It is suggested that the reward modulation occurs in the caudate where cortical inputs carrying spatial signals and dopaminergic inputs carrying reward-related signals are integrated. These data support a specific form of reinforcement learning theories, but also suggest further refinement of the theory.
This article has been cited by other articles:
![]() |
C.F. Geier, R. Terwilliger, T. Teslovich, K. Velanova, and B. Luna Immaturities in Reward Processing and Its Influence on Inhibitory Control in Adolescence Cereb Cortex, October 29, 2009; (2009) bhp225v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Jovancevic-Misic and M. Hayhoe Adaptive Gaze Control in Natural Environments J. Neurosci., May 13, 2009; 29(19): 6234 - 6238. [Abstract] [Full Text] [PDF] |
||||
![]() |
K.-i. Okada, K. Toyama, Y. Inoue, T. Isa, and Y. Kobayashi Different Pedunculopontine Tegmental Neurons Signal Predicted and Actual Task Rewards J. Neurosci., April 15, 2009; 29(15): 4858 - 4870. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. H. Kao, B. D. Wright, and A. J. Doupe Neurons in a Forebrain Nucleus Required for Vocal Plasticity Rapidly Switch between Precise Firing and Variable Bursting Depending on Social Context J. Neurosci., December 3, 2008; 28(49): 13232 - 13247. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. F. Atherton, D. L. Wokosin, S. Ramanathan, and M. D. Bevan Autonomous initiation and propagation of action potentials in neurons of the subthalamic nucleus J. Physiol., December 1, 2008; 586(23): 5679 - 5700. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. Hikosaka, S. R. Sesack, L. Lecourtier, and P. D. Shepard Habenula: Crossroad between the Basal Ganglia and the Limbic System J. Neurosci., November 12, 2008; 28(46): 11825 - 11829. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Kaneda, K. Isa, Y. Yanagawa, and T. Isa Nigral Inhibition of GABAergic Neurons in Mouse Superior Colliculus J. Neurosci., October 22, 2008; 28(43): 11071 - 11078. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Isoda and O. Hikosaka A Neural Correlate of Motivational Conflict in the Superior Colliculus of the Macaque J Neurophysiol, September 1, 2008; 100(3): 1332 - 1342. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Liu and M. A. Basso Substantia Nigra Stimulation Influences Monkey Superior Colliculus Neuronal Activity Bilaterally J Neurophysiol, August 1, 2008; 100(2): 1098 - 1112. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Nakamura, M. Matsumoto, and O. Hikosaka Reward-Dependent Modulation of Neuronal Activity in the Primate Dorsal Raphe Nucleus J. Neurosci., May 14, 2008; 28(20): 5331 - 5343. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. A. Farries and A. L. Fairhall Reinforcement Learning With Modulated Spike Timing Dependent Synaptic Plasticity J Neurophysiol, December 1, 2007; 98(6): 3648 - 3665. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. A. Taha, S. M. Nicola, and H. L. Fields Cue-evoked encoding of movement planning and execution in the rat nucleus accumbens J. Physiol., November 1, 2007; 584(3): 801 - 818. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Kojima and A. J. Doupe Song Selectivity in the Pallial-Basal Ganglia Song Circuit of Zebra Finches Raised Without Tutor Song Exposure J Neurophysiol, October 1, 2007; 98(4): 2099 - 2109. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Nevet, G. Morris, G. Saban, D. Arkadir, and H. Bergman Lack of Spike-Count and Spike-Time Correlations in the Substantia Nigra Reticulata Despite Overlap of Neural Responses J Neurophysiol, October 1, 2007; 98(4): 2232 - 2243. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. W. Balleine, M. R. Delgado, and O. Hikosaka The Role of the Dorsal Striatum in Reward and Decision-Making J. Neurosci., August 1, 2007; 27(31): 8161 - 8165. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Saitoh, A. Menard, and S. Grillner Tectal Control of Locomotion, Steering, and Eye Movements in Lamprey J Neurophysiol, April 1, 2007; 97(4): 3093 - 3108. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Ding and O. Hikosaka Temporal Development of Asymmetric Reward-Induced Bias in Macaques J Neurophysiol, January 1, 2007; 97(1): 57 - 61. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Nakamura and O. Hikosaka Facilitation of Saccadic Eye Movements by Postsaccadic Electrical Stimulation in the Primate Caudate J. Neurosci., December 13, 2006; 26(50): 12885 - 12895. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Soltani and X.-J. Wang A biophysically based neural model of matching law behavior: melioration by stochastic synapses. J. Neurosci., April 5, 2006; 26(14): 3731 - 3744. [Abstract] [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |