|
|
||||||||
The Journal of Neurophysiology Vol. 80 No. 2 August 1998,
pp. 947-963
Copyright ©1998 The American Physiological Society
Institute of Physiology, University of Fribourg, CH-1700 Fribourg, Switzerland
Hollerman, Jeffrey R., Léon Tremblay, and Wolfram Schultz. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80: 947-963, 1998. Rewards constitute important goals for voluntary behavior. This study aimed to investigate how expected rewards influence behavior-related neuronal activity in the anterior striatum. In a delayed go-nogo task, monkeys executed or withheld a reaching movement and obtained liquid or sound as reinforcement. An initial instruction picture indicated the behavioral reaction to be performed and the reinforcer to be obtained after a subsequent trigger stimulus. Movements varied according to the reinforcers predicted by the instructions, suggesting that animals differentially expected the two outcomes. About 250 of nearly 1,500 neurons in anterior parts of caudate nucleus, putamen, and ventral striatum showed typical task-related activations that reflected the expectation of instructions and trigger, and the preparation, initiation, and execution of behavioral reactions. Strikingly, most task-related activations occurred only when liquid reward was delivered at trial end, rather than the reinforcing sound. Activations close to the time of reward showed similar preferences for liquid reward over the reinforcing sound, suggesting a relationship to the expectation or detection of the motivational outcome of the trial rather than to a "correct" or "end-of-trial" signal. By contrast, relatively few activations in the present task occurred irrespective of the type of reinforcement. In conclusion, many of the behavior-related neurons investigated in the anterior striatum were influenced by an upcoming primary liquid reward and did not appear to code behavioral acts in a motivationally neutral manner. Rather, these neurons incorporated information about the expected outcome into their behavior-related activity. The activations influenced by reward several seconds before its occurrence may constitute a neuronal basis for the retrograde effects of rewards on behavioral reactions.
This article has been cited by other articles:
![]() |
F. Kasanetz, L. A. Riquelme, V. Della-Maggiore, P. O'Donnell, and M. G. Murer Functional integration across a gradient of corticostriatal channels controls UP state transitions in the dorsal striatum PNAS, June 10, 2008; 105(23): 8124 - 8129. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Lau and P. W. Glimcher Action and Outcome Encoding in the Primate Caudate Nucleus J. Neurosci., December 26, 2007; 27(52): 14502 - 14514. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Yamada, N. Matsumoto, and M. Kimura History- and Current Instruction-Based Coding of Forthcoming Behavioral Outcomes in the Striatum J Neurophysiol, December 1, 2007; 98(6): 3557 - 3567. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Ikeda and O. Hikosaka Positive and Negative Modulation of Motor Response in Primate Superior Colliculus by Reward Expectation J Neurophysiol, December 1, 2007; 98(6): 3163 - 3170. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. ROESCH and C. R. OLSON Neuronal Activity Related to Anticipated Reward in Frontal Cortex: Does It Represent Value or Reflect Motivation? Ann. N.Y. Acad. Sci., December 1, 2007; 1121(1): 431 - 446. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. SIMMONS, S. RAVEL, M. SHIDARA, and B. J. RICHMOND A Comparison of Reward-Contingent Neuronal Activity in Monkey Orbitofrontal Cortex and Ventral Striatum: Guiding Actions toward Rewards Ann. N.Y. Acad. Sci., December 1, 2007; 1121(1): 376 - 394. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. A. Taha, S. M. Nicola, and H. L. Fields Cue-evoked encoding of movement planning and execution in the rat nucleus accumbens J. Physiol., November 1, 2007; 584(3): 801 - 818. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. W. Balleine, M. R. Delgado, and O. Hikosaka The Role of the Dorsal Striatum in Reward and Decision-Making J. Neurosci., August 1, 2007; 27(31): 8161 - 8165. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Seo and D. Lee Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game J. Neurosci., August 1, 2007; 27(31): 8366 - 8377. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. van Duuren, F. A. N. Escamez, R. N.J.M.A. Joosten, R. Visser, A. B. Mulder, and C. M.A. Pennartz Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task Learn. Mem., June 11, 2007; 14(6): 446 - 456. [Abstract] [Full Text] [PDF] |
||||
![]() |
P.R. Corlett, G.D. Honey, and P.C. Fletcher From prediction error to psychosis: ketamine as a pharmacological model of delusions J Psychopharmacol, May 1, 2007; 21(3): 238 - 252. [Abstract] [PDF] |
||||
![]() |
D. LEE and H. SEO Mechanisms of Reinforcement Learning and Decision Making in the Primate Dorsolateral Prefrontal Cortex Ann. N.Y. Acad. Sci., May 1, 2007; 1104(1): 108 - 122. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. HIKOSAKA Basal Ganglia Mechanisms of Reward-Oriented Eye Movement Ann. N.Y. Acad. Sci., May 1, 2007; 1104(1): 229 - 249. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. R. WICKENS, C. S. BUDD, B. I. HYLAND, and G. W. ARBUTHNOTT Striatal Contributions to Reward and Decision Making: Making Sense of Regional Variations in a Reiterated Processing Matrix Ann. N.Y. Acad. Sci., May 1, 2007; 1104(1): 192 - 212. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. J. Kargo, B. Szatmary, and D. A. Nitz Adaptation of Prefrontal Cortical Firing Patterns and Their Fidelity to Changes in Action-Reward Contingencies J. Neurosci., March 28, 2007; 27(13): 3548 - 3559. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Pasquereau, A. Nadjar, D. Arkadir, E. Bezard, M. Goillandeau, B. Bioulac, C. E. Gross, and T. Boraud Shaping of Motor Responses by Incentive Values through the Basal Ganglia J. Neurosci., January 31, 2007; 27(5): 1176 - 1183. [Abstract] [Full Text] [PDF] |
||||
![]() |
X. Wan and L. L. Peoples Firing Patterns of Accumbal Neurons During a Pavlovian-Conditioned Approach Task J Neurophysiol, August 1, 2006; 96(2): 652 - 660. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Levy and B. Dubois Apathy and the Functional Anatomy of the Prefrontal Cortex-Basal Ganglia Circuits Cereb Cortex, July 1, 2006; 16(7): 916 - 928. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. Hikosaka, K. Nakamura, and H. Nakahara Basal Ganglia Orient Eyes to Reward J Neurophysiol, February 1, 2006; 95(2): 567 - 584. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Lehericy, E. Bardinet, L. Tremblay, P.-F. Van de Moortele, J.-B. Pochon, D. Dormont, D.-S. Kim, J. Yelnik, and K. Ugurbil Motor control in basal ganglia circuits using fMRI and brain atlas approaches Cereb Cortex, February 1, 2006; 16(2): 149 - 161. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Watanabe and O. Hikosaka Immediate Changes in Anticipatory Activity of Caudate Neurons Associated With Reversal of Position-Reward Contingency J Neurophysiol, September 1, 2005; 94(3): 1879 - 1887. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch and C. R. Olson Neuronal Activity Dependent on Anticipated and Elapsed Delay in Macaque Prefrontal Cortex, Frontal and Supplementary Eye Fields, and Premotor Cortex J Neurophysiol, August 1, 2005; 94(2): 1469 - 1497. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. I. G. Wilson and E. M. Bowman Rat Nucleus Accumbens Neurons Predominantly Respond to the Outcome-Related Properties of Conditioned Stimuli Rather Than Their Behavioral-Switching Properties J Neurophysiol, July 1, 2005; 94(1): 49 - 61. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. A. Taha and H. L. Fields Encoding of Palatability and Appetitive Behaviors by Distinct Neuronal Populations in the Nucleus Accumbens J. Neurosci., February 2, 2005; 25(5): 1193 - 1202. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. Worgotter and B. Porr Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms Neural Comput., February 1, 2005; 17(2): 245 - 319. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. J.-F. de Quervain, U. Fischbacher, V. Treyer, M. Schellhammer, U. Schnyder, A. Buck, and E. Fehr The Neural Basis of Altruistic Punishment Science, August 27, 2004; 305(5688): 1254 - 1258. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. J. DOUPE, M. M. SOLIS, R. KIMPO, and C. A. BOETTIGER Cellular, Circuit, and Synaptic Mechanisms in Song Learning Ann. N.Y. Acad. Sci., June 1, 2004; 1016(1): 495 - 523. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Nicola, I. A. Yun, K. T. Wakabayashi, and H. L. Fields Cue-Evoked Firing of Nucleus Accumbens Neurons Encodes Motivational Significance During a Discriminative Stimulus Task J Neurophysiol, April 1, 2004; 91(4): 1840 - 1865. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Nicola, I. A. Yun, K. T. Wakabayashi, and H. L. Fields Firing of Nucleus Accumbens Neurons During the Consummatory Phase of a Discriminative Stimulus Task Depends on Previous Reward Predictive Cues J Neurophysiol, April 1, 2004; 91(4): 1866 - 1882. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. A. Yun, K. T. Wakabayashi, H. L. Fields, and S. M. Nicola The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues J. Neurosci., March 24, 2004; 24(12): 2923 - 2933. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Wichmann and M. A. Kliem Neuronal Activity in the Primate Substantia Nigra Pars Reticulata During the Performance of Simple and Memory-Guided Elbow Movements J Neurophysiol, February 1, 2004; 91(2): 815 - 827. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Ravel, E. Legallet, and P. Apicella Responses of Tonically Active Neurons in the Monkey Striatum Discriminate between Motivationally Opposing Stimuli J. Neurosci., September 17, 2003; 23(24): 8489 - 8497. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch and C. R. Olson Impact of Expected Reward on Neuronal Activity in Prefrontal Cortex, Frontal and Supplementary Eye Fields and Premotor Cortex J Neurophysiol, September 1, 2003; 90(3): 1766 - 1789. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. T. Wyder, D. P. Massoglia, and T. R. Stanford Quantitative Assessment of the Timing and Tuning of Visual-Related, Saccade-Related, and Delay Period Activity in Primate Central Thalamus J Neurophysiol, September 1, 2003; 90(3): 2029 - 2052. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. J. Gruber, S. A. Solla, D. J. Surmeier, and J. C. Houk Modulation of Striatal Single Units by Expected Reward: A Spiny Neuron Model Displaying Dopamine-Induced Bistability J Neurophysiol, August 1, 2003; 90(2): 1095 - 1114. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. C. Cromwell and W. Schultz Effects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum J Neurophysiol, May 1, 2003; 89(5): 2823 - 2838. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. Ramnani and R.C. Miall Instructed Delay Activity in the Human Prefrontal Cortex is Modulated by Monetary Reward Expectation Cereb Cortex, March 1, 2003; 13(3): 318 - 327. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. K. Hassani, H. C. Cromwell, and W. Schultz Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum J Neurophysiol, June 1, 2001; 85(6): 2477 - 2489. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. E. Suri and W. Schultz Temporal Difference Model Reproduces Anticipatory Neural Activity Neural Comput., April 1, 2001; 13(4): 841 - 862. [Abstract] [Full Text] |
||||
![]() |
M. J. Gdowski, L. E. Miller, T. Parrish, E. K. Nenonene, and J. C. Houk Context Dependency in the Globus Pallidus Internal Segment During Targeted Arm Movements J Neurophysiol, February 1, 2001; 85(2): 998 - 1004. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. T. Williams, M. J. Christie, and O. Manzoni Cellular and Synaptic Adaptations Mediating Opioid Dependence Physiol Rev, January 1, 2001; 81(1): 299 - 343. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. M. Solis, M. S. Brainard, N. A. Hessler, and A. J. Doupe Song selectivity and sensorimotor signals in vocal learning and production PNAS, October 24, 2000; 97(22): 11836 - 11842. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. Amador, M. Schlag-Rey, and J. Schlag Reward-Predicting and Reward-Detecting Neuronal Activity in the Primate Supplementary Eye Field J Neurophysiol, October 1, 2000; 84(4): 2166 - 2170. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. Hauber, I. Bohn, and C. Giertler NMDA, But Not Dopamine D2, Receptors in the Rat Nucleus Accumbens Are Involved in Guidance of Instrumental Behavior by Stimuli Predicting Reward Magnitude J. Neurosci., August 15, 2000; 20(16): 6282 - 6288. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. Hikosaka, Y. Takikawa, and R. Kawagoe Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements Physiol Rev, July 1, 2000; 80(3): 953 - 978. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. M. Carelli, S. G. Ijames, and A. J. Crumling Evidence That Separate Neural Circuits in the Nucleus Accumbens Encode Cocaine Versus "Natural" (Water and Food) Reward J. Neurosci., June 1, 2000; 20(11): 4255 - 4266. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Tremblay and W. Schultz Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex J Neurophysiol, April 1, 2000; 83(4): 1864 - 1876. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Tremblay and W. Schultz Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Orbitofrontal Cortex J Neurophysiol, April 1, 2000; 83(4): 1877 - 1885. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. Schultz, L. Tremblay, and J. R. Hollerman Reward Processing in Primate Orbitofrontal Cortex and Basal Ganglia Cereb Cortex, March 1, 2000; 10(3): 272 - 283. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Handel and P. W. Glimcher Quantitative Analysis of Substantia Nigra Pars Reticulata Activity During a Visually Guided Saccade Task J Neurophysiol, December 1, 1999; 82(6): 3458 - 3475. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. L. PRICE Prefrontal Cortical Networks Related to Visceral Function and Mood Ann. N.Y. Acad. Sci., June 29, 1999; 877(1): 383 - 396. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Tremblay, J. R. Hollerman, and W. Schultz Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum J Neurophysiol, August 1, 1998; 80(2): 964 - 977. [Abstract] [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |