JN Journal of Applied Physiology
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
QUICK SEARCH:   [advanced]


     

J Neurophysiol 80: 947-963, 1998;
0022-3077/98 $5.00
This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Hollerman, J. R.
Right arrow Articles by Schultz, W.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Hollerman, J. R.
Right arrow Articles by Schultz, W.

The Journal of Neurophysiology Vol. 80 No. 2 August 1998, pp. 947-963
Copyright ©1998 The American Physiological Society

Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum

Jeffrey R. Hollerman, Léon Tremblay, and Wolfram Schultz

Institute of Physiology, University of Fribourg, CH-1700 Fribourg, Switzerland

Hollerman, Jeffrey R., Léon Tremblay, and Wolfram Schultz. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80: 947-963, 1998. Rewards constitute important goals for voluntary behavior. This study aimed to investigate how expected rewards influence behavior-related neuronal activity in the anterior striatum. In a delayed go-nogo task, monkeys executed or withheld a reaching movement and obtained liquid or sound as reinforcement. An initial instruction picture indicated the behavioral reaction to be performed and the reinforcer to be obtained after a subsequent trigger stimulus. Movements varied according to the reinforcers predicted by the instructions, suggesting that animals differentially expected the two outcomes. About 250 of nearly 1,500 neurons in anterior parts of caudate nucleus, putamen, and ventral striatum showed typical task-related activations that reflected the expectation of instructions and trigger, and the preparation, initiation, and execution of behavioral reactions. Strikingly, most task-related activations occurred only when liquid reward was delivered at trial end, rather than the reinforcing sound. Activations close to the time of reward showed similar preferences for liquid reward over the reinforcing sound, suggesting a relationship to the expectation or detection of the motivational outcome of the trial rather than to a "correct" or "end-of-trial" signal. By contrast, relatively few activations in the present task occurred irrespective of the type of reinforcement. In conclusion, many of the behavior-related neurons investigated in the anterior striatum were influenced by an upcoming primary liquid reward and did not appear to code behavioral acts in a motivationally neutral manner. Rather, these neurons incorporated information about the expected outcome into their behavior-related activity. The activations influenced by reward several seconds before its occurrence may constitute a neuronal basis for the retrograde effects of rewards on behavioral reactions.




This article has been cited by other articles:


Home page
 J. Neurophysiol.Home page
T. Minamimoto, G. La Camera, and B. J. Richmond
Measuring and Modeling the Interaction Among Reward Size, Delay to Reward, and Satiation Level on Motivation in Monkeys
J Neurophysiol, January 1, 2009; 101(1): 437 - 447.
[Abstract] [Full Text] [PDF]

Home page
 Phil Trans R Soc BHome page
H. Seo and D. Lee
Cortical mechanisms for reinforcement learning in competitive games
Phil Trans R Soc B, December 12, 2008; 363(1511): 3845 - 3857.
[Abstract] [Full Text] [PDF]

Home page
 Proc. Natl. Acad. Sci. USAHome page
F. Kasanetz, L. A. Riquelme, V. Della-Maggiore, P. O'Donnell, and M. G. Murer
Functional integration across a gradient of corticostriatal channels controls UP state transitions in the dorsal striatum
PNAS, June 10, 2008; 105(23): 8124 - 8129.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
B. Lau and P. W. Glimcher
Action and Outcome Encoding in the Primate Caudate Nucleus
J. Neurosci., December 26, 2007; 27(52): 14502 - 14514.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
H. Yamada, N. Matsumoto, and M. Kimura
History- and Current Instruction-Based Coding of Forthcoming Behavioral Outcomes in the Striatum
J Neurophysiol, December 1, 2007; 98(6): 3557 - 3567.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
T. Ikeda and O. Hikosaka
Positive and Negative Modulation of Motor Response in Primate Superior Colliculus by Reward Expectation
J Neurophysiol, December 1, 2007; 98(6): 3163 - 3170.
[Abstract] [Full Text] [PDF]

Home page
 J. Physiol.Home page
S. A. Taha, S. M. Nicola, and H. L. Fields
Cue-evoked encoding of movement planning and execution in the rat nucleus accumbens
J. Physiol., November 1, 2007; 584(3): 801 - 818.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
B. W. Balleine, M. R. Delgado, and O. Hikosaka
The Role of the Dorsal Striatum in Reward and Decision-Making
J. Neurosci., August 1, 2007; 27(31): 8161 - 8165.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
H. Seo and D. Lee
Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game
J. Neurosci., August 1, 2007; 27(31): 8366 - 8377.
[Abstract] [Full Text] [PDF]

Home page
 Learn. Mem.Home page
E. van Duuren, F. A. N. Escamez, R. N.J.M.A. Joosten, R. Visser, A. B. Mulder, and C. M.A. Pennartz
Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task
Learn. Mem., June 11, 2007; 14(6): 446 - 456.
[Abstract] [Full Text] [PDF]

Home page
 J PsychopharmacolHome page
P.R. Corlett, G.D. Honey, and P.C. Fletcher
From prediction error to psychosis: ketamine as a pharmacological model of delusions
J Psychopharmacol, May 1, 2007; 21(3): 238 - 252.
[Abstract] [PDF]

Home page
 J. Neurosci.Home page
W. J. Kargo, B. Szatmary, and D. A. Nitz
Adaptation of Prefrontal Cortical Firing Patterns and Their Fidelity to Changes in Action-Reward Contingencies
J. Neurosci., March 28, 2007; 27(13): 3548 - 3559.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
B. Pasquereau, A. Nadjar, D. Arkadir, E. Bezard, M. Goillandeau, B. Bioulac, C. E. Gross, and T. Boraud
Shaping of Motor Responses by Incentive Values through the Basal Ganglia
J. Neurosci., January 31, 2007; 27(5): 1176 - 1183.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
X. Wan and L. L. Peoples
Firing Patterns of Accumbal Neurons During a Pavlovian-Conditioned Approach Task
J Neurophysiol, August 1, 2006; 96(2): 652 - 660.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
R. Levy and B. Dubois
Apathy and the Functional Anatomy of the Prefrontal Cortex-Basal Ganglia Circuits
Cereb Cortex, July 1, 2006; 16(7): 916 - 928.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
O. Hikosaka, K. Nakamura, and H. Nakahara
Basal Ganglia Orient Eyes to Reward
J Neurophysiol, February 1, 2006; 95(2): 567 - 584.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
S. Lehericy, E. Bardinet, L. Tremblay, P.-F. Van de Moortele, J.-B. Pochon, D. Dormont, D.-S. Kim, J. Yelnik, and K. Ugurbil
Motor control in basal ganglia circuits using fMRI and brain atlas approaches
Cereb Cortex, February 1, 2006; 16(2): 149 - 161.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
K. Watanabe and O. Hikosaka
Immediate Changes in Anticipatory Activity of Caudate Neurons Associated With Reversal of Position-Reward Contingency
J Neurophysiol, September 1, 2005; 94(3): 1879 - 1887.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
M. R. Roesch and C. R. Olson
Neuronal Activity Dependent on Anticipated and Elapsed Delay in Macaque Prefrontal Cortex, Frontal and Supplementary Eye Fields, and Premotor Cortex
J Neurophysiol, August 1, 2005; 94(2): 1469 - 1497.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
D. I. G. Wilson and E. M. Bowman
Rat Nucleus Accumbens Neurons Predominantly Respond to the Outcome-Related Properties of Conditioned Stimuli Rather Than Their Behavioral-Switching Properties
J Neurophysiol, July 1, 2005; 94(1): 49 - 61.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
S. A. Taha and H. L. Fields
Encoding of Palatability and Appetitive Behaviors by Distinct Neuronal Populations in the Nucleus Accumbens
J. Neurosci., February 2, 2005; 25(5): 1193 - 1202.
[Abstract] [Full Text] [PDF]

Home page
 ScienceHome page
D. J.-F. de Quervain, U. Fischbacher, V. Treyer, M. Schellhammer, U. Schnyder, A. Buck, and E. Fehr
The Neural Basis of Altruistic Punishment
Science, August 27, 2004; 305(5688): 1254 - 1258.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
S. M. Nicola, I. A. Yun, K. T. Wakabayashi, and H. L. Fields
Cue-Evoked Firing of Nucleus Accumbens Neurons Encodes Motivational Significance During a Discriminative Stimulus Task
J Neurophysiol, April 1, 2004; 91(4): 1840 - 1865.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
S. M. Nicola, I. A. Yun, K. T. Wakabayashi, and H. L. Fields
Firing of Nucleus Accumbens Neurons During the Consummatory Phase of a Discriminative Stimulus Task Depends on Previous Reward Predictive Cues
J Neurophysiol, April 1, 2004; 91(4): 1866 - 1882.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
I. A. Yun, K. T. Wakabayashi, H. L. Fields, and S. M. Nicola
The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues
J. Neurosci., March 24, 2004; 24(12): 2923 - 2933.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
T. Wichmann and M. A. Kliem
Neuronal Activity in the Primate Substantia Nigra Pars Reticulata During the Performance of Simple and Memory-Guided Elbow Movements
J Neurophysiol, February 1, 2004; 91(2): 815 - 827.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
S. Ravel, E. Legallet, and P. Apicella
Responses of Tonically Active Neurons in the Monkey Striatum Discriminate between Motivationally Opposing Stimuli
J. Neurosci., September 17, 2003; 23(24): 8489 - 8497.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
M. R. Roesch and C. R. Olson
Impact of Expected Reward on Neuronal Activity in Prefrontal Cortex, Frontal and Supplementary Eye Fields and Premotor Cortex
J Neurophysiol, September 1, 2003; 90(3): 1766 - 1789.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
M. T. Wyder, D. P. Massoglia, and T. R. Stanford
Quantitative Assessment of the Timing and Tuning of Visual-Related, Saccade-Related, and Delay Period Activity in Primate Central Thalamus
J Neurophysiol, September 1, 2003; 90(3): 2029 - 2052.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
A. J. Gruber, S. A. Solla, D. J. Surmeier, and J. C. Houk
Modulation of Striatal Single Units by Expected Reward: A Spiny Neuron Model Displaying Dopamine-Induced Bistability
J Neurophysiol, August 1, 2003; 90(2): 1095 - 1114.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
H. C. Cromwell and W. Schultz
Effects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum
J Neurophysiol, May 1, 2003; 89(5): 2823 - 2838.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
N. Ramnani and R.C. Miall
Instructed Delay Activity in the Human Prefrontal Cortex is Modulated by Monetary Reward Expectation
Cereb Cortex, March 1, 2003; 13(3): 318 - 327.
[Abstract] [Full Text] [PDF]

Home page
 NeuroscientistHome page
W. Schultz
Book Review: Reward Signaling by Dopamine Neurons
Neuroscientist, August 1, 2001; 7(4): 293 - 302.
[Abstract] [PDF]

Home page
 J. Neurophysiol.Home page
O. K. Hassani, H. C. Cromwell, and W. Schultz
Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum
J Neurophysiol, June 1, 2001; 85(6): 2477 - 2489.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
M. J. Gdowski, L. E. Miller, T. Parrish, E. K. Nenonene, and J. C. Houk
Context Dependency in the Globus Pallidus Internal Segment During Targeted Arm Movements
J Neurophysiol, February 1, 2001; 85(2): 998 - 1004.
[Abstract] [Full Text] [PDF]

Home page
 Physiol. Rev.Home page
J. T. Williams, M. J. Christie, and O. Manzoni
Cellular and Synaptic Adaptations Mediating Opioid Dependence
Physiol Rev, January 1, 2001; 81(1): 299 - 343.
[Abstract] [Full Text] [PDF]

Home page
 Proc. Natl. Acad. Sci. USAHome page
M. M. Solis, M. S. Brainard, N. A. Hessler, and A. J. Doupe
Song selectivity and sensorimotor signals in vocal learning and production
PNAS, October 24, 2000; 97(22): 11836 - 11842.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
N. Amador, M. Schlag-Rey, and J. Schlag
Reward-Predicting and Reward-Detecting Neuronal Activity in the Primate Supplementary Eye Field
J Neurophysiol, October 1, 2000; 84(4): 2166 - 2170.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
W. Hauber, I. Bohn, and C. Giertler
NMDA, But Not Dopamine D2, Receptors in the Rat Nucleus Accumbens Are Involved in Guidance of Instrumental Behavior by Stimuli Predicting Reward Magnitude
J. Neurosci., August 15, 2000; 20(16): 6282 - 6288.
[Abstract] [Full Text] [PDF]

Home page
 Physiol. Rev.Home page
O. Hikosaka, Y. Takikawa, and R. Kawagoe
Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements
Physiol Rev, July 1, 2000; 80(3): 953 - 978.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurosci.Home page
R. M. Carelli, S. G. Ijames, and A. J. Crumling
Evidence That Separate Neural Circuits in the Nucleus Accumbens Encode Cocaine Versus "Natural" (Water and Food) Reward
J. Neurosci., June 1, 2000; 20(11): 4255 - 4266.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
L. Tremblay and W. Schultz
Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex
J Neurophysiol, April 1, 2000; 83(4): 1864 - 1876.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
L. Tremblay and W. Schultz
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Orbitofrontal Cortex
J Neurophysiol, April 1, 2000; 83(4): 1877 - 1885.
[Abstract] [Full Text] [PDF]

Home page
 Cereb CortexHome page
W. Schultz, L. Tremblay, and J. R. Hollerman
Reward Processing in Primate Orbitofrontal Cortex and Basal Ganglia
Cereb Cortex, March 1, 2000; 10(3): 272 - 283.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
A. Handel and P. W. Glimcher
Quantitative Analysis of Substantia Nigra Pars Reticulata Activity During a Visually Guided Saccade Task
J Neurophysiol, December 1, 1999; 82(6): 3458 - 3475.
[Abstract] [Full Text] [PDF]

Home page
 J. Neurophysiol.Home page
L. Tremblay, J. R. Hollerman, and W. Schultz
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
J Neurophysiol, August 1, 1998; 80(2): 964 - 977.
[Abstract] [Full Text] [PDF]


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Visit Other APS Journals Online