|
|
||||||||
The Journal of Neurophysiology Vol. 83 No. 4 April 2000, pp. 1864-1876
Copyright ©2000 by the American Physiological Society
Institute of Physiology and Program in Neuroscience, University of Fribourg, CH-1700 Fribourg, Switzerland
Tremblay, Léon and
Wolfram Schultz.
Reward-Related Neuronal Activity During Go-Nogo Task Performance
in Primate Orbitofrontal Cortex. J. Neurophysiol. 83: 1864-1876, 2000. The orbitofrontal cortex appears
to be involved in the control of voluntary, goal-directed behavior by
motivational outcomes. This study investigated how orbitofrontal
neurons process information about rewards in a task that depends on
intact orbitofrontal functions. In a delayed go-nogo task, animals
executed or withheld a reaching movement and obtained liquid or a
conditioned sound as reinforcement. An initial instruction picture
indicated the behavioral reaction to be performed (movement vs.
nonmovement) and the reinforcer to be obtained (liquid vs. sound) after
a subsequent trigger stimulus. We found task-related activations in 188 of 505 neurons in rostral orbitofrontal area 13, entire area 11, and
lateral area 14. The principal task-related activations consisted of
responses to instructions, activations preceding reinforcers, or
responses to reinforcers. Most activations reflected the reinforcing
event rather than other task components. Instruction responses occurred
either in liquid- or sound-reinforced trials but rarely distinguished
between movement and nonmovement reactions. These instruction responses
reflected the predicted motivational outcome rather than the behavioral reaction necessary for obtaining that outcome. Activations preceding the reinforcer began slowly and terminated immediately after the reinforcer, even when the reinforcer occurred earlier or later than
usually. These activations preceded usually the liquid reward but
rarely the conditioned auditory reinforcer. The activations also
preceded expected drops of liquid delivered outside the task, suggesting a primary appetitive rather than a task-reinforcing relationship that apparently was related to the expectation of reward.
Responses after the reinforcer occurred in liquid- but rarely in
sound-reinforced trials. Reward-preceding activations and reward
responses were unrelated temporally to licking movements. Several
neurons showed reward responses outside the task but instruction responses during the task, indicating a response transfer from primary
reward to the reward-predicting instruction, possibly reflecting the
temporal unpredictability of reward. In conclusion, orbitofrontal
neurons report stimuli associated with reinforcers are concerned with
the expectation of reward and detect reward delivery at trial end.
These activities may contribute to the processing of reward information
for the motivational control of goal-directed behavior.
This article has been cited by other articles:
![]() |
T. Furuyashiki, P. C. Holland, and M. Gallagher Rat Orbitofrontal Cortex Separately Encodes Response and Outcome Information during Performance of Goal-Directed Behavior J. Neurosci., May 7, 2008; 28(19): 5127 - 5138. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Ichihara-Takeda and S. Funahashi Activity of Primate Orbitofrontal and Dorsolateral Prefrontal Neurons: Effect of Reward Schedule on Task-related Activity. J. Cogn. Neurosci., April 1, 2008; 20(4): 563 - 579. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Simmons and B. J. Richmond Dynamic Changes in Representations of Preceding and Upcoming Reward in Monkey Orbitofrontal Cortex Cereb Cortex, January 1, 2008; 18(1): 93 - 103. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. BARBAS Specialized Elements of Orbitofrontal Cortex in Primates Ann. N.Y. Acad. Sci., December 1, 2007; 1121(1): 10 - 32. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. SCHOENBAUM, M. P. SADDORIS, and T. A. STALNAKER Reconciling the Roles of Orbitofrontal Cortex in Reversal Learning and the Encoding of Outcome Expectancies Ann. N.Y. Acad. Sci., December 1, 2007; 1121(1): 320 - 335. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. ROESCH and C. R. OLSON Neuronal Activity Related to Anticipated Reward in Frontal Cortex: Does It Represent Value or Reflect Motivation? Ann. N.Y. Acad. Sci., December 1, 2007; 1121(1): 431 - 446. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. SIMMONS, S. RAVEL, M. SHIDARA, and B. J. RICHMOND A Comparison of Reward-Contingent Neuronal Activity in Monkey Orbitofrontal Cortex and Ventral Striatum: Guiding Actions toward Rewards Ann. N.Y. Acad. Sci., December 1, 2007; 1121(1): 376 - 394. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. FURUYASHIKI and M. GALLAGHER Neural Encoding in the Orbitofrontal Cortex Related to Goal-Directed Behavior Ann. N.Y. Acad. Sci., December 1, 2007; 1121(1): 193 - 215. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Watanabe and M. Sakagami Integration of Cognitive and Motivational Context Information in the Primate Prefrontal Cortex Cereb Cortex, September 1, 2007; 17(suppl_1): i101 - i109. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Lee, M. F. S. Rushworth, M. E. Walton, M. Watanabe, and M. Sakagami Functional Specialization of the Primate Frontal Cortex during Decision Making J. Neurosci., August 1, 2007; 27(31): 8170 - 8173. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. B. Ostlund and B. W. Balleine Orbitofrontal Cortex Mediates Outcome Encoding in Pavlovian But Not Instrumental Conditioning J. Neurosci., May 2, 2007; 27(18): 4819 - 4825. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. ROESCH, D. J. CALU, K. A. BURKE, and G. SCHOENBAUM Should I Stay or Should I Go?: Transformation of Time-Discounted Rewards in Orbitofrontal Cortex and Associated Brain Circuits Ann. N.Y. Acad. Sci., May 1, 2007; 1104(1): 21 - 34. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. LEE and H. SEO Mechanisms of Reinforcement Learning and Decision Making in the Primate Dorsolateral Prefrontal Cortex Ann. N.Y. Acad. Sci., May 1, 2007; 1104(1): 108 - 122. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. SCHWEIGHOFER, S. C. TANAKA, and K. DOYA Serotonin and the Evaluation of Future Rewards: Theory, Experiments, and Possible Neural Mechanisms Ann. N.Y. Acad. Sci., May 1, 2007; 1104(1): 289 - 300. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch, T. A. Stalnaker, and G. Schoenbaum Associative Encoding in Anterior Piriform Cortex versus Orbitofrontal Cortex during Odor Discrimination and Reversal Learning Cereb Cortex, March 1, 2007; 17(3): 643 - 652. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Ichihara-Takeda and S. Funahashi Reward-period Activity in Primate Dorsolateral Prefrontal and Orbitofrontal Neurons Is Affected by Reward Schedules. J. Cogn. Neurosci., February 1, 2006; 18(2): 212 - 226. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. M. Wessels, S. A.R.B. Rombouts, S. Simsek, J. P.A. Kuijer, P. J. Kostense, F. Barkhof, P. Scheltens, F. J. Snoek, and R. J. Heine Microvascular Disease in Type 1 Diabetes Alters Brain Activation: A Functional Magnetic Resonance Imaging Study Diabetes, February 1, 2006; 55(2): 334 - 340. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. N. Tobler, J. P. O'Doherty, R. J. Dolan, and W. Schultz Human Neural Learning Depends on Reward Prediction Errors in the Blocking Paradigm J Neurophysiol, January 1, 2006; 95(1): 301 - 310. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Gutierrez, J. M. Carmena, M. A. L. Nicolelis, and S. A. Simon Orbitofrontal Ensemble Activity Monitors Licking and Distinguishes Among Natural Rewards J Neurophysiol, January 1, 2006; 95(1): 119 - 133. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Sugase-Miyamoto and B. J. Richmond Neuronal Signals in the Monkey Basolateral Amygdala during Reward Schedules J. Neurosci., November 30, 2005; 25(48): 11071 - 11083. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch and C. R. Olson Neuronal Activity in Primate Orbitofrontal Cortex Reflects the Value of Time J Neurophysiol, October 1, 2005; 94(4): 2457 - 2471. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Campos, B. Breznen, K. Bernheim, and R. A. Andersen Supplementary Motor Area Encodes Reward Expectancy in Eye-Movement Tasks J Neurophysiol, August 1, 2005; 94(2): 1325 - 1335. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch and C. R. Olson Neuronal Activity Dependent on Anticipated and Elapsed Delay in Macaque Prefrontal Cortex, Frontal and Supplementary Eye Fields, and Premotor Cortex J Neurophysiol, August 1, 2005; 94(2): 1469 - 1497. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Oya, R. Adolphs, H. Kawasaki, A. Bechara, A. Damasio, and M. A. Howard III Electrophysiological correlates of reward prediction error recorded in the human prefrontal cortex PNAS, June 7, 2005; 102(23): 8351 - 8356. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. S. Milak, R. V. Parsey, J. Keilp, M. A. Oquendo, K. M. Malone, and J. J. Mann Neuroanatomic Correlates of Psychopathologic Components of Major Depressive Disorder Arch Gen Psychiatry, April 1, 2005; 62(4): 397 - 408. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. J. Smith, S. Becker, and S. Kapur A Computational Model of the Functional Role of the Ventral-Striatal D2 Receptor in the Expression of Previously Acquired Behaviors Neural Comput., February 1, 2005; 17(2): 361 - 395. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Izquierdo and E. A. Murray Combined Unilateral Lesions of the Amygdala and Orbital Prefrontal Cortex Impair Affective Processing in Rhesus Monkeys J Neurophysiol, May 1, 2004; 91(5): 2023 - 2039. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Nicola, I. A. Yun, K. T. Wakabayashi, and H. L. Fields Cue-Evoked Firing of Nucleus Accumbens Neurons Encodes Motivational Significance During a Discriminative Stimulus Task J Neurophysiol, April 1, 2004; 91(4): 1840 - 1865. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Watanabe, J. Lauwereyns, and O. Hikosaka Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus J. Neurosci., November 5, 2003; 23(31): 10052 - 10057. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch and C. R. Olson Impact of Expected Reward on Neuronal Activity in Prefrontal Cortex, Frontal and Supplementary Eye Fields and Premotor Cortex J Neurophysiol, September 1, 2003; 90(3): 1766 - 1789. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. J. Gruber, S. A. Solla, D. J. Surmeier, and J. C. Houk Modulation of Striatal Single Units by Expected Reward: A Spiny Neuron Model Displaying Dopamine-Induced Bistability J Neurophysiol, August 1, 2003; 90(2): 1095 - 1114. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Coe, K. Tomihara, M. Matsuzawa, and O. Hikosaka Visual and Anticipatory Bias in Three Cortical Eye Fields of the Monkey during an Adaptive Decision-Making Task J. Neurosci., June 15, 2002; 22(12): 5081 - 5090. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. B. Pochon, R. Levy, P. Fossati, S. Lehericy, J. B. Poline, B. Pillon, D. Le Bihan, and B. Dubois The neural system that bridges reward and cognition in humans: An fMRI study PNAS, April 16, 2002; 99(8): 5669 - 5674. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Watanabe, K. Hikosaka, M. Sakagami, and S.-i. Shirakawa Coding and Monitoring of Motivational Context in the Primate Prefrontal Cortex J. Neurosci., March 15, 2002; 22(6): 2391 - 2400. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Tamm, V. Menon, C. K. Johnston, D. R. Hessl, and A. L. Reiss fMRI Study of Cognitive Interference Processing in Females with Fragile X Syndrome J. Cogn. Neurosci., February 1, 2002; 14(2): 160 - 171. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. E. Baldwin, K. Sadeghian, and A. E. Kelley Appetitive Instrumental Learning Requires Coincident Activation of NMDA and Dopamine D1 Receptors within the Medial Prefrontal Cortex J. Neurosci., February 1, 2002; 22(3): 1063 - 1071. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. P. Nair, J. D. Berndt, D. Barrett, and F. Gonzalez-Lima Maturation of Extinction Behavior in Infant Rats: Large-Scale Regional Interactions with Medial Prefrontal Cortex, Orbitofrontal Cortex, and Anterior Cingulate Cortex J. Neurosci., June 15, 2001; 21(12): 4400 - 4407. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. K. Hassani, H. C. Cromwell, and W. Schultz Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum J Neurophysiol, June 1, 2001; 85(6): 2477 - 2489. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Schoenbaum and B. Setlow Integrating Orbitofrontal Cortex into Prefrontal Theory: Common Processing Themes across Species and Subdivisions Learn. Mem., May 1, 2001; 8(3): 134 - 147. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. E. Suri and W. Schultz Temporal Difference Model Reproduces Anticipatory Neural Activity Neural Comput., April 1, 2001; 13(4): 841 - 862. [Abstract] [Full Text] |
||||
![]() |
L. Tremblay and W. Schultz Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Orbitofrontal Cortex J Neurophysiol, April 1, 2000; 83(4): 1877 - 1885. [Abstract] [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |