|
|
||||||||
The Journal of Neurophysiology Vol. 83 No. 4 April 2000, pp. 1864-1876
Copyright ©2000 by the American Physiological Society
Institute of Physiology and Program in Neuroscience, University of Fribourg, CH-1700 Fribourg, Switzerland
Tremblay, Léon and
Wolfram Schultz.
Reward-Related Neuronal Activity During Go-Nogo Task Performance
in Primate Orbitofrontal Cortex. J. Neurophysiol. 83: 1864-1876, 2000. The orbitofrontal cortex appears
to be involved in the control of voluntary, goal-directed behavior by
motivational outcomes. This study investigated how orbitofrontal
neurons process information about rewards in a task that depends on
intact orbitofrontal functions. In a delayed go-nogo task, animals
executed or withheld a reaching movement and obtained liquid or a
conditioned sound as reinforcement. An initial instruction picture
indicated the behavioral reaction to be performed (movement vs.
nonmovement) and the reinforcer to be obtained (liquid vs. sound) after
a subsequent trigger stimulus. We found task-related activations in 188 of 505 neurons in rostral orbitofrontal area 13, entire area 11, and
lateral area 14. The principal task-related activations consisted of
responses to instructions, activations preceding reinforcers, or
responses to reinforcers. Most activations reflected the reinforcing
event rather than other task components. Instruction responses occurred
either in liquid- or sound-reinforced trials but rarely distinguished
between movement and nonmovement reactions. These instruction responses
reflected the predicted motivational outcome rather than the behavioral reaction necessary for obtaining that outcome. Activations preceding the reinforcer began slowly and terminated immediately after the reinforcer, even when the reinforcer occurred earlier or later than
usually. These activations preceded usually the liquid reward but
rarely the conditioned auditory reinforcer. The activations also
preceded expected drops of liquid delivered outside the task, suggesting a primary appetitive rather than a task-reinforcing relationship that apparently was related to the expectation of reward.
Responses after the reinforcer occurred in liquid- but rarely in
sound-reinforced trials. Reward-preceding activations and reward
responses were unrelated temporally to licking movements. Several
neurons showed reward responses outside the task but instruction responses during the task, indicating a response transfer from primary
reward to the reward-predicting instruction, possibly reflecting the
temporal unpredictability of reward. In conclusion, orbitofrontal
neurons report stimuli associated with reinforcers are concerned with
the expectation of reward and detect reward delivery at trial end.
These activities may contribute to the processing of reward information
for the motivational control of goal-directed behavior.
This article has been cited by other articles:
![]() |
T. V. Maia Reinforcement learning, conditioning, and the brain: Successes and challenges Cogn Affect Behav Neurosci, December 1, 2009; 9(4): 343 - 364. [Abstract] [PDF] |
||||
![]() |
S. E. Morrison and C. D. Salzman The Convergence of Information about Rewarding and Aversive Stimuli in Single Neurons J. Neurosci., September 16, 2009; 29(37): 11471 - 11483. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Glascher, A. N. Hampton, and J. P. O'Doherty Determining a Role for Ventromedial Prefrontal Cortex in Encoding Action-Based Value Signals During Reward-Related Decision Making Cereb Cortex, February 1, 2009; 19(2): 483 - 495. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Isoda and O. Hikosaka A Neural Correlate of Motivational Conflict in the Superior Colliculus of the Macaque J Neurophysiol, September 1, 2008; 100(3): 1332 - 1342. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Simmons, Z. S. Saad, M. J. Lizak, M. Ortiz, A. P. Koretsky, and B. J. Richmond Mapping Prefrontal Circuits In Vivo with Manganese-Enhanced Magnetic Resonance Imaging in Monkeys J. Neurosci., July 23, 2008; 28(30): 7637 - 7647. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Cohen, I. Reuveni, E. Barkai, and M. Maroun Olfactory Learning-Induced Long-Lasting Enhancement of Descending and Ascending Synaptic Transmission to the Piriform Cortex J. Neurosci., June 25, 2008; 28(26): 6664 - 6669. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Furuyashiki, P. C. Holland, and M. Gallagher Rat Orbitofrontal Cortex Separately Encodes Response and Outcome Information during Performance of Goal-Directed Behavior J. Neurosci., May 7, 2008; 28(19): 5127 - 5138. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Simmons and B. J. Richmond Dynamic Changes in Representations of Preceding and Upcoming Reward in Monkey Orbitofrontal Cortex Cereb Cortex, January 1, 2008; 18(1): 93 - 103. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Watanabe and M. Sakagami Integration of Cognitive and Motivational Context Information in the Primate Prefrontal Cortex Cereb Cortex, September 1, 2007; 17(suppl_1): i101 - i109. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Lee, M. F. S. Rushworth, M. E. Walton, M. Watanabe, and M. Sakagami Functional Specialization of the Primate Frontal Cortex during Decision Making J. Neurosci., August 1, 2007; 27(31): 8170 - 8173. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. B. Ostlund and B. W. Balleine Orbitofrontal Cortex Mediates Outcome Encoding in Pavlovian But Not Instrumental Conditioning J. Neurosci., May 2, 2007; 27(18): 4819 - 4825. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch, T. A. Stalnaker, and G. Schoenbaum Associative Encoding in Anterior Piriform Cortex versus Orbitofrontal Cortex during Odor Discrimination and Reversal Learning Cereb Cortex, March 1, 2007; 17(3): 643 - 652. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. M. Wessels, S. A.R.B. Rombouts, S. Simsek, J. P.A. Kuijer, P. J. Kostense, F. Barkhof, P. Scheltens, F. J. Snoek, and R. J. Heine Microvascular Disease in Type 1 Diabetes Alters Brain Activation: A Functional Magnetic Resonance Imaging Study Diabetes, February 1, 2006; 55(2): 334 - 340. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. N. Tobler, J. P. O'Doherty, R. J. Dolan, and W. Schultz Human Neural Learning Depends on Reward Prediction Errors in the Blocking Paradigm J Neurophysiol, January 1, 2006; 95(1): 301 - 310. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Gutierrez, J. M. Carmena, M. A. L. Nicolelis, and S. A. Simon Orbitofrontal Ensemble Activity Monitors Licking and Distinguishes Among Natural Rewards J Neurophysiol, January 1, 2006; 95(1): 119 - 133. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Sugase-Miyamoto and B. J. Richmond Neuronal Signals in the Monkey Basolateral Amygdala during Reward Schedules J. Neurosci., November 30, 2005; 25(48): 11071 - 11083. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch and C. R. Olson Neuronal Activity in Primate Orbitofrontal Cortex Reflects the Value of Time J Neurophysiol, October 1, 2005; 94(4): 2457 - 2471. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Campos, B. Breznen, K. Bernheim, and R. A. Andersen Supplementary Motor Area Encodes Reward Expectancy in Eye-Movement Tasks J Neurophysiol, August 1, 2005; 94(2): 1325 - 1335. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch and C. R. Olson Neuronal Activity Dependent on Anticipated and Elapsed Delay in Macaque Prefrontal Cortex, Frontal and Supplementary Eye Fields, and Premotor Cortex J Neurophysiol, August 1, 2005; 94(2): 1469 - 1497. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Oya, R. Adolphs, H. Kawasaki, A. Bechara, A. Damasio, and M. A. Howard III Electrophysiological correlates of reward prediction error recorded in the human prefrontal cortex PNAS, June 7, 2005; 102(23): 8351 - 8356. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. S. Milak, R. V. Parsey, J. Keilp, M. A. Oquendo, K. M. Malone, and J. J. Mann Neuroanatomic Correlates of Psychopathologic Components of Major Depressive Disorder Arch Gen Psychiatry, April 1, 2005; 62(4): 397 - 408. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Izquierdo and E. A. Murray Combined Unilateral Lesions of the Amygdala and Orbital Prefrontal Cortex Impair Affective Processing in Rhesus Monkeys J Neurophysiol, May 1, 2004; 91(5): 2023 - 2039. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Nicola, I. A. Yun, K. T. Wakabayashi, and H. L. Fields Cue-Evoked Firing of Nucleus Accumbens Neurons Encodes Motivational Significance During a Discriminative Stimulus Task J Neurophysiol, April 1, 2004; 91(4): 1840 - 1865. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Watanabe, J. Lauwereyns, and O. Hikosaka Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus J. Neurosci., November 5, 2003; 23(31): 10052 - 10057. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Roesch and C. R. Olson Impact of Expected Reward on Neuronal Activity in Prefrontal Cortex, Frontal and Supplementary Eye Fields and Premotor Cortex J Neurophysiol, September 1, 2003; 90(3): 1766 - 1789. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. J. Gruber, S. A. Solla, D. J. Surmeier, and J. C. Houk Modulation of Striatal Single Units by Expected Reward: A Spiny Neuron Model Displaying Dopamine-Induced Bistability J Neurophysiol, August 1, 2003; 90(2): 1095 - 1114. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Coe, K. Tomihara, M. Matsuzawa, and O. Hikosaka Visual and Anticipatory Bias in Three Cortical Eye Fields of the Monkey during an Adaptive Decision-Making Task J. Neurosci., June 15, 2002; 22(12): 5081 - 5090. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. B. Pochon, R. Levy, P. Fossati, S. Lehericy, J. B. Poline, B. Pillon, D. Le Bihan, and B. Dubois The neural system that bridges reward and cognition in humans: An fMRI study PNAS, April 16, 2002; 99(8): 5669 - 5674. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Watanabe, K. Hikosaka, M. Sakagami, and S.-i. Shirakawa Coding and Monitoring of Motivational Context in the Primate Prefrontal Cortex J. Neurosci., March 15, 2002; 22(6): 2391 - 2400. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. E. Baldwin, K. Sadeghian, and A. E. Kelley Appetitive Instrumental Learning Requires Coincident Activation of NMDA and Dopamine D1 Receptors within the Medial Prefrontal Cortex J. Neurosci., February 1, 2002; 22(3): 1063 - 1071. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. P. Nair, J. D. Berndt, D. Barrett, and F. Gonzalez-Lima Maturation of Extinction Behavior in Infant Rats: Large-Scale Regional Interactions with Medial Prefrontal Cortex, Orbitofrontal Cortex, and Anterior Cingulate Cortex J. Neurosci., June 15, 2001; 21(12): 4400 - 4407. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. K. Hassani, H. C. Cromwell, and W. Schultz Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum J Neurophysiol, June 1, 2001; 85(6): 2477 - 2489. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Schoenbaum and B. Setlow Integrating Orbitofrontal Cortex into Prefrontal Theory: Common Processing Themes across Species and Subdivisions Learn. Mem., May 1, 2001; 8(3): 134 - 147. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Tremblay and W. Schultz Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Orbitofrontal Cortex J Neurophysiol, April 1, 2000; 83(4): 1877 - 1885. [Abstract] [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |