| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
The Journal of Neurophysiology Vol. 83 No. 4 April 2000, pp. 1877-1885
Copyright ©2000 by the American Physiological Society
Institute of Physiology and Program in Neuroscience, University of Fribourg, CH-1700 Fribourg, Switzerland
Tremblay, Léon and
Wolfram Schultz.
Modifications of Reward Expectation-Related Neuronal Activity
During Learning in Primate Orbitofrontal Cortex. J. Neurophysiol. 83: 1877-1885, 2000. This study
investigated how neuronal activity in orbitofrontal cortex related to
the expectation of reward changed while monkeys repeatedly learned to
associate new instruction pictures with known behavioral reactions and
reinforcers. In a delayed go-nogo task with several trial types, an
initial picture instructed the animal to execute or withhold a reaching
movement and to expect a liquid reward or a conditioned auditory
reinforcer. When novel instruction pictures were presented, animals
learned according to a trial-and-error strategy. After experience with
a large number of novel pictures, learning occurred in a few trials,
and correct performance usually exceeded 70% in the first 60-90
trials. About 150 task-related neurons in orbitofrontal cortex were
studied in both familiar and learning conditions and showed two major forms of changes during learning. Quantitative changes of responses to
the initial instruction were seen as appearance of new responses, increase of existing responses, or decrease or complete disappearance of responses. The changes usually outlasted initial learning trials and
persisted during subsequent consolidation. They often modified the
trial selectivities of activations. Increases might reflect the
increased attention during learning and induce neuronal changes underlying the behavioral adaptations. Decreases might be related to
the unreliable reward-predicting value of frequently changing learning
instructions. The second form of changes reflected the adaptation of
reward expectations during learning. In initial learning trials,
animals reacted as if they expected liquid reward in every trial type,
although only two of the three trial types were rewarded with liquid.
In close correspondence, neuronal activations related to the
expectation of reward occurred initially in every trial type. The
behavioral indices for reward expectation and their neuronal correlates
adapted in parallel during the course of learning and became restricted
to rewarded trials. In conclusion, these data support the notion that
neurons in orbitofrontal cortex code reward information in a flexible
and adaptive manner during behavioral changes after novel stimuli.
This article has been cited by other articles:
|
|
 |
|
  E. C. Finger, A. A. Marsh, D. G. Mitchell, M. E. Reid, C. Sims, S. Budhani, D. S. Kosson, G. Chen, K. E. Towbin, E. Leibenluft, et al. Abnormal Ventromedial Prefrontal Cortex Function in Children With Psychopathic Traits During Reversal Learning Arch Gen Psychiatry, May 1, 2008; 65(5): 586 - 594. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. M. Simmons and B. J. Richmond Dynamic Changes in Representations of Preceding and Upcoming Reward in Monkey Orbitofrontal Cortex Cereb Cortex, January 1, 2008; 18(1): 93 - 103. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Kuboshima-Amemori and T. Sawaguchi Plasticity of the Primate Prefrontal Cortex Neuroscientist, June 1, 2007; 13(3): 229 - 240. [Abstract] [PDF]
|
|
|
|
|
|
M. R. Roesch, T. A. Stalnaker, and G. Schoenbaum Associative Encoding in Anterior Piriform Cortex versus Orbitofrontal Cortex during Odor Discrimination and Reversal Learning Cereb Cortex, March 1, 2007; 17(3): 643 - 652. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Windmann, P. Kirsch, D. Mier, R. Stark, B. Walter, O. Gunturkun, and D. Vaitl On Framing Effects in Decision Making: Linking Lateral versus Medial Orbitofrontal Cortex Activation to Choice Outcome Processing. J. Cogn. Neurosci., July 1, 2006; 18(7): 1198 - 1211. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. N. Tobler, J. P. O'Doherty, R. J. Dolan, and W. Schultz Human Neural Learning Depends on Reward Prediction Errors in the Blocking Paradigm J Neurophysiol, January 1, 2006; 95(1): 301 - 310. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. A. Koene and M. E. Hasselmo An Integrate-and-fire Model of Prefrontal Cortex Neuronal Activity during Performance of Goal-directed Decision Making Cereb Cortex, December 1, 2005; 15(12): 1964 - 1981. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. M. Small, D. Gitelman, K. Simmons, S. M. Bloise, T. Parrish, and M.-M. Mesulam Monetary Incentives Enhance Processing in Brain Regions Mediating Top-down Control of Attention Cereb Cortex, December 1, 2005; 15(12): 1855 - 1865. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. A. Bunge, J. D. Wallis, A. Parker, M. Brass, E. A. Crone, E. Hoshi, and K. Sakai Neural Circuitry Underlying Rule Use in Humans and Nonhuman Primates J. Neurosci., November 9, 2005; 25(45): 10347 - 10350. [Full Text] [PDF]
|
|
|
|
|
|
A. Izquierdo, R. K. Suda, and E. A. Murray Comparison of the Effects of Bilateral Orbital Prefrontal Cortex Lesions and Amygdala Lesions on Emotional Responses in Rhesus Monkeys J. Neurosci., September 14, 2005; 25(37): 8534 - 8542. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Watanabe and O. Hikosaka Immediate Changes in Anticipatory Activity of Caudate Neurons Associated With Reversal of Position-Reward Contingency J Neurophysiol, September 1, 2005; 94(3): 1879 - 1887. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Yokoyama, H. Tsukada, Y. Watanabe, and H. Onoe A Dynamic Shift of Neural Network Activity before and after Learning-set Formation Cereb Cortex, June 1, 2005; 15(6): 796 - 801. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. M. Kincade, R. A. Abrams, S. V. Astafiev, G. L. Shulman, and M. Corbetta An Event-Related Functional Magnetic Resonance Imaging Study of Voluntary and Stimulus-Driven Orienting of Attention J. Neurosci., May 4, 2005; 25(18): 4593 - 4604. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Gisiger, M. Kerszberg, and J.-P. Changeux Acquisition and Performance of Delayed-response Tasks: a Neural Network Model Cereb Cortex, May 1, 2005; 15(5): 489 - 506. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. J. Smith, S. Becker, and S. Kapur A Computational Model of the Functional Role of the Ventral-Striatal D2 Receptor in the Expression of Previously Acquired Behaviors Neural Comput., February 1, 2005; 17(2): 361 - 395. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. M. Nicola, I. A. Yun, K. T. Wakabayashi, and H. L. Fields Cue-Evoked Firing of Nucleus Accumbens Neurons Encodes Motivational Significance During a Discriminative Stimulus Task J Neurophysiol, April 1, 2004; 91(4): 1840 - 1865. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. R. Roesch and C. R. Olson Impact of Expected Reward on Neuronal Activity in Prefrontal Cortex, Frontal and Supplementary Eye Fields and Premotor Cortex J Neurophysiol, September 1, 2003; 90(3): 1766 - 1789. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Petrides, B. Alivisatos, and S. Frey Differential activation of the human orbital, mid-ventrolateral, and mid-dorsolateral prefrontal cortex during the processing of visual stimuli PNAS, April 16, 2002; 99(8): 5649 - 5654. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. Schoenbaum and B. Setlow Integrating Orbitofrontal Cortex into Prefrontal Theory: Common Processing Themes across Species and Subdivisions Learn. Mem., May 1, 2001; 8(3): 134 - 147. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. Tremblay and W. Schultz Reward-Related Neuronal Activity During Go-Nogo Task Performance in Primate Orbitofrontal Cortex J Neurophysiol, April 1, 2000; 83(4): 1864 - 1876. [Abstract] [Full Text] [PDF]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |
