|
|
||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
REPORT
1The John B. Pierce Laboratory, 2Interdepartmental Neuroscience Program, and 3Department of Neurobiology, Yale University School of Medicine, New Haven, Connecticut
Submitted 10 January 2008; accepted in final form 9 May 2008
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
In primates, neurons in medial prefrontal regions, including anterior cingulate, supplementary motor regions, and superior frontal gyrus, are prominently modulated after errors (Amiez et al. 2006
; Niki and Watanabe 1976
; Ridderinkhof et al. 2004
; Rushworth et al. 2004
, 2007
; Schall et al. 2002
; Walton et al. 2007
). These studies implicate primate medial frontal areas in posterror processing. dmPFC in primates may not be directly homologous to rodent dmPFC (Preuss 1995
; Uylings et al. 2003
). Nevertheless, it has been argued that these areas mediate similar behavioral functions (Uylings et al. 2003
). Across species, medial prefrontal cortex may monitor behavioral performance (van Veen et al. 2004
) and integrate information about prior behavior to control future actions (Bush et al. 2002
; Dalley et al. 2004
; Ridderinkhof et al. 2004
; Rushworth et al. 2004
; Schall et al. 2002
; Shima et al. 2007
).
In the present study, we tested the hypothesis that rodent dmPFC is involved in posterror processing. Rats were trained to perform a simple reaction time task in which they held a lever down over a delay period of 1.0 s. Lever releases that occurred too early or too late were scored as errors and were unrewarded. After errors, animals showed a slowing of reaction times (RTs). That is, RTs were longer on trials that were preceded by an error than on trials that were preceded by a correct response. In one experiment, we inactivated dmPFC and found that rats showed attenuated posterror slowing of RTs. In a second experiment, we recorded neural activity in dmPFC and found that many dmPFC neurons increased their firing rates after errors and maintained such elevated firing into the delay period on the following trial. This pattern of neural activity was not observed in motor cortex. Together, our results suggest that dmPFC neurons are involved in posterror slowing and may mediate a form of retrospective working memory that improves task performance following errors.
| METHODS |
|---|
|
|
|---|
|
In these animals, microelectrodes configured in 4 x 4 arrays of 50-µm stainless steel wires (250 µm between wires; impedance measured in vitro at 100–300 k
; Neurolinc) were implanted into rat motor cortex (7 animals; coordinates from bregma: AP –0.5, ML ±2.5–3.5, DV –1.5 @ –25° in the frontal plane; 1 animal had poor recordings and was excluded from neural analyses) according to methods described in detail previously (Laubach et al. 2000
; Narayanan and Laubach 2006
; Narayanan et al. 2005
). In eight additional animals, microelectrode arrays were implanted into the dorsal prelimbic region of rat frontal cortex (8 animals; coordinates from bregma: AP +3.2, ML ±1.4, DV –3.6 @ 10° in the frontal plane;
94% of electrodes were in prelimbic cortex) targeting coordinates of previous inactivation (Narayanan and Laubach 2006
; Narayanan et al. 2006
) (Fig. 1B).
Neuronal ensemble recordings were made using a multi-electrode recording system (Plexon, Dallas, TX). Putative single neuronal units were identified on-line using an oscilloscope and audio monitor. The Plexon off-line sorter was used to analyze the signals off-line and to remove artifacts. Principal component analysis and waveform shape were used for spike sorting. Single units were identified as having consistent waveform shape, separable clusters in PCA space, average amplitude estimated at least three times larger than background activity, a consistent refractory period of
2 ms in interspike interval histograms, and consistent firing rates around behavioral events (as measured by a runs test of firing rates across trials around behavioral events; neurons with |z| scores >4 were considering "nonstationary" and were excluded). Analysis of neuronal activity and quantitative analysis of basic firing properties were carried out using Stranger (Biographics, Winston-Salem, NC), NeuroExplorer (Nex Technologies, Littleton, MA) and with custom routines for MATLAB. Peri-event rasters and average histograms were constructed around lever release, lever press, and tone offset.
Once experiments were complete, rats were anesthetized and killed by injections of 100 mg/kg sodium pentobarbital and then were transcardially perfused with either 10% formalin or 4% paraformaldehyde. Brains were sectioned on a freezing microtome, mounted on gelatin-subbed slides, and stained for Nissl with thionin.
The Animal Care and Use Committee at the John B. Pierce Laboratory approved all procedures.
| RESULTS |
|---|
|
|
|---|
Posterror slowing developed consistently after 16 days of training [paired T(1,6) = 3.43, P < 0.01; learning experiments done with 7 separate animals; Fig. 2 A], several days after animals' performance reached criterion of 60% correct responses (reached on day 11 at 62 ± 7%; Fig. 2B). Early in training, animals rarely exhibited posterror slowing [only on day 5; paired T(1,6) = 3.28, P < 0.02], suggesting that posterror slowing emerged as a feature of skilled performance and not of learning the basic procedure associated with the simple RT task.
|
These results implicate dmPFC in posterror slowing of RTs. To test this idea, we recorded from 194 single rodent dmPFC neurons (15 sessions, 8 animals) during simple RT task performance. Of these, 30% (58 of 194) of dmPFC neurons had significant posterror differences in delay-related firing (0.25–1 s after lever press; Wilcoxon rank-sum P < 0.05), more than were influenced by the outcome (correct vs. error) of the second trial back (14 of 194, or 7%;
2 = 33.02, P << 0.001). That is, neural activity of these neurons during the delay period while animals were waiting to respond was significantly different depending on whether the previous trial was correct or resulted in an error.
Two-thirds of neurons (39 of 58, or 64%) with posterror differences in delay-related firing rate also had significant posterror differences in firing rate during the intertrial interval (ITI; 1–2 s after lever release; Wilcoxon rank-sum P < 0.05; mean ITI = 7.21 ± 0.45 s). Most of these neurons (26 of 39, 67%) had increased firing rates after errors. Of these, 16 neurons (of 58, or 28%; 8% of all dmPFC neurons) had significantly increased posterror activity that persisted into the delay period of the following trial. Examples of such neurons are shown in Fig. 3. Sometime after the lever release, the firing rates of such neurons diverged by
25% (left panels) depending on trial outcome (correct or error). On the following trial, when rasters were sorted by the previous trial outcome (i.e., if the previous trial was correct or an error; right panels), differences in firing rate could persist into the delay period of the following trial when animals were holding down the lever. Few of these neurons fired differently on premature errors (dark gray) versus late errors (light gray; 3 of 39; 7%; no different from chance at P < 0.05:
2 = 0.21, P < 0.64).
|
This index is close to 1 if delay-related firing is stronger after correct trials. Conversely, this index is close to –1 if delay-related firing is stronger after error trials. For the subpopulation of neurons that showed significant differences in delay-related firing rate as a function of preceding trial outcome, 45% of 58 neurons had stronger delay-related firing following correct trials and 55% of 58 neurons had stronger delay-related firing following error trials (Fig. 4 A).
|
2 = 0.20, P < 0.67). In contrast to dmPFC, there were no neurons in motor cortex that showed significantly increased posterror activity that persisted into delay period of the following trial. Furthermore, most motor cortex neurons with delay-related posterror differences in firing rate had stronger delay-related firing following correct trials (23 of 29, or 79%;
2 = 6.41, P < 0.01) and less delay-related firing following error trials (6 of 29, or 20%;
2 = 5.73, P < 0.02) when compared with dmPFC (Fig. 4B). | DISCUSSION |
|---|
|
|
|---|
Neurons in motor cortex also had posterror differences in firing rate. However, these neurons tended to fire more after correct trials (Fig. 4B), and we could find no examples of neurons with persistent posterror differences in firing rate, suggesting that motor cortex patterns of posterror activity were distinct from that observed in rodent dmPFC.
Previous work from our lab has demonstrated that dmPFC inactivation dramatically increases premature responding and speeds RTs (Narayanan et al. 2006
), leading to the hypothesis that dmPFC exerts an inhibitory influence over responding (Narayanan et al. 2005
, 2006
; Risterucci et al. 2003
). The present data suggest that rats may benefit from dmPFC inhibitory control to slow RTs after errors. We note that RTs in dmPFC inactivation sessions are more variable; suggesting that without dmPFC-mediated inhibitory control, RTs may become faster and more erratic.
In addition to inhibitory control, rodent dmPFC has been implicated in maintaining task-relevant information (Baeg et al. 2003
; Batuev et al. 1990
; Ragozzino et al. 1998
). We find further evidence for mnemonic processing in our simple RT task based on the posterror activity of dmPFC neurons. This activity may function in a type of retrospective memory that could be used to improve task performance following an error.
Behavioral experiments were used to assess the effects of distractors on posterror slowing. This manipulation attenuated posterror slowing, suggesting that animals may be attending to recent trial outcomes. By contrast, removing the normal contextual cues associated with the ITI (such as the houselights) had no effect of posterror slowing. We note that dmPFC neural activity did not simply transiently increase and then decrease after errors. Instead, activity increased and persisted to the next trial following an error. Taken together, these data suggest that such neural processing might represent a form of retrospective working memory for trial outcome, i.e., a form of distractor-sensitive working memory (Baddeley 1987
). In the present study, it is difficult to determine which aspect of past task performance animals are maintaining—i.e., whether it is trial outcome (correct vs. error) or reward history (rewarded vs. unrewarded). Future experiments that manipulate reward contingencies will be needed to dissociate these possibilities.
Our findings converge with reports that primate medial frontal regions are prominently involved in posterror processing (Emeric et al. 2007
; Schall et al. 2002
; van Veen et al. 2004
; Walton et al. 2007
) as well as in action selection (Bush et al. 2002
; Rushworth et al. 2004
, 2007
; Shima et al. 2007
). During simple RT performance, inactivation of dmPFC decreased delay-related activity in motor cortex (Narayanan and Laubach 2006
), suggesting that rodent dmPFC may exert top-down control over neurons in rodent motor cortex that are responsible for executing movements (Donoghue et al. 1992
; Laubach et al. 2000
; Neafsey et al. 1986
). Taken together, these data suggest that in both primates and rodents, medial prefrontal regions may be involved in integrating information about task performance to achieve supervisory control of sensorimotor processes (Dalley et al. 2004
; Rushworth et al. 2004
; Schall et al. 2002
).
| GRANTS |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
|
|
|---|
| FOOTNOTES |
|---|
Address for reprint requests and other correspondence: M. Laubach, The John B. Pierce Laboratory, 290 Congress Ave., New Haven, CT 06519 (E-mail: mlaubach{at}jbpierce.org)
| REFERENCES |
|---|
|
|
|---|
Baddeley A. Working Memory. Oxford, UK: Oxford Univ. Press, 1987.
Baeg EH, Kim YB, Huh K, Mook-Jung I, Kim HT, Jung MW. Dynamics of population code for working memory in the prefrontal cortex. Neuron 40: 177–188, 2003.[CrossRef][Web of Science][Medline]
Batuev AS, Kursina NP, Shutov AP. Unit activity of the medial wall of the frontal cortex during delayed performance in rats. Behav Brain Res 41: 95–102, 1990.[CrossRef][Web of Science][Medline]
Bush G, Vogt BA, Holmes J, Dale AM, Greve D, Jenike MA, Rosen BR. Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc Natl Acad Sci USA 99: 523–528, 2002.
Corbit LH, Balleine BW. The role of prelimbic cortex in instrumental conditioning. Behav Brain Res 146: 145–157, 2003.[CrossRef][Web of Science][Medline]
Dalley JW, Cardinal RN, Robbins TW. Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci Biobehav Rev 28: 771–784, 2004.[CrossRef][Web of Science][Medline]
Donoghue JP, Leibovic S, Sanes JN. Organization of the forelimb area in squirrel monkey motor cortex: representation of digit, wrist, and elbow muscles. Exp Brain Res 89: 1–19, 1992.[CrossRef][Web of Science][Medline]
Emeric EE, Brown JW, Boucher L, Carpenter RH, Hanes DP, Harris R, Logan GD, Mashru RN, Pare M, Pouget P, Stuphorn V, Taylor TL, Schall JD. Influence of history on saccade countermanding performance in humans and macaque monkeys. Vision Res 47: 35–49, 2007.[CrossRef][Web of Science][Medline]
Gabbott PL, Warner TA, Jays PR, Salway P, Busby SJ. Prefrontal cortex in the rat: Projections to subcortical autonomic, motor, and limbic centers. J Comp Neurol 492: 145–177, 2005.[CrossRef][Web of Science][Medline]
Killcross S, Coutureau E. Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex 13: 400–408, 2003.
Laubach M, Wessberg J, Nicolelis MA. Cortical ensemble activity increasingly predicts behavior outcomes during learning of a motor task. Nature 405: 567–571, 2000.[CrossRef][Medline]
Lomber SG. The advantages and limitations of permanent or reversible deactivation techniques in the assessment of neural function. J Neurosci Methods 86: 109–117, 1999.[CrossRef][Web of Science][Medline]
Martin JH, Ghez C. Pharmacological inactivation in the analysis of the central control of movement. J Neurosci Methods 86: 145–159, 1999.[CrossRef][Web of Science][Medline]
Narayanan NS, Horst NK, Laubach M. Reversible inactivations of rat medial prefrontal cortex impair the ability to wait for a stimulus. Neuroscience 2006.
Narayanan NS, Kimchi EY, Laubach M. Redundancy and synergy of neuronal ensembles in motor cortex. J Neurosci 25: 4207–4216, 2005.
Narayanan NS, Laubach M. Top-down control of motor cortex ensembles by dorsomedial prefrontal cortex. Neuron 52: 921–931, 2006.[CrossRef][Web of Science][Medline]
Neafsey EJ, Bold EL, Haas G, Hurley-Gius KM, Quirk G, Sievert CF, Terreberry RR. The organization of the rat motor cortex: a microstimulation mapping study. Brain Res 396: 77–96, 1986.[CrossRef][Medline]
Niki H, Watanabe M. Cingulate unit activity and delayed response. Brain Res 110: 381–386, 1976.[CrossRef][Web of Science][Medline]
Ostlund SB, Balleine BW. Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. J Neurosci 25: 7763–7770, 2005.
Paxinos G, Watson C. The Rat Brain in Stereotaxic Coordinates. New York: Academic, 1982.
Preuss T. Do rats have prefrontal cortex? The Rose-Woolsey-Akert program reconsidered. J Cogn Neurosci 7: 1–24, 1995.[Medline]
Ragozzino ME, Adams S, Kesner RP. Differential involvement of the dorsal anterior cingulate and prelimbic-infralimbic areas of the rodent prefrontal cortex in spatial working memory. Behav Neurosci 112: 293–303, 1998.[CrossRef][Web of Science][Medline]
Ridderinkhof KR, Ullsperger M, Crone EA, Nieuwenhuis S. The role of the medial frontal cortex in cognitive control. Science 306: 443–447, 2004.
Risterucci C, Terramorsi D, Nieoullon A, Amalric M. Excitotoxic lesions of the prelimbic-infralimbic areas of the rodent prefrontal cortex disrupt motor preparatory processes. Eur J Neurosci 17: 1498–1508, 2003.[CrossRef][Web of Science][Medline]
Rushworth MF, Buckley MJ, Behrens TE, Walton ME, Bannerman DM. Functional organization of the medial frontal cortex. Curr Opin Neurobiol 17: 220–227, 2007.[CrossRef][Web of Science][Medline]
Rushworth MF, Walton ME, Kennerley SW, Bannerman DM. Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8: 410–417, 2004.[CrossRef][Web of Science][Medline]
Schall JD, Stuphorn V, Brown JW. Monitoring and control of action by the frontal lobes. Neuron 36: 309–322, 2002.[CrossRef][Web of Science][Medline]
Shima K, Isoda M, Mushiake H, Tanji J. Categorization of behavioral sequences in the prefrontal cortex. Nature 445: 315–318, 2007.[CrossRef][Medline]
Uylings HB, Groenewegen HJ, Kolb B. Do rats have a prefrontal cortex? Behav Brain Res 146: 3–17, 2003.[CrossRef][Web of Science][Medline]
van Veen V, Holroyd CB, Cohen JD, Stenger VA, Carter CS. Errors without conflict: implications for performance monitoring theories of anterior cingulate cortex. Brain Cogn 56: 267–276, 2004.[CrossRef][Web of Science][Medline]
Walton ME, Croxson PL, Behrens TE, Kennerley SW, Rushworth MF. Adaptive decision making and value in the anterior cingulate cortex. Neuroimage 36, Suppl 2: T142–154, 2007.
This article has been cited by other articles:
![]() |
N. S. Narayanan and M. Laubach Delay Activity in Rodent Frontal Cortex During a Simple Reaction Time Task J Neurophysiol, June 1, 2009; 101(6): 2859 - 2871. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. M. Barch, T. S. Braver, C. S. Carter, R. A. Poldrack, and T. W. Robbins CNTRICS Final Task Selection: Executive Control Schizophr Bull, January 1, 2009; 35(1): 115 - 135. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |