|
|
||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
REPORT
1Department of Psychology and Center for Neural Science, New York University, New York, New York; and 2Helen Wills Neuroscience Institute and Department of Psychology, Henry H. Wheeler Jr. Brain Imaging Center, University of California, Berkeley, California
Submitted 24 October 2005; accepted in final form 1 February 2006
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
In trying to understand the factors that influence which coding scheme is implemented, we focus on the effect that response selection has on persistent delay period activity. Successful performance of a delayed-response task requires maintaining an internal representation of the visual stimulus, but only until a response is selected. Once a response is selected, simply maintaining the motor plan becomes a sufficient strategy for bridging the memory delay. Therefore we consider response selection to be the most critical rate-limiting step in the evolution of sensation to action.
Strategically, visual and motor events are separated in time during delayed-response tasks so that the evoked physiological responses to each event can be independently quantified (Hikosaka and Wurtz 1983
). Building on this strategy, we designed a paradigm that isolated in time response selection from sensory encoding and motor execution (Fig. 1). Two working-memory retention intervals were used to separate response selection from the visually presented cues and from the execution of the memory-guided saccade. In an event-related functional magnetic resonance imaging (fMRI) study, we isolated evoked activity in the human frontal eye fields (FEF) and intraparietal sulcus (IPS) during response selection and further investigated its impact on the maintenance of visual spatial and motor information.
|
| METHODS |
|---|
|
|
|---|
![]() |
1 = 7.245 s, f1 = 0.04 Hz,
2 = 7.4 s, and f2 = 0.12 Hz (see Polonsky et al. 2000We specified FEF and IPS regions of interest (ROIs) by a two-step procedure. First, anatomical masks were drawn to include gray matter in and around the dorsal precentral sulcus at the junction of but not extending along the superior frontal sulcus for the FEF ROI and along the sulcus that separates the superior and inferior parietal lobules for the IPS ROI. Second, we selected voxels within these structural ROIs that showed a significant main effect of the linear combination of all the task covariates. These voxels showed some consistent deviation from baseline during the task without being biased by any task component. Similar to the way electrophysiologists first identify neurons that respond to the task and then subject those neurons to further study, our combination structural-functional criteria identified task related voxels in regions that were the basis of study in this report.
To test hypotheses about lateralized activity, we combined activity from both hemispheres of each ROI in the following way. Contralateral activity was defined as left ROI activity when the selected target fell in the right visual field plus right ROI activity when the selected target fell in the left visual field. Similarly, ipsilateral activity was defined as left ROI/left visual field plus right ROI/right visual field. Although we find the same results when we analyze each hemisphere ROI separately, this procedure allowed us to pool data across hemispheres to increase our statistical power. Because separate delay durations were used and it was necessary to align both the cue and response periods, Fig. 3 required the adjustment of some data points. Specifically, time points 3031 did not include data from the shortest second delay (12 s) because that time course was simply shifted ahead by 2 s at that point. Similarly, time points 2829 were cut from the longest second delay (16 s). Together, this allowed the time courses from the three delay durations to be in temporal register for the laterality analyses and plotting of Fig. 3. See Supplementary Materials1 Fig., B for the full plots of lateralized blood-oxygen-level-dependent (BOLD) responses.
|
| RESULTS AND DISCUSSION |
|---|
|
|
|---|
We plotted the evoked responses from the FEF and IPS phase-locked to the presentation of the sample cues and saccadic responses in Fig. 2A. Figure 2A shows summed right and left hemisphere responses on trials in which the selected target fell in the visual field contralateral to the ROI's hemisphere (e.g., right FEF responses when the selected target was in left visual field plus left FEF responses when the selected target was in right visual field). First we considered the cue-locked time courses. Both the FEF and IPS showed strong visually evoked activity that began shortly after the presentation of the four sample cues. Sustained activity in both ROIs was clearly evident at a level above baseline during the first delay. Indeed, parameter estimates modeling delay 1 were significantly greater than zero for both ROIs [FEF: t(13) = 5.25, P < 0.001; IPS: t(13) = 8.41, P < 0.0001].
|
Intriguingly, once the response was selected, activity sustained throughout the entire long and variable second retention interval (delay 2) in the FEF but not in the IPS [FEF: t(13) = 3.75, P < 0.01; IPS: t(13) = 1.04, NS]. Activity in the IPS fell below baseline before the memory-guided saccade was made, whereas in the FEF, it remained above baseline throughout the delay until the saccade was generated (Fig. 2A). Moreover, the FEF signal sustained despite that the memory load had been reduced by a factor of four and the cued location had been maintained for
30 s.
From the time-series data, it appears that selection affected maintenance differently in the FEF and IPS. To quantify and test this possibility, we computed an index of the drop in signal magnitude after selection for each region using the fitted parameter estimates [(delay 1 delay 2)/(delay 1 + delay 2)]. The magnitude of this index reflects how much the signal fell from the first to second delay period normalized by the responsiveness of the region during the delays. Again focusing on the contralateral data only, the FEF index was significantly smaller than the IPS index, t(13) = 3.65, P < 0.01, confirming what one intuits from the time-series plot of Fig. 2A, that the IPS signal dropped after selection by a disproportionate amount compared with that in the FEF (Fig. 2B).
If these signals are indeed related to selection and maintenance, then they should reflect the position of the target and therefore evoke a lateralized BOLD response. Specifically, the BOLD signal should be greater on trials in which the selected target fell in the visual field contralateral to the hemisphere containing the ROI. To test this hypothesis about the spatial selectivity of the BOLD signal, we subtracted the average time courses for ipsilateral from contralateral responses for each subject (Fig. 3). To test for significant differences between the lateralized responses in the FEF versus IPS, we summed over the time points in the trial epochs defined in Fig. 3 (gray boxes). These time points were chosen to capture the peak time-locked BOLD responses (see Fig. 2A) to the sample cue (time points 57), the selection event (time points 1820), and the memory-guided saccade (time points 3335), as well as the two delay periods (delay 1, time points 916; delay 2, time points 2231). As can be seen in Fig. 3, neither the FEF nor IPS showed any spatial bias during the presentation of the four spatial cues or during the first delay period when subjects were maintaining the four cues. During those epochs we did not expect a lateralized response. Because two task-relevant targets were presented in each hemifield and the subject did not yet know which to select, we predicted that the signals should balance. However, as soon as the single target was selected for response, both FEF and IPS activity was greater for contralateral compared with ipsilateral targets. This lateralized response was short-lived in the IPS; it was time-locked to the selection event and possibly during the early part of the second delay period. Lateralized activity in the FEF persisted and even climbed during the second delay. The FEF and IPS showed a similar profile of lateralized activity except during the second delay period when contralateral FEF activity was strongest. Integrating over the second delay period, FEF activity was
15% higher for contralateral compared with ipsilateral BOLD signal, significantly higher than the 3% differential signal in the IPS [t(13) = 3.34, P < 0.01].
We derive two important points from these findings. First, both the FEF and IPS show strong activity correlated with response selection independent of visual encoding or motor execution (Gottlieb 2002
; Medendorp et al. 2005
; Schall and Thompson 1999
). Here, we find robust BOLD responses in the FEF and IPS that were time-locked to the selection event and were lateralized according to the position of the selected target. We suggest that these signals reflect the processes involved in selection. In our task, selection likely involves two processes. Once the endogenous cue (i.e., the arrow) appears, one must select the correct cued target among the four stored locations. Then this location must be transformed into a prospective motor plan (i.e., a response must be selected). Although our data do not allow us to disambiguate between these two selection processes, we offer a hypothesis for further study. We hypothesize that the IPS activity we observed time-locked to the selection event reflects visual selection and thereby provides the spatial coordinates of the target (Andersen and Buneo 2002
; Goldberg et al. 2002
). We further suggest that the FEF activity time-locked to the selection event reflects the processes needed to select among the competing saccade goals (Schall 2002
).
Second, because delay-period activity following response selection only persisted in the FEF and not IPS, these areas appear to show a preference for maintaining different forms of information (Ploner et al. 1999
). We can propose that a brain region plays a critical role in maintenance only when activity persists throughout the entire delay period. After a prospective motor plan became available (i.e., after response selection), the FEF activity persisted throughout the delay until the memory-guided saccade was executed. Moreover, this persistent activity was greater in the FEF contralateral to the direction of the selected saccade and thus may reflect the maintenance of a saccadic plan. FEF neurons do show an enhanced firing rate during the maintenance and preparation of contraversive saccades (Bruce and Goldberg 1985
). FEF neurons that code for the metrics of the upcoming saccade may be tonically active as a way to bridge the memory delay. Indeed, microstimulation of monkey FEF neurons at levels below the threshold for evoking saccades during the delay period of an oculomotor delayed-response task biases the direction of the later memory-guided saccade toward the stimulated cell's preferred saccade direction (Opris et al. 2005
). Similarly, transcranial magnetic stimulation (TMS) applied to the human frontal cortex during the middle to late phases of oculomotor delayed-response tasks impairs memory-guided saccade accuracy (Brandt et al. 1998
; Muri et al. 1996
, 2000
). However, TMS applied to the human posterior parietal cortex only impairs memory-guided saccade accuracy if it is applied during the first 200300 ms of the delay, shortly after the visual cue disappears (Brandt et al. 1998
; Muri et al. 1996
, 2000
). Interestingly, TMS may have disrupted response selection processes that operate during this early phase of the delay. These data combined with our observation that the IPS activity does not persist after response selection occurs suggest that the critical role that the IPS plays in spatial working memory involves the maintenance of retrospective spatial cues and the conversion of these cues into a coordinate framework that can be read-out by motor systems for action guidance. Moreover, these data suggest that the FEF contributes to spatial working memory by selecting and maintaining saccade goals. Other evidence from studies of spatial working memory and motor preparation support our conclusion that the posterior parietal cortex and the frontal cortex differ in the degree to which they process visuospatial and visuomotor information, respectively (Connolly et al. 2002
; Curtis et al. 2004
; D'Esposito et al. 2000
; Wise et al. 1997
). Finally, we would like to emphasize what Joaquin Fuster has long argued (Fuster 2001
): the maintenance of prospective motor plans is no less important of a mechanism for working memory as the more traditional notions of maintenance of past sensory events.
| GRANTS |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
|
|
|---|
| FOOTNOTES |
|---|
1 The Supplementary Material for this article (two figures) is available online at http://jn.physiology.org/cgi/content/full/01120.2005/DC1. ![]()
Address for reprint requests and other correspondence: Department of Psychology and Center for Neural Science, 6 Washington Place, Room 859, New York University, New York City, NY 10003 (E-mail: clayton.curtis{at}nyu.edu)
| REFERENCES |
|---|
|
|
|---|
Boussaoud D. Attention versus intention in the primate premotor cortex. Neuroimage 14:S4045, 2001.[CrossRef][ISI][Medline]
Brandt SA, Ploner CJ, Meyer BU, Leistner S, and Villringer A. Effects of repetitive transcranial magnetic stimulation over dorsolateral prefrontal and posterior parietal cortex on memory-guided saccades. Exp Brain Res 118: 197204, 1998.[CrossRef][ISI][Medline]
Brown MR, DeSouza JF, Goltz HC, Ford K, Menon RS, Goodale MA, and Everling S. Comparison of memory- and visually guided saccades using event-related FMRI. J Neurophysiol 91: 873889, 2004.
Bruce CJ and Goldberg ME. Primate frontal eye fields. I. Single neurons discharging before saccades. J Neurophysiol 53: 603635, 1985.
Connolly JD, Goodale MA, Menon RS, and Munoz DP. Human fMRI evidence for the neural correlates of preparatory set. Nat Neurosci 5: 13451352, 2002.[CrossRef][ISI][Medline]
Constantinidis C, Franowicz MN, and Goldman-Rakic PS. The sensory nature of mnemonic representation in the primate prefrontal cortex. Nat Neurosci 4: 311316, 2001.[CrossRef][ISI][Medline]
Corbetta M and Shulman GL. Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3: 201215, 2002.[ISI][Medline]
Courtney SM, Petit L, Maisog JM, Ungerleider LG, and Haxby JV. An area specialized for spatial working memory in human frontal cortex. Science 279: 13471351, 1998.
Curtis CE. Prefrontal and parietal contributions to spatial working memory. Neuroscience In press.
Curtis CE and D'Esposito M. Persistent activity in the prefrontal cortex during working memory. Trends Cogn Sci 7: 415423, 2003.[CrossRef][ISI][Medline]
Curtis CE, Rao VY, and D'Esposito M. Maintenance of spatial and motor codes during oculomotor delayed response tasks. J Neurosci 24: 39443952, 2004.
D'Esposito M, Ballard D, Zarahn E, and Aguirre GK. The role of prefrontal cortex in sensory memory and motor preparation: an event-related fMRI study. Neuroimage 11: 400408, 2000.[CrossRef][ISI][Medline]
Funahashi S, Bruce CJ, and Goldman-Rakic PS. Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol 61: 331349, 1989.
Funahashi S, Chafee MV, and Goldman-Rakic PS. Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task. Nature 365: 753756, 1993.[CrossRef][Medline]
Fuster JM. The prefrontal cortexan update: time is of the essence. Neuron 30: 319333, 2001.[CrossRef][ISI][Medline]
Gnadt JW and Andersen RA. Memory related motor planning activity in posterior parietal cortex of macaque. Exp Brain Res 70: 216220, 1988.[ISI][Medline]
Goldberg ME, Bisley J, Powell KD, Gottlieb J, and Kusunoki M. The role of the lateral intraparietal area of the monkey in the generation of saccades and visuospatial attention. Ann NY Acad Sci 956: 205215, 2002.
Gottlieb J. Parietal mechanisms of target representation. Curr Opin Neurobiol 12: 134140, 2002.[CrossRef][ISI][Medline]
Hikosaka O and Wurtz RH. Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. J Neurophysiol 49: 12681284, 1983.
Medendorp WP, Goltz HC, and Vilis T. Remapping the remembered target location for anti-saccades in human posterior parietal cortex. J Neurophysiol 94: 734740, 2005.
Muri RM, Gaymard B, Rivaud S, Vermersch A, Hess CW, and Pierrot-Deseilligny C. Hemispheric asymmetry in cortical control of memory-guided saccades. A transcranial magnetic stimulation study. Neuropsychologia 38: 11051111, 2000.[CrossRef][ISI][Medline]
Muri RM, Vermersch AI, Rivaud S, Gaymard B, and Pierrot-Deseilligny C. Effects of single-pulse transcranial magnetic stimulation over the prefrontal and posterior parietal cortices during memory-guided saccades in humans. J Neurophysiol 76: 21022106, 1996.
Opris I, Barborica A and Ferrera VP. Effects of electrical microstimulation in monkey frontal eye field on saccades to remembered targets. Vision Res 45: 34143429, 2005.[CrossRef][ISI][Medline]
Ploner CJ, Rivaud-Pechoux S, Gaymard BM, Agid Y, and Pierrot-Deseilligny C. Errors of memory-guided saccades in humans with lesions of the frontal eye field and the dorsolateral prefrontal cortex. J Neurophysiol 82: 10861090, 1999.
Polonsky A, Blake R, Braun J, and Heeger DJ. Neuronal activity in human primary visual cortex correlates with perception during binocular rivalry. Nat Neurosci 3: 11531159, 2000.[CrossRef][ISI][Medline]
Postle BR, Berger JS, Taich AM, and D'Esposito M. Activity in human frontal cortex associated with spatial working memory and saccadic behavior. J Cogn Neurosci 12: 214, 2000.
Quintana J and Fuster JM. From perception to action: temporal integrative functions of prefrontal and parietal neurons. Cereb Cortex 9: 213221, 1999.
Rainer G, Rao SC, and Miller EK. Prospective coding for objects in primate prefrontal cortex. J Neurosci 19: 54935505, 1999.
Schall JD. The neural selection and control of saccades by the frontal eye field. Philos Trans R Soc Lond B Biol Sci 357: 10731082, 2002.[CrossRef][ISI][Medline]
Schall JD and Thompson KG. Neural selection and control of visually guided eye movements. Annu Rev Neurosci 22: 241259, 1999.[CrossRef][ISI][Medline]
Takeda K and Funahashi S. Prefrontal task-related activity representing visual cue location or saccade direction in spatial working memory tasks. J Neurophysiol 87: 567588, 2002.
Wise SP, Boussaoud D, Johnson PB, and Caminiti R. Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. Annu Rev Neurosci 20: 2542, 1997.[CrossRef][ISI][Medline]
This article has been cited by other articles:
![]() |
A. Ikkai and C. E. Curtis Cortical Activity Time Locked to the Shift and Maintenance of Spatial Attention Cereb Cortex, June 1, 2008; 18(6): 1384 - 1394. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. E. Curtis and J. D. Connolly Saccade Preparation Signals in the Human Frontal and Parietal Cortices J Neurophysiol, January 1, 2008; 99(1): 133 - 145. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. A. Kelley, J. T. Serences, B. Giesbrecht, and S. Yantis Cortical Mechanisms for Shifting and Holding Visuospatial Attention Cereb Cortex, January 1, 2008; 18(1): 114 - 125. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. G. Brown, T. Vilis, and S. Everling Frontoparietal Activation With Preparation for Antisaccades J Neurophysiol, September 1, 2007; 98(3): 1751 - 1762. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Shuwairi, C. E. Curtis, and S. P. Johnson Neural substrates of dynamic object occlusion. J. Cogn. Neurosci., August 1, 2007; 19(8): 1275 - 1285. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. O'Shea, N. G. Muggleton, A. Cowey, and V. Walsh Human Frontal Eye Fields and Spatial Priming of Pop-out. J. Cogn. Neurosci., July 1, 2007; 19(7): 1140 - 1151. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. A. Epstein, W. E. Parker, and A. M. Feiler Where Am I Now? Distinct Roles for Parahippocampal and Retrosplenial Cortices in Place Recognition J. Neurosci., June 6, 2007; 27(23): 6141 - 6149. [Abstract] [Full Text] [PDF] |
||||
![]() |
V. P. Ferrera and J. Grinband Perception, Memory, and Action in Frontal and Parietal Cortex. Focus on "Selection and Maintenance of Saccade Goals in the Human Frontal Eye Fields" J Neurophysiol, June 1, 2006; 95(6): 3309 - 3310. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |