|
|
||||||||
1National Brain Research Centre, Haryana, India; 2Vanderbilt Vision Research Center, Center for Integrative and Cognitive Neuroscience, Department of Psychology, Vanderbilt University, Nashville, Tennessee; and 3Laboratory of Sensorimotor Research, National Eye Institute, Bethesda, Maryland
Submitted 25 April 2006; accepted in final form 22 November 2006
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
A critical node in the network controlling the programming of saccadic eye movements is the frontal eye field (FEF), a sensorimotor area that contributes to the selection of targets and preparation of saccadic eye movements (reviewed by Schall 2002
; Schall et al. 2003
; Thompson et al. 2001
). In keeping with its sensorimotor function, a variety of cell types were previously described (e.g., Bruce and Goldberg 1985
; Schall 1991
) that specify where and when a saccade will be made. Although visual neurons appear to identify targets for saccades (e.g., Bichot and Schall 1999
; Thompson et al. 1996
), movement cells generate signals sufficient to control whether and when a saccade will be produced (Hanes and Schall 1996
; Hanes et al. 1998
). Even though much has been learned about how FEF contributes to the production of correct saccades, no studies have examined the role of FEF in producing saccades that correct errors. However, previous work identified neurons in the supplementary eye field and anterior cingulate cortex that signal when saccade errors are produced (Ito et al. 2003
; Stuphorn et al. 2000
).
When monkeys produce accurate corrective saccades with latencies less than the latency of visual feedback, these movements must be produced using a vector that is updated for the change of eye position produced by the error saccade. This problem has received much empirical and theoretical interest (e.g., Hallett and Lightstone 1976
; Sparks and Mays 1983
). One mechanism that can account for fast on-line error correction involves a comparison of the spatial location of the goal with the current eye displacement, for which a specific role for postsaccadic neurons in FEF was hypothesized (Goldberg and Bruce 1990
). In this framework, error correction can begin only after the erroneous saccade has occurred. Alternatively, fast on-line error correction may involve a comparison of the spatial location of the goal with the anticipated eye displacement. Consequently, programming the corrective saccade can begin before the occurrence of the error and in parallel with the erroneous saccade.
Evidence in support of this latter hypothesis is derived from the finding of a characteristic modulation of some visual neurons in the FEF, lateral intraparietal cortex (LIP), and the superior colliculus (SC) that has been described as remapping (Duhamel et al. 1992
; Umeno and Goldberg 1997
, 2001
; Walker et al. 1995
; reviewed by Colby and Goldberg 1999
). These neurons respond to stimuli that will be brought into their receptive fields by saccades, even before the saccades actually take place. More recently, McPeek and Keller (2002a)
reported that the activity of visually responsive neurons in SC represent the location of the salient object in a search array if monkeys shift gaze to another location before producing a corrective saccade to the overlooked target; they suggested that the sustained representation by these visual neurons remapped the location of the target in the reference frame of the errant saccade to afford rapid error correction.
If remapping the target location enables the brain to rapidly and accurately correct saccade errors (Vaziri et al. 2006
), then several implications of this hypothesis can be tested. First, parallel programming for rapid error correction occurs if the remapping is established early enough. Second, neurons that represent the target location as well as neurons associated with saccade programming will exhibit activation before afferent visual signals occur. Third, the timing of activation of neurons that represent the target location as well as the timing of activation of neurons associated with saccade programming must predict the time of initiation of the corrective saccade.
To investigate how remapped visual information before a saccade can be used rapidly to correct errors and improve visual search performance, we trained monkeys to perform a task that combines color singleton search with the classic double-step perturbation in which the target unpredictably changes location before the saccade is initiated. Monkeys were reinforced only for shifting gaze to the final target location, so the corrective saccades after errors were unreinforced. Reinforcing only the correct saccade as opposed to reinforcing after the second saccade results in faster corrective saccades (Ray et al. 2004
). As a result, this search-step task yielded a reliably high fraction of errors, most of which were followed by corrective saccades. Thus the search-step task affords an ideal opportunity to elucidate the neural mechanisms responsible for generation of rapid corrective saccades.
| METHODS |
|---|
|
|
|---|
|
In the data analyzed for this study all sessions had 50% step trials. A restricted set of targets steps was used to increase the yield of data during the neurophysiological sessions. Targets could step to and from the three array positions centered around and opposite to the neuron's response field, yielding 18 possible combinations of target steps. Thus targets stepped into or out of response fields but never stepped within a response field. Target steps were randomized and were interleaved with no-step trials in which target position was randomized and equiprobable across all locations. Behavioral data indicated that the monkeys could predict neither the occurrence of a target-step trial nor the location of the stepped target.
Analysis of data for this study required matching the direction and amplitude of correct and corrective saccades. Therefore only those combinations of target steps were chosen that resulted in subsequent corrective saccades falling into the response field of the cell in question. This was accomplished as illustrated in Fig. 2. For example, the no-step activity of a neuron with the movement field toward 9 o'clock was compared with the activity on step trials in which the error was directed to 2 or 4 o'clock, followed by a horizontal corrective saccade toward 9 o'clock. If the movement field were larger, the number of permissible configurations increased. Given the circular geometry of the search array, the amplitude of the corrective saccades between two positions in the array must be longer than the amplitude of the saccade from the center to one of the positions. The longest corrective saccade across the array (being a diameter) will have twice the amplitude of the saccade from the center (being a radius). Also, a corrective saccade from, for example, the upper-right to the upper-left position (Fig. 2, top) will have an amplitude
2 times that of the saccade from the center. Insofar as possible, the comparisons equated saccade amplitude. Furthermore, these differences in saccade amplitude were much less than the size of the response fields of FEF neurons. Nevertheless, we report below the maximal difference in the neural activity for correct and corrective saccades that would be expected based on such amplitude differences.
|
12 ms before and after the high-velocity gaze shift. Based on the 250-Hz sampling rate this method is accurate to within 4 ms because it identified the digitized eye-position sample at which the gaze shift began. The effectiveness of the algorithm can be evaluated in Fig. 6.
|
50 ms. A similar analysis was also carried out convolving spike trains with a function that resembled a postsynaptic potential (PSP) to generate the spike-density function. The time constant of the growth phase and the time constant of the decay phase of the function used for convolution were 1 and 20 ms, respectively.
In addition, we also used a receiver operating characteristic (ROC) analysis, based on signal detection theory (Green and Swets 1966
), to further validate the results. Two sets of trials corresponding to correct no-step trials and corrective step trials were compared. We considered only those neurons that provided at least four trials in both sets. Spike trains from original sets of trials were bootstrapped to construct 5,000 simulated spike trains in each set for reliable comparison. The spike-density function corresponding to each trial was constructed by convolving with a Gaussian distribution function (SD = 10 ms).
Comparisons were conducted in nonoverlapping 1-ms bins starting 100 ms before the end of saccade to 200 ms after the end of the saccade. Points on the ROC curve were generated by plotting the fraction of step trials when the monkey made the erroneous saccade away from the response field followed by the corrective saccade into the response field with activity greater than a criterion as a function of the fraction of no-step trials when the monkey made the correct saccade away from the response field with activity greater than that of the criterion. The entire ROC curve was generated by incrementing the criterion from zero to the maximum discharge rate observed on a single trial in steps of 1 spike/s. The area under the ROC curve provides a quantitative measure of the separation between two distributions of activity. An area under the ROC curve value of 0.5 signifies that the two distributions being compared are completely overlapping (i.e., indistinguishable), whereas a maximum value of 1.0 signifies that the two distributions do not overlap at all (i.e., perfectly distinguishable). To describe the growth in the area under the ROC curve over time the data were fit with a cumulative Weibull distribution function. The time of differential activity was determined from the growth of the ROC area over time and was defined as the time when the ROC area reached a value of 0.75 (Thompson et al. 1996
). To verify the efficiency of this method we repeated the same analysis constructing the spike-density function corresponding to each trial by convolving the spike train with a combination of exponentially increasing and decreasing functions that resembled a PSP. The time constant of growth phase and the time constant of decay phase of the function used for convolution were 1 and 20 ms, respectively. In 17 cases (seven with PSP filter and ten with Gaussian filter) the fits were not satisfactory, so the discrimination time was simply the time of the first ROC value that exceeded 0.75 and remained
0.75 for 6 ms. For seven cells for which ROCs were obtained with four or five trials, we verified the accuracy of the estimate of the discrimination time by repeating the bootstrap procedure three times for each cell. We found that the maximum error in the estimation was 3 ms.
Our application of the double-step task during visual search is designed to probe how the oculomotor system responds to new visual information before saccades are initiated. This motivation is somewhat distinct from that of certain other previous uses of the double-step task, such as investigating coordinate transformations by requiring subjects to execute a sequence of saccades to the successive target locations (e.g., Hallett and Lightstone 1976
; Umeno and Goldberg 1997
, 2001
). The reward contingencies of our task required monkeys to shift gaze directly to the final location. The reward contingencies of these other double-step saccade studies required human and monkeys to shift gaze to each target location in succession. In fact, we previously studied human performance under both instructions and found that corrective saccades have shorter latencies than those of correct saccades and parallel programming of saccades is facilitated when the second saccade was correcting an error instead of finishing a sequence (Ray et al. 2004
).
Visually evoked activity was distinguished from movement-related activity through established criteria (Hikosaka and Wurtz 1983
). In the conventional memory-guided saccade task visual neurons exhibited increased spike rate after stimulus presentation but no buildup of activity preceding gaze shifts (Fig. 5A). In contrast, movement-related neurons exhibited a pronounced increase of discharge rate before and during the memory-guided saccade (Fig. 5B). Some movement-related neurons had very weak or absent visual responses; these were classified as movement neurons. The movement-related neurons with pronounced visual responses were classified as visuomovement neurons.
|
| RESULTS |
|---|
|
|
|---|
Evidence for parallel programming of successive saccades was obtained from an analysis of the interval between the error and corrective saccade relative to the target-step delay (Fig. 3). The logic of this analysis applies to saccade programming (e.g., Becker and Jürgens 1979
) and, more generally, to the characterization of the psychological refractory period (e.g., Pashler 1994
). The key measure is the interval between the target step and the beginning of the noncompensated error saccade; this will be denoted as reprocessing time (RPT; identical to D of Becker and Jürgens 1979
). The label of reprocessing time for this interval is intended to convey the simple idea that until the saccade is initiated, the visual system can reprocess the search array that has changed; once gaze shifts, visual processing is disrupted. The premise of this analysis is that if saccade programming is strictly serialthat is, if programming the corrective saccade to the new target location can begin only some time after the errant saccade to the old target location has been executedthen the intersaccadic interval (ISI) cannot decrease with increasing reprocessing time (Fig. 3A, left, dotted lines in Fig. 3, B and C). However, if the corrective saccade can be programmed before the visual consequences of the errant saccade have been encoded or even before the errant saccade has been executed, then the ISI will be inversely related to reprocessing time (Fig. 3A, right, solid lines in Fig. 3, B and C).
|
We also collected data in 14 double-step sessions in which the target was presented with no distractors. On a random 50% of trials the target stepped to a new location before the saccade was initiated. We found the same negative correlation between ISI and RPT (Fig. 4; slope median = 0.68, min = 1.32, max = 0.12, r2 median = 0.10, min = 0.001, max = 0.43). Thus the monkeys exhibited the same pattern of parallel saccade programming here as in the search-step task. Having established that corrective saccades were produced rapidly after errant saccades, we can now consider the neural basis of this rapid error correction.
|
Cell classification: contrasting visually evoked and movement-related activity
Every neurophysiological investigation of FEF in macaque monkeys has agreed that the FEF contains diverse types of neurons with most exhibiting visual responses and some exhibiting modulation associated with saccade production (Bruce and Goldberg 1985
; DiCarlo and Maunsell 2005
; Hanes et al. 1998
; Helminski and Segraves 2003
; Schall 1991
; Segraves and Goldberg 1987
; Sommer and Wurtz 2001
). In addition to their patterns of modulation, the relative magnitude of visual and movement activity in the memory-guided saccade task was quantified using a visual-movement index (VMI), which was calculated for each neuron as VMI = (MA VA)/(VA ± MA). Neurons with comparatively higher movement activity yield positive VMI and neurons with greater visual activity yield negative VMI. Accordingly, the average VMIs (±SE) for movement and visual neurons were 0.4 (±0.09) and 0.06 (±0.09), respectively, which were significantly different from each other [t = 3.5, P < 0.001, degree of freedom (df) = 32], whereas the average VMI of visuomovement cells was 0.09 (±0.11). This report contrasts the pattern of activity of 15 visual neurons (13 from monkey C and two from monkey F) with that of 20 movement (15 from C, three from F, and two from L) and 24 visuomovement (21 from F and three from L) neurons.
Neurons with and without movement-related activity also exhibited different patterns of modulation when corrective saccades were produced. Compared with when a distractor remains in the receptive field, when the target steps into the receptive field, visual neurons select the new location of the target (Fig. 5C) (Murthy et al. 2001
). For the representative visual neuron, target selection occurred 193 ms after array presentation and persisted until the corrective saccade was produced. Thus visual neurons in FEF maintained a correct representation of the changing image in spite of an initial errant gaze shift. This activity was previously described as a remapping signal when observed in the superior colliculus (McPeek and Keller 2002b
). However, although the visual representation of the location of the stimulus is a necessary preliminary to error correction, the movement-related activity immediately preceding the corrective saccade is a more proximal basis of saccade preparation. We now show that neurons with movement-related activity producing a saccade to the final target location became active very soon after the error (Fig. 5D).
Analysis of saccade-related activity
To compare saccade-related activity specific to the programming of corrective saccades we ensured that comparisons were made between only correct and corrective saccades with similar directions and amplitudes (Fig. 2). Figure 6 illustrates the pattern of activity of a typical FEF movement-related neuron; behavioral data associated with this neuron are shown in Figs. 1, 3, and 4. Before addressing the question of how rapid saccade corrections occur, we determined whether the timing or magnitude of movement-related activity preceding corrective saccades (Fig. 6B) was different from that preceding correct saccades (Fig. 6A). Neural activation during correct no-step responses into the movement field was compared with the subset of errant step trials in which the corrective saccades most closely matched the direction and amplitude of correct saccades made into the movement field during no-step trials (Fig. 6C, inset). To ensure the most valid comparison between corrective and correct activity, trials were also matched for saccade latency.
Previous work showed that saccades are initiated when movement-related activity in FEF reaches a threshold that does not vary with saccade latency (Hanes and Schall 1996
). Therefore the average spike rate 1020 ms before initiation of correct and corrective saccades was compared. Although for the neuron shown in Fig. 6C the magnitude of activity for correct saccades was slightly less than that for corrective saccades, across the sample correct and corrective saccades were initiated when the level of movement-related activity in FEF reached a single discharge rate threshold. The mean (±SE) difference between threshold discharge rates before correct and corrective saccades was 7.2 ± 3.7 spikes/s, which was not significantly different from 0 (t = 1.93, P = 0.06, df = 42, power = 0.35).
It is well known that the timing and magnitude of movement-related activity vary with the location of a saccade relative to the most sensitive point of a neuron's movement field. Across the sample of movement-related neurons the mean amplitude of corrective saccades was 13.3° and that of correct saccades was 9.73°, with the mean absolute value of the difference in amplitudes across types of saccades being 3.55°. This difference in amplitude corresponds to that expected from the geometry of the circular search array (9.73° x
2 = 13.8°). Thus the amplitude of corrective saccades tended to exceed the amplitude of correct saccades, so some difference in the timing or magnitude of activity associated with corrective and correct saccades into a neuron's movement field may arise from variability in the location of the saccade endpoints relative to the optimal location in the movement field. Consideration of the size of FEF movement fields mitigates this concern. The movement fields of FEF neurons can be characterized as Gaussian in direction and log-Gaussian in amplitude (Bruce and Goldberg 1985
). Although we did not obtain amplitude tuning for the neurons in this sample, maps of saccade direction tuning obtained in this laboratory (Schall et al. 1995
, 2004
) quantitatively match the original report of Bruce and Goldberg (1985)
. Given the typical amplitude tuning of FEF movement neurons at the eccentricity of the neurons sampled (about 10°), a 3.55° difference in saccade amplitude would translate into no more than a 39% difference in discharge rate. Therefore any difference larger than roughly 10% in magnitude and timing of activity associated with correct and corrective saccades cannot be explained entirely by differences in saccade amplitude.
Analysis of activity before corrective saccades
To determine whether the activity of FEF movement-related neurons can account for the short latency of corrective saccades, the activity associated with corrective saccades into the movement field after noncompensated errors outside of the movement field (Fig. 6, B, C, E, and G) was compared with the activity associated with correct no-step saccades directed to the same location outside of the movement field (Fig. 6, D and G). Trials were matched for saccade latency and direction so that any difference in activity between these trials must arise from the process of producing the corrective saccade.
To match the direction with the correct saccade to the response field the equivalent corrective saccade was first translated to the origin of the coordinate of the display screen and then rotated clockwise by the angle subtended by the corresponding response field to the positive x-axis. If the endpoint of the saccade did not fall within ±5° the trial was discarded. A subset of correct saccades in no-step trials whose latency fell within the span of latency of noncompensated saccades of same direction in the step trials was examined.
As illustrated in Fig. 6G, the activity of this neuron producing the corrective saccade began 29 ms before the end of the error saccade. To validate this result we also determined the time of differential activity by performing ROC analyses, based on the theory of signal detection (Green and Swets 1966
; Thompson et al. 1996
). Based on this analysis the activity of this neuron producing the corrective saccade began 6 ms before the end of the error saccade (Fig. 6F). Qualitatively similar modulation was observed in double-step trials (Fig. 7). Because there were no distractors, these double-step data rule out the possibility that the early movement-related activity observed in the search-step trials was just the response to the distractor appearing in the response field before the target step.
|
|
|
We wanted to ensure that the conclusions drawn from this analysis were not susceptible to particularities of the measurement procedure. Therefore we repeated the analysis using different methods and criteria. First, we determined the time when the modulation preceding corrective saccades occurred based on an ROC analysis (Thompson et al. 1996
). The results of this ROC approach revealed qualitatively indistinguishable results using either the Gaussian or the PSP convolution kernels. The area under the ROC curve increased with the time measured from the end of erroneous saccade, indicating that the corrective activity evolved over time with increasing discriminability from the activity corresponding to the correct saccade. To estimate the time course of this correction process we fit the plot of area under the ROC with a Weibull function. The instant in time when the fit reached 0.75 was considered as the beginning of the modulation (Fig. 6F). Figure 10 shows the result from this ROC analysis across the population of neurons. Using a Gaussian (or PSP) convolution function, we found 32% (10%) of movement neurons, 15% (5%) of visuomovement neurons, and 67% (40%) of visual neurons exhibited significant modulation before the erroneous saccade was completed and another 37% (53%) of movement neurons, 25% (27%) of visuomovement neurons, and 33% (30%) of visual neurons became active after the error saccade but before the earliest visual efferent delay to FEF of 40 ms. The foregoing analysis was accomplished using measurements from average spike-density functions. Because the choice of the kernel used for the spike-density function can affect measurements of timing of modulation, a different analysis was also done that directly detects the moment of modulation according to spike times. A Poisson spike-train analysis was applied to measure the beginning of activation on single trials as described and demonstrated previously (Hanes et al. 1995
; Pouget et al. 2005
; Schmolesky et al. 1998
; Thompson et al. 1996
). How rapidly the correction began was determined by taking the median of the earliest periods of beginning of activation for each neuron across the trials (Fig. 6E, arrow). By this measure, neurons with only visual responses changed their discharge rates on average (±SE) 39.7 ± 20.2 ms after termination of the noncompensated error. Visuomovement neurons changed discharge rate on average 59.9 ± 12.5 ms after termination of the noncompensated error. Movement neurons changed discharge rate on average 63.9 ± 14.2 ms after termination of the noncompensated error. These times were not significantly different from one another (F = 0.6, df = 56, P = 0.55). According to this trial-by-trial measure, modulation in activity leading to the corrective saccade began before error saccade termination in 20% of movement neurons, before the earliest afferent delay measured in FEF (40 ms; Schmolesky et al. 1998
) for another 10% of movement neurons and before the common latency of explicit error signals observed in the supplementary eye fields and the anterior cingulate cortex during the stop-signal task (Ito et al. 2003
; Stuphorn et al. 2000
) for another 35% of movement neurons. A one-way ANOVA indicated that there was no difference in the time of the beginning of corrective activity of movement-related neurons (movement and visuomovement) measured by all three techniques (Fig. 10) (F = 0.97, df = 116, P = 0.38). Thus the general conclusion that activity in FEF producing corrective saccades begins earlier than error or visual feedback and sometimes even before the error is completed does not depend on the use of a particular form of analysis.
|
A further test of the role of movement-related activity to saccade generation is afforded by the tendency of the latency of the corrective saccade relative to the error saccade (ISI) to decrease with the latency of the error saccade relative to the target step (reprocessing time) (Figs. 3 and 4). Specifically, if movement-related activity in FEF contributes to programming the corrective saccade, that activity must begin earlier after longer reprocessing times. In contrast, if the onset of the movement-related activity arose from error feedback of some kind, then it should depend on the timing of the errant saccade alone and not reprocessing time. To evaluate these alternatives, corrective saccades were divided into those associated with the shortest reprocessing times (less than the mean reprocessing time) and those associated with longest reprocessing times (greater than the mean reprocessing time). The result of this analysis is shown in Fig. 11 for the movement neuron illustrated in Fig. 6. Figure 11A shows that corrective activity began earlier before errors associated with longer reprocessing times (and shorter ISIs) and began later before errors after shorter reprocessing times (and longer ISIs). To quantify this relationship, the average start time of corrective activity was related to the average reprocessing time from the groups of shorter and longer reprocessing time trials. For this neuron the two were inversely related (Fig. 11B; slope = 0.89), consistent with the hypothesis that the timing of the corrective saccade is dictated by the timing of movement-related activity.
|
|
| DISCUSSION |
|---|
|
|
|---|
Neuron classification
The interpretation of the results hinges on the distinction between visually evoked and movement-related activity. We do not take for granted the complexity of identifying neural activity with cognitive processes (Schall 2004
), but we do not see how some such identification can be avoided. Numerous investigators described visual, visuomovement, and movement neurons in FEF (Bruce and Goldberg 1985
; DiCarlo and Maunsell 2005
; Helminski and Segraves 2003
; Schall 1991
; Segraves and Goldberg 1987
; Sommer and Wurtz 2001
; Umeno and Goldberg 1997
, 2001
) and SC (Horwitz and Newsome 1999
; Mays and Sparks 1980
; McPeek and Keller 2002b
) and identified visual neurons in FEF and SC with visual processing but not saccade programming (Horwitz and Newsome 1999
; Horwitz et al. 2004
; McPeek and Keller 2002a
; Sato and Schall 2003
; Sato et al. 2001
; Thompson et al. 1996
, 1997
, 2001
). Data from the stop-signal task show that saccade-related but not visual activity in FEF and SC can be identified with saccade programming that specifies whether and when saccades will be initiated (Hanes et al. 1998
; Paré and Hanes 2003
). Further evidence for distinguishing neuron types is differential anatomical connectivity. It is well known, for example, that neurons in different layers of the cortex entertain different afferents and efferent targets and, consequently, have more or less distinct functional properties. Combined recording and electrical stimulation studies have demonstrated that neurons in FEF with movement-related activity project to the SC (Segraves and Goldberg 1987
; Sommer and Wurtz 2001
) and brain stem (Segraves 1992
). Therefore such neurons correspond to pyramidal cells in layer 5 (e.g., Fries 1984
). It is less clear whether neurons with exclusive visual responses project to the SC; one study obtained negative evidence (Segraves and Goldberg 1987
) and another, positive evidence (Sommer and Wurtz 2001
). Certainly, neurons in the supragranular layers of FEF that do not project to the SC subserve visual target selection (Thompson et al. 1996
). Thus the weight of the evidence seems to us to support the distinction between visually responsive and movement-related neurons. Ultimately, the adaptability and arbitrariness of macaque and human behavior cannot be explained without a distinction between sensory and motor processes.
Updating and remapping
The original evidence for the remapping hypothesis was that some visually responsive neurons in visuomotor structures, including FEF (Umeno and Goldberg 1997
), respond to a stimulus that is not currently in the response field but will be after an upcoming saccade. The present data extend this observation in several critical ways. First, Umeno and Goldberg (1997)
reported that 31% of visuomovement and 0% of movement cells showed predictive receptive field shifts. However, we found that 80% of visual neurons selected the new target on error trials and 100% of movement-related neurons demonstrated significant activity before the corrective saccade. Thus assuming equal sampling and classification criteria across studies, the extent of modulation we observed exceeds what has been reported for remapping and likely represents a different phenomenon or a more potent expression of the same phenomenon. Therefore we do believe it is useful to maintain a distinction between the process of "remapping" visual representations (presumably for perceptual stability) and the process of producing accurate saccades. Such a distinction is warranted because of the disparities that can occur between perceptual localization and saccade endpoints (Matin and Matin 1972
).
It should also be noted that the task conditions we used are qualitatively different from those used in the original studies describing remapping. Our search- and double-step tasks challenged monkeys to suppress one saccade to make the correct saccade in step trials. In contrast, the remapping studies either do not permit the monkey to make a second saccade or the two targets appear well before the first saccade is initiated. As a result, in the remapping studies monkeys never made saccades that were optimal for the movement cell, so it may not be surprising that none of the movement cells was activated. In testing with human subjects we found that performance of double-step saccades depends on instructions; second (corrective) saccades to the final target location occur significantly more rapidly if subjects are instructed to cancel the initial saccade and redirect gaze to the final target location as opposed to being instructed to follow the successive targets (Ray et al. 2004
).
Second, the original results suggest that a remapping signal would be synchronized on the error saccade that remaps the image, but we found that the onset of movement-related activity during search-step trials was inversely related to reprocessing time, the interval between the target step and the error saccade. Thus whereas the activity of visually responsive neurons in FEF may be described as spatial remapping, the activity of the movement-related neurons invites an interpretation in terms of saccade programming. It could be argued that the activity of movement neurons is simply driven by visual neurons. However, overwhelming evidence from cognitive psychology (e.g., Kornblum at al. 1990
) as well as several experiments from our laboratory (Juan et al. 2004
; Sato and Schall 2003
; Sato et al. 2001
) demonstrate conclusively that visual activity does not directly and immediately drive movement activity. In the final analysis, the process of remapping to maintain perceptual stability and the process of rapid error correction are more complementary than exclusive. In whatever manner the brain updates its representation of visual coordinates according to changing eye position, the new results of this study demonstrate that it must occur by the time that FEF movement-related activity begins.
Rapid error correction
The inference of parallel programming of saccades was made based on unusually brief intersaccadic intervals observed when subjects correct errors in the context of rapidly changing or alternative saccade endpoints (e.g., Becker and Jürgens 1979
; Goossens and Van Opstal 1997
; Hooge and Erkelens 1996
; McPeek and Keller 2002a
; McPeek et al. 2000
; Theeuwes et al. 1999
; Viviani and Swensson 1982
). ISIs
150 ms are generally regarded as evidence for parallel programming because the second saccade is produced before visual input can be processed. The present data included some but not a large number of such brief ISIs, probably resulting from particular features of this search-step task. In particular, the isoluminant color change in the search-step task is a weaker stimulus than the transient stimuli used in most double-step saccade studies. Also, the corrective saccade was never rewarded, so there was no urgency for the monkeys to redirect gaze. Finally, adjusting the target-step delay in a staircase procedure prevented monkeys from succeeding on many trials. In another study, we found that strategic control can be exerted on the production of the sequence of saccades in this task (Ray et al. 2004
). Therefore we believe the monkeys deliberately slowed saccade production to maximize reward earnings.
Nevertheless, equally conclusive evidence for parallel programming is an inverse relationship between the initiation of the first saccade and the reprocessing time (Becker and Jürgens 1979
). This inverse relationship was observed in nearly all of the search-step and double-step data-acquisition sessions. Therefore despite longer ISIs, the behavioral data are entirely consistent with the criteria previously used for rapid, parallel saccade programming.
Error and conflict detection in particular and executive control in general have been very active areas of inquiry in cognitive neuroscience for the last decade (e.g., Botvinick et al. 2004
). However, in spite of a great deal of work on error detection, relatively little is known about the neural mechanisms of error correction. Recently, several papers described the pattern of neural activity in the superior colliculus concomitant with saccades having curved trajectories (McPeek and Keller 2003
; Port and Wurtz 2003
; Walton et al. 2005
). The present results extend these earlier studies in at least four ways. Activity associated with the first (error) and second (corrective) saccades could be more clearly distinguished because we looked specifically at saccades requiring activation in the hemisphere opposite that which produced the first saccade. Second, we monitored both visually evoked and movement-related activity preceding the corrective saccade being made into the response field. Third, we demonstrate for the first time the temporal correlation between the movement-related activity and the initiation of the corrective saccade. Fourth, our results demonstrate in the frontal lobe the kinds of dynamic signals contributing to gaze control that heretofore were reported only in the superior colliculus.
As mentioned, previous studies showed how the endpoint