JN AJP citation statistics
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Neurophysiol 88: 2088-2095, 2002;
0022-3077/02 $5.00
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (40)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Hopf, J.-M.
Right arrow Articles by Luck, S. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Hopf, J.-M.
Right arrow Articles by Luck, S. J.

The Journal of Neurophysiology Vol. 88 No. 4 October 2002, pp. 2088-2095
Copyright ©2002 by the American Physiological Society

Localizing Visual Discrimination Processes in Time and Space

Jens-Max Hopf,1 Edward Vogel,2 Geoffrey Woodman,3 Hans-Jochen Heinze,1 and Steven J. Luck3

 1Department of Neurology II, Otto-von-Guericke University, D-39120 Magdeburg, Germany;  2Department of Psychology, University of Oregon, Eugene, Oregon 97403-1227; and  3Department of Psychology, University of Iowa, Iowa City, Iowa 52242-1407


    ABSTRACT
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES

Hopf, Jens-Max, Edward Vogel, Geoffrey Woodman, Hans-Jochen Heinze, and Steven J. Luck. Localizing Visual Discrimination Processes in Time and Space. J. Neurophysiol. 88: 2088-2095, 2002. Previous studies of visual processing in humans using event-related potentials (ERPs) have demonstrated that task-related modulations of an early component called the "N1" wave (140-200 ms) reflect the operation of a voluntary discrimination process. Specifically, this component is larger in tasks requiring target discrimination than in tasks requiring simple detection. The present study was designed to localize this discriminative process in both time and space by means of combined magnetoencephalographic (MEG) and ERP recordings. Discriminative processing led to differential ERP and MEG activity beginning within 150 ms of stimulus onset. Source localization of the combined ERP/MEG data was performed using anatomical constraints from structural magnetic resonance images. These analyses revealed highly reliable and focused activity in regions of inferior occipital-temporal cortex. These findings indicate that the earliest measurable correlates of discriminative operations in the visual system appear as neural activity in circumscribed regions of the ventral processing stream.


    INTRODUCTION
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES

The initial processing of visual stimuli appears to be entirely automatic, occurring regardless of task demands. For example, neural activity in the retina appears to be insensitive to the direction of covert attention (Mangun et al. 1986). Once visual information reaches primary visual cortex (area V1), factors such as arousal and spatial attention can influence neural activity (Gandhi et al. 1999; Ito and Gilbert 1999; Motter 1993; Roelfsema et al. 1998; Shulman et al. 1997; Somers et al. 1999). However, the effects of top-down factors are smaller in area V1 than in extrastriate visual areas (Kastner et al. 1998; Tootell et al. 1998), and these effects may reflect feedback rather than a modulation of the initial feedforward volley of sensory activity (Clark and Hillyard 1996; Martinez et al. 1999; Roelfsema et al. 1998). In contrast, top-down modulations of activity in extrastriate and inferotemporal visual areas are quite robust, and at least some extrastriate attention effects reflect a modulation of feedforward sensory activity (Hillyard et al. 1998; Luck et al. 1997; Mangun et al. 1997). In general, top-down factors play an increasing role as visual information reaches higher levels of processing, defined both in terms of neuroanatomy (i.e., larger top-down effects in higher-level cortical regions) and time (i.e., top-down effects become larger as more time elapses after stimulus onset).

The intention to make a visual discrimination can also influence neural responses. For example, Spitzer and Richmond (1991) found that stimulus-elicited responses in macaque inferotemporal neurons were smallest when the stimuli were task-irrelevant, became larger when the monkeys were required to make a simple detection response, and were largest when the monkeys were required to make a discriminative response. The time course of these effects was not analyzed, but the effects appeared to begin within 150 ms of stimulus onset.

The effects of discriminative processing have also been examined in neuroimaging studies that were focused on attention, but manipulated attention by varying the type of discrimination performed by the subjects. For example, Corbetta et al. (1990, 1991) found that blood flow was increased in different regions of visual cortex when subjects discriminated color, form, and velocity. Similarly, Clark et al. (1997) found differential patterns of activation when subjects discriminated color versus face identity, and Wojciulik et al. (1998) found that activity in the fusiform face area was influenced by whether subjects performed a face-matching task or a house-matching task. In a recent PET study, Dupont et al. (1998) report activity in fusiform gyrus and other regions in a orientation-discrimination task using square-wave gratings. However, given the relatively poor temporal resolution of neuroimaging techniques, these effects might reflect preparatory processes or postperceptual processes rather than perceptual-discrimination processes.

The time course of discriminative processing has been studied with event-related potential (ERP) recordings. For example, Ritter and his colleagues have conducted several experiments comparing two tasks, a simple-response task in which subjects made a speeded response as soon as they detected a stimulus, regardless of its form and a discriminative-response task in which subjects made different responses depending on the form of the stimulus (Ritter et al. 1982, 1983, 1988). The initial P1 sensory response was the same for these two conditions, but the subsequent N1 wave was larger in the discriminative-response condition than in the simple-response condition, beginning around 150 ms poststimulus. Ritter et al. (1982) concluded that this effect reflected the operation of a pattern discrimination process. More recently, Vogel and Luck (2000) found that this N1 discrimination effect can be found for color discriminations as well as for form discriminations and concluded that it reflects a more general discrimination process. Vogel and Luck also found that the N1 discrimination effect does not simply reflect increased arousal or increased perceptual load. Thus the intention to perform a discrimination can influence neural activity in the human brain within 150 ms of stimulus onset.

A similar N1 modulation has been found for attentional orienting in space (Luck and Hilyard 1995; Mangun 1995). That is, stimuli at attended locations elicit a larger N1 component than stimuli at unattended locations (we call this the N1 spatial attention effect). The time course and scalp topography of this N1 spatial attention effect resemble those of the N1 discrimination effect. Moreover, the N1 spatial attention effect appears to be present only when the attended stimulus necessitates some form of discriminative response (Mangun and Hillyard 1991). Hence the parallels between both N1 effects suggest that the N1 spatial attention effect may represent an ERP instantiation of the same discriminative operation under somewhat different experimental conditions.

The finding of similar ERP effects for manipulations of attention and manipulations of discrimination make it clear that it is sometimes difficult to distinguish between the concepts of attention and discrimination. This is a very complex issue that has been discussed in detail elsewhere (Luck and Vecera 2002). For the sake of simplicity, this article will make no distinction between discrimination processes per se and discrimination-related aspects of attention.

The purpose of the present study is to link the precise temporal information provided by human ERP recordings of the N1 discrimination effect with the underlying neuroanatomy. To accomplish this, we recorded both ERPs and MEG responses in simple- and discriminative-response conditions. We then subtracted the waveforms obtained in the simple-response condition from the waveforms obtained in the discriminative-response condition to isolate activity related to top-down control of discriminative processing. The neuroanatomical sources of this differential activity were then localized for each subject and for the grand average with the aid of structural magnetic resonance (MR) images of each subject's brain.


    METHODS
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES

Subjects

Ten subjects (mean age: 25.9 yr; 5 female; 1 left handed) with normal color vision and normal or corrected-to-normal visual acuity participated in this experiment. The experiment was undertaken with the understanding and written consent of the subjects. Subject were paid for participation.

Stimuli and procedure

The stimuli and procedure are illustrated in Fig. 1. Stimuli were back-projected from a video projector onto a screen at a viewing distance of 120 cm. The screen was gray (5.0 cd/m2) and contained a continuously visible fixation point at the center. The imperative stimulus was a 2 × 2° square centered at the fixation point. Each square was divided into four 1 × 1° quadrants, each filled with a different color selected from a set of six colors (red, green, blue, yellow, brown, pink; luminances between 53 and 78 cd/m2). The colors of the quadrants were selected at random, without replacement, with the constraint that one of the quadrants was red (the target color) on 10% of trials.



View larger version (7K):
[in this window]
[in a new window]
 
Fig. 1. Principial trial structure. While continuously fixating the the center dot, subjects were required to discriminate the presence or absence of the target color by alternative button presses (discriminative-response condition) or to press a button for each imperative stimulus, regardless of the presence or absence of the target color (simple-response condition).

Subjects performed simple- and discriminative-response tasks in separate blocks of trials. In the discriminative-response condition, subjects discriminated the presence of the red target color, pressing a button with one hand if red was present in the imperative stimulus and pressing a button with the opposite hand if the target was absent. The assignment of responses to hands was counterbalanced across subjects. In the simple-response condition, subjects were required to press a button for each imperative stimulus, regardless of the presence or absence of the target color. For each subject, the response hand used in the simple-response condition was the same as the response hand used on the red-absent trials in the discriminative-response condition. In both conditions, subjects were instructed to respond as quickly as possible without making errors.

Each stimulus was presented for 100 ms, with a stimulus onset asynchrony that varied randomly between 1,300 and 1,500 ms (rectangular distribution). On 10% of trials, the imperative stimulus was replaced by a 100-ms stimulus-free interval; subjects were instructed to make no response on these catch trials.

Subjects performed eight trial blocks in each condition, alternating between the simple- and discriminative-response conditions; half of the subjects started with the simple-response condition and half with the discriminative-response condition. Each block consisted of 300 trials, including 30 catch trials, 30 red-present trials, and 240 red-absent trials. Thus each subject received a total of 1,920 target-absent trials; this very large number of trials was intended to yield a high signal-to-noise ratio.

Recording and analysis

The MEG and electroencephalographic (EEG) signals were recorded simultaneously using a BTi Magnes 2500 whole-head MEG system (Biomagnetic Technologies) with 148 magnetometers for the MEG and an electrode cap (Electrocap International) in conjunction with a 32-channel Synamps amplifier (NeuroScan) for the EEG. Electrode locations were chosen according to standard electrode montage of the American Electroencephalographic Society (1994) (Fpz, Fz, Cz, Pz, Oz, Iz, Fp1, Fp2, F7, F8, F3, F4, FC1, FC2, T7, T8, C3, C4, CP1, CP2, P7, P8, P3, P4, PO3, PO4, PO7, PO8, IN3, IN4). High resolution anatomical MR scans (GE Signa Horizon LX 1.5 T Neuro-optimized MR) were acquired during a separate session using a quadrature head coil [3-dimensional (3D) spoiled gradient echo sequence, TR 24 ms, TE 8 ms, flip angle 24°, voxel size 1 × 1 × 1.5 mm, matrix dimensions 256 × 256 × 124].

The MEG and EEG signals were filtered with a band-pass of DC-50 Hz and digitized with a sampling rate of 254 Hz. The MEG was also subjected to an on-line noise reduction process that removes a weighted sum of environmentally induced magnetic noise measures (first-order spatial gradients of the field) recorded by eight remote reference channels that do not pick up brain activity (Robinson 1989). Artifact rejection was performed off-line by discarding epochs with peak-to-peak amplitudes exceeding a threshold of 3.0 × 10-12 T for the MEG and 100 µV for the EEG.

For each subject, a Polhemus 3Space Fastrak system was used to measure the 3D of the EEG electrodes and three skull/scalp landmarks (nasion and left and right preauricular points). The locations of these landmarks in relation to the MEG sensor positions were derived on the basis of localization signals provided by five spatially distributed coils attached to the subject's head with a fixed spatial relation to the landmarks. These landmarks, in turn, were matched with the individual subjects' anatomical MR scans.

Analyses were performed on both individual subjects and on a grand average across all subjects. To compute the grand average activity, the coordinate system for each subject was readjusted to the coordinate system of one reference subject, whose anatomical MR scan was used for the grand-average source analyses. This MR scan was, in turn, spatially normalized into the standardized reference frame of Talairach and Tournoux (1988) for the purpose of reporting MEG source localization coordinates.1

Average waveforms for both MEG and EEG were computed for each subject, time-locked to stimulus onset, with a100-ms prestimulus baseline interval. Separate averages were derived for the discriminative- and simple-response conditions. Averages were computed only for imperative stimuli lacking the red target color; the electrophysiological data from target-present stimuli and catch trials will not be considered in this report. The N1 discrimination effect was isolated by computing difference waves in which simple-response waveforms were subtracted from discriminative-response waveforms (these are called the discriminative-simple difference waveforms). This effect was quantified as the mean amplitude in these difference waveforms between 140 and 200 ms, relative to the 100-ms prestimulus baseline. Statistical analyses were performed with repeated-measures ANOVAs, using the Greenhouse-Geisser epsilon correction for nonsphericity when appropriate (Jennings and Wood 1976).

For each subject, source analysis was performed on the discriminative-simple difference waveforms using the multi-modal neuroimaging software Curry 4.0 (Philips Electronics N.V.). For source reconstruction, the MEG and ERP data were combined in a general model to achieve maximum localization power (Fuchs et al. 1998b). Realistic 3D-volume conductor models for each subject were derived by segmenting the individual MR scans into three shells (cortical surface, cerebrospinal fluid space, and bone structure of the scull) using the boundary element method (BEM) (Fuchs et al. 1998a). A distributed source model (a model of the distribution of current over the cortical surface) served for source localization based on the minimum norm least-squares method (MNLS) (Fuchs et al. 1999). In this model, the BEM surface grid of the cortical surface was used as a predefined source compartment. Inherent in the MNLS model is the natural bias toward high gain source locations that would overemphasize superficial source locations. This was compensated by an additional model term that weights the estimated currents to account for the lower gains of deeper dipole components (cf. Curry User Guide, Philips Electronics N.V. p. 151-154). Finally, the regularization parameter that links the model term to the data were determined by the chi 2 criterion relying on the assumption that the data misfit is in the order of the amount of noise in the data. Noise was estimated from baseline magnetic activity within a period of 100 ms preceding stimulus onset.

The same approach to source reconstruction was applied to the grand average MEG and ERP data using the BEM model of the reference subject (subject 8).


    RESULTS
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES

Electrical waveforms and distributions

Figure 2A shows the grand-average ERP waveforms for nontarget stimuli in the simple-response and discriminative-response conditions. The waveforms shown in this figure were recorded from parietal-occipital sites (PO7 and PO8, white circles), averaged across hemispheres. The gray area illustrates the N1-discrimination effect, which consists of greater negativity in the discriminative-response condition relative to the simple-response condition. This effect began at approximately 140 ms and continued until approximately 270 ms. Ritter et al. (1982, 1983) argued that this effect consists of an early phase and a late phase and demonstrated that only the early phase corresponds to discriminative processing per se. The late phase, in contrast, was shown to reflect subsequent processing stages that are more related to stimulus classification and target probability. Moreover, changing discrimination difficulty modulated the later but not the early phase (Ritter et al. 1988). A functional separation into early and late phases was furthermore suggested by differences in scalp topography. In particular, the scalp topography of the later phase differed for physical and semantic discrimination tasks. Hence, the later phase seems to reflect heterogeneous aspects of stimulus processing that go far beyond elementary discriminative processes. Because this report investigates the neural sources underlying earliest discriminative processing, we will focus exclusively on the early phase (140-200 ms), which is indicated by the gray region in Fig. 2A.



View larger version (41K):
[in this window]
[in a new window]
 
Fig. 2. A: grand-average event-related potentials (ERP) waveforms for nontarget stimuli in the simple- and discriminative-response condition at scalp locations showing the maximum discriminative-simple difference. The gray area between waveforms indicates the time range of the N1 component. The shown waveforms were recorded from left (PO7) and right (PO8) occipital electrode sites (white circles) and averaged across hemispheres. The black horizontal bar at the abszissa indicates the time range of significant differences (P < 0.05). B: grand-average MEG waveforms from 2 posterior sensor sites (white circles). The gray area between waveforms indicates the time range of the magnetic analog of the N1 component. The black horizontal bars at the abszissa indicate time ranges of significant differences (P < 0.05).

Figure 3A shows the time course the discriminative-simple difference along with the scalp distribution of the early phase (140-200 ms). This effect had a broad occipital distribution with a larger amplitude over the left hemisphere.



View larger version (48K):
[in this window]
[in a new window]
 
Fig. 3. A: grand-average ERP scalp distribution of the discriminative-simple difference waveform in the time range of the N1 wave. The difference waveform (right) was recorded from 2 posterior electrode sites (PO7/PO8) and averaged across hemipheres. The gray area indicates the time range for which the scalp distribution was computed. B: grand-average magnetic field distribution of the discriminative-simple difference waveform in the time range of the magnetic analog of the N1 component. The difference waveforms (right) were recorded from 2 posterior sensor sites (A100/A125). The gray areas highlight the time window for which the mean magnetic field distribution was computed. Inset: the geometry of overlapping efflux-influx patterns of the magnetic flux that would arise from 2 symmetrical current sources with the same polarity orientation. The black arrows indicate the direction of the generating current sources, the colored arrows indicate the direction of the magnetic flux leaving (red) and entering (blue) the brain.

A repeated-measures ANOVA was performed on the N1 measurements for the simple- and discriminative-response conditions. Three factors were included: condition, anterior-posterior electrode position, and electrode hemisphere (the midline electrode sites were excluded). The larger N1 observed for the discriminative-response condition yielded a significant main effect of condition (F(1,9) = 11.93, P < 0.005). The occipital maximum of this effect yielded a significant 2-way interaction between condition and anterior-posterior electrode position (F(1,9) = 13.8, P < 0.005).

Magnetic waveforms and distributions

Figure 2B illustrates the grand-average MEG waveforms from two posterior sensor sites (A100, A125). The gray areas between the simple- and discriminative-response waveforms highlight the magnetic analog of the N1 discrimination effect. Downward deflections indicate that the magnetic flux is leaving the head (an efflux) and upward deflections indicate that the magnetic flux is entering the head (an influx). The magnetic analog of the N1 wave consisted of an efflux over the left hemisphere and an influx over the right hemisphere, and the magnitude of these fluxes was greater for the discriminative-response condition than for the simple-response condition (just as the magnitude of the electrical response was greater for the discriminative-response condition). This is further illustrated in Fig. 3B, which shows the time-course and distribution of the mean magnetic field for the discriminative-simple difference waveforms. The gray areas highlight the time range of the early phase of the discrimination effect (140-200 ms), which was the focus of the present analyses. Separate ANOVAs were performed using the data from the left and right posterior sensor sites drawn in white in Fig. 2B, with a single factor of condition (simple vs. discriminative response). This ANOVA yielded a significant main effect of condition at both the left- and right-hemisphere sites (left: F(1,9) = 7.64, P < 0.05; right F(1,9) = 6.93; P < 0.05).

In the field distribution map shown in Fig. 3B, red lines indicate efflux from the head and blue lines indicate influx into the head. Note that, unlike the ERP voltage maps, the MEG maps show opposite-polarity effects over the left and right hemispheres as would be expected due to the physics of the magnetic signal. More specifically, regions of efflux and influx were present over the left and right occipital lobes, respectively. These regions were separate by a wide transition region---marked with a dashed ellipse---that exhibited very little net flux. This pattern is consistent with the presence of two mirror-symmetrical current sources---each producing an efflux and an influx---that are spatially arranged such that the efflux of one cancels the influx of the other (see Fig. 3B, inset, which illustrates the overlapping efflux-influx pattern in a schematic manner). That is, a left occipital current source may produce the efflux observed over the left hemisphere along with a midline influx, and a right occipital current source may produce the influx observed over the right hemisphere along with a midline efflux. The influx and efflux at the midline would then cancel, yielding the observed broad region of little net flux. This would also explain the observation of an efflux over the left hemisphere and an influx over the right hemisphere, which would be predicted for current sources in these locations that have the same polarity orientation. Note, current sources with the same polarity orientation would be expected for foveal stimulation as has been used in this experiment. This is because visual up-stream projections and their top-down modulatory projections would enter into homologue cortical regions given rough symmetry between hemispheres. Hence, neural currents arising from mirror image cortical regions would also display mirror symmetry compatible with the two negative maxima of the observed electric field (Fig. 3A), and the magnetic flux orthogonal to these currents would produce overlapping efflux-influx patterns as illustrated in Fig. 3B, inset, consistent with our observed pattern.

Current density estimates

To estimate the cortical distribution of electrical currents that give rise to the magnetic and electric field distributions, the discriminative-simple difference waveforms from both the EEG and MEG recordings were subjected to a compound distributed source analysis (see METHODS).

Figure 4A shows distributed-source estimates (140-200 ms) for each subject and the grand average in left-hemisphere, back, and right-hemisphere views.2 Note that the plots are scaled differently for each subject to allow optimal illustration of the source distribution. The grand-average estimates show a strong left inferior occipito-temporal source and a somewhat weaker right inferior occipito-temporal source. For both hemispheres, this activity also spread weakly into more anterior portions of the inferior temporal lobes. The left occipito-temporal source was clearly evident in 9 of the 10 individual subjects (all except 6), and the right occipito-temporal source tended to be weaker and more variable. The more anterior inferior temporal activity that was evident in the grand average was present in some subjects (e.g., 6 and 8) but was not clearly present in many other subjects. Some prefrontal activity was also evident in a few of the subjects (e.g., 2, 5, and 8).



View larger version (53K):
[in this window]
[in a new window]
 
Fig. 4. Distributed-source estimates from the discriminative-simple difference waveforms (EEG and MEG, 140-200 ms) for each individual subject (A) and the grand average (B) in left-hemisphere, back, and right-hemisphere views. To allow optimal illustration of the source distribution, the plots are scaled differently for each subject.

For each subject, we computed the coordinates of the location with the greatest current density in both the left and right hemispheres, using the reference frame of Talairach and Tournoux (Talairach and Tournoux 1988). These locations are shown in Fig. 5, superimposed on the reconstructed brain of the reference subject. The coordinates are also provided in Table 1, along with information about signal-to-noise ratio and explained variance. These maxima are located in the inferior occipital lobe or occipito-temporal junction for every subject except one (6). This high level of consistency indicates that the localization procedure was reasonably accurate and was not substantially distorted by noise. Thus it is reasonable to conclude that the N1 discrimination effect largely reflects activity in inferior occipital or occipito-temporal cortex.


                              
View this table:
[in this window]
[in a new window]
 
Table 1. Signal-to-noise ratios in the source reconstruction interval (140-200 ms) of MEG and EEG data for the grand average and the individual subjects


    DISCUSSION
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES

The goal of this study was to localize---in both time and space---the effects of top-down control over discriminative processing. As in previous ERP studies (Ritter et al. 1982, 1988; Vogel and Luck 2000), we observed a greater negativity in the ERP waveforms in the time range of the N1 wave for the discriminative-response condition than for the simple-response condition. This effect was largest over occipital cortex, with greater activity over the left hemisphere. This distribution is consistent with previous reports of the N1 discrimination effect. The MEG waveforms also included a larger response in the N1 latency range for the discriminative-response condition than for the simple-response condition, and this effect was again largest at left posterior sites. Thus the intention to perform a discrimination influences both electrical and magnetic responses within 150 ms of stimulus onset.

The timing of the N1 discrimination effect appears to be similar to the timing of the effects of discriminative processing observed by Spitzer and Richmond (1991) in macaque inferotemporal cortex. It is also similar to the timing of some previously observed ERP effects that were related to visual discriminations. For example, Thorpe et al. (1996) recorded ERPs while subjects viewed real-world photographs that either did or did not contain an animal, and they found an enhanced negativity for animal-containing photographs starting around 150 ms poststimulus (see also Fabre-Thorpe et al., 2001). Although that effect was largest at frontal electrode sites, the timing was similar to the present N1 discrimination effect. Other studies have also shown that faces and words elicit differential ERP responses compared with other stimuli within 150 ms of stimulus onset (e.g., Bentin et al. 1996; Eimer 1998; Jeffreys 1989; Schendan et al. 1998), and intracranial recordings have yielded similar effects in regions of the posterior fusiform gyrus (Allison et al. 1994). Thus different varieties of complex visual stimuli produce differential activity by 150 ms poststimulus, and the intention to perform a discrimination also produces differential activity in this time range. It therefore seems plausible that the N1 discrimination effect reflects a top-down modulation of stimulus-driven discrimination processes.

The discriminative-response condition was more difficult than the simple-response condition, and it is therefore important to consider whether the observed ERP and MEG effects simply reflect a higher level of arousal. This possibility was addressed experimentally in a previous ERP study (Vogel and Luck 2000) that used nearly identical experimental parameters (stimulus duration, stimulus onset asynchrony (SOA) randomization, instruction for fast and accurate responses; the stimuli, however, were sets of 5 colored letters rather than single-colored squares). In addition to the discriminative- and simple-response conditions used in the present study, the previous study assessed the contribution of arousal by including an additional simple-response condition in which response speed was highly stressed and feedback about RT was given. This speed-stressed condition led to faster RTs and an increase in P1 amplitude, consistent with an increased level of arousal, but the posterior N1 wave was actually reduced in amplitude. Thus increased arousal does not lead to an increased N1 wave.



View larger version (42K):
[in this window]
[in a new window]
 
Fig. 5. Locations showing maximum current density in both the left and right hemispheres of each subject (1-10). Locations are based on Talairach/Tournoux-coordinates (Talairach and Tournoux 1988) and superimposed on the reconstructed brain of the reference subject.

Although onset latency and source localization suggest that the N1 discrimination effect reflects top-down modulation of sensory processing in the ventral stream, the actual computational function of this modulation remains to be explained. The present findings cannot provide an in-depth answer to this more fundamental question, but we will briefly discuss how the present results are related to a more general modeling framework of top-down cortical processing that has been advanced recently. The predictive coding model (Rao and Ballard 1997, 1999) proposes that top-down-mediated neural responses in the visual cortex mainly reflect the interaction (discrepancy) between the higher levels' predictions about the stimulus features and the actual features registered by bottom-up visual processing. Along these lines, the instruction to discriminate the stimuli in the present study would entail feature (color)-specific predictions to be built up in the cortical regions we have identified, whereas the simple task would not necessitate such predictions. The observed neural activity may reflect the interaction between the bottom-up sensory information and these predictions in the discriminative-response task.

In the present study, the neural generator sources of the N1 discrimination effect were estimated by combining ERP and MEG distributions with structural MR images. There was some variability across subjects in the overall pattern of estimated cortical distributions, but the estimated maximum site of activation was highly similar across both hemispheres and across all subjects except one. This maximum was located in inferior occipital or occipito-temporal cortex, near the border between areas 19 and 37. Previous neuroimaging studies have also shown that active processing of color information leads to enhanced activity in this general region. For example, Corbetta et al. (1990, 1991) compared a passive condition similar to our simple-response condition with focused attention conditions in which subjects performed color, form, and velocity discriminations; an additional divided-attention condition was also included in which subjects performed color, form, and velocity discriminations simultaneously. When the passive condition was subtracted from the attend-color condition, significant activation was observed in the left lingual gyrus. When the divided-attention condition was subtracted from the attend-color condition, a broadband of activation was observed in lateral occipital cortex, particularly in the left hemisphere. The general location and lateralization of these effects are similar to the maximum estimated activity observed in the present study, and they may reflect exactly the same neural processes. Thus the present results suggest that previously observed neuroimaging effects may reflect, in part, activity from approximately 140-200 ms poststimulus.

Spatial attention also influences neural activity in this time range and in this region of cortex. Specifically, attended-location stimuli elicit enhanced N1 waves (e.g., Eimer 1994; Mangun and Hillyard 1990; Van Voorhis and Hillyard 1977), and attended-location stimuli elicit enhanced activity in lateral occipital cortex (e.g., Kastner et al. 1998; Tootell et al. 1998; Woldorff et al. 1997). Moreover, spatial attention does not appear to influence the N1 wave unless subjects perform a discrimination at the attended location (Mangun and Hillyard 1991). Together with the present results, these findings suggest that discriminative processes in human occipital cortex begin to operate within 150 ms poststimulus and are influenced by both the overall intention to perform a discrimination and by spatial attention.


    ACKNOWLEDGMENTS

We are grateful to J. Heinrich for technical support and A. Schoenfeld for helpful discussions and comments on earlier versions of the manuscript.

This research was supported by grant RG0136 from the Human Frontier Science Program (G. R. Mangun, principal applicant), grant He1531/3-5 from the Deutsche Forschungs-Gemeinschaft (H.-J. Heinze, principal applicant), grant MH-56877 from the National Institute of Mental Health (S. J. Luck, principal investigator), and grant SBR 98-09126 from the National Science Foundation (S. J. Luck, principal investigator).


    FOOTNOTES

Address for reprint requests: J.-M. Hopf, Dept. of Neurology II, Otto-von-Guericke-University, D-39120 Magdeburg, Germany, Leipziger Str. 44, D-39120 Magdeburg, Germany (E-mail: jens-max.hopf{at}medizin.uni-magdeburg.de).

1 The following steps were applied to transform the cortical surface of individual brains into the reference space of Talairach and Tournoux (1988). 1) The individual brain was first roughly centered into the Talairach-space using the extensions of the subject's brain on the principal axes (x, y, z) of the Talairach AC/PC-based system. 2) (x-y-z) extensions of 260 equidistantly spaced locators were then obtained from the surface-envelope of the reference brain of Talairach and Tournoux (1988) (Data from all 3 slice-orientations were taken into account). 3) The extensions of an equivalent set of 260 locators were obtained from the surface of the individual brain. 4) The deviation between corresponding sets of locators was minimized by deforming the subject's individual cortex surface using linear scaling and rotation in 3 principal directions (for rotation, additional locators in the gap between the hemispheres were also used).

2 An MR scan was not available for subject 5, and the BEM of the reference subject (8) was therefore used as an approximation for calculating the distributed source estimates for this subject.

Received 18 October 2001; accepted in final form 10 June 2002.


    REFERENCES
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES

0022-3077/02 $5.00 Copyright © 2002 The American Physiological Society



This article has been cited by other articles:


Home page
Cereb CortexHome page
C. N. Boehler, T. F. Munte, R. M. Krebs, H. -J. Heinze, M. A. Schoenfeld, and J. -M. Hopf
Sensory MEG Responses Predict Successful and Failed Inhibition in a Stop-Signal Task
Cereb Cortex, January 1, 2009; 19(1): 134 - 145.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
M. Rose, C. Schmid, A. Winzen, T. Sommer, and C. Buchel
The Functional and Temporal Characteristics of Top-down Modulation in Visual Selection
Cereb Cortex, September 1, 2005; 15(9): 1290 - 1298.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
K. Kessler and M. Kiefer
Disturbing Visual Working Memory: Electrophysiological Evidence for a Role of the Prefrontal Cortex in Recovery from Interference
Cereb Cortex, July 1, 2005; 15(7): 1075 - 1087.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
G. Pourtois, D. Grandjean, D. Sander, and P. Vuilleumier
Electrophysiological Correlates of Rapid Spatial Orienting Towards Fearful Faces
Cereb Cortex, June 1, 2004; 14(6): 619 - 633.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
J.-M. Hopf, K. Boelmans, M. A. Schoenfeld, S. J. Luck, and H.-J. Heinze
Attention to Features Precedes Attention to Locations in Visual Search: Evidence from Electromagnetic Brain Responses in Humans
J. Neurosci., February 25, 2004; 24(8): 1822 - 1832.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (40)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Hopf, J.-M.
Right arrow Articles by Luck, S. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Hopf, J.-M.
Right arrow Articles by Luck, S. J.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Visit Other APS Journals Online