JN Fuel your research with LabChart
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Neurophysiol 92: 622-629, 2004. First published February 18, 2004; doi:10.1152/jn.00974.2003
0022-3077/04 $5.00
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
92/1/622    most recent
00974.2003v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (26)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Pinsk, M. A.
Right arrow Articles by Kastner, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Pinsk, M. A.
Right arrow Articles by Kastner, S.

REPORT

Push-Pull Mechanism of Selective Attention in Human Extrastriate Cortex

Mark A. Pinsk, Glen M. Doniger and Sabine Kastner

Department of Psychology, Center for the Study of Brain, Mind, and Behavior, Princeton University, Princeton, New Jersey 08544

Submitted 9 October 2003; accepted in final form 11 February 2004


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Selective attention operates in visual cortex by facilitating processing of selected stimuli and by filtering out unwanted information from nearby distracters over circumscribed regions of visual space. The neural representation of unattended stimuli outside this focus of attention is less well understood. We studied the neural fate of unattended stimuli using functional magnetic resonance imaging by dissociating the activity evoked by attended (target) stimuli presented to the periphery of a visual hemifield and unattended (distracter) stimuli presented simultaneously to a corresponding location of the contralateral hemifield. Subjects covertly directed attention to a series of target stimuli and performed either a low or a high attentional-load search task on a stream of otherwise identical stimuli. With this task, target-search-related activity increased with increasing attentional load, whereas distracter-related activity decreased with increasing load in areas V4 and TEO but not in early areas V1 and V2. This finding presents evidence for a load-dependent push-pull mechanism of selective attention that operates over large portions of the visual field at intermediate processing stages. This mechanism appeared to be controlled by a distributed frontoparietal network of brain areas that reflected processes related to target selection during spatially directed attention.


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Converging evidence from single-cell physiology studies in monkeys and functional brain mapping studies in humans suggest that selective attention operates in extrastriate visual cortex by enhancing neural activity evoked by attended stimuli and by counteracting suppressive influences of nearby distracter stimuli that compete for neural representation (Desimone and Duncan 1995Go; Kastner and Ungerleider 2000Go; Tsotsos 1990Go). As a result, the selected information is preferentially processed and the unwanted information from nearby distracters is effectively filtered out. This filter mechanism that occurs most strongly at the level of the receptive field (RF) is compatible with the idea that selective attention to a stimulus causes the RF to shrink around the attended stimulus, thereby leaving the unattended stimuli at nearby locations outside the RF (Connor et al. 1996Go; Moran and Desimone 1985Go; Reynolds and Desimone 1999Go). Importantly, this mechanism provides a neural correlate for an attentional "spotlight" that operates across circumscribed regions of visual space (Brefczynski and DeYoe 1999Go; Eriksen and James 1986Go; Tootell et al. 1998Go). The size of the spotlight may be flexibly scaled to the different RF sizes of early and intermediate visual areas.

Less is known about the neural representation of unattended stimuli outside the focus of attention. Results from neuroimaging and behavioral studies suggest that the processing of unattended stimuli depends on the degree to which attentional resources are engaged by an attended stimulus (Lavie and Tsal 1994Go; Rees et al. 1997Go). For example, Rees and colleagues (1997)Go demonstrated that activation in area MT evoked by unattended moving stimuli was abolished when subjects performed a linguistic task of high attentional load relative to a low-load version of the task at fixation. In contrast, results from patients suffering from visuospatial hemineglect have shown that neural responses evoked by faces and object stimuli presented to the neglected hemifield were similar compared with those evoked by the same stimuli presented to the intact hemifield (Rees et al. 2000Go; Vuilleumier et al. 2001Go), suggesting that unattended stimuli undergo processing to advanced stages of category-specific object representations.

We have investigated the neural fate of unattended stimuli in an fMRI study in which attended (target) stimuli were presented to the periphery of the upper right quadrant of the visual field while unattended (distracter) stimuli were presented to a corresponding location of the contralateral hemifield. Thereby, neural activity evoked by target and distracter stimuli could be dissociated in visual areas with a quadrant or hemifield representation within the spatial resolution limits of functional magnetic resonance imaging (fMRI). Target stimuli evoked activity in areas of left visual cortex, whereas distracter stimuli evoked activity in areas of right visual cortex. Subjects covertly directed attention to a series of sequentially presented target stimuli and performed either a low attentional load or a high attentional load search task while irrelevant distracter stimuli appeared in the contralateral hemifield. In both search tasks, stimuli were identical but appeared in different sequence. For the target-search-related activity, we predicted that neural activity should increase with increasing attentional load (Ress et al. 2000Go; Spitzer and Richmond 1991). For the distracter-related activity, the prediction was less clear, and several different possibilities were considered. First, neural responses evoked by distracter stimuli in the contralateral hemifield may be suppressed in ventral extrastriate cortex depending on the attentional load of the task as previously shown in dorsal extrastriate cortex (Rees et al. 1997Go). Second, neural responses evoked by distracter stimuli may not be affected in terms of attentional suppression as suggested by studies of patients suffering from visuospatial hemineglect (Rees et al. 2000Go; Vuilleumier et al. 2001Go). And third, both mechanisms may operate at different processing levels. With our task, we found that target-related activity was enhanced to a similar degree and thus independent of attentional load in early areas V1 and V2 but increased depending on attentional load in areas V4 and TEO. Distracter-related activity was not affected by load in early visual cortex but decreased with increasing load in V4 and TEO. This finding presents evidence for a load-dependent push-pull mechanism of selective attention that operates over large portions of the visual field at intermediate processing levels. This mechanism appears to be controlled by a distributed frontoparietal network of brain areas that reflected target selection processes during spatially directed attention.


    METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Subjects, visual stimuli, and tasks

Nine subjects (5 males; age: 22-38 yr) participated in the study, which was approved by the Institutional Review Panel of Princeton University. All subjects participated in the behavioral experiments; seven of them participated in the scanning experiments. Subjects were in good health with no past history of psychiatric or neurological diseases and gave their informed written consent. Subjects had normal or corrected-to-normal visual acuity.

Colorful complex images (each 2 x 2° in size) were used that have previously been shown to activate human ventral visual cortex (Kastner et al. 1998Go, 1999Go). Pairs of stimuli were faded into each other by superimposing the stimuli and varying their contrast levels. Thereby, a wide range of ambiguous stimuli that were perceptually difficult to discriminate was generated. Two examples are given in Fig. 1A. The stimulus to the left contains 100% stimulus A and 0% stimulus B, whereas the stimulus to the right contains 0% stimulus A and 100% stimulus B. The two stimuli in between contain 70% stimulus A/30% stimulus B and 30% stimulus A/70% stimulus B, respectively. Eight stimuli from a given pair (100/0, 80/20, 70/30, 60/40, 40/60, 30/70, 20/80, and 0/100%) were presented sequentially and in random order at 9.5° eccentricity in the right upper quadrant. The 50/50% stimulus was presented repeatedly as the distracter stimulus at a corresponding location in the opposite hemifield. Stimuli were presented for 250 ms followed by a 1,000-ms blank period in blocks of 20 s. Subjects performed either a low attentional load or a high attentional load search, viewing the same stimuli but in different sequence (Fig. 1B). Both search tasks required subjects to covertly direct attention to the target location while maintaining fixation and to discriminate each of the sequentially presented stimuli. In the low-load condition, subjects counted the occurrence of a nonambiguous (=100/0%) stimulus following its initial presentation (Fig. 1B, see <-). In the high-load condition, subjects counted the occurrences of stimuli that were identical to the previously shown stimulus (Fig. 1B, see <-). This experimental design was aimed at varying parametrically mainly the perceptual processing load (and less so the cognitive load) at the target location, while keeping all other parameters, notably the information processed at the target location, constant. Presentations of target and distracter stimuli were also tested in a fixation-task condition during which subjects counted letters at fixation and ignored both stimuli (for details on the letter counting task, see Kastner et al. 1998Go, 2001Go). Presentation blocks during which either low- or high-load search or fixation tasks were performed were interleaved with blank periods of 14 s during which subjects performed the fixation task. It should be noted that differences in activity evoked at the target and distracter locations during the different attention tasks could not be attributed to fMRI adaptation due to repeated stimulus presentation in a block design. Sensory presentation conditions were kept constant during the different tasks, and only attentional processing load was manipulated. Therefore any fMRI adaptation would have affected visually evoked responses during the different conditions similarly. The blocks with directed attention to the display were indicated by a marker, an oriented line pointing to the target location, which was presented briefly close to fixation. After each scan, subjects reported the number of detected images or matches that they had counted at the target location in each attended block. Presentation blocks during which subjects performed search or fixation tasks were counterbalanced across the scanning session. Differences in processing load between the two search tasks were tested in behavioral sessions outside the scanner. Procedures during behavioral testing were identical to scanning procedures; only subjects were to respond by pressing a button instead of counting.



View larger version (73K):
[in this window]
[in a new window]
 
FIG. 1. Experimental design. A: pairs of complex images (2 x 2° in size) were superimposed at varying contrast levels (as indicated for the 4 stimuli) to provide a range of ambiguous stimuli that were perceptually difficult to discriminate. B: a series of 16 attended (target) stimuli (6 shown for each load task) from a given pair were presented sequentially at 9.5° eccentricity to the right upper quadrant, while unattended (distracter) stimuli were presented to a corresponding location of the contralateral hemifield. Stimuli were presented for 250 ms followed by a 1,000-ms blank period in blocks of 20 s. Subjects performed either a low attentional load search of a nonambiguous stimulus in a 0-back task or a high attentional load search, which required them to distinguish between stimuli in a 1-back task. In both conditions, the same stimuli were presented but in different sequences. <-, correctly identified stimuli in the 2 tasks.

 
Eye movements were controlled during behavioral testing sessions. Display and viewing conditions were calibrated to match the conditions of the scanner experiments. Head position and viewing distance were kept constant with a chin rest. Subjects' eye positions were monitored at a sampling rate of 60 Hz by a remote infrared eye-tracking system (model 504, Applied Science Laboratories, Bedford, MA). Eye-position data were output to disk in a standard NTSC (261 x 240) coordinate system for off-line analysis. Data of seven subjects were converted from NTSC coordinates to degrees of visual angle (dva) that deviated from fixation. Fixation was defined in each run as the average eye position during the blank periods. The first blank period was discarded from each run for the two analyses performed. Horizontal and vertical eye positions were both sharply peaked and centered on the fixation cross. For the first analysis, ANOVA tests were performed on the average eye position during each condition to determine if there was any relation between overall eye position and task condition. No significant differences in eye position were found for either the horizontal or vertical dimensions. Second, to check for the presence of saccades, the eye traces for each subject were imported to ILAB v.3.57 eye movement analysis software (Gitelman 2002Go) where blinks were removed using a pupil size and location filter and a region of interest (radius = 1.5 dva) was centered around fixation. On average, <1 saccade was detected per subject as defined by any sample that left the region of interest. The times and end points for these rare eye movements did not relate to the task conditions. Of all the eye samples, 99.88% remained within the region of interest.

Data acquisition

Images were acquired with a 3 Tesla head scanner (Allegra, Siemens, Erlangen, Germany) using a standard head coil. Subjects were tested in two separate scanning sessions, each lasting 2 h. Functional images were taken with a gradient echo, echo planar sequence (TR = 2 s, TE = 30 ms, flip angle = 90°, 64 x 64 matrix). In session 1, 16 contiguous, coronal slices (thickness = 4 mm, gap = 1 mm, FOV = 192 x 192 mm) were acquired in 12 series of 95 images each, covering activation areas in occipital, posterior temporal, and parietal cortex. In session 2, 22 contiguous axial slices were taken starting from the top of the brain (thickness = 4 mm, gap = 1 mm, FOV = 192-220 x 192-220 mm) and covering activation areas in frontal and parietal cortex. Seven subjects were scanned in session 1; five of the seven subjects were scanned in session 2. For each subject, retinotopic mapping was performed in a separate scanning session. Echo-planar images were compared with a co-aligned high-resolution anatomical scan of each subject's brain taken in the same session (FLASH, TR = 150 ms, TE = 4.6 ms, flip angle = 90°, 256 x 256 matrix). Another high-resolution anatomical scan of the entire brain (MPRAGE sequence; TR = 11.1 ms; TE = 4.3 ms; flip angle = 8°; matrix 256 x 256 voxels; 3-dimensional resolution, 1 mm3) was taken to perform spatial normalization and to create cortical surface reconstructions using BrainVoyager software (Brain Innovation, Maastricht, The Netherlands).

Visual stimuli were projected onto a translucent screen located at the back of the scanner bore at a distance of 60 cm from the subjects' eyes. Stimuli were viewed from inside the bore of the magnet via a mirror system attached to the head coil, providing a maximal visual angle of 28 x 36°.

Data analysis

Between-scan head movements were corrected by aligning each image to a reference image obtained in the middle of the session. Statistical analyses were restricted to brain voxels with adequate signal intensity (average intensity of >20% of the maximum value across voxels). The first five images of each scan were excluded from analysis. Statistical analyses were performed using multiple regression in the framework of the general linear model (Friston et al. 1995Go) with National Institutes of Health functional imaging data analysis program (FIDAP) software. Square-wave functions matching the time course of the experimental design were defined as effects of interest in the multiple regression model. The square-wave functions contrasted epochs of visual presentations versus blank periods and epochs of visual presentations during search versus fixation tasks. Activated voxels in visual cortex were identified based on the first effect of interest; activated voxels in frontal and parietal cortex were identified based on the second effect of interest. For each effect of interest, square-wave functions were convolved with a Gaussian model of the hemodynamic response (lag: 4.8 s, dispersion: 1.8 s) to generate idealized response functions, which were used as regressors in the regression model. Additional regressors were included in the model to partially factor out variance due to between-run changes in mean intensity and within-run linear changes. Statistical maps were thresholded at a Z score of 2.33 (P < 0.01) (degrees of freedom corrected for correlation of adjacent time points). Regions of interest (ROIs) were located by identifying clusters of seven or more contiguous statistically significant voxels. Statistical significance (P < 0.01) of these clusters was assessed using random Gaussian field methods based on their spatial extent and peak height (Friston et al. 1994Go; Poline et al. 1997Go). Statistically significant clusters of voxels were overlaid on structural T1-weighted scans taken in the same session and in the same plane. Activity in visual cortex was assigned to retinotopically organized areas based on retinotopic mapping as described in detail elsewhere (Kastner et al. 2001Go). Briefly, areas V1, V2, and VP were identified by determining the alternating representations of the vertical and horizontal meridians, which form the borders of these areas. Areas V4 and TEO were identified by their characteristic upper (UVF) and lower visual field (LVF) topography. The UVF and LVF are separated in V4 and located medially and laterally on the fusiform gyrus, whereas this separation is not seen in the region anterior to V4, which we term TEO. Superior parietal lobule (SPL, intraparietal sulcus (IPS), and inferior parietal lobule (IPL) in parietal cortex and frontal and supplementary eye fields (FEF and SEF) in frontal cortex, which are part of a distributed spatial attention network, were identified by their reported locations in the literature (for meta-analyses, see Kastner and Ungerleider 2000Go; Pessoa et al. 2002Go). All time course analyses were performed on unsmoothed data. Time series of fMRI intensities, presented as group data, were averaged over all voxels in a given ROI, normalized to the mean intensity obtained during the control condition. For each subject, the 10 peak intensities of the fMRI signal obtained during a given presentation block and task were averaged, resulting in mean signal changes. These values were further quantified by defining an attentional modulation index (AMI), which normalizes the attention effects relative to the fixation task condition, in which target and distracter stimuli were both ignored [AMIHigh= (ATTHigh – FIX)/ (ATTHigh + FIX) where ATTHigh and FIX refer to averaged responses during high-load search or fixation condition; accordingly, an AMILow was computed for responses during low-load search]. Statistical significance of time series data were determined by a random effects analysis using one-sample, one-tailed t-test; reported P values refer to these statistical tests, if not specified otherwise. Interaction terms are only reported when significant. t-test and ANOVAs were calculated to assess significance for behavioral data and activated volumes. For each subject, statistical maps and structural images were transformed into Talairach space (Talairach and Tournoux 1988Go) using BrainVoyager software.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Differences in attentional load between the two search tasks (see Fig. 1B) were established in behavioral experiments outside the scanner. Subjects (n = 9) detected significantly more targets during the low-load than during the high-load search task and made fewer errors (0.4 ± 0.02 vs. 20.6 ±1.8%; ANOVA, main effect of task: P < 0.001). Reaction times were significantly longer in the high-load condition compared with the low-load condition (446 ± 19 vs. 567 ± 29 ms; ANOVA, main effect of load condition: P < 0.01). Taken together, behavioral performance indicated that the processing load was effectively manipulated by the two search tasks. Behavioral performance in the search tasks was not different in the presence and in the absence of distracters in the contralateral hemifield, suggesting that distracter presentations did not interfere with search task performance.

Complex images presented at the target location evoked significant activity as compared with blank presentations in visual areas V1, V2, VP, and V4 of the left hemisphere in all subjects (n = 7) and area TEO in six subjects. As the border between V2 and VP could not be distinguished unequivocally in some of the subjects, the combined region will henceforth be referred to as V2. Stimuli presented at the distracter location significantly activated areas V1 and V2 of the right hemisphere in all subjects, area V4 in five subjects, and area TEO in two subjects. The locations of the activations were in the ventral parts of these areas, consistent with the locations of stimuli in the upper visual field. This is illustrated for a single subject in Fig. 2A; in this subject, the upper visual field representation of dorsal area V3A was also activated by stimuli presented at the target location. Mean activated volumes were not different in left and right V1 and V2 (520 mm3 compared with 546 mm3 in V1; 642 mm3 compared with 617 mm3 in V2) but were significantly smaller in right than in left V4 and TEO (1,369 mm3 compared with 581 mm3 in combined V4 and TEO; t-test, P < 0.001) with a significant interaction of activated hemisphere and area (ANOVA, main effect of hemisphere: P < 0.01; main effect of area: P < 0.05; interaction hemisphere x area: P < 0.01).



View larger version (112K):
[in this window]
[in a new window]
 
FIG. 2. Activated areas in visual, parietal, and frontal cortex. A: areas in visual cortex activated by presentations of complex images relative to blank periods presented on a flattened surface reconstruction of a single subject's occipital cortex. Area boundaries as identified by retinotopic mapping are indicated by - - - (horizontal meridian representation) and — (vertical meridian representation) lines. Target-related activity (left) was found in areas V1, V2, VP, V4, TEO, and V3A of the left hemisphere. Distracter-related activity (right) was found in V1, V2, VP, and V4 of the right hemisphere. {star}, regions of foveal representations. B: areas in frontal [frontal eye field (FEF)] and parietal [superior parietal lobule (SPL), intraparietal sulcus (IPS), inferior parietal lobule (IPL)] cortex activated during search tasks relative to the fixation task, thereby revealing regions involved with the spatial attention tasks at the target location. Activations are depicted on inflated left and right hemispheres of a single subject.

 
An analysis of the time series of the fMRI signal (Fig. 3) and the mean signal changes (Fig. 4A) averaged across subjects showed that in left V1 and V2 target search-related activity was enhanced but to a similar degree during low- and high-load search relative to the fixation task condition during which the same stimuli were ignored. Mean fMRI signals increased in V1 from 1.21 to 1.53% during low-load search and to 1.41% during high-load search (Fig. 4A; main effect of attention, P < 0.01; main effect of attentional load: NS) and in V2 from 1.25 to 1.44 and 1.58%, respectively (Fig. 4A; main effect of attention, P < 0.01; main effect of attentional load: NS). In left V4 and TEO (Figs. 3 and 4A), target search-related activity was also enhanced relative to the control condition (main effect of attention: P < 0.001 for V4, TEO), but the attentional response enhancement increased with increasing attentional load (main effect of attentional load: P < 0.05 for V4, TEO). Mean fMRI signals increased from 1.38 to 1.61% during low-load search and to 1.89% during high-load search in V4 and from 1.12 to 1.41 and 1.79%, respectively, in TEO (Fig. 4A). Hence, in V4 and TEO, fMRI signals evoked by target stimuli reflected the subjects' behavioral performance.



View larger version (30K):
[in this window]
[in a new window]
 
FIG. 3. Time series of functional magnetic resonance imaging (fMRI) signals in visual cortex. Time series of fMRI signals for target-search-related activity and distracter-related activity in combined areas V1/V2 and V4/TEO averaged across scans and subjects. Time courses are shown during the fixation task, when both stimuli were ignored (FT), and during the low-load (LLS) and high-load search (HLS) tasks. In V1 and V2, target-related activity was enhanced for attended relative to fixation conditions to a similar degree during the 2 search task conditions. Distracter-related activity was not affected by the load manipulation. Conversely, in V4 and TEO, target-related activity was greater during the high-load as compared with the low-load search condition; distracter-related activity was suppressed depending on attentional load.

 


View larger version (24K):
[in this window]
[in a new window]
 
FIG. 4. Mean signal changes and attentional modulation index in visual, frontal and parietal cortex. A: mean signal changes in right [R] and left [L] V1, V2, V4, and TEO, averaged across subjects. For each subject, the 10 peak intensities of the fMRI signal obtained during visual presentations of the fixation task (FT), the low-load search (LLS), or the high-load search task (HLS) were averaged. Target-search-related activity was evoked in left visual cortex; distracter-related activity was evoked in right visual cortex. B: attentional response modulation on visual stimuli as quantified with an attentional modulation index (AMI), which normalizes the activities obtained during the 2 search task conditions relative to the activity obtained in the fixation task condition. In V1 and V2, attentional response enhancement of target-evoked activity was similar; distracter-related activity was not affected by attention. In V4 and TEO, attentional enhancement effects on target stimuli increased with increasing attentional load, whereas suppressive effects on distracter stimuli were found with increasing load. C: mean signal changes in SPL, IPS, and IPL of parietal cortex and FEF and supplementary eye fields (SEF) of frontal cortex were computed as described in A. Activity was entirely suppressed when target stimuli were ignored and increased during target search with increasing attentional load, thereby reflecting target selection processes. Vertical bars indicate SE.

 
In right V1 and V2, distracter-related activity was not different across the three different task conditions (Figs. 3 and 4A). Mean signals in V1 and V2 were 1.16 and 1.23% during fixation, 1.21 and 1.34% during low-load search, and 1.18 and 1.30% during high-load search (Fig. 4A), suggesting that visual processing in early visual cortex was mediated by bottom-up mechanisms and did not depend on attentional load. In right V4 and TEO, however, distracter-related activity was attenuated depending on the attentional load (Figs. 3 and 4A). Mean signal changes combined for V4 and TEO were 1.70% during fixation, 1.68% during low-load search, and 1.45% during high-load search (main effect of attentional load: P < 0.01). Thus in areas at intermediate but not at early processing stages, the attentional load-dependent suppression of distracter-related activity mirrored the attentional load-dependent enhancement of target-search-related activity as also reflected in the attentional modulation index shown in Fig. 4B (ANOVA; AMI for target-related activity: main effect of task: NS; main effect of area: NS; interaction task x area: P < 0.01; AMI for distracter-related activity: main effect of task: P < 0.05; main effect of area: P < 0.05).

Areas in frontal and parietal cortex activated during high- and low-load search relative to the fixation task condition are depicted for a single subject in Fig. 2B. Across all subjects (n = 5), areas in the FEF, the SEF, the SPL, the IPS, and the IPL were found to be consistently activated. These areas have been previously described to form a distributed frontoparietal spatial attention network (see Kastner and Ungerleider 2000Go; Pessoa et al. 2002Go for references). In addition, areas in the middle and inferior frontal gyrus and in the insula were consistently activated. We will focus our analysis on activity in areas of the attention network, which are more likely to reflect the attentional manipulations associated with the different tasks and not other differences between pattern discrimination and letter identification. The locations of FEF, SEF, SPL, IPS, and IPL in Talairach space were found to be similar as described previously (Kastner et al. 1999Go) (FEF: –31, –9, +50; +42, –8, +48; SEF: +1, +6, +51; SPL: –16, –72, +42; +13, –70, +42; IPS: –35, –51, +36; +34, –53, +35; IPL: –48, –43, +39; +47, –42, +40). Areas in the FEF, SPL, IPS, and IPL were activated bilaterally without hemispheric differences. Mean signal changes averaged across subjects and hemispheres are shown in Fig. 4C for SPL, IPS, IPL, FEF, and SEF. In all areas, activity increased with increasing attentional load, thereby reflecting subjects' behavioral performance. In this respect, target-search-related activity in areas of the frontoparietal cortex was similar compared with response patterns in left V4 and TEO (main effect of attention: P < 0.001 for IPS and P < 0.01 for FEF, SEF, SPL, and IPL; main effect of attentional load: P < 0.05 for FEF, SEF, SPL, IPS, and IPL). However, unlike in these extrastriate areas, activity was entirely suppressed in the frontoparietal network when subjects performed the fixation task and ignored target stimuli (Fig. 4C). Thus areas of the frontoparietal attention network were activated only when target stimuli were attentionally selected but not when the same stimuli were ignored, supporting the idea that these areas are involved with target selection and distracter suppression during spatially directed attention rather than sensory-driven processes (Everling et al. 2002Go; Moore and Armstrong 2003Go; Schall and Thompson 1999Go).


    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
We investigated the neural representation of attended and unattended stimuli under conditions of varying perceptual load by having subjects perform either a detection or a discrimination task of identical target stimuli while presenting unattended stimuli simultaneously. By varying the processing requirements for identical stimuli, the perceptual load of information processing at the target location was primarily manipulated (Lavie 1995Go). The low- and high-load search tasks were designed as 0- and 1-back tasks to keep the cognitive load in terms of working-memory (WM) requirements relatively constant, as shown previously for similar 0- and 1-back WM tasks (Nystrom et al. 2000Go). With this task, we found that target-search-related activity was enhanced during search tasks independent of attentional load in early cortical areas V1 and V2, whereas distracter-related activity was not affected by the load manipulation. In intermediate areas V4 and TEO, target-search-related activity increased and distracter-related activity decreased depending on attentional load. Activity in a frontoparietal network of brain regions reflected processes related to target selection and distracter suppression during spatially directed attention. In behavioral studies outside the scanner, we found that eye movements were not systematically correlated with the different task conditions and were therefore an unlikely source to account for the response modulation found in visual, parietal, and frontal cortex. Taken together, these results provide evidence for a long-ranging and load-dependent push-pull mechanism of selective attention operating at intermediate processing stages of visual cortex. This mechanism may serve to partially filter out unwanted information over large spatial scales.

For the target-search-related activity, we predicted that neural activity should increase with increasing attentional load in visual cortex based on previous results from single-cell physiology and neuroimaging (Rees et al. 1997Go; Spitzer and Richmond 1991). In support of our hypothesis, such response pattern was found in intermediate areas V4 and TEO, where the load-dependent increases of neural activity reflected the subjects' behavioral performance. In these areas, neural activity was also strongly correlated with the response patterns of higher-order frontoparietal areas known to be involved in processes of target selection during spatially directed attention (Everling et al. 2002Go; Schall and Thompson 1999Go). In contrast, load-independent enhancement of neural responses to attended stimuli was found in early areas V1 and V2. There are several different possibilities to interpret the dissociation of attentional effects at early and intermediate processing levels. First, the dissociation may be related to the visual stimuli used in our study. The colorful patterned stimuli activated ventral extrastriate cortex presumably more optimally than early visual cortex. Differential effects of attention depending on task difficulty have been obtained in V1 with achromatic grating stimuli that are better suited to activate early visual areas (Ress et al. 2000Go). Second, our findings may indicate a dissociation of attentional functions at different processing stages within the visual system. The load-independent effects may be related to a more general attentional gain control mechanism that affects visual processing as early as in the LGN (O'Connor et al. 2002Go), whereas the load-dependent effects may be more closely related to the attentional selection process. Importantly, because of the dissociation of attention effects in early and intermediate visual areas, it is not likely that the effects merely reflected an addition of attention-related baseline increases to visually evoked activity (Kastner et al. 1999Go; Ress et al. 2000Go).

For the distracter-related activity, we probed two alternative but not mutually exclusive hypotheses. One prediction was that distracter-related activity may be suppressed dependent on the attentional load of the task at hand based on previous results from neuroimaging studies in dorsal extrastriate cortex (Rees et al. 1997Go). Another prediction was that distracter-related activity may not be affected by attention, based on results from neglect patients (Rees et al. 2000Go; Vuilleumier et al. 2001Go). Our results provide evidence that both mechanisms operate at different processing stages. Consistent with the results from neglect patients, distracter-related activity was not affected by attention in early visual cortex, suggesting that visual processing was mediated considerably by bottom-up mechanisms. Consistent with accounts of attentional load (Lavie and Tsal 1994Go), distracter-related activity was attenuated depending on attentional load at intermediate processing stages. It is conceivable that fMRI adaptation effects due to repeated presentation of the same stimulus contributed to the overall responses evoked at the distracter location. However, because the sensory presentation conditions at the distracter location were kept constant across all attention tasks, it is unlikely that adaptation effects accounted for the dissociation of the load-dependent suppression of distracter-related activity between early and intermediate visual areas. Taken together, our results show that attentional-load dependent suppression of distracter-related activity operates not only in dorsal extrastriate cortex, as previously shown (Rees et al. 1997Go), but also in ventral extrastriate cortex and that the suppression appears to be correlated with a load-dependent facilitation of neural responses evoked by attended stimuli. Indeed, the load-dependent suppression of distracter-related activity mirrored the load-dependent enhancement of target-search-related activity in areas V4 and TEO.

Notably, the suppressive mechanism operated over large portions if not the entire visual scene suggesting that the focus of attentional selection may be surrounded by extensive suppressive zones (LaBerge and Brown 1989Go; Smith et al. 2000Go; Tsotsos et al. 2001Go; Vanduffel et al. 2000Go). This result may provide a neural basis for psychophysical studies that have implicated suppressive surrounds around the locus of attentional selection based on poorer performance in discriminating and slower reaction times in responding to distracter stimuli (Bahcall and Kowler 1999Go; Caputo and Guerra 1998Go; Cave and Zimmerman 1997Go; Cutzu and Tsotsos 2003Go). How may such a long-ranging mechanism be implemented at the neural level? There are at least three possibilities that need to be considered. First, visual stimuli presented to the contralateral hemifield have been shown to influence the processing of stimuli within receptive fields (RFs) of the ipsilateral hemifield in V4 (Desimone et al. 1993Go). Such long-ranging and context-dependent extra-RF modulation of neural responses is thought to be mediated by transcallosal connections in this area (Van Essen et al. 1982Go). Selective attention may operate in visual cortex by affecting local circuits that mediate context modulation as previously shown in V1 (Ito and Gilbert 1999Go). Second, it has been demonstrated that microstimulation of the FEF can enhance neural activity in V4 at target locations and suppress activity at distracter locations (Moore and Armstrong 2003Go). Thus the attention effects obtained in extrastriate cortex in the present study may be under feedback control of higher-order areas of the frontoparietal attention network that mediate both target selection and distracter suppression (Everling et al. 2002Go; Schall and Thompson 1999Go). And third, results from computational neuroscience have shown that long-ranging suppressive mechanisms may result from feedback between visual areas flowing from higher to lower areas (Tsotsos et al. 2001Go). fMRI studies demonstrating that attention effects increase in magnitude from early to later processing stages in visual cortex (e.g., O'Connor et al. 2002Go) provide evidence in support of such a feedback mechanism that reverses the visual processing hierarchy. It should be noted that these possibilities are not mutually exclusive.

Our results add to a growing number of physiology, lesion, and neuroimaging studies (DeWeerd et al. 1999Go; Gallant et al. 2000Go; Kastner et al. 1998Go; Moran and Desimone 1985Go; Recanzone and Wurtz 2000Go; Reynolds et al. 1999Go) that demonstrate an important functional role for areas V4 and TEO in the spatial filtering of distracters. In single-cell recording studies, it has been demonstrated that spatially directed attention can influence the competition among multiple stimuli in favor of one of the stimuli by modulating competitive interactions in extrastriate areas V2, V4, and MT, thereby filtering out unwanted information from nearby distracters (Moran and Desimone 1985Go; Recanzone and Wurtz 2000Go; Reynolds et al. 1999Go). Consistent with these results, studies in a patient with an isolated V4 lesion (Gallant et al. 2000Go) and in monkeys with lesions of areas V4 and TEO (DeWeerd et al. 1999Go) have demonstrated significant performance deficits in an orientation discrimination task in the presence but not in the absence of distracters, suggesting a deficit in the efficacy of the filtering of distracter information. The present findings suggest that, in addition to filter mechanisms that operate at the level of the RF, attention can also attenuate distracter-evoked activity from areas beyond the RF. Future studies are needed to clarify whether intra- and extra-RF mechanisms for the filtering of unwanted information constitute separate entities or are interdependent. Further, the relation of these spatial attention effects to previously demonstrated long-ranging feature-based attention effects needs to be explored (Saenz et al. 2002Go; Treue and Martinez Trujillo 1999Go).


    GRANTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
This work was supported by a National Science Foundation Graduate Research Fellowship to M. A. Pinsk and by National Institute of Mental Health Grants RO1 MH-64043 and P50 MH-62196 and the Whitehall Foundation to S. Kastner.


    ACKNOWLEDGMENTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
We thank D. M. Beck and K. A. Schneider for valuable discussions and H. M. Fehd for help with manuscript preparation.


    FOOTNOTES
 
The costs of publication of this article were defrayed in part by the payment of page charges. The article must therefore be hereby marked "advertisement" in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

Address for reprint requests and other correspondence: S. Kastner, Dept. of Psychology, Center for the Study of Brain, Mind, and Behavior, Princeton University, Green Hall, Princeton, NJ 08544 (E-mail: skastner{at}princeton.edu).


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Bahcall DO and Kowler E. Attentional interference at small spatial separations. Vision Res 39: 71–86, 1999.[CrossRef][ISI][Medline]

Brefczynski JA and DeYoe EA. A physiological correlate of the "spotlight" of visual attention. Nat Neurosci 2: 370–374, 1999.[CrossRef][ISI][Medline]

Caputo G and Guerra S. Attentional selection by distractor suppression. Vision Res 38: 669–689, 1998.[CrossRef][ISI][Medline]

Cave KR and Zimmerman JM. Flexibility in spatial attention before and after practice. Psychol Sci 8: 399–403, 1997.

Connor CE, Gallant JL, Preddie DC, and Van Essen DC. Responses in area V4 depend on the spatial relationship between stimulus and attention. J Neurophysiol 75: 1306–1308, 1996.[Abstract/Free Full Text]

Cutzu F and Tsotsos JK. The selective tuning model of attention: psychophysical evidence for a suppressive annulus around an attended item. Vision Res 43: 205–219, 2003.[CrossRef][ISI][Medline]

Desimone R and Duncan J. Neural mechanisms of selective visual attention. Annu Rev Neurosci 18: 193–222, 1995.[CrossRef][ISI][Medline]

Desimone R, Moran J, Schein SJ, and Mishkin M. A role for the corpus callosum in visual area V4 of the macaque. Visual Neurosci 10: 159–171, 1993.[ISI][Medline]

De Weerd P, Peralta MR, Desimone R, and Ungerleider LG. Loss of attentional stimulus selection after extrastriate cortical lesions in macaques. Nat Neurosci 2: 753–758, 1999.[CrossRef][ISI][Medline]

Eriksen CW and St James JD. Visual attention within and around the field of focal attention: a zoom lens model. Percept Psychophys 40: 225–240, 1986.[ISI][Medline]

Everling S, Tinsley CJ, Gaffan D, and Duncan J. Filtering of neural signals by focused attention in the monkey prefrontal cortex. Nat Neurosci 5: 671–676, 2002.[CrossRef][ISI][Medline]

Friston KJ, Holmes AP, Worsley KJ, Poline JP, Frith CD, and Frackowiak RSJ. Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2: 189–210, 1995.[CrossRef]

Friston KJ, Worsley KJ, Frackowiak RSJ, Mazziotta JC, and Evans AC. Assessing the significance of focal activations using their spatial extent. Hum Brain Mapp 1: 210–220, 1994.[CrossRef]

Gallant JL, Shoup RE, and Mazer JA. A human extrastriate area functionally homologous to macaque V4. Neuron 27: 227–235, 2000.[CrossRef][ISI][Medline]

Gitelman DR. ILAB: a program for postexperimental eye movement analysis. Behav Res Methods Instrum Comput 34: 605–612, 2002.[ISI][Medline]

Ito M and Gilbert CD. Attentional modulates contextual influences in the primary visual cortex of alert monkeys. Neuron 22: 593–604, 1999.[CrossRef][ISI][Medline]

Kastner S, De Weerd P, Desimone R, and Ungerleider LG. Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. Science 282: 108–111, 1998.[Abstract/Free Full Text]

Kastner S, De Weerd P, Pinsk MA, Elizondo MI, Desimone R, and Ungerleider LG. Modulation of sensory suppression: implications for receptive field sizes in the human visual cortex. J Neurophysiol 86: 1398–1411, 2001.[Abstract/Free Full Text]

Kastner S, Pinsk MA, De Weerd P, Desimone R, and Ungerleider LG. Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron 22: 751–761, 1999.[CrossRef][ISI][Medline]

Kastner S and Ungerleider LG. Mechanisms of visual attention in the human cortex. Annu Rev Neurosci 23: 315–341, 2000.[CrossRef][ISI][Medline]

LaBerge D and Brown V. Theory of attentional operations in shape identification. Psychol Rev 96: 101–124, 1989.[CrossRef]

Lavie N and Tsal Y. Perceptual load as a major determinant of the locus of selection in visual attention. Percept Psychophys 56: 183–197, 1994.[ISI][Medline]

McAdams CJ and Maunsell JH. Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. J Neurosci 19: 431–441, 1999.[Abstract/Free Full Text]

Moore T and Armstrong KM. Selective gating of visual signals by microstimulation of frontal cortex. Nature 421: 370–373, 2003.[CrossRef][Medline]

Moran J and Desimone R. Selective attention gates visual processing in the extrastriate cortex. Science 229: 782–784, 1985.[Abstract/Free Full Text]

Nystrom LE, Braver TS, Sabb FW, Delgado MR, Noll DC, and Cohen JD. Working memory for letters, shapes, and locations: fMRI evidence against stimulu-based regional organization in human prefrontal cortex. NeuroImage 11: 424–446, 2000.[CrossRef][ISI][Medline]

O'Connor DH, Fukui MM, Pinsk MA, and Kastner S. Attention modulates responses in the human lateral geniculate nucleus. Nat Neurosci 5: 1203–1209, 2002.[CrossRef][ISI][Medline]

Pessoa L, Kastner S, and Ungerleider LG. Attentional control of the processing of neutral and emotional stimuli. Cog Brain Res 15: 31–45, 2002.[CrossRef][Medline]

Poline JB, Worsley KJ, Evans AC, and Friston KJ. Combining spatial extent and peak intensity to test for activations in functional imaging. NeuroImage 5: 83–96, 1997.[CrossRef][ISI][Medline]

Recanzone GH and Wurtz RH. Effects of attention on MT and MST neuronal activity during pursuit initiation. J Neurophysiol 83: 777–790, 2000.[Abstract/Free Full Text]

Rees G, Frith CD, and Lavie N. Modulating irrelevant motion perception by varying attentional load in an unrelated task. Science 278: 1616–1619, 1997.[Abstract/Free Full Text]

Rees G, Wojciulik E, Clarke K, Husain M, Frith C, and Driver J. Unconscious activation of visual cortex in the damaged right hemisphere of a parietal patient with extinction. Brain 123: 1624–1633, 2000.[Abstract/Free Full Text]

Ress D, Backus BT, and Heeger DJ. Activity in primary visual cortex predicts performance in a visual detection task. Nat Neurosci 3: 940–945, 2000.[CrossRef][ISI][Medline]

Reynolds JH, Chelazzi L, and Desimone R. Competitive mechanisms subserve attention in macaque areas V2 and V4. J Neurosci 19: 1736–1753, 1999.[Abstract/Free Full Text]

Reynolds JH and Desimone R. The role of neural mechanisms of attention in solving the binding problem. Neuron 24: 111–125, 1999.

Saenz M, Buracas GT, and Boynton GM. Global effects of feature-based attention in human visual cortex. Nat Neurosci 5: 631–632, 2002.[CrossRef][ISI][Medline]

Schall JD and Thompson KG. Neural selection and control of visually guided eye movements. Annu Rev Neurosci 22: 241–259, 1999.[CrossRef][ISI][Medline]

Smith AT, Singh KD, and Greenlee MW. Attentional suppression of activity in the human visual cortex. Neuroreport 11: 271–277, 2000.[ISI][Medline]

Spitzer H and Richmond BJ. Task difficulty: ignoring, attending to, and discriminating a visual stimulus yield progressively more activity in inferior temporal neurons. Exp Brain Res 83: 340–348, 1991.[ISI][Medline]

Talairach J and Tournoux P. Co-Planar Stereotactic Atlas of the Human Brain. New York: Thieme, 1988.

Tootell RBH, Hadjikhani N, Hall EK, Marrett S, Vanduffel W, Vaughan JT, and Dale AM. The retinotopy of visual spatial attention. Neuron 21: 1409–1422, 1998.[CrossRef][ISI][Medline]

Treue S and Martinez Trujillo JC. Feature-based attention influences motion processing gain in macaque visual cortex. Nature 399: 575–579, 1999.[CrossRef][Medline]

Tsotsos JK. Analyzing vision at the complexity level. Behav Brain Sci 13: 423–469, 1990.

Tsotsos JK, Culhane SM, and Cutzu F. From foundational principles to a hierarchical selection circuit for attention. In: Visual Attention and Cortical Circuits, edited by Braun J, Koch C, and Davis JL. Cambridge, MA: MIT Press, 2001.

Van Essen DC, Newsome WT, and Bixby JL. The pattern of interhemispheric connections and its relationship to extrastriate visual areas in the macaque monkey. J Neurosci 2: 265–283, 1982.[Abstract]

Vanduffel W, Tootell RB, and Orban GA. Attention-dependent suppression of metabolic activity in the early stages of the macaque visual system. Cereb Cortex 10: 109–126, 2000.[Abstract/Free Full Text]

Vuilleumier P, Sagiv N, Hazeltine E, Poldrack RA, Swick D, Rafal RD, and Gabrieli JDE. Neural fates of seen and unseen faces in visuospatial neglect: a combined event-related functional MRI and event-related potential study. Proc Natl Acad Sci USA 98: 3495–3500, 2001.[Abstract/Free Full Text]




This article has been cited by other articles:


Home page
J. Cogn. Neurosci.Home page
I. SanMiguel, M.-J. Corral, and C. Escera
When Loading Working Memory Reduces Distraction: Behavioral and Electrophysiological Evidence from an Auditory-Visual Distraction Paradigm
J. Cogn. Neurosci., July 1, 2008; 20(7): 1131 - 1145.
[Abstract] [Full Text] [PDF]


Home page
Learn. Mem.Home page
D. Talmi, A. K. Anderson, L. Riggs, J. B. Caplan, and M. Moscovitch
Immediate memory consequences of the effect of emotion on attention to pictures
Learn. Mem., March 5, 2008; 15(3): 172 - 182.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
M. Cicek, D. Gitelman, R. S. E. Hurley, A. Nobre, and M. Mesulam
Anatomical Physiology of Spatial Extinction
Cereb Cortex, December 1, 2007; 17(12): 2892 - 2898.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
G. L. Shulman, S. V. Astafiev, M. P. McAvoy, G. d'Avossa, and M. Corbetta
Right TPJ Deactivation during Visual Search: Functional Significance and Support for a Filter Hypothesis
Cereb Cortex, November 1, 2007; 17(11): 2625 - 2633.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
S. A. McMains, H. M. Fehd, T.-A. Emmanouil, and S. Kastner
Mechanisms of Feature- and Space-Based Attention: Response Modulation and Baseline Increases
J Neurophysiol, October 1, 2007; 98(4): 2110 - 2121.
[Abstract] [Full Text] [PDF]


Home page
BrainHome page
N. W. Roach and J. H. Hogben
Impaired filtering of behaviourally irrelevant visual information in dyslexia
Brain, March 1, 2007; 130(3): 771 - 785.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
J. J. Geng, E. Eger, C. C. Ruff, A. Kristjansson, P. Rotshtein, and J. Driver
On-Line Attentional Selection From Competing Stimuli in Opposite Visual Fields: Effects on Human Visual Cortex and Control Processes
J Neurophysiol, November 1, 2006; 96(5): 2601 - 2612.
[Abstract] [Full Text] [PDF]


Home page
Proc. Natl. Acad. Sci. USAHome page
J.-M. Hopf, C. N. Boehler, S. J. Luck, J. K. Tsotsos, H.-J. Heinze, and M. A. Schoenfeld
Direct neurophysiological evidence for spatial suppression surrounding the focus of attention in vision
PNAS, January 24, 2006; 103(4): 1053 - 1058.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
S. Schwartz, P. Vuilleumier, C. Hutton, A. Maravita, R. J. Dolan, and J. Driver
Attentional Load and Sensory Competition in Human Vision: Modulation of fMRI Responses by Load at Fixation during Task-irrelevant Stimulation in the Peripheral Visual Field
Cereb Cortex, June 1, 2005; 15(6): 770 - 786.
[Abstract] [Full Text] [PDF]