JN Journal of Applied Physiology
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Neurophysiol 92: 1880-1891, 2004. First published April 7, 2004; doi:10.1152/jn.01042.2003
0022-3077/04 $5.00
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
92/3/1880    most recent
01042.2003v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (31)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Neri, P.
Right arrow Articles by Heeger, D. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Neri, P.
Right arrow Articles by Heeger, D. J.

Stereoscopic Processing of Absolute and Relative Disparity in Human Visual Cortex

Peter Neri1, Holly Bridge2 and David J. Heeger1

1Department of Psychology, Stanford University, Stanford, California 94305-2130; and 2University Laboratory of Physiology, Oxford OX1 3PT, United Kingdom

Submitted 29 October 2003; accepted in final form 5 April 2004


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Stereoscopic vision relies mainly on relative depth differences between objects rather than on their absolute distance in depth from where the eyes fixate. However, relative disparities are computed from absolute disparities, and it is not known where these two stages are represented in the human brain. Using functional MRI (fMRI), we assessed absolute and relative disparity selectivity with stereoscopic stimuli consisting of pairs of transparent planes in depth in which the absolute and relative disparity signals could be independently manipulated (at a local spatial scale). In experiment 1, relative disparity was kept constant, while absolute disparity was varied in one-half the blocks of trials ("mixed" blocks) and kept constant in the remaining one-half ("same" blocks), alternating between blocks. Because neuronal responses undergo adaptation and reduce their firing rate following repeated presentation of an effective stimulus, the fMRI signal reflecting activity of units selective for absolute disparity is expected to be smaller during "same" blocks as compared with "mixed" ones. Experiment 2 similarly manipulated relative disparity rather than absolute disparity. The results from both experiments were consistent with adaptation with differential effects across visual areas such that 1) dorsal areas (V3A, MT+/V5, V7) showed more adaptation to absolute than to relative disparity; 2) ventral areas (hV4, V8/V4{alpha}) showed an equal adaptation to both; and 3) early visual areas (V1, V2, V3) showed a small effect in both experiments. These results indicate that processing in dorsal areas may rely mostly on information about absolute disparities, while ventral areas split neural resources between the two types of stereoscopic information so as to maintain an important representation of relative disparity.


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
The horizontal offset of our eyes causes slightly different images of solid objects and surfaces to be generated on the retinae. These differences, known as retinal disparities, are exploited by our brain to retrieve the three-dimensional layout of the environment and lead to a stereoscopic percept of depth (Howard and Rogers 1995Go; Julesz 1971Go; Wheatstone 1838Go). The neural investigation of stereoscopic processing started in the 1960s, when neurons selective for binocular disparity were described in the cat primary visual cortex (Barlow et al. 1967Go; Nikara et al. 1968Go; Pettigrew et al. 1968Go). Subsequent studies in monkey cortex confirmed this result in visual areas primary visual cortex (V1) (Poggio et al. 1988Go), V2 (Burkhalter and Van Essen 1986Go; Poggio et al. 1988Go), V3 (Felleman and Van Essen 1987Go; Poggio et al. 1988Go), V3A (Poggio et al. 1988Go), V4 (Hinkle and Conner 2000Go; Watanabe et al. 2002Go), VP (Burkhalter and Van Essen 1986Go), middle temporal area (MT) (V5) (DeAngelis and Newsome 1999Go; Maunsell and Van Essen 1983Go), middle superior temporal (MST) (Roy et al. 1992Go), caudal aspect of the intraporietal suleus (CIPS) (Taira et al. 2000Go), lateral intraporietal (LIP) (Gnadt and Mays 1995Go), interior inferotemporal cortex (TE) (Janssen et al. 2000Go), inferotemporal cortex (IT) (Janssen et al. 2003Go), parietal cortex (Shikata et al. 1996Go), and frontal eye fields (FEFs) (Ferraina et al. 2000Go).

In the following decades, psychophysical and computational work emphasized the distinction between two stages in the processing of stereoscopic information (Marr 1985Go): 1) local matching of the retinal images to obtain estimates of the absolute disparity of objects or surfaces in reference to where the eyes are fixating; and 2) a more perceptually useful representation based on the relative disparity between different objects, independent of fixation depth. We use the term "absolute disparity" to mean absolute retinal disparity. The difference between absolute and relative disparity is shown in Fig. 1.



View larger version (11K):
[in this window]
[in a new window]
 
FIG. 1. Diagram showing relative and absolute disparities of 2 points in different depth planes. Left: the more distant dot is fixated and has an absolute disparity of 0. The near dot projects to noncorresponding retinal locations and has an absolute disparity, arbitrarily assigned 1 unit. Right: if depth of fixation changes, absolute disparity of both dots changes (to ±1/2), but the difference in absolute disparity between the dots, termed their relative disparity, is unchanged. Relative disparity is therefore a property of perceptual representation that is invariant with respect to vergence eye position.

 
Recent electrophysiological work in macaques has shown that primary visual cortex (V1) is involved in carrying out step number 1, but does not go beyond (Cumming and Parker 1999Go, 2000Go). The responses of disparity-selective neurons in V1 are modulated by absolute disparity, but not by relative disparity (Cumming and Parker 1999Go). Moreover, these neurons respond to stimuli that do not evoke a percept of depth (Cumming and Parker 1997Go). The question then remains as to where in cortex stereoscopic processing is completed (Backus 2000Go; Cumming 2002Go; Parker and Cumming 2001Go; Parker et al. 2000Go).

The neural substrate of human stereoscopic vision has been studied previously using visually evoked potentials (Braddick and Atkinson 1983Go; Fiorentini and Maffei 1970Go; Lehmann and Julesz 1978Go; Norcia and Tyler 1984Go; Norcia et al. 1985Go; Regan and Spekreijse 1970Go), PET (Gulyas and Roland 1994Go), and functional MRI (fMRI) (Backus et al. 2001Go; Gilaie Dotan et al. 2002Go; Kwee et al. 1999Go; Nakadomari et al. 1999Go; Ptito et al. 1993Go; Rutschmann and Greenlee 1999Go; Tsao et al. 2003Go). The number of studies is rather small, mostly because binocular presentation of visual stimuli can pose technical difficulties when constrained by PET and fMRI scanners. There is general agreement from these studies that disparity signals are spread throughout the visual cortex with, as yet, no putative "depth area" analogous to MT for motion.

We opted for a design that exploits the phenomenon of neural adaptation to assess selectivity for absolute and relative disparity. This method has previously been used to identify visual areas selective for objects (Grill-Spector et al. 1999Go), motion (Huk and Heeger 2002Go; Huk et al. 2001Go), color (Engel and Furmanski 2001Go), and shape (Kourtzi and Kanwisher 2001Go). It relies on a comparison of the fMRI response to stimuli under two conditions, one in which the attribute of interest remains constant, thus causing adaptation in neurons sensitive to this attribute, and one in which the attribute is varied so as to avoid adaptation. Any reduction in the fMRI signal should be a consequence of the reduction in response from adapted neurons selective for the attribute being tested. The major advantage of this approach is that it targets specific subpopulations of neurons, as response differences can be referred back to adaptation-tagged neurons (Grill-Spector and Malach 2001Go). In conventional fMRI experiments, on the other hand, it is not possible to know whether response differences (or lack of differences) between stimulus conditions are due to changes in the activity of one subpopulation of neurons, changes in how activity is subdivided across different subpopulations, or both.

We presented observers with two pairs of transparent planes in depth: one pair above and the other below fixation. For each pair of planes, we could independently vary the distance in depth between each plane and fixation (absolute disparity) and the distance in depth between the two planes (relative disparity). We measured adaptation as a function of both manipulations and found that 1) dorsal areas (V3A, MT+/V5, V7) adapted only to absolute disparity; 2) ventral areas (hV4, V8/V4{alpha}) adapted to both absolute and relative disparity; and 3) early visual areas (V1, V2, V3) showed a small effect in both experiments.


    METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Subjects and scanning sessions

The experiments were undertaken with the written consent of each subject and in compliance with the safety guidelines for MRI research. Subjects participated in multiple MRI scanning sessions on different days: one to obtain a standard, high-resolution, anatomical scan; one to functionally define retinotopic visual areas; one to provide further definition for area MT+/V5; and seven sessions to measure fMRI responses in the different experimental conditions (2 sessions for absolute disparity, 2 for relative disparity, 1 for both absolute and relative, 1 for the control experiment, and 1 for the baseline measurement). Across all sessions, each subject performed between 24 and 30 scans for each of the absolute and relative disparity experiments. All subjects had normal or corrected-to-normal vision.

Experimental set-up and visual stimuli

Observers (lying on their backs) viewed stimuli through a custom-made stereoscope (made of a set of 2 mirrors and a pair of 8x binoculars, 320 cm from the display) that allowed separate projection of left and right halves of the LCD monitor (NEC multisynch LCD 2000, placed inside a Faraday box) to left and right eyes (Fig. 2A). To ensure that the left eye did not see the image meant for the right eye, and vice versa, subjects held a septum between their knees. A bite bar stabilized subjects' heads.



View larger version (31K):
[in this window]
[in a new window]
 
FIG. 2. Experimental protocol and visual stimuli. A: observers, lying inside the scanner, viewed an LCD display through a custom-built device that allowed left and right halves of the image to separately project to the 2 eyes. B: when fused, stereo pairs were perceived as 4 planes of dots in depth, 2 planes above and 2 planes below fixation. C: interplane depth distance for the top pair of planes (d) differed from that for the bottom pair by a small amount {Delta}d. Subjects were asked to select the pair of planes with larger interplane distance, and {Delta}d was varied using a staircase procedure. D: absolute disparity adaptation experiment. Scans consisted of 2 alternating blocks (8 trials each). Interplane distance (local relative disparity) was fixed (ignoring the small changes in {Delta}d) in all trials in both blocks. In "same" blocks, absolute disparity of individual planes was always the same. In "mixed" blocks, it was different on every trial. E: relative disparity adaptation experiment. Absolute disparities varied within each block, but the same absolute disparities were presented in both blocks and for the same number of times. Interplane distance, on the other hand, was fixed in "same" blocks but varied in "mixed" blocks. Dotted lines indicate fixation disparity.

 
Stimuli (Fig. 2B) were presented for 1 s and were dynamic random-dot stereograms (dots were randomly repositioned at 4 Hz), made of antialiased dots (0.4° half-width at half height) on a black background. When fused, they depicted two pairs of frontal planes (each plane subtending 8° x 8° and made of 30 dots): one pair above fixation (1° between bottom of the plane and fixation center) and one below. The fixation marker was a binocular square (1° x 1°) with horizontal and vertical monocular Nonius lines to allow subjective monitoring of fixation accuracy. The absolute disparity of each plane could be at any of 18 values between –34 and +34 arcmin, in steps of 4 arcmin. The pairs of planes were always symmetrically arranged in depth around fixation (i.e., if the absolute disparities of the top 2 planes were –34 and +2, those of the 2 bottom planes would be +34 and –2). This ensured that, apart from a small additional disparity introduced for the psychophysical task (see Psychophysical task), the average content in absolute disparity for the overall stimulus was zero, thus minimizing vergence eye movements away from Nonius fixation.

Psychophysical task

It is critical to control the subject's attention when attempting to measure stimulus-evoked responses in visual cortex. Several studies have shown that the attentional state of the observer can have dramatic effects on fMRI signals in visual cortex (Brefczynski and DeYoe 1999Go; Gandhi et al. 1999Go; Huk et al. 2001Go; Kastner et al. 1999Go; Martinez et al. 1999Go; Ress et al. 2000Go; Tootell et al. 1998Go). Moreover, trial-to-trial variability in attention is correlated with trial-to-trial variability in the amplitude of the fMRI responses (Ress et al. 2000Go). To control attention in our experiments, the subject performed a difficult disparity-discrimination task in all experimental and control conditions.

The subjects' task was to detect the pair of depth planes that contained the larger interplane depth distance (difference in absolute disparity between 2 planes belonging to the same pair). On each trial, the interplane distance was nearly the same for both pairs of planes, except one pair had a small additional disparity {Delta}d (from 5 to 25% of the interplane distance; Fig. 2C). While in the scanner, subjects were asked to choose either the top or the bottom pair by pressing one of two keys during the 1 s following stimulus presentation. No response was recorded if subjects failed to respond within 1 s, but this rarely occurred. Auditory feedback was provided (correct/incorrect) immediately following each trial.

In one subject (PN) {Delta}d was held constant at psychophysical threshold (absolute disparity experiment, 10% of interplane distance; relative disparity experiment, 7%). For the other two subjects, task difficulty was adjusted dynamically using a staircase procedure: the interplane disparity difference was decreased slightly after two consecutive correct responses, and it was increased slightly after an incorrect response. Each block started with the smallest {Delta}d.

Main experiments

Two experiments were run to study absolute and relative disparity separately. Scanning sessions consisted of 10–12 repeated scans. Each scan utilized a block alternation procedure containing 12 cycles of block-alternation, and each block consisted of eight trials (2 s/trial).

In the absolute disparity experiment, interplane distance was kept constant in all trials throughout the scan (with the exception of {Delta}d used for the psychophysical task), thus keeping local relative disparity unchanged (Fig. 2D). On "same" blocks, both pairs of planes were at ±18 arcmin (centered around fixation), providing constant local absolute disparity. On "mixed" blocks, each of the eight trials was randomly assigned (without replacement) one of the eight possible combinations of absolute disparities (Table 1; Fig. 2D). The top and bottom pairs were symmetrically placed in depth around fixation.


View this table:
[in this window]
[in a new window]
 
TABLE 1. Disparity values (in arcmin) for the 8 pairs of stimulus planes used in the Absolute disparity experiment "mixed" block and the Relative disparity experiment "same" block

 
In the relative disparity experiment, a fixed set of absolute disparities was presented in both blocks, while the relative disparities alternated between "same" and "mixed" (Fig. 2E). In the "same" block, the interplane disparity remained constant (Table 1; Fig. 2E). Note that the stimuli presented in this block were exactly the same as those presented in the "mixed" block of the absolute disparity experiment, but in randomly shuffled order. In the "mixed" block, planes within a pair were symmetrical about fixation, but their interplane distance was varied so that the eight trials were randomly assigned (without replacement) one of eight possible combinations (Table 2; Fig. 2E).


View this table:
[in this window]
[in a new window]
 
TABLE 2. Disparity values (in arcmin) for the 8 pairs of stimulus planes used in the Relative disparity experiment "mixed" block

 
Control experiment

Control experiments were performed to determine if the decreased response during "same" blocks in our main experiments could be explained by a lower responsivity to the specific absolute (or relative) disparity that was repeatedly presented during that block compared with the disparities chosen for the "mixed" block. In the control experiments, we measured the summed response to the "mixed" disparities and compared it with the response to the "same" disparity. Each session consisted of 16 scans, 8 corresponding to the 8 different absolute disparities presented in the "mixed" block of the absolute disparity main experiment (Table 1), and 8 corresponding to the relative disparities (Table 2). Each scan alternated between a pair of stimulus conditions, and subjects performed the same task as in the main experiment, using the same staircase procedure.

For the absolute disparity control, one block consisted of four repeated presentations of the stimulus that was used in the "same" block of the absolute disparity experiment (±18 arcmin), while the other block consisted of four repeated presentations of one of the eight absolute disparity stimuli (Table 1). In other words, across the eight scans, we showed exactly the same stimuli as in the absolute disparity main experiment, but they were reordered to present the eight stimuli from the "mixed" block in eight separate scans. The data were analyzed by averaging across these eight scans. For the relative disparity control, likewise, one block consisted of four repeated presentations of a stimulus that had the same relative disparity (±18 arcmin) used in the "same" block of the relative disparity experiment (which was also the same stimulus used in the absolute disparity control), while the other block in each scan consisted of four repeated presentations of one of the eight relative disparity stimuli (Table 2).

To understand the logic of the control experiment, we begin by assuming that there was no adaptation and that the response modulations observed in the main experiment were caused by a lower responsivity to the stimuli in the "same" block than to those in the "mixed" block. If this were true (in the complete absence of adaptation), the control experiment would have given the same results as the main experiment. It did not (see Table 3), from which we conclude that the responses measured in the main experiment were caused by adaptation to the repeated stimulus presentations in the "same" block, not by a lower responsivity to the stimuli in the "same" block.

Baseline scans

To properly compare the strength of adaptation effects, it is necessary to take into account possible differences in baseline responsivity across visual areas. We therefore defined a "disparity selectivity index," which we computed as the ratio of the mean response from the adaptation scans to the mean response elicited during a separate series of baseline scans, separately for each subject.

The baseline scans consisted of 12 blocks, eight trials per block (as in the main experiment). During the "on" block, we presented a version of the stimulus in which each dot in each plane was randomly assigned one of the absolute disparities used in the main experiment. This generated two clouds of dots in depth, one above and one below fixation. During the "off" block, no stimulus was presented (other than the fixation square). Subjects were not performing any task.

Defining the visual areas

Visual areas were defined using well-established methods that have been extensively described previously (DeYoe et al. 1996Go; Engel et al. 1994Go, 1997Go; Sereno et al. 1995Go). Briefly, we presented rotating and expanding-contracting stimuli that evoked traveling waves of activity in retinotopic visual areas. To visualize the retinotopic maps, we rendered the fMRI data on a computationally flattened representation (flat map) of each subject's brain using software developed at Stanford University (Teo et al. 1998Go; Wandell et al. 2000Go). These procedures allowed for the determination of area boundaries and identification according to well-known anatomical arrangements. We mapped V1, V2, V3, V3A, hV4 (Wade et al. 2002Go), V7 (Press et al. 2001Go; Tootell et al. 1998Go), and V8 (Hadjikhani et al. 1998Go) in each subject. The anterior borders of V7 and V8 were often difficult to define precisely. We defined those areas consistent with the retinotopic maps and so that their size would be comparable to early ones. Because our analysis focuses on differences between groups of areas, an exact definition of area boundaries is not crucial to our conclusions. There is some debate over the definition and nomenclature of some of these visual areas, such as V8 versus V4{alpha} (Wandell and Wade 2003Go; Zeki and Bartels 1999Go) and V4v versus hV4 (Fize et al. 2003Go; Wade et al. 2002Go). We adopted hV4 as defined by Wade et al. (2002)Go, and we defined V8 as an area adjacent to hV4 with a retinotopic map of a quarter field.

Area MT+ (the MT complex), also known as V5, was further defined in a separate scanning session as a contiguous region of gray matter in the occipital extension of the inferior temporal cortex that responded more strongly to full field moving dots than to a stationary dot pattern (Huk et al. 2002Go; Tootell et al. 1995Go; Zeki et al. 1991Go).

Each of the above visual areas was further restricted according to the measured responses from "reference" scans. This was done for two reasons. First, the reference scan responses were used to extract the subregion of each visual area that corresponded retinotopically to the stimulus aperture. Second, we have found that doing so reduces session-to-session variability in the fMRI responses. We believe that some of the session-to-session variability derives from small differences in slice orientation and position such that voxels that were mostly gray matter in one session were only partially gray matter in a subsequent session. A liberal statistical threshold on the reference scan responses effectively compensated for this source of variability. The reference scans, which were run at the beginning and at the end of each session, consisted of 12 blocks, eight trials per block (as in the main experiment). During the "on" block, we presented the stimulus with all planes at zero (fixation) absolute disparity, thus reducing it to two square planes, one above and one below fixation. During the "off" block, no stimulus was presented (other than the fixation square). Subjects did not perform a task during the reference scans. We selected a subregion of gray matter within each visual area that was correlated with the stimulus alternations in the reference scans. The data were analyzed with several different choices of correlation threshold to ensure that our conclusions did not depend on a particular value.

The specific stimuli used for the reference and baseline conditions were somewhat arbitrary. The only critical issues in choosing these stimuli were that 1) the stimuli evoked strong responses in all of the visual cortical areas and 2) we needed to acquire separate, statistically independent data for each of these two purposes. We could have used the same stimuli for the reference scans and for the baseline scans. In fact we directly compared the spatial extent of activity to the reference and baseline stimuli and found that there was virtually no difference between the two conditions. Furthermore, we also re-analyzed our data using the reference scan stimulus (rather than the baseline condition) to calculate the adaptation indices, and again the results were almost identical.

Acquisition and analysis of fMRI data

MR imaging was performed on a GE 3T scanner with custom-designed dual surface coils (NMSC-002-TR-3GE transmit-receive coil, Nova Medical, Wakefield, MA).

Each scanning session began by acquiring a set of T1-weighted structural images using a spin-echo pulse sequence (500-ms repetition time, 15-ms echo time, 90 flip angle) in the same slices as the functional images. These inplane anatomical images were aligned to a high-resolution anatomical scan of each subject's brain using custom software (Nestares and Heeger 2000Go), so that the functional data (across multiple scanning sessions) from a given subject were co-registered.

fMRI scans were performed using a T2*-sensitive, gradient-recalled echo, spiral pulse sequence (Glover 1999Go; Glover and Lai 1998Go). Eleven obliquely oriented slices (either parallel or perpendicular to the calcarine sulcus) were acquired every 1.3 s (TR = 666 ms with 2 interleaves/frame), with an effective spatial resolution of 2.9 x 2.9 x 4 mm.

The fMRI data were preprocessed by 1) discarding the first block of each scan to minimize transient effects of magnetic saturation and to allow the hemodynamics to reach steady state, 2) removing the linear trend in the time series at each voxel to compensate for slow signal drift (Smith et al. 1999Go), 3) dividing each voxel's time series by its mean intensity to convert the data from arbitrary image intensity units to percent signal modulation and to compensate for the decrease in mean image intensity with distance from the coil, and 4) averaging the resulting time-series across the gray matter subregion of each visual area that corresponded retinotopically to the stimulus.

We quantified the stimulus-evoked responses by fitting a sinusoid to the resulting average time series. The amplitude and phase of this sinusoid equal the component of the discrete Fourier transform (DFT) at the block alternation period. The amplitude reflects the difference in cortical activity evoked by alternating between the two stimulus conditions. The phase reflects the temporal delay caused by the sluggish hemodynamics. The hemodynamic delay was estimated by computing the vector average of all the bivariate (amplitude and phase) responses from all of the experimental conditions, separately for each visual area in each subject. Then the response amplitudes were estimated by projecting the bivariate responses onto a line corresponding to the estimated hemodynamic delay (Heeger et al. 1999Go). This response amplitude was positive when the blood oxygenation level–dependent (BOLD) signal evoked during the "mixed" block was larger than the "same" block. The response amplitudes were averaged across the repeated scans for each visual area and each observer.

Adaptation indices were computed from the response amplitudes as shown in Fig. 3. The three small panels show time series (data for 1 subject averaged across scans) from the baseline scan (Fig. 3A), the absolute disparity adaptation experiment (Fig. 3B), and the relative disparity adaptation experiment (Fig. 3C). For each of these conditions, we computed a response amplitude in each visual area. The absolute disparity adaptation index was computed by dividing the response amplitude from the absolute disparity experiment by the response amplitude from the baseline experiment; this is the quantity on the abscissa in Fig. 3D. The relative disparity adaptation index was similarly obtained and plotted on the ordinate. A positive adaptation index indicates adaptation (i.e., smaller response during "same" blocks compared with "mixed" blocks). This procedure of normalizing by a baseline response is the same as that used by Huk and Heeger (2002)Go and Backus et al. (2001)Go, and is analogous to procedures used in neurophysiology for computing selectivity indices.



View larger version (32K):
[in this window]
[in a new window]
 
FIG. 3. Computation of adaptation indices. We computed the amplitude of the functional MRI (fMRI) responses (see METHODS) in each visual area for the baseline experiment (A), the absolute disparity adaptation experiment (B), and the relative disparity adaptation experiment (C). Absolute disparity adaptation index (abscissa in D) was computed by dividing response amplitude from the absolute disparity experiment by response amplitude from the baseline experiment. Relative disparity adaptation index (reported on ordinate) was computed similarly. Adaptation indices provide a measure of the amount of adaptation within a given area as a percentage of overall responsivity of that area to the adapting attribute. For example, a value of 0.1 means that response difference due to adaptation was ~10% as large as that evoked by alternating the stimulus with a blank screen. Black, red, and blue curves represent data from the earliest visual area (V1), the most ventral area (V8), and the most dorsal area (V7), respectively. Error bars are ±SE, estimated using a bootstrap procedure (see METHODS).

 
Error estimates in Figs. 35 were obtained with a bootstrap method (Efron and Tibshirani 1993Go), in which random picks (with replacement) were repeatedly taken from the experimentally obtained data sets, separately for each condition (absolute, relative, baseline). Adaptation indices were computed from 1,000 samples of these synthetic data, thus generating bootstrap estimates of the sampling distributions. Error bars show ±SE.



View larger version (17K):
[in this window]
[in a new window]
 
FIG. 5. Control experiment. Same conventions as Fig. 4, but data now refer to a control experiment designed to measure the response differences to the 16 stimulus conditions used in the main experiments (see METHODS). Unlike the results of the main experiments (Fig. 4), there are no differences between visual areas, thereby implying that results in the main experiment are due to adaptation. Error bars plot ±SE, estimated using a bootstrap procedure (see METHODS).

 
Because of potential correlations across visual areas, data acquired simultaneously from different visual areas cannot be treated as independent when assessing the statistical reliability of our results. We therefore performed a bootstrap analysis that incorporated these potential correlations. Specifically, we repeatedly resampled the data separately for each stimulus condition. Each sample consisted of a vector of response amplitudes, corresponding to all of the visual areas, from the same scan. If there were scan-to-scan correlations between two areas such that they both tended to be more active during certain scans and less active during others, this correlation would have been preserved by the resampling. We then used the resampled response amplitudes to compute adaptation indices, average across subjects (Table 4), and average further across visual areas (Table 5). For each resampling, bootstrap adaptation indices were compared according to the different hypotheses (e.g., early > dorsal). The percentage of resampled sets for which the hypothesis is confirmed yields the probability value for the hypothesis, reported in Tables 4 and 5. When this value is 1, it indicates that the hypothesis is true. When equal to 0, it indicates that the complementary hypothesis (e.g., early < dorsal when testing early > dorsal) is true.


View this table:
[in this window]
[in a new window]
 
TABLE 4. Bootstrap statistics for each visual area averaged across subjects

 

View this table:
[in this window]
[in a new window]
 
TABLE 5. Bootstrap statistics averaged across visual area groups and across subjects

 

    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Main experiment

We observed effects consistent with adaptation in both experiments, but the adaptation effects differed across visual areas (Fig. 4). Early areas (Fig. 4, black symbols) exhibited small (but significant, see Table 4) effects that were roughly the same for both types of disparity. Dorsal areas (Fig. 4, blue symbols), on the other hand, departed from early areas in that they showed strong adaptation to absolute disparity (stronger than early areas, see Table 5), but no adaptation to relative disparity (Table 4). This is clearly visible in the projection histogram at the top right of Fig. 4, where the blue data points are shifted away from the unity line. Ventral areas (Fig. 4, red symbols) showed equal and significant (Table 4) adaptation to both types of disparity, but the amount of adaptation (to both relative and absolute disparity) was greater than in early areas (highly significant, Table 5). This pattern is summarized by the two arrows in Fig. 4, which start at the average for the early visual areas and point to the averages for the dorsal and ventral areas. The projection histogram at the bottom of the plot shows the adaptation to absolute disparity and shows the greater adaptation for both dorsal and ventral areas (red and blue bars) compared with the early areas (black bars). Similarly, the histogram on the left shows the adaptation to relative disparity and shows the greater adaptation for ventral areas (red bars) than to early and dorsal areas (black and blue bars).



View larger version (24K):
[in this window]
[in a new window]
 
FIG. 4. Adaptation to absolute and relative disparity in different visual areas. Each point reports absolute (abscissa) and relative (ordinate) disparity adaptation indices for 1 visual area in 1 subject. Early visual areas (V1, V2, and V3) are in black, ventral areas (hV4 and V8) in red, and dorsal ones (V3A, MT+, and V7) in blue. Yellow arrow points from the mean for early areas to the mean for ventral areas; the cyan arrow from early areas to dorsal areas. Histograms are projected distributions along cardinal and diagonal axes. Error bars plot ±SE, estimated using a bootstrap procedure (see METHODS).

 
These results were also evident in the fMRI response amplitudes (from which the adaptation indices were computed), separately for each subject and visual area (Fig. 6; Table 3A). There are four main results that were evident in the main experiments (the results from the control experiment are discussed in Control experiment). First, the responses were generally positive, consistent with adaptation. Second, the response amplitudes were similar in magnitude for the absolute and relative disparity experiments for visual areas V1, V2, V3, hV4, and V8. The only exceptions to this were in subject HB, who exhibited weak responses to relative disparity in V3 and V8. Third, adaptation was stronger in ventral areas than in early visual areas. This conclusion is reinforced by the baseline responses (Fig. 7), which showed the opposite pattern (early responses > ventral responses). The combination of larger adaptation in ventral and larger baseline in early areas resulted in the large difference between the regions when we computed adaptation indices. Fourth, dorsal areas (V3A, V7, and MT+) exhibited strong adaptation to absolute disparity and weak or negative adaptation to relative disparity.



View larger version (37K):
[in this window]
[in a new window]
 
FIG. 6. fMRI response amplitudes [% blood oxygenation level–dependent (BOLD) signal modulation] for each subject, visual area, and experimental condition (absolute and relative disparity for both main and control experiments). Error bars plot ±SE.

 

View this table:
[in this window]
[in a new window]
 
TABLE 3. Statistical significance of fMRI response amplitudes for each visual area and subject

 


View larger version (36K):
[in this window]
[in a new window]
 
FIG. 7. fMRI response amplitudes (% BOLD signal modulation) for each subject and visual area in the baseline experiment (see METHODS). Notice that the ordinate scale is an order of magnitude larger than in Fig. 6. Error bars plot ±SE.

 
Control experiment

Reductions in activity during "same" blocks compared with "mixed" blocks could be explained in two different ways. The first explanation is based on adaptation: the single disparity that is repeatedly presented in the "same" block leads to adaptation of the neurons that respond to it and therefore to reduced neural activity. This does not happen during the "mixed" blocks, because different disparities are presented and never repeated. Our current hypothesis is based on this explanation. However, an alternative explanation could be that the disparity we chose for the "same" block was less effective per se (in the absence of adaptation) in driving neuronal activity than the disparities chosen for the "mixed" block. This would be sufficient to cause a smaller response in the "same" block. To verify that this potential explanation did not apply in our experiments, we ran a control experiment designed to measure the responses to each of the 16 stimulus conditions (8 for absolute, 8 for relative) separately (see METHODS).

The results of the control experiments indicate that our main results were due to adaptation and not simply to differences in responsivity to the different disparity levels (Fig. 5). If our results were due to adaptation, the effects we observed in our main experiments should disappear in the control. If, on the other hand, the effects we observed were simply due to differences in responses to the different disparity levels, the outcome of the control experiment should look very similar to that obtained in the main experiment. Most of the data from the control experiments showed no effect (the data points clearly cluster around the origin). When averaged across subjects, the data showed a small effect of negative absolute disparity adaptation in three visual areas (Table 4), but there were no statistically significant differences between groups of areas (early, dorsal, and ventral) in either absolute or relative disparity adaptation indices (Table 5).

These results were also evident in the fMRI response amplitudes, separately for each subject and visual area (Fig. 6; Table 3B). The responses were small or negative for both control experiments in all three subjects (Fig. 6). In only a few cases were the responses statistically significant (Table 3B).

Psychophysics

The purpose of the psychophysical task was to engage subjects equally in both the "same" and the "mixed" blocks, so that differences in activation between these two blocks would not be dominated by the subjects' attentional state (Huk and Heeger 2000Go). To that end, we adjusted the task difficulty to control performance accuracy as a proxy for controlling attention.

Performance was not perfectly matched between blocks, but the same small differences were present in both the main and control experiments (Table 6). The mismatch in performance resulted from a technical limitation on the number of interplane disparities that could be sampled by the staircase procedure. While there were differences in psychophysical performance between (same and mixed) blocks, these differences were present in both our main experiments and in our control experiments, but significant adaptation effects were only observed in the former. We can conclude that adaptation effects observed in the main experiment were not a consequence of differences in psychophysical performance.


View this table:
[in this window]
[in a new window]
 
TABLE 6. Psychophysical results averaged across all subjects

 
It is also unlikely that our results were due to the addition of the very small disparity increments in the psychophysical task. Many previous studies have found that thresholds for detecting a disparity increment increase when the stimulus is moved away from fixation (Badcock and Schor 1985Go; Blakemore 1970Go; McKee et al. 1990Go; Siderov and Harweth 1995Go). This was also true in our data. In the absolute disparity experiment, the disparity increment was slightly larger (1.4 arcmin on average) in the "mixed" than the "same" blocks. In the relative disparity experiment, the disparity increment was slightly larger (2.5 arcmin on average) in the "same" than the "mixed" blocks. These differences in the disparity increments were, however, very small compared with disparity tuning curves measured electrophysiologically, and by definition, threshold disparity increments are small relative to psychophysical bandwidths. In addition, these disparity increments were an order of magnitude smaller than the full range of disparities represented by cortical neurons (Prince et al. 2002aGo).


    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Summary of results

Our results can be summarized as follows. In early visual areas (V1, V2, and V3), there were small effects in both the absolute and relative disparity experiments. In dorsal and ventral streams, different patterns emerged. Dorsal areas (V3A, V7, and MT+) exhibited adaptation to (and hence, selectivity for) absolute disparity but not relative disparity. Ventral areas (hV4 and V8), on the other hand, exhibited equal adaptation to both types of disparity, implying either that an equal number of neurons in these areas are selective for both absolute and relative disparity or that the neurons exhibit partial selectivity for relative disparity. The control experiment allowed us to exclude the possibility that these results were due to differential responses to the particular stimulus configurations in the absence of adaptation. The psychophysical data allowed us to exclude the possibility that our results were due to differences in attention or behavioral performance across conditions.

Overall size of the effects

The effects of adaptation that we observed were rather small; the overall mean adaptation index was ~0.1, meaning that the response differences due to adaptation were only ~10% as large as those evoked by alternating the stimuli with a blank screen. There are at least two reasons for the small size of the effects. First, not all neurons in early visual areas are selective for disparity, and even among "disparity-selective" cells, there is a continuum of selectivity (DeAngelis and Newsome 1999Go; Prince et al. 2002bGo; Roy et al. 1992Go). Second, our experimental protocol only exposed adaptation in a fraction of this disparity-selective subpopulation. Our experiments targeted neurons with a disparity tuning profile that was reasonably selective for one of our stimulus conditions (with a particular absolute disparity or a particular relative inter-plane disparity) but not other stimuli (with disparities as nearby as ±4 arcmin). Electrophysiological (Prince et al. 2000Go, 2002bGo) and psychophysical (Cormack et al. 1993Go; Neri et al. 1999Go; Stevenson et al. 1992Go) studies indicate that it is reasonable to expect this degree of selectivity in some disparity-selective neurons. Many neurons are, however, responsive to a broad range of disparities (≤1°) (Prince et al. 2002aGo). These neurons would respond, and consequently adapt, equally to stimuli presented in both ("same" and "mixed") blocks; therefore no differential effect would be observed.

Effect of relative disparity between upper and lower hemifields

Is it possible that the interpretation of our results is confounded by the presence of neurons whose receptive fields were large enough to span both pairs of planes? When referring to relative disparity in the design of these experiments, we mean the local interplane distance restricted to a spatial region within either the top or bottom pair of planes. Because all the visual areas explored in this study were defined by their retinotopic organization, it is unlikely that the receptive fields of many neurons spanned both upper and lower hemifields. We accept, however, that there could have been some neurons (e.g., with central receptive fields) for which this was the case. In the absolute disparity experiment "mixed" block, there was a changing relative disparity between the upper and lower pairs of planes. If a significant proportion of neurons were selective to the relative disparity between the upper and lower hemifields in a particular visual area, this change in relative disparity would predict the larger response that was found in the "mixed" block in the absolute disparity experiment. Thus if we only consider the results of this experiment, it is not possible to distinguish adaptation to relative disparity between the upper and lower visual fields from adaptation to absolute disparity within a stimulus pair. However, the interpretation of our results is unambiguous when we take into account the results of the relative disparity experiment. In the relative disparity experiment, the relative disparity between the upper and lower visual fields was constant during the "mixed" block, and it was changing during the "same" block. Therefore if it were the relative disparity between the upper and lower pairs of planes causing the adaptation in the absolute disparity experiment, one would also expect a larger response to the "same" condition in the relative disparity experiment (i.e., a negative adaptation to relative disparity). Because this only occurred in a single subject (Table 3A, subject HB, visual areas V3A, V7, and MT+), we suggest that this is an unlikely explanation of our results.

Potential role of featural attention

Detailed analysis of our psychophysical data allows us to exclude that our results may be due to unspecific changes in the attentional state of our subjects (see RESULTS section). However, it seems possible that our results could be partially influenced by more specific extraretinal signals, such as featural attention. Our relative disparity task required observers to select different regions of depth space in different conditions, and it is possible that the attentional strategies underlying these selection processes were different for the different stimulus conditions we explored. For example, the "same" block in the absolute disparity experiment was the only condition in which observers could always focus on the same depth region. Another interpretation along similar lines may be that top-down attention is directed to regions of cortex encoding for the property that varies rather than to those representing the property that remains constant—in this scenario, our signals would not reflect neural adaptation but rather top-down attentional shifts.

It appears to us that any interpretation along these lines would have to be rather convoluted to account for all our results, including the differences we observed across visual areas, and that such formulations would not be aided by solid experimental evidence. Instead, we provide a physiologically justified interpretation of our data that is consistent with a large number of previous studies on this subject.

Possible physiological interpretations

In monkey electrophysiology, data directly pertaining to the issue addressed in this paper (coding of absolute and relative disparity) is available for areas V1, V2, MT, and IT. However, there are many different stimuli that can be used for investigating relative disparity tuning. The current experiment used transparent planes, while many single unit studies used a center-surround relative disparity configuration. There is currently no evidence to suggest whether or not these different types of stimuli will be coded with the same neurons. We also briefly consider studies measuring the response of single neurons to binocularly correlated and anti-correlated random dot stereograms (RDS), as depth is only perceived in correlated stereo-pairs. If neurons in specific visual areas represent perceived depth, one might expect neurons in such areas to be both selective for relative disparity, and only respond to correlated RDS stimuli.

Our results in early visual areas differ from the single-unit physiology. Single unit recordings have shown that V1 neurons are only selective for absolute disparity (Cumming and Parker 1999Go). V2, on the other hand, contains a small but significant number of units that show partial selectivity for relative disparity (Thomas et al. 2002Go). No such distinction between V1 and V2 was seen in our data. Rather, we observed small but roughly equal effects for both relative and absolute disparities in V1, V2, and V3. Our failure to find a difference between V1 and V2 in selectivity for relative disparity might follow from the fact that any such difference would be expected to be small when averaged across the entire neural population (with a small proportion of V2 neurons exhibiting only partial selectivity for relative disparity). The adaptation to relative disparity that we observed in V1 is not consistent with previous literature (Cumming and Parker 1999Go), and we do not have an obvious explanation for it. One possibility is that it may reflect feedback from ventral areas, which did show a stronger effect for relative disparity. The overall conclusion that we draw with respect to early areas is that, consistent with the physiology, they are likely to be involved in the early steps of stereoscopic processing. This is also in line with studies using correlated and anticorrelated random dot stereograms (Cumming and Parker 1997Go).

The only dorsal area for which we have relevant electrophysiological data is MT. Using center-surround RDS stimuli, Uka and DeAngelis (2002)Go reported that there is no coding of relative disparity in MT, and a similar conclusion was reached by Tsao et al. (2003)Go. Our fMRI results are in agreement with these studies and actually take an even stronger stand in this respect—the data in Fig. 4 suggest that, as one proceeds along the dorsal stream, stereoscopic processing becomes more involved with information about absolute disparity and less with relative. There is, however, evidence that some MT neurons are selective for relative disparity in that they respond selectively to slanted surfaces, irrespective of the absolute position in depth of the surface (Nguyenkim and DeAngelis 2003Go). Our results may also seem inconsistent with micro-stimulation studies in which it was shown that activity in MT can influence stereoscopic judgements (DeAngelis et al. 1998Go), but we would argue that this is not necessarily the case. What these micro-stimulation studies show is that MT is part of the circuitry that leads to the final stereoscopic percept (as assessed using certain behavioral parameters), in the same way that the computation of absolute disparities is part of the processing that leads to the computation of relative disparities. However, they do not imply that the neural representation of the final stereoscopic percept must reside in MT. This consideration also applies to psychophysical studies in which it was shown that anticorrelated signals affect behavioral responses in a way that resembles very closely the response of neurons in V1 (Neri et al. 1999Go). While the earliest stage of binocular combination can be exposed psychophysically in conditions in which it affects behavioral performance, it does not mean that the final percept actually resides at that stage.

Ventral area IT neurons are selective for disparity-defined shapes, a computation that requires the use of relative disparity (Janssen et al. 2000Go). However, such stimuli are more complicated than the transparent planes used in this study, because they contain disparity gradients and curvature. The same group showed that neurons in IT do not respond to anticorrelated random-dot stimuli (Janssen et al. 2003Go). It is possible that anticorrelated signals are discarded at an earlier stage between V1 and IT, but at least at the level of this ventral area neuronal signals seem to correlate more closely with perception. The fMRI results presented here point in a direction that is consistent with this electrophysiological evidence. Our data indicate that if one is to find a visual area that codes predominantly for relative disparity, this is likely to be along the ventral, and not the dorsal, stream.

Our results are also in agreement with previous fMRI studies of stereoscopic depth perception. Backus et al. (2001)Go addressed the relationship between neural activity and stereoscopic depth perception. These authors showed that most retinotopically defined areas in visual cortex display activity that correlates with behavioral parameters of stereoscopic perception—this trend became more evident progressing from V1 toward extrastriate cortex and was particularly marked in area V3A. A recent study by Tsao et al. (2003)Go examined disparity sensitivity using fMRI in both macaque monkeys and humans. Using a disparity checkerboard pattern, they showed a similar pattern of activation to Backus et al. (2001)Go and also showed that MT does not respond well to this edge-rich disparity pattern but prefers large disparity patterns that changed coherently (i.e., without relative disparity). Neither of these studies, however, was specifically designed to assess selectivity for relative versus absolute disparity. Although Tsao et al. (2003)Go did attempt to address this issue, their experiments did not allow for a segregation of neural subpopulations specifically encoding for relative disparity. Their relative disparity condition contained (obviously) strong absolute disparity signals, and it is conceivable that their absolute disparity condition evoked responses in relative disparity selective units.

It is widely believed that the phenomena of stereovision require an explanation in terms of the relative changes in the responses of subpopulations of neurons with different disparity selectivities. An increase in overall level of activity in a cortical area in response to a stereoscopic stimulus does not mean that neurons in that area are selective for disparity. Such an increase in activity might, to the contrary, be caused by increased attention to the stereoscopic percept (Huk et al. 2001Go). Likewise, a lack of an increase does not imply that the neurons are not selective. For example, a particular cortical area may contain subpopulations of neurons with different selectivities such that changing the stimulus shifts the activity from one subpopulation to another, while overall activity remains unchanged. Our goal in using an adaptation protocol was to explicitly assess selectivity for absolute and relative disparity to identify the roles played by individual brain regions in different computational stages of disparity processing. Adaptation can be used to reveal the selectivities of subpopulations of neurons in the human brain, even when those neurons are intermingled at a spatial scale that is finer than the spatial sampling resolution (voxel size) of the fMRI measurements (Engel and Furmanski 2001Go; Grill-Spector and Malach 2001Go; Huk and Heeger 2002Go; Huk et al. 2001Go; Kourtzi and Kanwisher 2001Go).

The results presented here suggest a rough dichotomy between dorsal and ventral streams, in which signals about absolute disparity are mostly represented in dorsal areas, whereas relative disparity coding is represented (together with absolute disparity) in ventral areas. Tyler (1990)Go suggested a similar dichotomy between magno and parvo pathways on the basis of psychophysical evidence. It is important to notice that, although it is true that humans perform much better when relative disparity signals are available (Westheimer 1979Go), and that large changes in absolute disparity go unnoticed when relative disparity is kept constant (Erkelens and Collewijn 1985Go; Regan et al. 1986Go), it is also the case that humans do perceive absolute disparity and can use it to make coarse judgments about the depth of objects (stereoacuity thresholds for the depth task designed by Westheimer 1979Go are measurable when only absolute disparity is available, despite being 5 times larger than the corresponding relative disparity thresholds). This means that the concept of associating only relative disparity with stereoscopic perception is an oversimplification. A less radical view would be to associate different behavioral demands with the two different types of disparity information. For example, absolute disparity can be useful in providing a rough estimate of the distance of an approaching object, as well as in controlling vergence eye movements (Howard and Rogers 1995Go). If signals about absolute disparity are made available more quickly to visual cortex, spatial navigation and orienting may benefit from these signals. This would also make sense in the context of our results, because the dorsal stream has been associated with this type of behavior (Goodale and Milner 1992Go). Relative disparity becomes necessary when making fine judgments about the precise three-dimensional shape of an object. This also makes sense in the context of our results because shape processing and object recognition have been associated with the ventral stream (Goodale and Milner 1992Go).

It is clear that further research is needed, using both electrophysiological and imaging techniques, if we are to obtain a full account of the neural basis of stereoscopic processing. Our results prompt electrophysiologists interested in these problems to direct their efforts toward the ventral stream, a region of cortex that has so far been relatively neglected in studies of perceptually relevant stereoscopic signals compared with its dorsal counterpart.


    GRANTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
This project was supported by Wellcome Trust International Prize Traveling Research Fellowship GR063322MA to P. Neri; the Wellcome Trust, The Physiological Society, the Guarantors of Brain, and a Network Grant from the McDonnell Centre for Cognitive Neuroscience (University of Oxford) to H. Bridge; and National Eye Institute Grant R01-EY-12741 to D. J. Heeger.


    ACKNOWLEDGMENTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
We thank A. Parker and B. Cumming for useful comments on the manuscript.

Present addresses: P. Neri, 486–488 Minor Hall, University of California, Berkeley, CA 94720-2020; D. J. Heeger, Department of Psychology and Center for Neural Science, New York University, 6 Washington Place, New York, NY 10003.


    FOOTNOTES
 
The costs of publication of this article were defrayed in part by the payment of page charges. The article must therefore be hereby marked "advertisement" in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

Address for reprint requests and other correspondence: P. Neri, Dept. of Zoology, Univ. of Cambridge, Downing St., Cambridge CB2 3EJ, UK (E-mail: pn232{at}hermes.cam.ac.uk).


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Backus BT. Stereoscopic vision: what's the first step? (Dispatch). Curr Biol 10: R701–R703, 2000.[CrossRef][Web of Science][Medline]

Backus BT, Fleet DJ, Parker AJ, and Heeger DJ. Human cortical activity correlates with stereoscopic depth perception. J Neurophysiol 86: 2054–2068, 2001.[Abstract/Free Full Text]

Badcock C and Schor C. Depth-increment detection functions for individual spatial channels. J Opt Soc Am A 2: 1211–1216, 1985.[Web of Science][Medline]

Barlow HB, Blakemore C, and Pettigrew JD. The neural mechanism of binocular depth discrimination. J Physiol 193: 327–342, 1967.[Abstract/Free Full Text]

Blakemore CB. The range and scope of binocular depth discrimination. J Physiol 211: 599–622, 1970.[Abstract/Free Full Text]

Braddick OJ and Atkinson J. Some recent findings on the development of human binocularity: a review. Behav Brain Res 10: 141–150, 1983.[CrossRef][Web of Science][Medline]

Brefczynski JA and DeYoe EA. A physiological correlate of the ‘spotlight’ of visual attention. Nature Neurosci 2: 370–374, 1999.[CrossRef][Web of Science][Medline]

Burkhalter A and Van Essen DC. Processing of color, form and disparity information in visual areas VP and V2 of ventral extrastriate cortex in the macaque monkey. J Neurosci 6: 2327–2351, 1986.[Abstract]

Cormack LK, Stevenson SB, and Schor CM. Disparity-tuned channels of the human visual system. Vis Neurosci 10: 585–596, 1993.[Web of Science][Medline]

Cumming BG. Stereopsis: where depth is seen. Curr Biol 12: R93–R95, 2002.[CrossRef][Web of Science][Medline]

Cumming BG and Parker AJ. Responses of primary visual cortical neurons to binocular disparity without depth perception. Nature 389: 280–283, 1997.[CrossRef][Medline]

Cumming BG and Parker AJ. Binocular neurons in V1 of awake monkeys are selective for absolute, not relative, disparity. J Neurosci 19: 5602–5618, 1999.[Abstract/Free Full Text]

Cumming BG and Parker AJ. Local disparity not perceived depth is signaled by binocular neurons in cortical area V1 of the macaque. J Neurosci 20: 4758–4767, 2000.[Abstract/Free Full Text]

DeAngelis GC, Cumming BG, and Newsome WT. Cortical area MT and the perception of stereoscopic depth. Nature 394: 677–680, 1998.[CrossRef][Medline]

DeAngelis GC and Newsome WT. Organization of disparity-selective neurons in macaque area MT. J Neurosci 19: 1398–1415, 1999.[Abstract/Free Full Text]

DeYoe EA, Carman GJ, Bandettini P, Glickman S, Wieser J, Cox R, Miller D, and Neitz J. Mapping striate and extrastriate visual areas in human cerebral cortex. Proc Natl Acad Sci USA 93: 2382–2386, 1996.[Abstract/Free Full Text]

Efron B and Tibishirani R. An Introduction to the Bootstrap. New York: Chapman and Hall, 1993.

Engel SA and Furmanski CS. Selective adaptation to color contrast in human primary visual cortex. J Neurosci 21: 3949–3954, 2001.[Abstract/Free Full Text]

Engel SA, Glover GH, and Wandell BA. Retinotopic organization in human visual cortex and the spatial precision of functional MRI. Cereb Cortex 7: 181–192, 1997.[Abstract/Free Full Text]

Engel SA, Rumelhart DE, Wandell BA, Lee AT, Glover GH, Chichilnisky EJ, and Shadlen MN. fMRI of human visual cortex. Nature 369: 525, 1994.[CrossRef][Medline]

Erkelens CJ and Collewijn H. Motion perception during dichoptic viewing of moving random-dot stereograms. Vision Res 25: 583–588, 1985.[CrossRef][Web of Science][Medline]

Felleman DJ and Van Essen DC. Receptive field properties of neurons in area V3 of macaque monkey extrastriate cortex. J Neurophysiol 57: 889–920, 1987.[Abstract/Free Full Text]

Ferraina S, Pare M, and Wurtz RH. Disparity sensitivity of frontal eye field neurons. J Neurophysiol 83: 625–629, 2000.[Abstract/Free Full Text]

Fiorentini A and Maffei L. Electrophysiological evidence for binocular disparity detectors in human visual system. Science 169: 208–209, 1970.[Abstract/Free Full Text]

Fize D, Vanduffel W, Nelisson K, Denys K, Chef d'Hotel C, Faugeras O, and Orban GA. The retinotopic organization of primate dorsal V4 and surrounding areas: a functional magnetic resonance imaging study in awake monkeys. J Neurosci 23: 7395–7406, 2003.[Abstract/Free Full Text]

Gandhi SP, Heeger DJ, and Boynton GM. Spatial attention affects brain activity in human primary visual cortex. Proc Natl Acad Sci USA 96: 3314–3319, 1999.[Abstract/Free Full Text]

Gilaie Dotan S, Ullman S, Kushnir T, and Malach R. Shape-selective stereo processing in human object-related visual areas. Hum Brain Map 15: 67–79, 2002.[CrossRef][Web of Science][Medline]

Glover GH. Simple analytic spiral K-space algorithm. Magn Reson Med 42: 412–415, 1999.[CrossRef][Web of Science][Medline]

Glover GH and Lai S. Self-navigated spiral fMRI: interleaved versus single-shot. Magn Reson Med 39: 361–368, 1998.[Web of Science][Medline]

Gnadt J and Mays L. Neurons in monkey parietal area lip are tuned for eye-movement parameters in three-dimensional space. J Neurophysiol 73: 280–297, 1995.[Abstract/Free Full Text]

Goodale MA and Milner AD. Separate visual pathways for perception and action. Trends Neurosci 15: 20–25, 1992.[CrossRef][Web of Science][Medline]

Grill-Spector K, Kushnir T, Edelman S, Avidan-Carmel G, Itzchak Y, and Malach R. Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron 24: 187–203, 1999.[CrossRef][Web of Science][Medline]

Grill-Spector K and Malach R. fMR-adaptation: a tool for studying the functional properties of human cortical neurons. Acta Psychologica 107: 293–321, 2001.[CrossRef][Medline]

Gulyas B and Roland PE. Binocular disparity discrimination in human cerebral cortex: functional anatomy by positron emission tomography. Proc Natl Acad Sci USA 91: 1239–1243, 1994.[Abstract/Free Full Text]

Hadjikhani N, Liu AK, Dale AM, Cavanagh P, and Tootell RB. Retinotopy and color sensitivity in human visual cortical area V8. Nat Neurosci 1: 235–241,1998.[CrossRef][Web of Science][Medline]

Heeger DJ, Boynton GM, Demb JB, Seidemann E, and Newsome WT. Motion opponency in visual cortex. J Neurosci 19: 7162–7174, 1999.[Abstract/Free Full Text]

Hinkle D and Connor C. Disparity tuning in macaque area V4. Neuroreport 12: 365–369, 2000.

Howard IP and Rogers BJ. Binocular Vision and Stereopsis. New York: Oxford, 1995.

Huk AC, Dougherty RF, and Heeger DJ. Retinotopy and functional subdivision of human areas MT and MST. J Neurosci 22: 7195–7205, 2002.[Abstract/Free Full Text]

Huk AC and Heeger DJ. Task-related modulation of visual cortex. J Neurophysiol 83: 3525–3536, 2000.[Abstract/Free Full Text]

Huk AC and Heeger DJ. Pattern-motion responses in human visual cortex. Nat Neurosci 5: 72–75, 2002.[CrossRef][Web of Science][Medline]

Huk AC, Ress D, and Heeger DJ. Neuronal basis of the motion aftereffect reconsidered. Neuron 32: 161–172, 2001.[CrossRef][Web of Science][Medline]

Janssen P, Vogels R, Liu Y, and Orban GA. At least at the level of inferior temporal cortex, the stereo correspondence problem is solved. Neuron 37: 693–701, 2003.[CrossRef][Web of Science][Medline]

Janssen P, Vogels R, and Orban GA. Selectivity for 3D shape that reveals distinct areas within macaque inferior temporal cortex. Science 288: 2054–2056, 2000.[Abstract/Free Full Text]

Julesz B. Foundations of Cyclopean Perception. Chicago, IL: Chicago University Press, 1971.

Kastner S, Pinsk MA, De Weerd P, Desimone R, and Ungerleider LG. Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron 22: 751–761, 1999.[CrossRef][Web of Science][Medline]

Kourtzi Z and Kanwisher N. Representation of perceived object shape by the human lateral occipital complex. Science 293: 1506–1509, 2001.[Abstract/Free Full Text]

Kwee IL, Fujii Y, Matsuzawa H, and Nakada T. Perceptual processing of stereopsis in humans: high-field (3.0-tesla) functional MRI study. Neurology 53: 1599–1601, 1999.[Abstract/Free Full Text]

Lehmann D and Julesz B. Lateralized cortical potentials evoked in humans by dynamic random-dot stereograms. Vision Res 18: 1265–1271, 1978.[CrossRef][Web of Science][Medline]

Marr D. Vision. New York: Freeman, 1985.

Martinez A, Anllo-Vento L, Sereno MI, Frank LR, Buxton RB, Dubowitz DJ, Wong EC, Hinrichs H, Heinze HJ, and Hillyard SA. Involvement of striate and extrastriate visual cortical areas in spatial attention. Nat Neurosci 2: 364–369, 1999.[CrossRef][Web of Science][Medline]

Maunsell JH and Van Essen DC. Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. J Neurophysiol 49: 1148–1167, 1983.[Abstract/Free Full Text]

McKee S, Levi D, and Bowne S. The imprecision of stereopsis. Vision Res 30: 1763–1779, 1990.[CrossRef][Web of Science][Medline]

Nakadomari S, Kitahara K, Kamada Y, Yoshida S, Kaito M, and Miyauchi S. The cuneus plays an important role in stereoscopic vision: a neuropsychological and fMRI study. Invest Ophthalmol Vis Sci Abstr 40: S819, 1999.

Neri P, Parker AJ, and Blakemore C. Probing the human stereoscopic system with reverse correlation. Nature 401: 695–698, 1999.[CrossRef][Medline]

Nestares O and Heeger DJ. Robust multiresolution alignment of MRI brain volumes. Magn Reson Med 43: 705–715, 2000.[CrossRef][Web of Science][Medline]

Nguyenkim JD and DeAngelis GC. Disparity-based coding of three-dimensional surface orientation in macaque middle temporal neurons. J Neurosci 23: 7117–7128, 2003.[Abstract/Free Full Text]

Nikara T, Bishop PO, and Pettigrew JD. Analysis of retinal correspondence by studying receptive fields of binocular single units in cat striate cortex. Exp Brain Res 6: 353–372, 1968.[Web of Science][Medline]

Norcia AM, Sutter EE, and Tyler CW. Electrophysiological evidence for the existence of coarse and fine disparity mechanisms in human. Vision Res 25: 1603–1611, 1985.[CrossRef][Web of Science][Medline]

Norcia AM and Tyler CW. Temporal frequency limits for stereoscopic apparent motion processes. Vision Res 24: 395–401, 1984.[CrossRef][Web of Science][Medline]

Parker AJ and Cumming BG. Cortical mechanisms of binocular stereoscopic vision. In: Progress in Brain Research 134: 205–216, 2001.[Web of Science][Medline]

Parker AJ, Cumming BG, and Dodd JV. Binocular neurons and the perception of depth. In: The Cognitive Neurosciences, edited by Gazzaniga M. Cambridge, MA: MIT Press, 2000, p. 263–278.

Pettigrew JD, Nikara T, and Bishop PO. Binocular interaction on single units in cat striate cortex: simultaneous stimulation by single moving slit with receptive fields in correspondence. Exp Brain Res 6: 391–410, 1968.[Web of Science][Medline]

Poggio GF, Gonzalez F, and Krause F. Stereoscopic mechanisms in monkey visual cortex: binocular correlation and disparity selectivity. J Neurosci 8: 4531–4550, 1988.[Abstract]

Press WA, Brewer AA, Dougherty RF, Wade AR, and Wandell BA. Visual areas and spatial summation in human visual cortex. Vision Res 41: 1321–1332, 2001.[CrossRef][Web of Science][Medline]

Prince SJD, Cumming BG, and Parker AJ. Range and mechanism of encoding in horizontal disparity in macaque V1. J Neurophysiol 87: 209–221, 2002a.[Abstract/Free Full Text]

Prince SJD, Pointon AJ, Cumming BG, and Parker AJ. The prediction of single neuron responses in cortical area V1 during stereoscopic depth judgements. J Neurosci 20: 3387–3400, 2000.[Abstract/Free Full Text]

Prince SJD, Pointon AJ, Cumming BG, and Parker AJ. Quantitative analysis of the responses of V1 neurons to horizontal disparity in random dot stereograms. J Neurophysiol 87: 191–208, 2002b.[Abstract/Free Full Text]

Ptito A, Zatorre RJ, Petrides M, Frey S, Alivisatos B, and Evans AC. Localization and lateralization of stereoscopic processing in the human brain. Neuroreport 4: 1155–1158, 1993.[Web of Science][Medline]

Regan D, Erkelens CJ, and Collewijn H. Necessary conditions for the perception of motion-in-depth. Invest Ophthalmol Vis Sci 27 :584–597, 1986.[Abstract/Free Full Text]

Regan D and Spekreijse H. Electrophysiological correlate of binocular depth perception in man. Nature 255: 92–94, 1970.

Ress D, Backus BT, and Heeger DJ. Activity in primary visual cortex predicts performance in a visual detection task. Nat Neurosci 3: 940–945, 2000.[CrossRef][Web of Science][Medline]

Roy JP, Komatsu H, and Wurtz RH. Disparity sensitivity of neurons in monkey extrastriate area MST. J Neurosci 12: 2478–2492, 1992.[Abstract]

Rutschmann R and Greenlee M. Human cortical areas responding to disparity: an fMRI study. Perception 28(suppl): 134, 1999.

Sereno MI, Dale AM, Reppas JB, Kwong KK, Belliveau JW, Brady TJ, Rosen BR, and Tootell RBH. Borders of multiple human visual areas in humans revealed by functional MRI. Science 268: 889–893, 1995.[Abstract/Free Full Text]

Shikata E, Tanaka Y, Nakamura H, Taira M, and Sakata H. Selectivity of the parietal visual neurons in 3D orientation of surface of stereoscopic stimuli. Neuroreport 7: 2389–2394, 1996.[Web of Science][Medline]

Siderov J and Harwerth R. Stereopsis, spatial frequency and retinal eccentricity. Vision Res 35: 2329–2337, 1995.[CrossRef][Web of Science][Medline]

Smith AM, Lewis BK, Ruttimann UE, Ye FQ, Sinnwell TM, Yang Y, Duyn JH, and Frank JA. Investigation of low frequency drift in fMRI signal. Neuroimage 9: 526–533, 1999.[CrossRef][Web of Science][Medline]

Stevenson SB, Cormack LK, Schor CM, and Tyler CW. Disparity tuning in mechanisms of human stereopsis. Vision Res 32: 1685–1694, 1992.[CrossRef][Web of Science][Medline]

Taira M, Tsutsui KI, Jiang M, Yara K, and Sakata H. Parietal neurons represent surface orientation from the gradient of binocular disparity. J Neurophysiol 83: 3140–3146, 2000.[Abstract/Free Full Text]

Teo P, Sapiro G, and Wandell BA. Creating connected representations of cortical gray matter for functional MRI visualization. IEEE Med Trans 16: 852–863, 1998.

Thomas OM, Cumming BG, and Parker AJ. A specialization for relative disparity in V2. Nature Neurosci 5: 472–478, 2002.[CrossRef][Web of Science][Medline]

Tootell RB, Hadjikhani N, Hall EK, Marrett S, Vanduffel W, Vaughan DT, and Dale AM. The retinotopy of visual spatial attention. Neuron 21: 1409–1422, 1998.[CrossRef][Web of Science][Medline]

Tootell RB, Reppas JB, Kwong KK, Malach R, Born RT, Brady TJ, Rosen BR, and Belliveau JW. Functional analysis of human MT and related visual cortical areas using functional magnetic resonance imaging. J Neurosci 15: 3215–3240, 1995.[Abstract]

Tsao DY, Vanduffel W, and Sasaki Y. Stereopsis activates V3A and caudal intraparietal areas in macaques and humans. Neuron 39: 555–568, 2003.[CrossRef][Web of Science][Medline]

Tyler CW. A stereoscopic view of visual processing streams. Vision Res 30: 1877–1895, 1990.[CrossRef][Web of Science][Medline]

Uka T and DeAngelis GC. MT neurons do not signal relative disparity. J Vision 2: 37a, 2002.

Wade AR, Brewer AA, Rieger JW, and Wandell BA. Functional measurements of human ventral occipital cortex: retinotopy and colour. Phil Trans Roy Soc B Lond 257: 963–973, 2002.

Wandell BA, Chial S, and Backus BT. Visualization and measurement of the cortical surface. J Cogn Neurosci 12: 739–752, 2000.[CrossRef][Web of Science][Medline]

Wandell BA and Wade AR. Functional imaging of the visual pathways. Neurol Clin North Am 21: 417–443, 2003.

Watanabe M, Tanaka H, Uka T, and Fujita I. Disparity-selective neurons in area V4 of macaque monkeys. J Neurophysiol 87: 1960–1973, 2002.[Abstract/Free Full Text]

Westheimer G. Cooperative neural processes involved in stereoscopic acuity. Exp Brain Res 36: 585–597, 1979.[Web of Science][Medline]

Wheatstone C. Contributions to the physiology of vision: part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision. Phil Trans Roy Soc B Lond 128: 371–394, 1838.[CrossRef]

Zeki S and Bartels A. The clinical and functional measurement of cortical (in-) activity in the visual brain, with special reference to the two subdivisions (V4 and V4{alpha}) of the human colour center. Phil Trans Roy Soc Lond B 354: 1371–1382, 1999.

Zeki S, Watson JC, Lueck CJ, Friston KJ, Kennard D, and Frackowiak RS. A direct demonstration of functional specialization in human visual cortex. J Neurosci 11: 641–549, 1991.[Abstract]




This article has been cited by other articles:


Home page
J. Neurosci.Home page
T. J. Preston, Z. Kourtzi, and A. E. Welchman
Adaptive Estimation of Three-Dimensional Structure in the Human Brain
J. Neurosci., February 11, 2009; 29(6): 1688 - 1698.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
S. Georgieva, R. Peeters, H. Kolster, J. T. Todd, and G. A. Orban
The Processing of Three-Dimensional Shape from Disparity in the Human Brain
J. Neurosci., January 21, 2009; 29(3): 727 - 742.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
T. J. Preston, S. Li, Z. Kourtzi, and A. E. Welchman
Multivoxel Pattern Selectivity for Perceptually Relevant Binocular Disparities in the Human Brain
J. Neurosci., October 29, 2008; 28(44): 11315 - 11327.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
A. W. Roe, A. J. Parker, R. T. Born, and G. C. DeAngelis
Disparity Channels in Early Vision
J. Neurosci., October 31, 2007; 27(44): 11820 - 11831.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
I. Dinstein, U. Hasson, N. Rubin, and D. J. Heeger
Brain Areas Selective for Both Observed and Executed Movements
J Neurophysiol, September 1, 2007; 98(3): 1415 - 1427.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
K. Umeda, S. Tanabe, and I. Fujita
Representation of Stereoscopic Depth Based on Relative Disparity in Macaque Area V4
J Neurophysiol, July 1, 2007; 98(1): 241 - 252.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
C. Nakatsuka, B. Zhang, I. Watanabe, J. Zheng, H. Bi, L. Ganz, E. L. Smith, R. S. Harwerth, and Y. M. Chino
Effects of Perceptual Learning on Local Stereopsis and Neuronal Responses of V1 and V2 in Prism-Reared Monkeys
J Neurophysiol, April 1, 2007; 97(4): 2612 - 2626.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
C. Chandrasekaran, V. Canon, J. C. Dahmen, Z. Kourtzi, and A. E. Welchman
Neural Correlates of Disparity-Defined Shape Discrimination in the Human Brain
J Neurophysiol, February 1, 2007; 97(2): 1553 - 1565.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
T. Uka and G. C. DeAngelis
Linking neural representation to function in stereoscopic depth perception: roles of the middle temporal area in coarse versus fine disparity discrimination.
J. Neurosci., June 21, 2006; 26(25): 6791 - 6802.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
S. O. Murray, C. A. Olman, and D. Kersten
Spatially Specific fMRI Repetition Effects in Human Visual Cortex
J Neurophysiol, April 1, 2006; 95(4): 2439 - 2445.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
J. Larsson, M. S. Landy, and D. J. Heeger
Orientation-Selective Adaptation to First- and Second-Order Patterns in Human Visual Cortex
J Neurophysiol, February 1, 2006; 95(2): 862 - 881.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
T. Uka, S. Tanabe, M. Watanabe, and I. Fujita
Neural Correlates of Fine Depth Discrimination in Monkey Inferior Temporal Cortex
J. Neurosci., November 16, 2005; 25(46): 10796 - 10802.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
P. Neri
A Stereoscopic Look at Visual Cortex
J Neurophysiol, April 1, 2005; 93(4): 1823 - 1826.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
92/3/1880    most recent
01042.2003v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (31)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Neri, P.
Right arrow Articles by Heeger, D. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Neri, P.
Right arrow Articles by Heeger, D. J.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Visit Other APS Journals Online
Copyright © 2004 by the The American Physiological Society.