JN Fuel your research with LabChart
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Neurophysiol 92: 1512-1523, 2004. First published April 14, 2004; doi:10.1152/jn.01174.2003
0022-3077/04 $5.00
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
92/3/1512    most recent
01174.2003v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (8)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Ilg, U. J.
Right arrow Articles by Churan, J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Ilg, U. J.
Right arrow Articles by Churan, J.

Motion Perception Without Explicit Activity in Areas MT and MST

Uwe J. Ilg1 and Jan Churan2

1Oculomotor Laboratory, Department of Cognitive Neurology, Hertie-Institute for Clinical Brain Research, University of Tübingen, D-72076 Tübingen; and 2Generation Research Program, University of München, 83646 Bad Tölz, Germany

Submitted 8 December 2003; accepted in final form 10 April 2004


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
It is widely accepted that middle temporal (MT) and middle superior temporal (MST) cortical areas in the brain of rhesus monkeys are essential for processing visual motion. We asked whether this assumption holds true if the moving stimulus consists of a second-order motion stimulus. In addition, we asked whether neurons in area MT and MST code for moving sound sources. To answer these questions, we trained three rhesus monkeys on a direction-discrimination task. Our monkeys were able to correctly report the direction of all motion stimuli used in this study. Firing rates of directionally selective neurons from area MT (n = 38) and MST (n = 68) were recorded during task performance. These neurons coded only for the stimulus movement if the motion stimulus was separated from the background by luminance or flicker (Fourier and drift-balanced motion). If these segregation cues were absent (in the case of theta motion and of the moving sound source), firing rates did not code for the stimulus' direction. Therefore we conclude that although areas MT and MST are undoubtedly involved in processing a moving stimulus, they are not the final cortical stages responsible for perceiving it.


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Animals' ability to correctly decode visual motion has likely been subject to significant evolutionary pressure. Tasks such as image segmentation, deducing structure from motion, judging time to collision, and recovering three-dimensional (3D) structure as well as goal-directed behavior are critically dependent on the appropriate analysis of visual motion signals (see Nakayama 1985Go for an overview). Visual motion can be related to ego motion of the subject or, alternatively, can be produced by the movement of an object in the external world. Here, we will address aspects of the neuronal processing underlying the perception of a moving object.

It is well established that visual-motion processing in primates is intimately related to the neuronal activity observed in the middle temporal (MT) and middle superior temporal (MST) areas (for review, see Albright 1993Go). It was shown that activity recorded from areas MT and MST is closely related to the perception of visual motion. Neurons in area MT respond to stochastic motion signals, and the strength of the responses increase with the number of coherently moving dots (Britten et al. 1993Go). Using such stochastic motion signals, a clear relationship between the monkey's behavioral choices and visual responses of area MT was found within single trials (Britten et al. 1996Go). For area MST, similar neuronal and psychophysical sensitivities were documented (Celebrini and Newsome 1994Go). Microstimulation in area MST affects the motion perception of monkeys (Celebrini and Newsome 1995Go) as well as the judgements of heading directions (Britten and van Wenzel 1998Go). Neurons recorded from the posterior polysensory part of the superior temporal sulcus (STPp) respond to moving stimuli in accordance with the monkeys' perception of motion (Thiele and Hoffmann 1996Go). More recently, it was shown that microstimulation in area MT affects both the monkey's choices and the speed of decision-making, i.e., monkeys decided more quickly in favor of the stimulation site's preferred direction (Ditterich et al. 2003Go). Lesions in area MT and MST result in an impairment of motion perception (Newsome and Paré 1988Go; Rudolph and Pasternak 1999Go). Finally, using a glass pattern (Glass 1969Go), it was shown that response properties in primate area MT and MST are similar to the properties of perception in humans and monkeys (Krekelberg et al. 2003Go).

Neuronal activity in areas MT and MST was also shown to be related to the execution of smooth-pursuit eye movements (SPEM) (Ilg and Thier 2003Go; Kawano et al. 1994Go; Newsome et al. 1988Go; Thier and Erickson 1992Go). Small lesions of these areas yield an ipsiversive deficit in SPEM (Dürstler and Wurtz 1988Go; Yamasaki et al. 1991Go). Intracortical microstimulation is able to modify ongoing SPEM (Born et al. 2000Go; Groh et al. 1997Go; Komatsu and Wurtz 1989Go).

In previous studies, the motion signal has been created by luminance-defined moving objects. However, a moving object need not be separated from the background by luminance or color. It can be defined by coherent moving dots [Fourier motion (fm)] (Cavanagh and Mather 1989Go), by changes in luminance [drift-balanced motion (dbm)] (Chubb and Sperling 1988Go), or by opposed motion [theta motion (tm)] (Zanker 1993Go). Note that the dbm stimulus is segregated from the background by flicker, whereas the tm stimulus has the same amount of flicker as the background. These two motion stimuli are referred to as second-order motion as opposed to first-order motion such as Fourier motion (Cavanagh and Mather 1989Go). Previously, it was assumed that neurons in area MT might code for the direction of a moving stimulus invariant of the stimulus' visual properties (Albright 1992Go; O'Keefe and Movshon 1998Go).

Most real-world moving objects provide not only visual motion cues but also auditory motion information. In the laboratory, the perception of a moving sound source can be produced in different ways: by binaural beat, by changing interaural time or intensity differences, by artificial auditory surround using individual head-related transfer functions, or by an actively moved loudspeaker. The area activated in the human brain depends on the kind of stimulus used (see Warren et al. 2002Go for a overview). Here, we opted for apparent auditory motion generated by the sequential activation of a single loudspeaker within a linear array of loudspeakers. It might be quite reasonable to assume that neurons in area MT and MST respond to a moving sound source, especially if the monkey has to report the direction of this movement. This idea is supported by cortical connectivity: there are direct anatomical connections from auditory cortical areas to area MST (Boussaoud et al. 1990Go). In addition, the primary visual cortex receives projections from the core and parabelt areas of the auditory cortex (Falchier et al. 2002Go).

The aim of the present study was twofold: first, we tried to prove that rhesus monkeys are able to correctly detect the direction of a stimulus defined either by second-order motion or by a moving sound source. Second, we asked whether the activity of individual neurons recorded from areas MT and MST code the movement of the stimuli in a directionally selective manner independent of the specific parameters of the moving object.


    METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
While our highly trained rhesus monkeys performed a direction discrimination task as explained in the following text, we recorded single-unit activity from areas MT and MST.

Animal preparation

Three adult male rhesus monkeys (F, B, and G) were used in this study. Under sterile conditions and intubation anesthesia using isoflurane, the monkeys received a dental cement implant including head post and recording chambers as well as a subconjunctival search coil to monitor precisely the eye movements (Judge et al. 1980Go; Robinson 1963Go). All animal procedures were carried out in accordance with National Institutes of Health guidelines and German law and were approved by the local ethics committee. The position of the recording chambers allowed for electrode tracks leading to areas MT and MST. The chamber axis was aligned with a parasagittal plane, tilted 30° upward from the horizontal plane. This axis was aimed at the stereotactic location of area MST (lateral 18, posterior 3.5, and dorsal 16 mm). Single-unit activity was recorded with self-made glass-insulated tungsten electrodes the high stability and stiffness of which allowed for transdural electrode tracks. The signal from the electrode was preamplified, low-pass filtered, and fed to a multispike detector (Alpha Omega, Model MSD). The temporal resolution of single-unit activity was 4 kHz, and horizontal as well as vertical eye positions were sampled at 1 kHz per channel. All data acquisition was performed by an i586 PC (LINUX). Eye-position signals were calibrated by having the monkeys fixated targets at known positions.

Passive visual stimulation

To determine the visual response properties of an individual neuron, such as the location and size of the receptive field, preferred direction, preferred velocity, tuning width, and strength of directional selectivity, we displayed a moving random-dot pattern within a stationary aperture while the monkeys simply fixated a stationary target. The preferred direction of this passive visual response was determined by testing the responses to eight different directions (with 45° spacing). The responses to visual motion in these directions were fitted by a Gaussian function. The mean value of this function indicates the preferred direction of the recorded neuron and the SD gives its tuning width. The directional index (DI) was computed according Eq. 1 (see following text). The location, size, and eccentricity of the visual receptive field were determined by the investigator using a mouse-driven bar adjusted to the parameters of the individual neuron.

Direction discrimination task (DDT)

At the onset of each trial, the monkeys fixated a small red stationary target (diameter: 20 arc min, 0.5 cd/m2) placed in the center of the tangent screen (size: 86° * 66°, viewing distance: 85.5 cm). All visual stimuli were generated by a second PC (i586, LINUX) and displayed by a video projector (Electrohome ECP 4100, 1200*1024 Hz at 60 Hz). Gaze fixation was monitored throughout the trial. The size of the fixation control window was 2° in each dimension. If the deviation of gaze exceeded the control window, the trial was aborted instantaneously, the data were discarded, and the monkey was not rewarded for the trial. After the initial fixation period of 500 ms, a randomly selected motion stimulus as explained in the following text was presented for 2,000 ms. The stimulus moved either in the preferred or nonpreferred direction of the recorded neuron (i.e., left- or rightward). The preference was determined beforehand during the passive visual stimulation. The stimulus trajectory crossed the center of the recorded neuron's receptive field halfway through its presentation. The velocity was adjusted to the previously determined preferred velocity of the recorded neuron. After the presentation of the stimulus, the monkeys had to maintain fixation (delay of 500 ms) until two green targets (diameter of 20 arc min) were presented 20° to the left and right of the central fixation target. To report the direction of the perceived movement, the monkeys had to perform a saccade toward the target in the direction of the movement. The monkeys had to execute this saccade within an interval of 3,000 ms to complete the task correctly and to receive the drop of apple juice or water for reward.

Motion stimuli

Three different motion stimuli were generated by the stimulation PC and presented during the performance of the DDT. Each stimulus consisted of a rectangular object the size of which was adjusted to the size of the receptive field of the recorded neurons. In the case of the Fourier motion stimulus, the rectangle was an unchanging pattern of coherently moving dots as indicated in space-time diagram of Fig. 1 by the diagonal lines. In the case of the drift-balanced stimulus, the rectangle can be imagined as a moving window through which a second distant plane of stationary dots was seen. Here the moving stimulus is indicated in the space-time diagram as short vertical lines, i.e., stationary dots. Finally, in the case of theta motion, the rectangle consisted of coherently moving dots. However, as opposed to the Fourier motion stimulus, the dots are moving in the opposite direction with respect to the entire rectangle. In the space-time diagram of Fig. 1, the dots are moving toward the left while the rectangle is moving rightward. The stimuli were presented on top of a dynamic random-dot pattern (2% coverage, maximal 500 dots, mean luminance 1.9 cd/m2). Figure 1 shows sketches of the space-time diagrams of these three different motion stimuli.



View larger version (92K):
[in this window]
[in a new window]
 
FIG. 1. Sketch of space-time diagrams of the motion stimuli used in this study: Fourier motion (fm), drift balanced motion (dbm), and theta motion (tm). Each row in the diagrams represents the actual distribution of black-and-white pixels in a single row on the stimulation monitor. The vertical spacing represents the refresh rate of the graphic card (60 Hz).

 
In addition to the visual stimuli displayed by the video projector, apparent visual, auditory, or bimodal motion stimuli were also presented over the course of the DDT. We had 48 light-emitting diodes (LEDs) and loudspeakers mounted on the tangent screen in a linear arrangement with a spacing of 1° at a distance of 85.5 cm in front of the animal. The LEDs and/or loudspeakers were subsequently switched on for 25 ms and off for 25 ms by a digital IO card in a i286 PC (DOS) that was synchronized with the data-acquisition PC. The resulting apparent velocity of the stimuli was 20°/s in these experiments. The brightness of the LEDs was 5 cd/m2. The auditory stimuli were band-pass noise pulses (–10dB bandwidth: 1.7–3.4 kHz) presented at 60 dB SPL. Frequency response curves of the 48 loudspeakers used were measured with a Bruel & Kjaer -in microphone system and analyzed with Cool Edit (Syntrillium). The frequency responses deviated by <5 dB and overall sound pressure level deviated by <2 dB between speakers. The trajectory of these stimuli was centered on the visual receptive field of the recorded neuron. Human observers perceived a smoothly moving stimulus in every case.

Training of the animals

Before the monkeys underwent the aforementioned surgery, we trained them in the primate chair on a standard fixation paradigm using a single-touch bar (Wurtz 1969Go). After ~4 wk, the monkeys were subjected to a simple version of the DDT. To start a single trial, the monkeys had to hold the central touch bar. After a randomized delay, a bright bar moved either to the left or right. On color change of the fixation target, the monkeys had to move their hand to either the left or right touch bar, respectively. Over the course of these training lesson, the monkeys learned to report the direction of bar movement independent of the bar position at the onset of each trial. The monkeys could not use the bar position at the offset of each trial to complete the task correctly. Once the monkeys' performance stabilized >80% correct trials, they underwent surgery. Subsequently, the DDT paradigm was changed to its final design. Instead of using three touch bars, the monkeys reported their perception by making saccades. In addition, the stimuli used during the recording sessions were displayed. Overall, the training on the DDT lasted ~3 mo. Note that during the recording sessions, the position of the receptive field of the recorded neuron dictated the trajectory of the stimulus.

Data analysis

The neuronal responses were obtained as the number of action potentials within a time interval during which the stimulus crossed the receptive field. The dimensions of the visual receptive field had previously been determined as explained earlier. Using this information, the time interval for data analysis was adjusted for each individual recorded neuron. Based on these responses, we calculated the strength of directional tuning as

In the case of the tm stimulus, the neuronal response apparently inverts its preferred direction. To document this effect, we calculated the DI as explained in the preceding text, i.e., we followed the apparent inversion of the preferred direction, but set the DI to be negative.

To quantify possible inhibitory effects, we also calculated the net responses for which we subtracted the activity recorded during the initial fixation period of each trial from the above mentioned response. To address the statistical significance of the responses to the different stimuli or different directions of stimulus movement, we performed t-test on the responses or net responses, respectively, of single trials. For the purpose of displaying the neuronal activity, we calculated and plotted spike density functions (sigma = 25 ms).

Pursuit study

To strengthen the argument that our monkeys indeed report the perceived direction of a moving target, we performed an additional pursuit eye-movement study similar to previously published studies of human eye movements (Butzer et al. 1997Go; Lindner and Ilg 2000Go). The stimuli were identical to those used in the direction discrimination task except that we did not display the stationary fixation target. Instead, the eye-position control window moved with the stimulus. After a training period of several weeks, monkey B was able to pursue the moving target. We quantified the initial acceleration of presaccadic pursuit initiation as described previously (Lindner and Ilg 2000Go). In addition, we determined steady-state pursuit velocity within a fixed time interval extending from 500 to 1,200 ms after the onset of target movement. The saccades were removed automatically based on an acceleration criterion (see Lindner and Ilg 2000Go).

Histology

After perfusion of one (F) of the animals, the brain was cut parasagittally in 40-µm sections. The sections were stained for cell bodies (Nissl) and for myelination (Gallyas). Area MT in the posterior bank of superior temporal sulcus (STS) was identified by the dense myelination visible in the Gallyas staining. The reconstruction of recording sites was made possible by injections of fluorescent tracers at the end of the recording period into sites that were previously identified as areas MT or MST, respectively, based on their single-unit response properties. The histology of the two remaining monkeys (B and G) is not available at present.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
While our monkeys performed the DDT, we recorded the activity of 38 neurons located in area MT and 68 neurons located in area MST. We first present the recording sites and the general visual response properties of our neuron sample, then we present the psychophysical results of the DDT, and finally we describe the single-unit activities obtained.

Properties of single-unit responses during passive visual stimulation

The microelectrode approached areas MT and MST within a parasagittal plane, entering the brain in the lunate sulcus, at the transition between areas V1 and V2. The neurons recorded from area MST were concentrated along the floor of the superior temporal sulcus (STS) where the lateral part of area MST (MST-l) is located. The anatomical reconstruction of recording sites shown in Fig. 2 was performed in one (F) of the three monkeys. In the remaining two animals (B and G), the classification of area MT and MST was performed based on the specific single-unit response properties observed during the experiments as well as the 3D positions of the electrode tip. The anatomical reconstruction of monkey F clearly overlaps with the classification of areas MT and MST based on single-unit response properties and the 3D position of the electrode tip.



View larger version (28K):
[in this window]
[in a new window]
 
fig.2. Recording sites in monkey F. Four parasagittal sections are shown based on drawings of Nissl-stained sections. Bold line, the surface of the cortex; thin line, the transition between gray and white matter. The reconstruction of MT area along the posterior bank of STS is based on Gallyas-stained sections. Note that the recordings of middle superior temporal (MST) neurons were performed along the floor of the STS.

 
Because of methodological limitations, we were restricted to a horizontal stimulus trajectory during execution of the DDT. Therefore our data sample shows a clear bimodal bias toward horizontal (see Fig. 3A). The histogram of the tuning widths reveals a clear maximum at 90° (see Fig. 3B). Most neurons in our sample are highly directionally selective irrespective of whether they were recorded from area MT or MST (see Fig. 3C). The only significant difference between the responses obtained from area MT and MST neurons was the receptive fields' size (see Fig. 3D). In area MST, the receptive fields were slightly but significantly (P = 0.005, t-test) larger than those of neurons recorded from area MT.



View larger version (27K):
[in this window]
[in a new window]
 
FIG. 3. General visual response properties of all recorded neurons from area MT and MST in this study. The clear bias in preferred direction toward horizontal orientations (shown in A) was due to a methodological limitation that constrained stimulus movement to horizontal directions. The distribution of tuning widths showed a clear maximum around 90° (B). All neurons were directionally selective (C). The white bars in B and C, the distribution of directionality of neurons recorded from area MT, exclusively. Note the similarity between the distribution of all recorded neurons and those recorded from area MT. Only the size of receptive fields in area MST (shown in D) are slightly but significantly (P = 0.005, t-test) larger than the receptive field size observed in area MT.

 
Monkey psychophysics

The results of the DDT are shown in Fig. 4. The performances for all stimuli used were significantly above chance level (significantly different from 50%, t-test, P < 0.003). The statistical analysis (2-way ANOVA) revealed a significant influence of the factor stimulus (P < 0.001) on the performance. However, there was no significant difference in the performance of our monkeys (factor monkey: P = 0.138). Because the interaction of both factors was also not significant (P = 0.732), we can conclude that the differences between the stimuli were very similar in all monkeys.



View larger version (19K):
[in this window]
[in a new window]
 
FIG. 4. Performance of our monkeys in the direction discrimination task (DDT) for Fourier, drift-balanced and theta motion as well as the moving sound source stimulus. The data were based on ≥3 blocks consisting of 10 trials each. The performance for every stimulus was significantly different from chance level (50%, t-test, P < 0.003)

 
Smooth pursuit eye movement elicited by second-order motion

It is possible to argue that our monkeys did not report the direction of the moving stimuli in the DDT but rather reported the position of the stimuli at the offset of the stimulus presentation. To check this hypothesis, we asked whether a monkey is able to track the moving second-order motion stimulus by smooth-pursuit eye movements and whether the way in which this monkey tracks this stimulus is similar to the way in which humans do it (Butzer et al. 1997Go; Lindner and Ilg 2000Go).

The monkey was able to pursue the theta motion and drift-balanced stimuli as well as the Fourier motion stimulus, as shown in Fig. 5. However, steady-state pursuit gain was less in case of the paradoxical motion stimulus than for the Fourier motion stimulus. In addition, we analyzed the initiation of SPEM. The initial eye acceleration depended on the motion stimulus being tracked. Fourier motion elicited higher acceleration values (–39°/s2) compared with drift-balanced motion (–14°/s2). In the case of theta motion, the initial acceleration occurred in the opposite direction (i.e., in the direction of the moving dots), denoted by the positive sign of the acceleration value (36°/s2).



View larger version (34K):
[in this window]
[in a new window]
 
FIG. 5. Results of the pursuit study in monkey B. Horizontal eye and target position as well as eye and target velocity while tracking a target defined by either Fourier motion, drift-balanced, or theta motion. Saccades were cut from the velocity profiles. Open arrow: the initiation of pursuit that was in the direction of pixel movement. Solid arrow: steady-state pursuit that was in the direction of the moving object. In addition, the numerical values of steady-state pursuit velocity and initial eye acceleration for this experiment are provided (10 trials each).

 
Taken together, the results of this pursuit study support the notion that monkeys reported the direction of motion in our task not simply the position of the stimulus at the offset. In addition, the monkey's eye movements were quite similar to human eye movements elicited by these stimuli (Butzer et al. 1997Go; Lindner and Ilg 2000Go).

Single-unit responses during performance of DDT

As already mentioned, we focused our study on directionally selective neurons, which were tuned for horizontal directions. Figure 6 shows the response of a typical neuron recorded from area MST to the presentation of Fourier, drift-balanced, and theta motion stimuli in preferred and nonpreferred directions. The eye-position profiles document that the monkey maintained fixation during stimulus presentation and subsequently reported the direction of the moving stimulus correctly.



View larger version (30K):
[in this window]
[in a new window]
 
FIG. 6. Response of a typical MST neuron (No. 110/1, monkey G) to Fourier, drift-balanced, and theta motion stimuli moving leftward (left) and rightward (right). Target and eye position are shown together with the neuronal activity as raster display and as a spike density function. Leftward motion is indicated by negative numbers. The dotted vertical lines indicate the time when the stimulus entered the receptive field and left it, respectively.

 
The response of the presented neuron to Fourier motion was clearly directionally selective. The horizontal dimension of the receptive field were from 16° left (contralateral) to 4° right (ipsilateral) as indicated by the vertical dashed lines in Fig. 6. We determined the neuronal response during a time interval of 1,000 ms while the stimulus was moving across the receptive field. The response in the preferred direction (74 spikes/s) was significantly higher than in the nonpreferred direction (11 spikes/s) resulting in a DI of 0.85. The directionality of this neuron was slightly diminished, but its response to drift-balanced motion stimuli was significant. Here the response in the preferred direction was only 31 spikes/s, whereas the response in the nonpreferred direction was 5 spikes/s, resulting in a DI of 0.83. During the presentation of the theta motion stimulus, the directionality was apparently inverted. The response to the theta stimulus moving in the nonpreferred direction (58 spikes/s) was larger than the response in the preferred direction (13 spikes/s), yielding a DI of –0.77. The response in the preferred direction disappeared in the case of theta motion, whereas the response in nonpreferred direction was increased. This apparent inversion indicates that the neuron's response was determined by the direction of the individual pixel constituting the target not by the direction of the moving target itself. Not only was the preferred direction apparently inverted, but the absolute value of directionality was also reduced in the case of theta motion as compared with Fourier motion.

With respect to the responses of all recorded neurons (see Fig. 7), we observed weaker directionality in the responses to drift-balanced motion stimuli than in responses to Fourier motion stimuli. However, 36% of neurons from area MT (14 of 38) and 53% of neurons from MST (36 of 68) responded significantly to drift-balanced stimuli (P < 0.01, t-test). We did not find significant differences between the response properties such as preferred direction, width of tuning, preferred velocity, strength of directional selectivity, receptive field size, or receptive field eccentricity of neurons responding significantly to drift-balanced motion and neurons lacking this selectivity (see Table 1). Therefore we are not able to deduce the ability of a neuron to code for drift-balanced motion from any other visual response property determined by the passive visual stimulation.



View larger version (37K):
[in this window]
[in a new window]
 
FIG. 7. The strength of directionality expressed as a directional index (DI) obtained using Fourier and drift-balanced motion stimuli (neurons directionally selective for dbm, {circ}, n = 50; neurons not directionally selective for dbm, x, n = 56). Note that directionality is markedly lower when motion is drift-balanced.

 

View this table:
[in this window]
[in a new window]
 
TABLE 1. Response characteristics of neurons selective for drift-balanced versus non-selective neurons

 
Based on the responses shown in Fig. 6, one might argue that the responses to the theta motion stimulus were exclusively determined by retinal image motion (i.e., by the movement of individual dots). However, as Fig. 8A shows, the absolute value of theta-motion-related directionality was significantly less than the Fourier motion related directionality (t-test, P < 0.001). This indicates that although the direction of pixel motion determined the preferred direction of the neuronal response, the strength of directionality was different for theta and Fourier motion. Similar to the neuronal responses to Fourier and theta motion, the absolute values of eye acceleration during initiation of pursuit elicited by theta motion were significantly less than when pursuit was elicited by Fourier motion (t-test, P < 0.001) as shown in Fig. 8B. The consistency of neuronal activities and initial eye acceleration during SPEM indicates that areas MT and MST are involved in the generation of these eye movements.



View larger version (17K):
[in this window]
[in a new window]
 
FIG. 8. Comparison of directional selectivity of neuronal responses (A) and eye acceleration during pursuit initiation (B) elicited by Fourier, drift-balanced, and theta stimuli. It is important to note that the preferred direction as well as the eye acceleration seemed to be determined by the direction of dot movement. However, there is a significant difference in absolute values of DI (P < 0.001) and eye acceleration (t-test, P < 0.001). The number of neurons included (A) and single-pursuit trials included (B) are indicated.

 
We analyzed the responses to the auditory and bimodal moving stimulus only in those neurons the directionally selective response of which to the visual motion stimulus was significant (t-test preferred versus nonpreferred direction, P < 0.01). Figure 9 shows the response of a typical neuron recorded from area MT to visual, auditory, and bimodal moving stimuli during DDT. The receptive field of this neuron extended from 16° left (contralateral) to 12° right (ipsilateral), therefore the time interval used to determine the neuronal response was 1,400 ms. While the neuron clearly responded with an increase in discharge rate if the visual (net response of 22 spikes/s) or bimodal stimulus (net response of 20 spikes/s) moved across its receptive field, there was a small decrease in discharge rate if the auditory stimulus moved across the receptive field (net response of –2 spikes/s).



View larger version (32K):
[in this window]
[in a new window]
 
FIG. 9. The responses of a typical neuron recorded from area MST (No. 363/1, monkey B) to a visual, bimodal, or auditory stimuli moving at 20°/s toward the left (left) or right (right). Note the brief suppression of neuronal activity when the auditory stimulus moved in the preferred direction across the receptive field.

 
Overall, the responses of 33 neurons (6 of 28 neurons from area MT, 27 of 68 neurons from area MST) fulfilled the above-mentioned directionality criterion and were included in this analysis. Because we did not observe any significant differences between net responses recorded from area MT and MST, respectively, we pooled the responses of all 33 neurons. As Fig. 10 shows, the net responses to the visual and bimodal stimulus were not significantly different (t-test, P = 0.83). However, the inhibition induced by the moving auditory stimulus shown in Fig. 9 was not observed at the population level. The population response to the auditory stimulus was not significantly different from zero (t-test, P = 0.70).



View larger version (18K):
[in this window]
[in a new window]
 
FIG. 10. The net responses of the population (n = 33) to a visual, auditory, or bimodal moving stimulus. The net responses elicited by the visual and bimodal stimulus are highly significant from 0 (P < 0.001), whereas the responses due to the auditory stimulus were not (P = 0.7, t-test).

 

    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
The performance of our monkeys in the DDT strongly suggests that the animals were able to correctly report the direction of a moving stimulus, independent of whether the stimulus was defined by first- or second-order motion or by a moving sound source. The results of our pursuit study seem to indicate that the monkeys reported the motion direction not simply the position of the stimulus at least for the second-order motion stimulus. However, the activity in areas MT and MST coded only for those moving stimuli that were segregated from the background by luminance or flicker.

We are convinced that our data sample is quite representative for areas MT and MST because the general response properties of our recorded neurons to visual motion fit well with those previously described in the literature. The size of the receptive fields in areas MT and MST, respectively, were of the same dimension as described earlier (Komatsu and Wurtz 1988Go). Similarly, the mean tuning width of the neurons in our data sample was close to 90° as previously reported (Albright 1984Go; Britten and Newsome 1998Go; Snowden et al. 1992Go).

The absence of selective neuronal responses during perception of theta motion and moving sound sources might be surprising because it was previously shown that some neurons in area MST respond to inferred motion (Assad and Maunsell 1995Go). The neurons in their study responded to an inferred motion stimulus without any physical stimulus. However, it must be noted that the monkeys were trained to report the movement of a visual stimulus, so it is likely that they inferred the presence of the visual motion stimulus that they had been trained on. In contrast, there is no evidence to assume that our monkeys inferred visual motion in the presence of a moving sound source. Therefore the lack of response in our study does not contradict results reported during inferred motion perception (Assad and Maunsell 1995Go). However, the finding that a moving sound source did not lead to neuronal excitation does seem surprising because anatomical connections from the monkey's auditory cortical areas to primary visual cortex (Falchier et al. 2002Go) as well as to area MST (Boussaoud et al. 1990Go) have been previously described.

Alternative interpretation of our results

Our data show that the neuronal activity recorded from areas MT and MST did not always parallel the motion perception of the monkeys. From this, we concluded that these areas are not the final stages in motion processing. However, an alternative interpretation is possible based on the fact that in our study, the monkeys could theoretically perform the DDT correctly without processing the motion signals at all and simply using position information, i.e., reporting the position of the stimulus at the offset of every trial. The outcome of our experiments might have been different if we had used a task in which positional information could not have been used, for instance, if the monkeys had to respond to a change in stimulus velocity. However, there are three arguments against this alternative explanation. First the outcome of the pursuit study indicates that the monkey could use the velocity of the second-order motion stimuli to generate smooth-pursuit eye movements. Second, during the training history, the monkeys were able to report the direction of stimulus movements at randomized positions within the visual field. Finally, in case of visual motion, drift-balanced motion, and Fourier motion, the neuronal activity paralleled the motion perception of the monkeys, and it is unclear why the monkeys would change their strategy depending on the stimulus type. The alternative explanation cannot be completely ruled out, but it seems less likely that the lack of response to auditory stimulation as well as the apparent inversion of the preferred direction in the case of theta motion could be explained by the fact that specially in these conditions, the monkeys did only report the position of the stimulus, not its motion.

Processing of first- and second-order motion

When a flicker component segregated the moving stimulus from the background (dbm), some neurons in our sample coded for object motion, a result that has also been reported previously (Albright 1992Go; O'Keefe and Movshon 1998Go). As found in those experiments, the strength of directionality in response to drift-balanced motion was clearly less than in response to first-order motion.

On the other hand, the apparent inversion of preferred direction in case of the theta motion indicates that the motion processing is not yet complete in areas MT and MST. It is important to note that this does not contradict findings that microstimulation in these areas affects motion perception (Britten and van Wezel 1998Go; Celebrini and Newsome 1995Go) as well as the execution of smooth pursuit eye movements (Born et al. 2000Go; Groh et al. 1997Go; Komatsu and Wurtz 1989Go). These effects convincingly demonstrate that these areas are involved in processing visual motion but do not support the notion that these areas are final stages in this processing. Because these areas are retinotopically organized, subsequent areas could be able to recover object motion based on the processing of the various arrangements of receptive fields in an appropriate temporal sequence. Along the same line of argument, a computational model consisting of two layers of elementary motion detectors has been proposed that is capable of decoding second-order motion (Zanker 1993Go).

The similarity of eye acceleration during the initiation of SPEM and the neuronal responses to theta motion strongly supports the idea that areas MT and MST are definitively involved in the processing of first- and second-order motion. When a theta motion stimulus was used, the absolute value of eye acceleration as well as the directionality of neuronal responses to theta motion differed significantly from eye acceleration and directionality of responses when a Fourier motion stimulus was used even though the absolute amount of retinal image motion was identical for both stimuli. This suggests that both eye acceleration during SPEM initiation and neuronal responses might not depend exclusively on the movement of individual pixels. It is possible that the processing of pixel motion (first-order) interacts with the processing of object motion (second-order), which would in turn predict a decreased response if the two components were in opposite directions. The similarity in eye acceleration and neuronal responses shows that the initiation of SPEM and neuronal processing in areas MT and MST are tightly connected.

Motion processing in higher cortical areas of rhesus monkeys

Taken together, the results clearly confirm previous findings that areas MT and MST are not the final stages in the cortical processing of a moving visual stimulus. Areas higher up in the hierarchy of visual motion processing such as the anterior and posterior part of the superior temporal polysensory area (STPa and STPp) (Felleman and van Essen 1991Go), area 7A (Siegel and Read 1997Go), the ventral intraparietal area (VIP) Colby et al. 1993Go), and the cortical vestibular areas as the parietoinsular vestibular cortex (PIVC) (Grüsser et al. 1990Go) and area 2v (Büttner and Buettner 1978Go) may be involved.

With respect to multisensory processing of visual and auditory information, it has previously been shown that neurons recorded from the superior temporal sulcus (STS), especially from the anterior parts of the sulcus, responded to stimulation in both modalities (Benevento et al. 1977Go; Bruce et al. 1981Go). From the lateral intraparietal area (LIP), it was reported that neurons responded to an auditory stimulus only if this stimulus was used as a saccade target. This auditory response was only observable after training; in naïve monkeys, there was no response to auditory stimulation (Grunewald et al. 1999Go). Neurons recorded from the VIP displayed responses to somatosensory, vestibular, and visual stimulation (Bremmer et al. 2002Go; Duhamel et al. 1998Go). Finally, in the frontal cortex (area F4), multimodal signal processing was described in mirror neurons. These neurons discharge if the monkey either performs a specific action or watches another subject, either human or monkey, performing the same action (Rizzolatti et al. 1996Go). Some of these mirror neurons responded if the monkey heard the action (Kohler et al. 2002). Taken together, these results suggest that there is a widespread overlap of visual and auditory processing within the rhesus monkeys' brain. This notion was further supported by a 2-deoxy-glucose study that showed widespread overlap between visual and auditory areas (Poremba et al. 2003Go): many areas within the superior temporal sulcus as well as in the frontal cortex showed responsiveness to auditory and visual stimulation.

Multimodal motion processing in the human brain

The rapid development of functional brain imaging capabilities has made it possible to compare the outcome of single-unit recordings in awake and behaving monkeys with activation studies of the human brain. The involvement of area V5 or human MT (hMT) in visual motion perception has been demonstrated (Beauchamp et al. 1997Go; Castelo-Branco et al. 2002Go). Even a moving tactile stimulus yielded an activation of hMT (Hagen et al. 2002Go). The activity in hMT as well as the perception of the motion aftereffect have been modified by an auditory attention task (Berman and Colby 2002Go). When human subjects had to perform a similar direction discrimination task with a moving visual stimulus, clear activation of hMT and surrounding areas, human homologues of areas MST and FST, was shown. However, when subjects had to report the movement of an auditory stimulus, a slight decrease in activation was observed in hMT (Lewis et al. 2000Go). This fMRI finding is very similar to the single-unit responses from area MST in monkeys reported here. In addition, it has been shown by PET and fMRI experiments that a bilateral posterior network including the planum temporale and parieto-temporal operculum is activated during the perception of sound-source motion (Warren et al. 2002Go). When subjects were exposed to second-order motion stimuli, areas such as V3 and hMT were activated (Smith et al. 1998Go). However, the signals detected by fMRI do not allow retinal image motion and object motion to be differentiated. This result is consistent with our finding that the neurons are driven by tm stimuli but do not code for the direction of the object. Furthermore, when subjects were exposed to visual, auditory, and tactile motion stimuli, activation was found in the intraparietal sulcus, which is most likely the human homologue of primate area VIP (Bremmer et al. 2001Go). Interestingly, these authors did not report polymodal activation of hMT, which has been reported by others (Lewis et al. 2000Go). Thus there is a high degree of overlap between fMRI studies in humans and the single-unit responses from rhesus monkeys presented here, especially with respect to the responses of hMT and surrounding areas.

In summary, there is clear evidence that areas MT and MST are involved in the processing of a moving stimulus that underlies motion perception, but there is also clear evidence that this processing is not completed by these areas.


    GRANTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
This project was supported by Deutsche Forschungsgemeinschaft (Heisenberg and SFB 550, A3) as well as the Hermann and Lilly Schilling Foundation.


    ACKNOWLEDGMENTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Thanks to C. Cavada for histology, T. Cooke for language assistance, J. Ostwald for measuring the spectral properties of the loudspeakers used, and P. Thier for innumerable discussions on various aspects of this work.


    FOOTNOTES
 
The costs of publication of this article were defrayed in part by the payment of page charges. The article must therefore be hereby marked "advertisement" in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

Address for reprint requests and other correspondence: U. J. Ilg, Oculomotor Lab, Dept. of Cognitive Neurology, Hertie-Institute for Clinical Brain Research, University of Tübingen, Hoppe-Seyler-Str. 3, D-72076 Tübingen, Germany (E-mail: uwe.ilg{at}uni-tuebingen.de).


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Albright TD. Direction and orientation selectivity of neurons in visual area MT of the macaque. J Neurophysiol 52: 1106–1130, 1984.[Abstract/Free Full Text]

Albright TD. Form-cue invariant motion processing in primate visual cortex. Science 255: 1141–1143, 1992.[Abstract/Free Full Text]

Albright TD. Cortical processing of visual motion. Rev Oculomot Res 5: 177–201, 1993.[Medline]

Assad JA and Maunsell JH. Neuronal correlates of inferred motion in primate posterior parietal cortex. Nature 373: 518–521, 1995.[CrossRef][Medline]

Beauchamp MS, Cox RW, and DeYoe EA. Graded effects of spatial and featural attention on human area MT and associated motion processing areas. J Neurophysiol 78: 516–520, 1997.[Abstract/Free Full Text]

Benevento LA, Fallon J, Davis BJ, and Rezak M. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp Neurol 57: 849–872, 1977.[CrossRef][ISI][Medline]

Berman RA and Colby CL. Auditory and visual attention modulate motion processing in area MT+. Brain Res Cogn Brain Res 14: 64–74, 2002.[CrossRef][Medline]

Born RT, Groh JM, Zhao R, and Lukasewycz SJ. Segregation of object and background motion in visual area MT: effects of microstimulation on eye movements. Neuron 26: 725–734, 2000.[CrossRef][ISI][Medline]

Boussaoud D, Ungerleider LG, and Desimone R. Pathways for motion analysis: cortical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque. J Comp Neurol 296: 462–495, 1990.[CrossRef][ISI][Medline]

Bremmer F, Klam F, Duhamel JR, Ben Hamed S, and Graf W. Visual-vestibular interactive responses in the macaque ventral intraparietal area (VIP). Eur J Neurosci 16: 1569–1586, 2002.[CrossRef][ISI][Medline]

Bremmer F, Schlack A, Shah NJ, Zafiris O, Kubischik M, Hoffmann K, Zilles K, and Fink GR. Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys. Neuron 29: 287–296, 2001.[CrossRef][ISI][Medline]

Britten KH and Newsome WT. Tuning bandwidths for near-threshold stimuli in area MT. J Neurophysiol 80: 762–770, 1998.[Abstract/Free Full Text]

Britten KH, Newsome WT, Shadlen MN, Celebrini S, and Movshon JA. A relationship between behavioral choice and the visual responses of neurons in macaque MT. Vis Neurosci 13: 87–100, 1996.[ISI][Medline]

Britten KH, Shadlen MN, Newsome WT, and Movshon JA. Responses of neurons in macaque MT to stochastic motion signals. Vis Neurosci 10: 1157–1169, 1993.[ISI][Medline]

Britten KH and van Wezel RJ. Electrical microstimulation of cortical area MST biases heading perception in monkeys. Nat Neurosci 1: 59–63, 1998.[CrossRef][ISI][Medline]

Bruce C, Desimone R, and Gross CG. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol 46: 369–384, 1981.[Free Full Text]

Butzer F, Ilg UJ, and Zanker JM. Smooth-pursuit eye movements elicited by first-order and second-order motion. Exp Brain Res 115: 61–70, 1997.[CrossRef][ISI][Medline]

Büttner U and Buettner UW. Parietal cortex (2v) neuronal activity in the alert monkey during natural vestibular and optokinetic stimulation. Brain Res 153: 392–397, 1978.[CrossRef][ISI][Medline]

Castelo-Branco M, Formisano E, Backes W, Zanella F, Neuenschwander S, Singer W, and Goebel R. Activity patterns in human motion-sensitive areas depend on the interpretation of global motion. Proc Natl Acad Sci USA 99: 13914–13919, 2002.[Abstract/Free Full Text]

Cavanagh P and Mather G. Motion: the long and short of it. Spat Vis 4: 103–129, 1989.[Medline]

Celebrini S and Newsome WT. Neuronal and psychophysical sensitivity to motion signals in extrastriate area MST of the macaque monkey. J Neurosci 14: 4109–4124, 1994.[Abstract]

Celebrini S and Newsome WT. Microstimulation of extrastriate area MST influences performance on a direction discrimination task. J Neurophysiol 73: 437–448, 1995.[Abstract/Free Full Text]

Chubb C and Sperling G. Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. J Opt Soc Am A 5: 1986–2007, 1988.[ISI][Medline]

Colby CL, Duhamel JR, and Goldberg ME. Ventral intraparietal area of the macaque: anatomic location and visual response properties. J Neurophysiol 69: 902–914, 1993.[Abstract/Free Full Text]

Ditterich J, Mazurek ME, and Shadlen MN. Microstimulation of visual cortex affects the speed of perceptual decisions. Nat Neurosci 6: 891–898, 2003.[CrossRef][ISI][Medline]

Duhamel JR, Colby CL, and Goldberg ME. Ventral intraparietal area of the macaque: congruent visual and somatic response properties. J Neurophysiol 79: 126–136, 1998.[Abstract/Free Full Text]

Dürsteler MR and Wurtz RH. Pursuit and optokinetic deficits following chemical lesions of cortical areas MT and MST. J Neurophysiol 60: 940–965, 1988.[Abstract/Free Full Text]

Falchier A, Clavagnier S, Barone P, and Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 22: 5749–5759, 2002.[Abstract/Free Full Text]

Felleman DJ and Van Essen DC. Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1: 1–47, 1991.[Abstract/Free Full Text]

Glass L. Moire effect from random dots. Nature 223: 578–580, 1969.[CrossRef][Medline]

Groh JM, Born RT, and Newsome WT. How is a sensory map read out? Effects of microstimulation in visual area MT on saccades and smooth pursuit eye movements. J Neurosci 17: 4312–4330, 1997.[Abstract/Free Full Text]

Grunewald A, Linden JF, and Andersen RA. Responses to auditory stimuli in macaque lateral intraparietal area. I. Effects of training. J Neurophysiol 82: 330–342, 1999.[Abstract/Free Full Text]

Grüsser OJ, Pause M, and Schreiter U. Localization and responses of neurones in the parieto-insular vestibular cortex of awake monkeys (Macaca fascicularis). J Physiol 430: 537–557, 1990.[Abstract/Free Full Text]

Hagen MC, Franzen O, McGlone F, Essick G, Dancer C, and Pardo JV. Tactile motion activates the human middle temporal/V5 (MT/V5) complex. Eur J Neurosci 16: 957–964, 2002.[CrossRef][ISI][Medline]

Ilg UJ and Thier P. Visual tracking neurons in primate area MST are activated by smooth-pursuit eye movements of an "imaginary" target. J Neurophysiol 90: 1489–1502, 2003.[Abstract/Free Full Text]

Judge SJ, Richmond BJ, and Chu FC. Implantation of magnetic search coils for measurement of eye position: an improved method. Vision Res 20: 535–538, 1980.[CrossRef][ISI][Medline]

Kawano K, Shidara M, Watanabe Y, and Yamane S. Neural activity in cortical area MST of alert monkey during ocular following responses. J Neurophysiol 71: 2305–2324, 1994.[Abstract/Free Full Text]

Kohler E, Keysers C, Umilta MA, Fogassi L, Gallese V, and Rizzolatti G. Hearing sounds, understanding actions: action representation in mirror neurons. Science 297: 846–848, 2002.[Abstract/Free Full Text]

Komatsu H and Wurtz RH. Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons. J Neurophysiol 60: 580–603, 1988.[Abstract/Free Full Text]

Komatsu H and Wurtz RH. Modulation of pursuit eye movements by stimulation of cortical areas MT and MST. J Neurophysiol 62: 31–47, 1989.[Abstract/Free Full Text]

Krekelberg B, Dannenberg S, Hoffmann KP, Bremmer F, and Ross J. Neural correlates of implied motion. Nature 424: 674–677, 2003.[CrossRef][Medline]

Lewis JW, Beauchamp MS, and DeYoe EA. A comparison of visual and auditory motion processing in human cerebral cortex. Cereb Cortex 10: 873–888, 2000.[Abstract/Free Full Text]

Lindner A and Ilg UJ. Initiation of smooth-pursuit eye movements to first-order and second-order motion stimuli. Exp Brain Res 133: 450–456, 2000.[CrossRef][ISI][Medline]

Nakayama K. Biological image motion processing: a review. Vision Res 25: 625–660, 1985.[CrossRef][ISI][Medline]

Newsome WT, Wurtz RH, and Komatsu H. Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputs. J Neurophysiol 60: 604–620, 1988.[Abstract/Free Full Text]

Newsome WT and Pare EB. A selective impairment of motion perception following lesions of the middle temporal visual area (MT). J Neurosci 8: 2201–2211, 1988.[Abstract]

O'Keefe LP and Movshon JA. Processing of first- and second-order motion signals by neurons in area MT of the macaque monkey. Vis Neurosci 15: 305–317, 1998.[CrossRef][ISI][Medline]

Poremba A, Saunders RC, Crane AM, Cook M, Sokoloff L, and Mishkin M. Functional mapping of the primate auditory system. Science 299: 568–572, 2003.[Abstract/Free Full Text]

Rizzolatti G, Fadiga L, Gallese V, and Fogassi L. Premotor cortex and the recognition of motor actions. Brain Res Cogn Brain Res 3: 131–141, 1996.[CrossRef][Medline]

Robinson DA. A method of measuring eye movement using a scleral search coil in a magnetic field. IEEE Trans Biomed Eng 10: 137–145, 1963.[Medline]

Rudolph K and Pasternak T. Transient and permanent deficits in motion perception after lesions of cortical areas MT and MST in the macaque monkey. Cereb Cortex 9: 90–100, 1999.[Abstract/Free Full Text]

Siegel RM and Read HL. Analysis of optic flow in the monkey parietal area 7a. Cereb Cortex 7: 327–346, 1997.[Abstract/Free Full Text]

Smith AT, Greenlee MW, Singh KD, Kraemer FM, and Hennig J. The processing of first- and second-order motion in human visual cortex assessed by functional magnetic resonance imaging (fMRI). J Neurosci 18: 3816–3830, 1998.[Abstract/Free Full Text]

Snowden RJ, Treue S, and Andersen RA. The response of neurons in areas V1 and MT of the alert rhesus monkey to moving random dot patterns. Exp Brain Res 88: 389–400, 1992.[CrossRef][ISI][Medline]

Thiele A and Hoffmann KP. Neuronal activity in MST and STPp, but not MT, changes systematically with stimulus-independent decisions. Neuroreport 7: 971–976, 1996.[ISI][Medline]

Thier P and Erickson RG. Responses of visual-tracking neurons from cortical area MST-I to visual, eye and head motion. Eur J Neurosci 4: 539–553, 1992.[CrossRef][ISI][Medline]

Warren JD, Zielinski BA, Green GG, Rauschecker JP, and Griffiths TD. Perception of sound-source motion by the human brain. Neuron 34: 139–148, 2002.[CrossRef][ISI][Medline]

Wurtz RH. Visual receptive fields of striate cortex neurons in awake monkeys. J Neurophysiol 32: 727–742, 1969.[Free Full Text]

Yamasaki DS and Wurtz RH. Recovery of function after lesions in the superior temporal sulcus in the monkey. J Neurophysiol 66: 651–673, 1991.[Abstract/Free Full Text]

Zanker JM. Theta motion: a paradoxical stimulus to explore higher order motion extraction. Vision Res 33: 553–569, 1993.[CrossRef][ISI][Medline]