Journal of Neurophysiology, Vol 76, Issue 1 109-129, Copyright © 1996 by APS

ARTICLES

Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey

M. W. Oram and D. I. Perrett
School of Psychology, University of St. Andrews, Fife, United Kingdom.

1. Processing of visual information in primates is believed to occur in at least two separate cortical pathways, commonly labeled the "form" and "motion" pathways. This division lies in marked contrast to our everyday visual experience, in which we have a unified percept of both the form and motion of objects, implying integration of both types of information. We report here on a neuronal population in the anterior part of the superior temporal polysensory area (STPa) both sensitive to form (heads and bodies) and selective for motion direction. 2. A total of 161 cells were found to be sensitive to body form and motion. The majority of cells (125 of 161, 78%) responded to only one combination of view and direction (termed unimodal cells, e.g., left profile view moving left, not right profile moving left, or left profile moving right). We show that the response of some of these cells is selective for both the motion and the form of a single object, not simply the juxtaposition of appropriate form and motion signals. 3. A smaller number of cells (9 of 161, 6%) responded selectively to two opposite combinations of view and direction (e.g., left profile moving left and right profile moving right, but no other view and direction combinations). A few cells (4 of 161, 2%) showed "object-centered" selectivity to view and direction combinations, responding to all directions of motion where the body moves in a direction compatible with the direction it faces, for example, responding to left profile going left, right profile going right, face view moving toward the observer, back view moving away from the observer, but not other view and direction combinations. 4. The majority of the neurons (106 of 138, 77%) selective for specific body view and direction combinations responded best to compatible motion (e.g., left profile moving left), and one fourth (23%) showed selectivity for incompatible motion (e.g., right profile moving left). 5. The relative strengths of motion and form inputs to cells in STPa conjointly sensitive to information about form and motion were assessed. The majority of the responses (95%) were characterized as showing nonlinear summation of form and motion inputs. 6. The capacity to discriminate different directions and different forms was compared across three populations of STPa cells, namely those sensitive to 1) form only, 2) motion only, and 3) both form and motion. The selectivity of the latter class could be predicted from combinations of the other two classes. 7. The response latencies of cells selective for form and motion are on average coincident with cells selective for direction of motion (but not stimulus form). Both these cell populations have response latencies on average 20 ms earlier than cells selective for static form. 8. Calculation of the average of early response latency cells (cell whose response latency was under the sample mean) suggests that direction information is present in cell responses some 35 ms before form information becomes evident. Direction information and form information become evident within 5 ms of each other in the average late response latency cells (those cells whose response latency was greater than the sample mean). Inputs relating to movement show an initial response period that does not discriminate direction. The quality of initial direction discrimination appeared to be independent of response latency. The initial discrimination of form was related to response latency in that cells with longer response latencies showed greater initial discrimination of form in their responses. We argue that these findings are consistent with form inputs arriving to area STPa approximately 20 ms after motion inputs into area STPa.

This article has been cited by other articles:

				J. Vangeneugden, F. Pollick, and R. Vogels Functional Differentiation of Macaque Visual Temporal Cortical Neurons Using a Parametric Action Space Cereb Cortex, July 16, 2008; (2008) bhn109v1. [Abstract] [Full Text] [PDF]

				S. YOSHIKAWA and W. SATO Dynamic facial expressions of emotion induce representational momentum Cogn Affect Behav Neurosci, March 1, 2008; 8(1): 25 - 31. [Abstract] [PDF]

				T. Chaminade, J. Hodgins, and M. Kawato Anthropomorphism influences perception of computer-animated characters' actions Soc Cogn Affect Neurosci, September 1, 2007; 2(3): 206 - 216. [Abstract] [Full Text] [PDF]

				A. P. Saygin Superior temporal and premotor brain areas necessary for biological motion perception Brain, September 1, 2007; 130(9): 2452 - 2461. [Abstract] [Full Text] [PDF]

				J. T. Crinion, E. A. Warburton, M. A. Lambon-Ralph, D. Howard, and R. J.S. Wise Listening to Narrative Speech after Aphasic Stroke: the Role of the Left Anterior Temporal Lobe Cereb Cortex, August 1, 2006; 16(8): 1116 - 1125. [Abstract] [Full Text] [PDF]

				J. Lange and M. Lappe A model of biological motion perception from configural form cues. J. Neurosci., March 15, 2006; 26(11): 2894 - 2906. [Abstract] [Full Text] [PDF]

				M. A. Pinsk, K. DeSimone, T. Moore, C. G. Gross, and S. Kastner Representations of faces and body parts in macaque temporal cortex: A functional MRI study PNAS, May 10, 2005; 102(19): 6996 - 7001. [Abstract] [Full Text] [PDF]

				N. E. Barraclough, D. Xiao, C. I. Baker, M. W. Oram, and D. I. Perrett Integration of Visual and Auditory Information by Superior Temporal Sulcus Neurons Responsive to the Sight of Actions J. Cogn. Neurosci., March 1, 2005; 17(3): 377 - 391. [Abstract] [Full Text] [PDF]

				B. Haslinger, P. Erhard, E. Altenmuller, U. Schroeder, H. Boecker, and A. O. Ceballos-Baumann Transmodal Sensorimotor Networks during Action Observation in Professional Pianists J. Cogn. Neurosci., February 1, 2005; 17(2): 282 - 293. [Abstract] [Full Text] [PDF]

				H.-O. Karnath, M. Fruhmann Berger, W. Kuker, and C. Rorden The Anatomy of Spatial Neglect based on Voxelwise Statistical Analysis: A Study of 140 Patients Cereb Cortex, October 1, 2004; 14(10): 1164 - 1172. [Abstract] [Full Text] [PDF]

				T. Jellema, G. Maassen, and D. I. Perrett Single Cell Integration of Animate Form, Motion and Location in the Superior Temporal Cortex of the Macaque Monkey Cereb Cortex, July 1, 2004; 14(7): 781 - 790. [Abstract] [Full Text] [PDF]

				T. Jellema and D. I. Perrett Perceptual History Influences Neural Responses to Face and Body Postures J. Cogn. Neurosci., October 1, 2003; 15(7): 961 - 971. [Abstract] [Full Text] [PDF]

				M. S. Beauchamp, K. E. Lee, J. V. Haxby, and A. Martin fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects J. Cogn. Neurosci., October 1, 2003; 15(7): 991 - 1001. [Abstract] [Full Text] [PDF]

				K. S. LaBar, M. J. Crupain, J. T. Voyvodic, and G. McCarthy Dynamic Perception of Facial Affect and Identity in the Human Brain Cereb Cortex, October 1, 2003; 13(10): 1023 - 1033. [Abstract] [Full Text] [PDF]

				N. Sato and K. Nakamura Visual Response Properties of Neurons in the Parahippocampal Cortex of Monkeys J Neurophysiol, August 1, 2003; 90(2): 876 - 886. [Abstract] [Full Text] [PDF]

				R. Edwards, D. Xiao, C. Keysers, P. Foldiak, and D. Perrett Color Sensitivity of Cells Responsive to Complex Stimuli in the Temporal Cortex J Neurophysiol, August 1, 2003; 90(2): 1245 - 1256. [Abstract] [Full Text] [PDF]

				S. O. Murray, B. A. Olshausen, and D. L. Woods Processing Shape, Motion and Three-dimensional Shape-from-motion in the Human Cortex Cereb Cortex, May 1, 2003; 13(5): 508 - 516. [Abstract] [Full Text] [PDF]

				J. A. Phillips, U. Noppeney, G. W. Humphreys, and C. J. Price Can segregation within the semantic system account for category-specific deficits? Brain, September 1, 2002; 125(9): 2067 - 2080. [Abstract] [Full Text] [PDF]

				S. Berthoz, J. L. Armony, R. J. R. Blair, and R. J. Dolan An fMRI study of intentional and unintentional (embarrassing) violations of social norms Brain, August 1, 2002; 125(8): 1696 - 1708. [Abstract] [Full Text] [PDF]

				M. F. S. Rushworth, M. Krams, and R. E. Passingham The Attentional Role of the Left Parietal Cortex: The Distinct Lateralization and Localization of Motor Attention in the Human Brain J. Cogn. Neurosci., July 1, 2001; 13(5): 698 - 710. [Abstract] [Full Text] [PDF]

				R. C. Leiguarda and C. D. Marsden Limb apraxias: Higher-order disorders of sensorimotor integration Brain, May 1, 2000; 123(5): 860 - 879. [Abstract] [Full Text] [PDF]

				M. H. Giard and F. Peronnet Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study J. Cogn. Neurosci., September 1, 1999; 11(5): 473 - 490. [Abstract] [Full Text]

				A. Puce, T. Allison, and G. McCarthy Electrophysiological Studies of Human Face Perception. III: Effects of Top-down Processing on Face-specific Potentials Cereb Cortex, July 1, 1999; 9(5): 445 - 458. [Abstract] [Full Text] [PDF]

				K. C. Anderson and R. M. Siegel Optic Flow Selectivity in the Anterior Superior Temporal Polysensory Area, STPa, of the Behaving Monkey J. Neurosci., April 1, 1999; 19(7): 2681 - 2692. [Abstract] [Full Text] [PDF]