The Journal of Neurophysiology Vol. 78 No. 3 September 1997, pp. 1263-1275
Copyright ©1997 The American Physiological Society

Sensory Modality Specificity of Neural Activity Related to Memory in Visual Cortex

Jay R. Gibson¹ and John H. R. Maunsell²

¹ Department of Neuroscience, Brown University, Providence, Rhode Island 02912; and ² Division of Neuroscience, Baylor College of Medicine, Houston, Texas 77030

Gibson, Jay R. and John H. R. Maunsell. Sensory modality specificity of neural activity related to memory in visual cortex. J. Neurophysiol. 78: 1263-1275, 1997. Previous studies have shown that when monkeys perform a delayed match-to-sample (DMS) task, some neurons in inferotemporal visual cortex are activated selectively during the delay period when the animal must remember particular visual stimuli. This selective delay activity may be involved in short-term memory. It does not depend on visual stimulation: both auditory and tactile stimuli can trigger selective delay activity in inferotemporal cortex when animals expect to respond to visual stimuli in a DMS task. We have examined the overall modality specificity of delay period activity using a variety of auditory/visual cross-modal and unimodal DMS tasks. The cross-modal DMS tasks involved making specific long-term memory associations between visual and auditory stimuli, whereas the unimodal DMS tasks were standard identity matching tasks. Delay activity existed in auditory/visual cross-modal DMS tasks whether the animal anticipated responding to visual or auditory stimuli. No evidence of selective delay period activation was seen in a purely auditory DMS task. Delay-selective cells were relatively common in one animal where they constituted up to 53% neurons tested with a given task. This was only the case for up to 9% of cells in a second animal. In the first animal, a specific long-term memory representation for learned cross-modal associations was observed in delay activity, indicating that this type of representation need not be purely visual. Furthermore, in this same animal, delay activity in one cross-modal task, an auditory-to-visual task, predicted correct and incorrect responses. These results suggest that neurons in inferotemporal cortex contribute to abstract memory representations that can be activated by input from other sensory modalities, but these representations are specific to visual behaviors.

This article has been cited by other articles:

				U. Noppeney, O. Josephs, J. Hocking, C. J. Price, and K. J. Friston The Effect of Prior Visual Information on Recognition of Speech and Sounds Cereb Cortex, March 1, 2008; 18(3): 598 - 609. [Abstract] [Full Text] [PDF]

				N. Y. Masse and E. P. Cook The Effect of Middle Temporal Spike Phase on Sensory Encoding and Correlates with Behavior during a Motion-Detection Task J. Neurosci., February 6, 2008; 28(6): 1343 - 1355. [Abstract] [Full Text] [PDF]

				Y.-D. Zhou, A. Ardestani, and J. M. Fuster Distributed and Associative Working Memory Cereb Cortex, September 1, 2007; 17(suppl_1): i77 - i87. [Abstract] [Full Text] [PDF]

				Y. E. Cohen, F. Theunissen, B. E. Russ, and P. Gill Acoustic Features of Rhesus Vocalizations and Their Representation in the Ventrolateral Prefrontal Cortex J Neurophysiol, February 1, 2007; 97(2): 1470 - 1484. [Abstract] [Full Text] [PDF]

				G. Spitsyna, J. E. Warren, S. K. Scott, F. E. Turkheimer, and R. J. S. Wise Converging language streams in the human temporal lobe. J. Neurosci., July 12, 2006; 26(28): 7328 - 7336. [Abstract] [Full Text] [PDF]

				Y. E. Cohen, B. E. Russ, and G. W. Gifford III Auditory processing in the posterior parietal cortex. Behav Cogn Neurosci Rev, September 1, 2005; 4(3): 218 - 231. [Abstract] [PDF]

				H. C. Tanabe, M. Honda, and N. Sadato Functionally Segregated Neural Substrates for Arbitrary Audiovisual Paired-Association Learning J. Neurosci., July 6, 2005; 25(27): 6409 - 6418. [Abstract] [Full Text] [PDF]

				N. E. Barraclough, D. Xiao, C. I. Baker, M. W. Oram, and D. I. Perrett Integration of Visual and Auditory Information by Superior Temporal Sulcus Neurons Responsive to the Sight of Actions J. Cogn. Neurosci., March 1, 2005; 17(3): 377 - 391. [Abstract] [Full Text] [PDF]

				R. J. Zatorre, M. Bouffard, and P. Belin Sensitivity to Auditory Object Features in Human Temporal Neocortex J. Neurosci., April 7, 2004; 24(14): 3637 - 3642. [Abstract] [Full Text] [PDF]

				E. Salinas Background Synaptic Activity as a Switch Between Dynamical States in a Network Neural Comput., July 1, 2003; 15(7): 1439 - 1475. [Abstract] [Full Text] [PDF]

				A. Falchier, S. Clavagnier, P. Barone, and H. Kennedy Anatomical Evidence of Multimodal Integration in Primate Striate Cortex J. Neurosci., July 1, 2002; 22(13): 5749 - 5759. [Abstract] [Full Text] [PDF]

				A. Messinger, L. R. Squire, S. M. Zola, and T. D. Albright Neuronal representations of stimulus associations develop in the temporal lobe during learning PNAS, September 19, 2001; (2001) 211431098. [Abstract] [Full Text] [PDF]

				J. W. Bisley and T. Pasternak The Multiple Roles of Visual Cortical Areas MT/MST in Remembering the Direction of Visual Motion Cereb Cortex, November 1, 2000; 10(11): 1053 - 1065. [Abstract] [Full Text] [PDF]

				A. Messinger, L. R. Squire, S. M. Zola, and T. D. Albright Neuronal representations of stimulus associations develop in the temporal lobe during learning PNAS, October 9, 2001; 98(21): 12239 - 12244. [Abstract] [Full Text] [PDF]