JN Information on EB 2010
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Neurophysiol 87: 1018-1027, 2002;
0022-3077/02 $5.00
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (46)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Ringach, D. L.
Right arrow Articles by Hawken, M. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Ringach, D. L.
Right arrow Articles by Hawken, M. J.

The Journal of Neurophysiology Vol. 87 No. 2 February 2002, pp. 1018-1027
Copyright ©2002 by the American Physiological Society

Suppression of Neural Responses to Nonoptimal Stimuli Correlates With Tuning Selectivity in Macaque V1

D. L. Ringach,1,2,3 C. E. Bredfeldt,2 R. M. Shapley,4 and M. J. Hawken4

 1Department of Neurobiology,  2Department of Psychology, and  3Brain Research Institute, University of California, Los Angeles, California 90095; and  4Center for Neural Science, New York University, New York, New York 10003


    ABSTRACT
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
APPENDIX
REFERENCES

Ringach, D. L., C. E. Bredfeldt, R. M. Shapley, and M. J. Hawken. Suppression of Neural Responses to Nonoptimal Stimuli Correlates With Tuning Selectivity in Macaque V1. J. Neurophysiol. 87: 1018-1027, 2002. Neural responses in primary visual cortex (area V1) are selective for the orientation and spatial frequency of luminance-modulated sinusoidal gratings. Selectivity could arise from enhancement of the cell's response by preferred stimuli, suppression by nonoptimal stimuli, or both. Here, we report that the majority of V1 neurons do not only elevate their activity in response to preferred stimuli, but their firing rates are also suppressed by nonoptimal stimuli. The magnitude of suppression is similar to that of enhancement. There is a tendency for net response suppression to peak at orientations near orthogonal to the optimal for the cell, but cases where suppression peaks at oblique orientations are observed as well. Interestingly, selectivity and suppression correlate in V1: orientation and spatial frequency selectivity are higher for neurons that are suppressed by nonoptimal stimuli than for cells that are not. This finding is consistent with the idea that suppression plays an important role in the generation of sharp cortical selectivity. We show that nonlinear suppression is required to account for the data. However, the precise structure of the neural circuitry generating the suppressive signal remains unresolved. Our results are consistent with both feedback and (nonlinear) feed-forward inhibition.


    INTRODUCTION
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
APPENDIX
REFERENCES

The cortical representation of the retinal image undergoes profound transformations as it progresses along the visual pathway. Cells in primary visual cortex are tuned for local attributes of the image, such as stimulus orientation, spatial frequency, and color, among other dimensions (De Valois et al. 1982; Hubel and Wiesel 1962, 1968; Movshon et al. 1978). Understanding how such selectivity is generated in V1 requires separating the relative contributions of the feedforward circuitry and intracortical mechanisms.

An important question is the role that intracortical inhibition plays in the generation of stimulus selectivity (Anderson et al. 2000; Benevento et al. 1972; Blakemore and Tobin 1972; Bonds 1989; De Valois and Tootell 1983; Ferster and Miller 2000; Hata et al. 1988; Morrone et al. 1982; Nelson and Frost 1978; Nelson 1991; Ramoa et al. 1986; Ringach et al. 1997b; Sillito et al. 1980; Sompolinsky and Shapley 1997; Volgushev et al. 1993). There is an on-going debate regarding the role of inhibition in establishing sharp selectivity for orientation. On one hand, some studies suggest that inhibition has no role in sharpening tuning selectivity. This claim appears to be supported by the following findings: the tuning of excitation and inhibition, recorded in layer 4 cortical neurons intracellularly, appear to be very similar (Carandini and Ferster 2000; Ferster 1986); the tuning of a V1 cell's membrane potential modulation in response to drifting grating stimuli remains unchanged when the cortex is inactivated by cooling or by electrical stimulation (Chung and Ferster 1998; Ferster et al. 1996); and neurons retain their tuning selectivity when inhibition is blocked intracellularly (Nelson et al. 1994). On the other hand, several studies suggest that suppression plays a critical role in establishing sharp selectivity for orientation. Some of the findings that support this view are response enhancement and suppression in V1 have different bandwidths, with suppression being more broadly tuned than enhancement (Blakemore and Tobin 1972; Bonds 1989; Burr et al. 1981; Monier et al. 2000; Morrone et al. 1982; Nelson and Frost 1978; Nelson 1991; Ringach et al. 1997a); blocking inhibition pharmacologically leads to a broadening in V1 tuning selectivity (Allison and Bonds 1994; Allison et al. 1995, 1996; Crook et al. 1998; Hata et al. 1988; Sato et al. 1996; Sillito et al. 1980); and theoretical work indicates that broadly tuned inhibition could act as a mechanism to suppress the response of the cell to nonoptimal stimuli and sharpen selectivity (Ben-Yishai et al. 1995; McLaughlin et al. 2000; Pugh et al. 2000; Somers et al. 1995). There is also a similar lack of agreement about the role of inhibition in spatial frequency tuning. Some authors report the absence of response suppression at nonoptimal frequencies (Ramoa et al. 1986), while others find a substantial amount of suppression (Bauman and Bonds 1991; De Valois and Tootell 1983).

We studied the steady-state and dynamical tuning properties of neurons in the joint orientation and spatial frequency domain (the Fourier plane). The dynamics of orientation and spatial frequency were measured using a new reverse correlation method that was an improvement on methods used previously to measure orientation tuning dynamics (Ringach et al. 1997b). The pattern of response enhancement and suppression in the Fourier plane revealed that the responses of the most highly selective neurons are almost always suppressed by nonoptimal stimuli. This correlation between high selectivity and suppression indicates that intracortical inhibition probably plays an important role in the generation of sharp stimulus selectivity.


    METHODS
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
APPENDIX
REFERENCES

Acute experiments were performed on adult Old World monkeys (Macaca fascicularis) in compliance with National Institutes of Health and University of California Los Angeles/Animal Research Committee guidelines. Details of the preparation can be found elsewhere (Ringach et al. 1997a).

An increase in the firing rate of a neuron, as measured extracellularly, will be termed an "enhancement" of the neuron's response relative to some baseline. Similarly, a decrease in the firing rate of a neuron will be termed a "suppression" of the neuron's response. Enhancement and suppression are also often called "net excitation" and "net inhibition." We do this to avoid confusion with the words inhibition and excitation, which indicate, respectively, changes in the opening times of the inhibitory and excitatory ionic channels of a neuron. It is not possible to determine the underlying inhibitory and excitatory components of a cell uniquely from its extracellular firing rate. For example, response enhancement could be due to increased excitation, decreased inhibition, or a combination of both.

We measured the dynamics of tuning in the orientation and spatial frequency plane using a newly developed variant of the reverse correlation technique (Mazer et al. 2000; Ringach et al. 1997a,b). The stimulus is a sequence of luminance-modulated gratings with randomized orientations, spatial frequencies, and spatial phases presented rapidly one after the other at an effective rate of 50 Hz (Fig. 1A). The refresh rate of the monitor was 100 Hz, but each image in the sequence was presented twice. The linear size of the stimulus was 1.5 to 3 times that of the classical receptive field, defined by the peak (or saturation point) of an area summation curve obtained with a grafting drifting at the optimal spatiotemporal parameters. The contrast of the stimulus was 99%. The total experimental time was 15 min.



View larger version (42K):
[in this window]
[in a new window]
 
Fig. 1. A: segment of stimulus sequence and the response of the neuron. Each image in the stimulus sequence is a sinusoidal grating at different orientations, spatial frequencies and spatial phases. B: plot of R(theta , omega ) in the Fourier plane. Areas in red represent response enhancement, areas in blue represent response suppression, and neutral stimuli are shown in green. The baseline is calculated as the probability of stimuli at the boundary of the stimulus space. These are the stimuli located between the 2 concentric outlined squares in the figure and correspond to the gratings having maximal spatial frequency at each orientation.

The neuron's response consists of the arrival times of action potentials elicited during the period of visual stimulation. Given a fixed time lag, tau , we calculate the probability that a grating of a particular spatial frequency, omega , and orientation, theta , preceded an impulse response by tau  ms, Pr{omega , theta ; tau }. Spatial phase information is averaged in this computation. The result of the analysis is a family of two-dimensional probability distributions, one for each value of tau . We investigate the dynamics of tuning by studying the evolution of the probability distribution with time. For small or large values of tau  (usually for tau  < 30 ms or tau  > 150 ms), the stimulus does not influence the neuron's response and Pr{omega , theta ; tau } approximates a uniform (flat) distribution. At intermediate values of tau , the preference of a cell for a particular set of stimulus parameters is revealed as a peak in the probability distribution. Similarly, suppression of the cell's response for some stimuli produces valleys in the probability distribution. It should be noted that this "reverse correlation" method is formally equivalent to calculating the probability that a grating with a particular spatial frequency and orientation evokes a spike tau  ms after its presentation, or a "forward correlation" analysis.

Each image in the stimulus set was a Hartley basis function (Ringach et al. 1997b) of size M × M pixels, <IT>H</IT><SUB><IT>k<SUB>x</SUB>,k<SUB>y</SUB></IT></SUB>(<IT>l, m</IT>) =cas<FENCE><FR><NU>2&pgr;(<IT>k<SUB>x</SUB>l + k<SUB>y</SUB>m</IT>)</NU><DE><IT>M</IT></DE></FR></FENCE> for all 0 <=  l, m <=  M - 1. Here, cas alpha  triple-bond  sin alpha  + cos alpha , and kx and ky represent the spatial frequency of the grating in units of cycles per stimulus side. The stimulus space consisted of all the basis functions {±Hkx,ky} such that |kx<=  kmax and |ky<=  kmax. The maximal spatial frequency tested along the x or y axes is given by omega max = kmax/L, where L is the size of one side of the stimulus patch in degrees of visual angle.

In defining our stimulus space, kmax was chosen to ensure that stimuli along the "boundary" of the space (given by all gratings in the set B = {Hkxomega max vee  H±omega max,ky}) had no effect on the neuron's response. The choice of kmax was based on the spatial frequency tuning for the cell to drifting sinusoidal gratings at the optimal spatiotemporal frequency and size. From the definition, it is clear that four spatial phases, 90° apart, are present for each combination of (omega , theta ). We denote all gratings in the stimulus space by S(kmax). Each frame in the stimulus is drawn at random from S(kmax) with a uniform distribution.

To visualize the data, we compare the probability attained by each grating in the stimulus space to a baseline. A natural choice for the baseline is the probability of stimuli that are known to have no effect on the neuron's activity, such as sinusoidal gratings with arbitrary orientations but spatial frequencies so high that the cell cannot resolve them. We define the baseline B(tau ) as the median probability of a set of such gratings. In our case, we selected stimuli located at the boundary of our stimulus space that correspond to the gratings with the highest spatial frequency tested at each orientation as defined by the set B in the preceding text. The median was chosen to minimize the effects of a few responses reaching the boundary of the space, such as in Fig. 2C.



View larger version (59K):
[in this window]
[in a new window]
 
Fig. 2. Response enhancement and suppression in the Fourier plane. Each plot illustrates an example of R(theta , omega ). A-C: both enhancement by optimal stimuli and suppression by nonoptimal stimuli are evident in the majority of V1 cells. D: some fraction of cells, like the one shown here, showed no evident suppression. The maximal spatial frequency along the x axis and the amplitude of the scale, Y, for each case is as follows: 9.1 cycles/deg, Y = 1.35 (A) , 10.1 cycles/deg, Y = 0.89 (B), 5.0 cycles/deg, Y =1.64 (C), and 7.8 cycles/deg, Y = 1.2 (D).

The empirical probability distributions were smoothed at each time using a 3 × 3 Gaussian kernel with sigma  = 1 cycle/stimulus side and then transformed by calculating
<IT>R</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT>≡log<SUB>10</SUB> </IT><FENCE><FR><NU><IT>Pr</IT>{<IT>&ohgr;, &thgr;; &tgr;</IT>}</NU><DE><IT>B</IT>(<IT>&tgr;</IT>)</DE></FR></FENCE> (1)
By definition, stimuli whose probability is the same as that of the baseline are mapped to R(omega , theta ; tau ) = 0. Similarly, stimuli that enhance the response of the cell are mapped to values R(omega , theta ; tau ) > 0, while stimuli that suppress the response of the cell are mapped to values R(omega , theta ; tau ) < 0. There is an optimal time lag, tau peak, at which R(omega , theta ; tau ) reaches a maximum absolute value. The analysis in this study is based solely on R(omega , theta ) triple-bond  R(omega , theta ; tau peak). A description of the temporal dynamics of response enhancement and suppression will be the subject of a separate report.

R(omega , theta ) can also be interpreted as the log probability of finding a spike in a small time window tau peak ms after a grating with parameters (omega , theta ). Using logarithms means that we consider enhancement and suppression equal in magnitude if the geometric mean of their firing probabilities equals the baseline probability. It can be shown that, under the assumption of Poisson firing, this definition implies that enhancement and suppression have equal magnitudes if and only if they can be discriminated equally well from the baseline rate of the cell (i.e., they have the same d', see APPENDIX).

To plot the results, we image R(omega , theta ) using a pseudo-color map (Fig. 1B). Areas of enhancement are represented by red hues, areas of suppression are represented by blue hues, and green areas represent neutral stimuli. The data are plotted in the Fourier plane (cf. DeValois et al. 1982; Jones et al. 1987). The origin is at the center of the graph. The distance from the origin to any point in the plane represents the spatial frequency of the grating at that location, and the angle with respect to the positive x axis represents its orientation; the x axis represents the spatial frequency of the grating in the horizontal meridian, omega x omega  cos theta , and the y axis represents the spatial frequency along the vertical meridian, omega y = omega  sin theta . All the relevant information is contained in the first and fourth quadrants: the data in the second and third quadrants are obtained by symmetry. We plot all four quadrants for visualization purposes only. Enhancement in the response of a cell is defined as significant if
<LIM><OP>max</OP><LL>&ohgr;,&thgr;,&tgr;</LL></LIM> <IT>R</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT>≥4</IT><RAD><RCD><IT> var</IT>(<IT>R</IT>(<IT>&ohgr;, &thgr;; 0</IT>))</RCD></RAD>
That is, there is a peak in the response at least four times the SD of the noise. The same criterion was applied to determine the presence of a significant suppression after the appropriate sign change. Cells were subdivided into two sets. Cells that had both significant response enhancement and suppression are members of S. Cells with only significant enhancement are members of <A><AC>S</AC><AC>&cjs1171;</AC></A>. Two cells had only a significant suppressive component and they were discarded.

Computer simulations

We simulated the reverse correlation experiment on three models of simple cortical neurons. First, a model cell whose membrane voltage depended linearly on the luminance contrast of the stimulus followed by half-wave rectification due to spike generation (Fig. 6C). The linear receptive field was modeled as a spatiotemporal separable function, h(x, y, t) = A(x, y)B(t). The space kernel, A(x, y), was a Gabor function: A(x, y) = exp(-x2/2sigma <UP><SUB><IT>x</IT></SUB><SUP>2</SUP></UP> - y2/2sigma <UP><SUB><IT>y</IT></SUB><SUP>2</SUP></UP>) cos (2pi omega x + phi ), and the temporal profile was a Hanning window, B(nDelta t) = 1/2 - cos [2pi n/(N + 1)]/2, where Delta t = 10 ms is the duration of one time slice and n = 1, ... , 8 (n = 8). Spatial kernels were sampled on a 64 × 64 grid representing 1 × 1 deg of visual angle. Two different types of spatial profiles were simulated: a filter that had broad tuning in orientation and spatial frequency and was even symmetric in space (Fig. 6A) and an odd-symmetric filter that was well tuned in orientation and spatial frequency (Fig. 6B). The parameters for the first filter were sigma x = 0.15 deg, sigma y = 0.15 deg, omega  = 1.6 cycles/deg, and phi  = 0 deg, and for the second filter they were sigma x = 0.11 deg, sigma y = 0.25 deg, omega  = 5.3 cycles/deg, and phi  = 90 deg. The static nonlinearity was a half-wave rectifier, Phi (x) = x if x >=  0, and zero otherwise. This type of linear-nonlinear model is commonly used to model simple cells under constant levels of contrast gain control (Movshon et al. 1978).

We also explored two additional models that incorporate suppression. In the first of these models, a divisive gain control signal (Carandini et al. 1997), not tuned for orientation, and predominantly low-pass in spatial frequency was added to the linear-nonlinear model (Fig. 6D). The tuning of this feedback signal in the Fourier domain was equal to F(omega ) = K exp[-(omega  - omega 0)2/2sigma <UP><SUB>&ohgr;</SUB><SUP>2</SUP></UP>], where omega 0 = 2 cycles/deg and sigma omega  = 1.4 cycles/deg. Note that F(omega ) is independent of the orientation, and therefore the feedback signal is untuned for orientation. In this model, the output of the linear receptive field is divided by a factor (the gain) that is proportional to the energy (variance) of the stimulus in a Fourier space weighted by F(omega ). This value can be estimated by pooling the responses of cortical cells with different tuning selectivities. A purely feed-forward circuit can estimate the signal energy as well (Fig. 7). The temporal weights of the gain signal were identical to the temporal kernel of the linear filter. The second variant of a suppressive model used subtractive inhibition (Fig. 6E). Here, the output from a linear filter representing the excitatory input to the neuron is shifted by a DC hyperpolarization caused by a nonlinear suppressive signal. The magnitude of this hyperpolarization was proportional to the energy of the stimulus in the Fourier domain weighted by F(omega ), which can also be estimated via pooling of cortical responses. This model may also be implemented in a feed-forward fashion (Fig. 6F). In both suppressive models, the tuning of the inhibitory signal in the Fourier plane overlapped partially with the tuning of the excitatory input but was broader in orientation and mostly low-pass in spatial frequency.


    RESULTS
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
APPENDIX
REFERENCES

Measurement of enhancement and suppression

Response enhancement and suppression in different locations of the Fourier plane are evident in the majority of V1 neurons (Fig. 2). A typical example of R(omega , theta ) is shown in Fig. 2A. The magnitude of peak enhancement equals Rmax = +1.29. Thus at the peak time lag, the optimal stimulus is approx 20 times more likely to precede a spike than baseline stimuli (see Eq. 1). Suppression has a similar magnitude of Rmin = -1.35. Nonoptimal stimuli are approx 22 times less likely to precede a spike than baseline stimuli. A similar response profile is illustrated in Fig. 2B. Suppression may also peak at orientations flanking the optimal for the cell (Fig. 2C). Maximal response suppression occurs for stimuli about 30 deg away from the optimal. This sort of flanking suppression in the orientation domain is consistent with our previous results on the dynamics of orientation tuning (Ringach et al. 1997a). Because a baseline was not available in previous studies, we could not establish with certainty that the valleys were the product of suppression. The present method overcomes this limitation and shows that suppression is indeed present in the responses of many cells.

There are some neurons that do not show response suppression (Fig. 2D). These cells tend to be broadly tuned for orientation and low-pass in spatial frequency. Such cells make up a significant proportion of our population (31/75, 41.3%), but the majority of cells had both response enhancement and suppression in their responses (42/75, 56%). Two cells had pure suppressive responses (2/75, 2.7%).

Our population consisted of 51 simple cells and 24 complex cells, defined as in Skottun et al. (1991). At present we do not observe any obvious differences between simple and complex cells, but a larger sample is required for a careful comparison of simple/complex properties.

To evaluate the relative importance of suppression in the development of tuning selectivity, we first compare the absolute magnitude of response enhancement and suppression in the subpopulation of neurons having both components (Fig. 3A). On average, peak suppression tends to be slightly smaller than enhancement. In a significant fraction of cells, however, enhancement and suppression have similar magnitudes. For such neurons, not responding to the "wrong" stimulus appears to be as important as responding to the "right" one.



View larger version (13K):
[in this window]
[in a new window]
 
Fig. 3. A: scatter-plot of the magnitude of peak enhancement vs. magnitude of peak suppression. B: location of suppression relative to enhancement. The data were normalized so that the location of peak enhancement occurs at (x, y) = (1, 0). The distance from the origin represents the ratio between the optimal spatial frequency for suppression and inhibition. The angle with respect to the positive x axis indicates the location of suppression relative to enhancement. Cells with preferences for very low spatial frequencies are excluded from this analysis as the estimation of angles between enhancement and suppression is unreliable in these cases. C: histogram of the relative angle between peak suppression relative to peak enhancement. There is a tendency for suppression to occur at an angle orthogonal to that of enhancement.

Further insight into the role of suppression can be gained by looking at its location in the Fourier plane relative to the preferred stimulus for the cell (Fig. 3B). Here, data are normalized so that the peak response enhancement for each cell is always located at zero orientation and a spatial frequency of one [that is, at (omega x, omega y) = (1, 0)]. The distance from the origin represents the ratio between the spatial frequency for peak suppression and enhancement. The x axis represents the horizontal component of the spatial frequency and the y axis the vertical component. Points inside the circular sector of radius one have peak suppression at spatial frequencies lower than that of enhancement. The angle between each point and the positive x axis represents the relative difference in orientation between the location of peak enhancement and suppression in the Fourier plane. Peak suppression tends to occur at orientations near the orthogonal to that of peak enhancement and for similar spatial frequencies. However, cases where suppression peaks at oblique angles are also observed (Fig. 3C). In about 80% of the cases, the spatial frequency of suppression is within an octave of the optimum for response enhancement.

Suppression and orientation selectivity

The comparable magnitudes of peak enhancement and suppression and the particular location of suppression in the Fourier plane suggest that suppression of neural responses to nonoptimal stimuli may play an important role in the development of neural selectivity. Therefore we looked for a correlation between the presence or absence of suppression in the responses of neurons and their degree of selectivity. If the hypothesis is correct, one would expect cells that are suppressed by nonoptimal stimuli to have higher selectivity than neurons with purely excitatory responses. Indeed, we find that selectivity for stimulus orientation is higher in neurons whose responses exhibit suppression for nonoptimal stimuli than for cells that do not. To obtain this result, we first divide our population into two groups: cells that have a significant suppressive component in their response, S (n = 42) and those that do not, <A><AC>S</AC><AC>&cjs1171;</AC></A> (n = 31; see METHODS). Then we ask if orientation selectivity is higher for cells in S compared with those in <A><AC>S</AC><AC>&cjs1171;</AC></A>. To cross-validate results, we calculated the orientation selectivity of neurons based on an analysis of the dynamics data as well as the response of the cell to sinusoidal gratings drifting at a constant speed. The first measure is derived from the dynamics measurements by calculating the angular projection of the response inside a disk in Fourier space:
<IT>R</IT>(&thgr;) = <LIM><OP>∫</OP><LL>&ohgr;≤&ohgr;<SUB>max</SUB></LL></LIM> <IT>R</IT><SUP>+</SUP>(&ohgr;, &thgr;) d&ohgr;
Here, R+(omega , theta ) represents the positive part of R(theta , omega ); the negative part is clipped to zero. Averaging over spatial frequencies increases the signal to noise of our measurements and is reasonable given that most of the responses are very well approximated by separable functions in spatial frequency and orientation. The circular variance of the projection gives a measure of orientation tuning selectivity and is defined as (Mardia 1972)
<IT>V</IT><IT>=1−</IT><FR><NU><IT>‖</IT><LIM><OP>∫</OP></LIM> <IT>R</IT>(<IT>&thgr;</IT>)<IT>e</IT><SUP><IT>i2&thgr;</IT></SUP><IT>d&thgr; ‖</IT></NU><DE><LIM><OP>∫</OP></LIM> <IT>R</IT>(<IT>&thgr;</IT>)<IT>d&thgr;</IT></DE></FR>
This measure is bounded between zero and one. Cells that are highly selective for stimulus orientations have circular variance values close to zero. Cells that have broad selectivity are mapped to values close to one.

The distribution of the circular variance of R(theta ), for both cell groups, is shown in Fig. 4A. Cells that have a suppressive component in their dynamics are more selective (have lower circular variance) than those that do not (P < 1.5 × 10-8, Wilcoxon rank sum test with continuity correction). By definition, the way we calculated circular variance as a measure of orientation selectivity only reflects the tuning of response enhancement [due to the positive clipping of R(theta , omega )]. Thus there is no reason why, in principle, selectivity and suppression should be correlated with one another, but we find that they are.



View larger version (19K):
[in this window]
[in a new window]
 
Fig. 4. Suppression for nonoptimal stimuli correlates with orientation selectivity in V1 neurons. A: histogram of circular variance calculated from dynamics data in cells with (S) and without (<A><AC>S</AC><AC>&cjs1171;</AC></A>) suppressive components. B: distribution of circular variance calculated based on the steady-state orientation tuning curves.

Also we evaluated the orientation selectivity of a neuron based on its steady-state tuning curve. In this experiment, we measure the steady-state orientation tuning curve of a cell using drifting gratings at its optimal spatiotemporal frequency and define R(theta ) as the mean firing rate at each drift direction. The circular variance of R(theta ) is calculated from the steady-state tuning curve using the same formula as above. Histograms of the circular variance of R(theta ), for both cell groups, are illustrated in Fig. 4B. Steady-state selectivity is also significantly higher for cells showing suppression for nonoptimal stimuli than those showing pure excitatory responses (P < 7 × 10-4, Wilcoxon rank sum test with continuity correction).

Suppression and spatial frequency selectivity

Spatial frequency tuning is also influenced by suppression. The main effect of suppression is in shaping the low-frequency limb of the tuning curve. Cells with pure excitatory components tend to have low-pass tuning curves, while cells that show suppression tend to have band-pass tuning curves. To obtain this result, we first use the dynamic measurements to calculate the average response at each spatial frequency averaged across all orientations,
<IT>R</IT>(&ohgr;) = <FR><NU>1</NU><DE>2&pgr;&ohgr;</DE></FR> <LIM><OP>∫</OP><LL>&thgr;</LL></LIM> <IT>R</IT><SUP>+</SUP>(&ohgr;, &thgr;) d&thgr;
The ratio between the response at the lowest spatial frequency tested (omega 0) and the response at the peak spatial frequency (omega peak), alpha  triple-bond  R(omega 0)/R(omega peak), provides an index that is close to zero for tuning curves that are band-pass shaped and close to one for tuning curves that are low-pass shaped. We call alpha  a low-pass index. Histograms of alpha , for both cell groups, are illustrated in Fig. 5A. Cells that have a suppressive component in their dynamics have lower low-pass indices (tuning curves that are more band-pass shaped) than those that exhibit pure excitatory components in their responses (P < 2 × 10-6, Wilcoxon rank sum test with continuity correction).



View larger version (16K):
[in this window]
[in a new window]
 
Fig. 5. Suppression for nonoptimal stimuli correlates with the shape of spatial frequency tuning curves in V1 neurons. A: histogram of low-pass indices calculated from dynamics data in cells with (S) and without (<A><AC>S</AC><AC>&cjs1171;</AC></A>) suppressive components. B: distribution of low-pass indices calculated based on the steady-state spatial frequency tuning curves.

A similar result is obtained if we analyze the steady-state spatial frequency tuning curves. Here, R(theta ) represents the mean firing rate at each spatial frequency. Histograms of alpha , for both cell groups, are illustrated in Fig. 5B. Cells showing suppression for nonoptimal stimuli have lower low-pass indices (i.e., the tuning curves are more band-pass) than those showing pure excitatory responses (P < 7 × 10-3, Wilcoxon rank sum test with continuity correction).

Comparison with models

We compared the experimental results with the prediction of three mathematical models. First, we simulated the response of a quasi-linear feedforward model to our stimulus (Fig. 6C) (Movshon et al. 1978). The model consists of a linear spatiotemporal filter followed by half-wave rectification. The input is the luminance contrast spatiotemporal pattern generated by the stimulus and the output is the rate of firing of the cell. In the APPENDIX, we formally show that if the static nonlinearity is convex (as in the case of a half-rectifier or half-squaring) the resulting kernels will always be positive (independently of the form of the feedforward filter). This means that such a model cannot generate suppression as defined by our analysis. The simulations confirm this theoretical result.



View larger version (46K):
[in this window]
[in a new window]
 
Fig. 6. Computer simulation. A and B: the two spatial kernels used in the simulations, h1 and h2. C: a linear-nonlinear cascade model of simple cell function. The two kernels depict the result of simulating the reverse correlation mapping experiment on this model for both h1 (left) and h2 (right). D: a divisive inhibition model and the resulting kernels from the simulation. E: a subtractive inhibition model and the resulting kernels from the simulation. The circular variance and low-pass index for each kernel are written on top of each panel.

We offer two examples of feed-forward receptive fields. In both cases, the linear receptive field was modeled as a separable filter in space and time. In the first example, the space kernel was an even-symmetric Gabor function broadly tuned in orientation and low-pass in spatial frequency, denoted by h1 (Fig. 6A). In the second case (Fig. 6B), the filter was an odd-symmetric Gabor function well tuned in both orientation and spatial frequency, denoted by h2. The reverse correlation kernels obtained for the different models are shown as panels in Fig. 6, C-E. The left panel corresponds to the results of h1 and the right panels correspond to h2.

As expected, the results of the simulation for the linear-nonlinear model reveal responses with no suppressive component (Fig. 6C). In this sort of feedforward model, tuning selectivity can be set to high or low by an appropriate choice of the linear kernel. The kernel obtained using h1, shown in the left panel of Fig. 6C, has broad tuning (circular variance of 0.8 and low-pass index of 0.8). In contrast, the kernel generated by h2 has sharp selectivity in the Fourier plane (circular variance of 0.25 and low-pass index of 0.1). However, because the linear-nonlinear model never generates suppression, it cannot explain the correlation between suppression and tuning in our data. The linear-nonlinear model could account for neurons like the one whose results are shown in Fig. 2D. Such weakly tuned neurons comprise a significant fraction of the data set.

A nonlinear suppressive signal is therefore required to explain the results in the sharply tuned neurons. We then investigated if the addition of suppression to the basic linear-nonlinear model could sharpen tuning selectivity. We considered two different suppression mechanisms: divisive and subtractive. In the models we studied, suppression is assumed to originate as a feedback signal in the cortex by pooling a number of cortical cells, but as we discuss in the following text, equivalent feed-forward implementations can be postulated as well. Thus while our data show that suppression might be important in the generation of tuning they do not speak as to the structure of the circuit underlying its generation.

In the divisive suppression scheme, the output of the linear filter is divided by a gain signal obtained by pooling the activities of a large number of cortical cells with different tuning selectivities (e.g., Carandini et al. 1997). The resulting kernel in the left panel of Fig. 6D resembles some of the empirical kernels (Fig. 2, A and B) and shows that divisive inhibition can be used to enhance selectivity. For h1, divisive inhibition generates a kernel with CV = 0.23 and alpha  = 0, compared with the linear-nonlinear model, which has CV = 0.8 and alpha  = 0.8). A similar outcome is obtained if we use subtractive inhibition (Fig. 6E). Here suppression acts by shifting the feedforward contribution away from threshold. These simulations demonstrate that both subtractive or divisive feedback can transform a broadly tuned excitatory component (Fig. 6C, left) into a response with higher selectivity in orientation and spatial frequency (Fig. 6, D and E, left). Adding suppression to a well-tuned filter generates similar kernels but the sharpening effect is much reduced (Fig. 6, C-E, right). These findings, together with the fact that we rarely observe sharply tuned cells without suppression (as in the right panel in Fig. 6C), are consistent with the view that feedforward mechanisms may provide broad stimulus selectivity to the cortex, but the way the cortex seems to achieve high selectivity is by the use of intracortical inhibition.

Based solely on the qualitative shapes of the simulated kernels, it appears that our data cannot distinguish between divisive and subtractive inhibition. We are now investigating if a quantitative comparison of the resulting kernels may provide a way to differentiate between the two. Recent intracellular experiments in cat visual cortex, however, suggest that shunting (divisive) inhibition plays an important role in suppressing nonoptimal responses (Monier et al. 2000; but see Anderson et al. 2000; Ferster et al. 1996).


    DISCUSSION
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
APPENDIX
REFERENCES

We used a reverse correlation technique to map response enhancement and suppression in V1 neurons. The method can be considered a refinement of the classical "conditioning stimulus" technique, where the response to a test stimulus is measured on top of some elevated firing rate set by a conditioning (or base) stimulus (e.g., among others, Blakemore and Tobin 1972; Bonds 1989; Nelson and Frost 1978). This elevated rate facilitates the detection of suppression. In the reverse correlation method, the elevation in firing rate is caused by the rapid stimulus sequence itself. The elements in the sequence are themselves the test stimuli, which appear multiple times embedded in different contexts. The analysis averages the effect of a test stimulus across the different contexts. A significant advantage of the reverse correlation technique is that the cortex does not adapt to the "base" stimulus (as is the case in the conditioning paradigm). This is a potential problem with the classical conditioning stimulus technique because it is known that adaptation can induce changes in tuning (Dragoi et al. 2001). An additional refinement we have made in the method over our previous work (Ringach et al. 1997b) is to define a baseline response explicitly. Suppression can now be measured directly instead of being inferred from the "Mexican-hat" shape of the tuning functions. Furthermore, global (uniform) suppression, which might have gone undetected by the previous method, can now be measured as well. Finally, by measuring response on the whole Fourier domain with reverse correlation, we have obtained a clear picture of the relationship between enhancement and suppression in V1.

Previous work showed the presence of response suppression in the orientation or spatial frequency domains but did not systematically study the relationship between suppression and selectivity or make comparisons to model outputs (Bauman and Bonds 1991; Blakemore and Tobin 1972; Bonds 1989; Burr et al. 1981; De Valois and Tootell 1983; De Valois et al. 1982; Morrone et al. 1982; Nelson and Frost 1978; Nelson 1991; Ringach et al. 1997a; Sclar and Freeman 1982). By using a new technique that allows us to map simultaneously the precise location of response enhancement and suppression in the Fourier plane, we found that suppression and tuning selectivity are correlated in V1 neurons. Cells that are suppressed by nonoptimal stimuli are more selective, both in the orientation and spatial frequency domains. In the spatial frequency domain, however, suppression acts mainly on the lower-frequency-limb of the tuning curve, enhancing the neurons' band-pass characteristics. This was established without the need for pharmacological manipulations as done in some previous studies. Instead we took advantage of the natural variability of tuning selectivity in the cortex to study the correlation between inhibition and tuning selectivity in the normal V1 population.

The modeling shows that a broadly tuned inhibition, which overlaps significantly with the response of the feedforward signal in the Fourier domain, is sufficient to generate results that are qualitatively similar with most of the experimental data (a tuned inhibitory signal is required to replicate the flank suppression in Fig. 2C). Broadly tuned suppression was used in the simulations to be consistent with experimental results in cat area 17 (DeAngelis et al. 1992), which show a suppressive component that is broadly tuned for orientation and spatial frequency. Both subtractive and divisive inhibition generated results that are in qualitative agreement with the measured kernels. The divisive model has been proposed before to account for contrast gain control in the cortex (Albrecht and Geisler 1991; Carandini et al. 1997; Heeger 1992). The suppression observed in the kernels could be related to a contrast gain control signal acting on fast time scales. An assumption of these models is that response selectivity is invariant at different levels of contrast gain control. However, the observed correlation between selectivity and suppression, together with the modeling results and the findings of previous studies (McLaughlin et al. 2000), show that in addition to controlling contrast gain, divisive inhibition might sharpen response selectivity in the cortex.

A question that remains unanswered in our study is the exact structure of the cortical circuitry generating the inhibitory signals. The numerical simulations show that cortical feedback is one possibility. In principle, feedback suppression can be replaced with feed-forward suppression using a circuit as shown in Fig. 7A. Here, the nonlinear suppressive signal is generated by summing in a feed-forward fashion the output of simple cells. This is similar to the hierarchical complex cell model of Hubel and Wiesel. The nonlinear signal is then used to inhibit, via division or subtraction, the target cell. An alternative is that several inhibitory simple-cells synapse directly on the target cell (Fig. 7B). These feed-forward inhibition models can be made to generate results that resemble those of the feedback models.



View larger version (21K):
[in this window]
[in a new window]
 
Fig. 7. Feed-forward implementations of the models in Fig. 6 (D and E). Op is an operator that can be either subtraction or division. A: the output from several simple cells with different preferences in the Fourier domain are pooled to generate a complex-like cell that provides the required (nonlinear) suppressive signal. B: the output from several (inhibitory) simple cells with different preferences in the Fourier domain synapse directly onto the target cell.

Because there is no evidence for direct thalamo-cortical inhibition, the feed-forward inhibition models postulate the existence of a cortical inhibitory interneuron for the main purpose of inverting the LGN input (Troyer et al. 1998). However, we feel the existence of such purely "feed-forward" circuitry through inhibitory interneurons is doubtful given our knowledge of the cortical anatomy (Dantzker and Callaway 2000; Lund 1987, 1988; Lund et al. 1995). It appears likely that inhibitory interneurons also receive a substantial cortical input that is dependent on visual stimulation and that the entire circuit is more appropriately described as a feedback system. Nevertheless the actual organization of the inhibitory circuitry remains a question for further research.

The data presented here significantly advance our knowledge of the relationship between suppression and tuning. Specifically, the correlations in our data are consistent with the idea that nonlinear suppression, whether generated by feedback or feed-forward mechanisms, plays a role in generating sharp stimulus selectivity in the Fourier plane. Models of cortical selectivity need to predict the observed correlation between response suppression and tuning selectivity in primary visual cortex. Simple models that generate high orientation selectivity through feed-forward (linear) excitatory mechanisms but no suppression, as shown by simulations (Fig. 6) and analytically, do not predict such a correlation and therefore are rejected by the data.


    APPENDIX
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
APPENDIX
REFERENCES

Calculation of d' for the Poisson case

Given two Poisson distributions, with rates lambda  and alpha lambda , we can derive a measure of d' analogous to the Gaussian case (Green and Swets 1966). The parameter d' gives a measure of how separated the two distributions are---the more separated the rates are the higher the d'. The log-likelihood function for a Poisson distributed variable is easily calculated and equals L(k) = -lambda  + k ln lambda  - ln k!. Thus the log-likelihood ratio between two hypotheses with rates lambda  and alpha lambda can be written as, l(k) = k ln alpha  + C, where C is a constant that depends on lambda  and alpha . In analogy to the equal-variance Gaussian case, we can write d' = ln alpha . The parameter d' is the log of the ratio between the means of the two distributions. Given a baseline rate lambda  there are only two different rates that will yield the same (absolute) d' value: lambda ed' and lambda e-d'. Clearly, the product of these rates equals lambda , and the logarithm of the ratio between the rates and the baseline rate equals ±d'. Therefore the absolute magnitude of enhancement and suppression, as defined in this study, is effectively a measure of d' relative to the baseline rate.

Nonnegativity of kernels in a linear-nonlinear system

Consider the linear-nonlinear system depicted in Fig. 6C. We claim that if Phi (·) is convex then the reverse correlation kernel is nonnegative, R(omega , theta ; tau >=  0.

In other words, this model cannot generate suppression as defined in our analysis. This can be seen as follows. Let us denote by y(t) the output of the linear filter at time t and the instantaneous (Poisson) rate of firing by r(t) = Phi [y(t)]. At any point in time, the probability of the neuron firing in an interval Delta t is given r(t) Delta t. Thus the expected firing rate tau  ms after the presentation of a grating with a fixed spatial frequency (omega ) and orientation (theta ), but random spatial phase (phi ) is given by
<IT>E</IT>{<IT>&PHgr;</IT>(<IT>y</IT>)}<IT>=</IT><IT>E</IT>{<IT>&PHgr;</IT>(<IT>H</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT> sin &phgr;+</IT><IT>z</IT>)}
Here, H(omega , theta ; tau ) is the amplitude spectrum of the linear filter evaluated at t = tau , and z is a random variable that represents the contribution of the filter to y(t) from times other than tau . If Phi (·) is convex, we can use Jensen's inequality
<IT>E</IT>{<IT>&PHgr;</IT>(<IT>y</IT>)}<IT>≥&PHgr;</IT>(<IT>E</IT>{<IT>y</IT>})
to obtain
<IT>E</IT>{<IT>&PHgr;</IT>(<IT>H</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT> sin &phgr;+</IT><IT>z</IT>)}<IT>≥&PHgr;</IT>(<IT>E</IT>{<IT>H</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT> sin &phgr;+</IT><IT>z</IT>})
but
&PHgr;(<IT>E</IT>{<IT>H</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT> sin &phgr;+</IT><IT>z</IT>})<IT>=</IT><IT>&PHgr;</IT>(<IT>E</IT>{<IT>H</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT> sin &phgr;</IT>}<IT>+</IT><IT>E</IT>{<IT>z</IT>})

=&PHgr;(<IT>E</IT>{<IT>H</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT> sin &phgr;</IT>})

=&PHgr;(0)
Which yields
<IT>E</IT>{<IT>&PHgr;</IT>(<IT>H</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT> sin &phgr;+</IT><IT>z</IT>)}<IT>≥&PHgr;</IT>(<IT>0</IT>)
However, Phi (0) is also the firing rate of a baseline stimulus, as the definition requires that for such stimuli H(omega , theta ; tau ) = 0, which means that the stimuli cannot be resolved by the neuron. We conclude that
<IT>R</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT>≡log<SUB>10</SUB> </IT><FENCE><FR><NU><IT>E</IT>{<IT>&PHgr;</IT>(<IT>H</IT>(<IT>&ohgr;, &thgr;; &tgr;</IT>)<IT> sin &phgr;+</IT><IT>z</IT>)}</NU><DE><IT>&PHgr;</IT>(<IT>0</IT>)</DE></FR></FENCE><IT>≥log<SUB>10</SUB> </IT>{<IT>1</IT>}<IT>≥0</IT>


    ACKNOWLEDGMENTS

This research was supported by National Eye Institute Grants EY-12816 (D. L. Ringach), EY-08300 (M. J. Hawken), and EY-01472 (R. M. Shapley) and by the Sloan Foundation for support of the New York University Theoretical Neuroscience Program.


    FOOTNOTES

Address for reprint requests: D. L. Ringach, Dept. of Neurobiology and Psychology, Franz Hall, Rm. 8441B, University of California, Los Angeles, CA 90095-1563 (E-mail: dario{at}ucla.edu).

Received 25 July 2001; accepted in final form 15 October 2001.


    REFERENCES
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
APPENDIX
REFERENCES

0022-3077/02 $5.00 Copyright © 2002 The American Physiological Society



This article has been cited by other articles:


Home page
J. Neurosci.Home page
M. Scolari and J. T. Serences
Adaptive Allocation of Attentional Gain
J. Neurosci., September 23, 2009; 29(38): 11933 - 11942.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
Y. Yang, J. Zhang, Z. Liang, G. Li, Y. Wang, Y. Ma, Y. Zhou, and A. G. Leventhal
Aging Affects the Neural Representation of Speed in Macaque Area MT
Cereb Cortex, September 1, 2009; 19(9): 1957 - 1967.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
R. Kimura and I. Ohzawa
Time Course of Cross-Orientation Suppression in the Early Visual Cortex
J Neurophysiol, March 1, 2009; 101(3): 1463 - 1479.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
B. J. Malone and D. L. Ringach
Dynamics of Tuning in the Fourier Domain
J Neurophysiol, July 1, 2008; 100(1): 239 - 248.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
K. S. Sasaki and I. Ohzawa
Internal Spatial Organization of Receptive Fields of Complex Cells in the Early Visual Cortex
J Neurophysiol, September 1, 2007; 98(3): 1194 - 1212.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
S. Nishimoto, T. Ishida, and I. Ohzawa
Receptive field properties of neurons in the early visual cortex revealed by local spectral reverse correlation.
J. Neurosci., March 22, 2006; 26(12): 3269 - 3280.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
M. Gur, I. Kagan, and D. M. Snodderly
Orientation and Direction Selectivity of Neurons in V1 of Alert Monkeys: Functional Relationships and Laminar Distributions
Cereb Cortex, August 1, 2005; 15(8): 1207 - 1221.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
T. I. Baker and N. P. Issa
Cortical Maps of Separable Tuning Properties Predict Population Responses to Complex Visual Stimuli
J Neurophysiol, July 1, 2005; 94(1): 775 - 787.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
D. Xing, R. M. Shapley, M. J. Hawken, and D. L. Ringach
Effect of Stimulus Size on the Dynamics of Orientation Selectivity in Macaque V1
J Neurophysiol, July 1, 2005; 94(1): 799 - 812.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
M. L. Mata and D. L. Ringach
Spatial Overlap of ON and OFF Subregions and Its Relation to Response Modulation Ratio in Macaque Primary Visual Cortex
J Neurophysiol, February 1, 2005; 93(2): 919 - 928.
[Abstract] [Full Text] [PDF]


Home page
Proc. Natl. Acad. Sci. USAHome page
L. Sirovich and R. Uglesich
The organization of orientation and spatial frequency in primary visual cortex
PNAS, November 30, 2004; 101(48): 16941 - 16946.
[Abstract] [Full Text] [PDF]


Home page
J. Physiol.Home page
D. L. Ringach
Mapping receptive fields in primary visual cortex
J. Physiol., August 1, 2004; 558(3): 717 - 728.
[Abstract] [Full Text] [PDF]


Home page
J. Physiol.Home page
D. Xing, D. L. Ringach, R. Shapley, and M. J Hawken
Correlation of local and global orientation and spatial frequency tuning in macaque V1
J. Physiol., June 15, 2004; 557(3): 923 - 933.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
B. J. Mickey and J. C. Middlebrooks
Representation of Auditory Space by Cortical Neurons in Awake Cats
J. Neurosci., September 24, 2003; 23(25): 8649 - 8663.
[Abstract] [Full Text] [PDF]


Home page
J. Neurophysiol.Home page
D. L. Ringach, M. J. Hawken, and R. Shapley
Dynamics of Orientation Tuning in Macaque V1: The Role of Global and Tuned Suppression
J Neurophysiol, July 1, 2003; 90(1): 342 - 352.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
D. L. Ringach, R. M. Shapley, and M. J. Hawken
Orientation Selectivity in Macaque V1: Diversity and Laminar Dependence
J. Neurosci., July 1, 2002; 22(13): 5639 - 5651.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
C. E. Bredfeldt and D. L. Ringach
Dynamics of Spatial Frequency Tuning in Macaque V1
J. Neurosci., March 1, 2002; 22(5): 1976 - 1984.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (46)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Ringach, D. L.
Right arrow Articles by Hawken, M. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Ringach, D. L.
Right arrow Articles by Hawken, M. J.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Visit Other APS Journals Online