|
|
||||||||
The Journal of Neurophysiology Vol. 85 No. 6 June 2001, pp. 2303-2323
Copyright ©2001 by the American Physiological Society
1Department of Physiology, Hadassah Medical School and Center for Neural Computation, Hebrew University, Jerusalem 91120; and 2Department of Computer Science, Tel-Aviv University, Tel-Aviv 69978, Israel
| |
ABSTRACT |
|---|
|
|
|---|
Fishbach, Alon, Israel Nelken, and Yehezkel Yeshurun. Auditory Edge Detection: A Neural Model for Physiological and Psychoacoustical Responses to Amplitude Transients. J. Neurophysiol. 85: 2303-2323, 2001. Primary segmentation of visual scenes is based on spatiotemporal edges that are presumably detected by neurons throughout the visual system. In contrast, the way in which the auditory system decomposes complex auditory scenes is substantially less clear. There is diverse physiological and psychophysical evidence for the sensitivity of the auditory system to amplitude transients, which can be considered as a partial analogue to visual spatiotemporal edges. However, there is currently no theoretical framework in which these phenomena can be associated or related to the perceptual task of auditory source segregation. We propose a neural model for an auditory temporal edge detector, whose underlying principles are similar to classical visual edge detector models. Our main result is that this model reproduces published physiological responses to amplitude transients collected at multiple levels of the auditory pathways using a variety of experimental procedures. Moreover, the model successfully predicts physiological responses to a new set of amplitude transients, collected in cat primary auditory cortex and medial geniculate body. Additionally, the model reproduces several published psychoacoustical responses to amplitude transients as well as the psychoacoustical data for amplitude edge detection reported here for the first time. These results support the hypothesis that the response of auditory neurons to amplitude transients is the correlate of psychoacoustical edge detection.
| |
INTRODUCTION |
|---|
|
|
|---|
The sensitivity of the auditory
system to amplitude transients is well documented, both physiologically
and psychoacoustically. Psychoacoustical studies have demonstrated the
importance of the temporal structure of amplitude envelope to auditory
perception in general (e.g., Drullman 1995
;
Drullman et al. 1994a
,b
; Shannon et al. 1995
; Turner et
al. 1994
), and to the segregation process of complex auditory
scenes in particular (Bregman et al.
1994a
,b
). These
studies demonstrate that both the magnitude and duration of amplitude
transients affect auditory perception. However, it is still unclear
which physical parameters of the amplitude transients most affect
auditory perception of the transient.
Animal studies have shown that temporal changes in amplitude envelope
in general, and amplitude onset in particular, generate strong neural
responses throughout the auditory pathways (Eggermont 1993
; Kitzes et al. 1978
; Phillips
1988
; Rees and Møller 1983
; Schreiner
and Langner 1988a
; Suga 1971
). Several studies
of the dependence of neuronal responses on the shape of an onset ramp (Barth and Burkard 1993
; Heil
1997a
,b
; Heil and
Irvine 1996
, 1997
; Phillips 1988
, 1998
;
Phillips and Burkard 1999
; Phillips et al. 1995
) have shown that neural response characteristics can
neither be ascribed to a simple function of onset plateau level nor to onset duration per se. Rather, the dynamics of the onset, such as the
rate or acceleration of peak pressure, shape the neural response. These
phenomena are evident across multiple levels of the auditory pathways.
Furthermore, they have been demonstrated using a variety of
experimental procedures, such as single-cell recordings from the cat
primary auditory cortex and posterior field (Heil
1997a
,b
; Heil and
Irvine 1996
, 1998b
;
Phillips 1988
, 1998
), inferior colliculus potential of the awake
chinchilla (Phillips and Burkard 1999
), and human brain
stem-evoked response (Barth and Burkard 1993
).
The dependence of neural responses on the dynamics of the amplitude envelope raises the possibility that these responses reflect the computation of temporal auditory edges. Following this assumption, we suggest a neural model for the detection of amplitude transients (auditory temporal edges), which is inspired by visual edge detector models. The model responses are compared to published physiological responses to amplitude transients, and its predictions regarding the responses to amplitude transients that have not been examined before are verified experimentally. In addition, we attempt to define the physical parameters of amplitude transient that affect human perception of amplitude discontinuity, in order to characterize the psychophysical properties of perceived auditory temporal edge.
Our results suggest that the same physical parameters may govern both physiological and psychophysical responses to amplitude transients. Moreover, we show that both physiological and psychoacoustical responses can be explained by our simple neural model for auditory temporal edge detection. These results suggest that the sensitivity of the auditory system to amplitude transients is a realization of auditory temporal edge calculation that may have a primary role in neural auditory processing.
| |
METHODS |
|---|
|
|
|---|
Neural model principles
In line with the auditory-visual edge detection
analogy, we adapted a model of visual edge detection to the auditory
modality. The fundamental principle of the operation of visual edge
detector is the calculation of a local brightness gradient. This is
accomplished by differentiating the brightness function along some
spatial direction or directions, using a combination of inhibitory and excitatory connections. The spatial organization of these connections in terms of the retinal image induces a receptive field that might be
functionally described as an edge detector. Although there are recent
and more elaborated visual receptive fields models, the simplest edge
detecting receptive field model (Marr 1982
; Rodieck 1965
), which has an on-center off-surround (or
vice versa) response pattern, suffices for our purpose. This receptive
field describes the responses of edge detector neurons that can be
found mostly in sub-cortical visual centers. The spatial properties of
an idealized receptive field can be approximated by the second derivative of a gaussian or a difference of two gaussians (DOG), one
wider than the other.
To adapt such a mechanism to auditory temporal edge detection, we hypothesize the existence of a temporal delay dimension, analogous to the visual spatial dimensions. The stimulus is progressively delayed along this delay dimension. Information related to the temporal dynamics of the amplitude envelope (e.g., its rate of change) can be made explicit by differentiating the stimulus along this dimension, as the visual brightness gradient is made explicit by differentiating the stimulus along a spatial dimension.
We construct the delay dimension by using the well-known temporal
characteristics of a standard version of the integrate-and-fire model
(I&F). Our I&F makes use of a kernel function in the form
|
(1) |
m is the
membrane time constant that may range from 3 to 25 ms (McCormick
et al. 1985
m values induce
greater delay in the neuron's response (Agmon-Snir and Segev
1993
ms to an edge detector neuron using
inhibitory and excitatory connections with various efficacies that
reflect the receptive field shape. Differentiation of the stimuli is
obtained by using a receptive field shape of a first-order derivative
of a gaussian.
Figure 1 presents a schematic diagram of the model and the flow of data along the different model components. Each model component is annotated with an approximate expression for its operation on its input. These formulations will be used in the analysis of the model. Exact implementation details are given in APPENDIX A. The inputs tested consisted of tone bursts shaped with ON and OFF ramps of various shapes. An example of a tone burst with linear ramps is displayed in Fig. 1A.
|
NEURAL REPRESENTATION.
The neural representation (Fig. 1B) is roughly the expected
peripheral representation of sound by the inner hair cell DC potential. This representation is generated using a simple preprocessing that
includes demodulation to extract the temporal envelope, non-linear compression and low-pass filtering. In our analysis we formulate the
demodulation and the non-linear compression using the amplitude envelope of the input converted to dB SPL scale (the constants in Fig.
1B are set to A = 20/ln (10) and
P0 = 2 · 10
5 Pa). The
form of the argument to the log transformation eases the analysis for
near-zero values of t and has negligible effect for
t
0. The low-pass filtering is formulated by convolving the log-envelope with an alpha kernel function (Eq. 1) with
a time constant of
1, which is in the millisecond range
(Hewitt and Meddis 1990
; Smith 1988
).
This preprocessing stage can be replaced by a more realistic inner hair
cell model (which produces simulation of auditory nerve firing
probabilities) (Hewitt and Meddis 1990
; as implemented
by Slaney 1998
) without any qualitative change in the
response characteristics of the model.
DELAY LAYER.
The preprocessed input is fed to the delay layer of the model, which
consists of standard integrate & fire (I&F) neurons with ascending
membrane time decay constants. Each unit U(t,
2) in the delay layer represents a population of neurons
with identical characteristics. The population response is modeled as
an analogue variable, by convolving the neuronal representation
N(t), with a kernel (Gerstner
1999b
) whose time constant is
2. I&F kernel functions and membrane time-constant values are shown for several units
(Fig. 1C). The membrane potential of each neuron in the delay layer is then saturated using a sigmoidal function
|
(2) |
RECEPTIVE FIELD.
The delay layer neurons are connected to an edge detector neuron using
inhibitory and excitatory connections with various efficacies (Fig.
1D) that reflect the receptive field shape, which is a first
derivative of a gaussian. The output of the receptive field,
R(t), is shown in Fig. 3 for stimuli similar to
the stimulus presented in Fig. 1 and is approximately a smoothed first
derivative of the outputs of the delay neurons along the
2 dimension.
EDGE DETECTOR NEURON.
The edge detector neuron (Fig. 1E) is a single I&F neuron
with a membrane time constant
3. The output of the edge
detector neuron is also the output of the model. In the numerical
implementation of the model, a noisy integration was used
(Gerstner 1999a
). For the analytical treatment presented
here, the membrane potential of the edge detection neuron,
M(t), is modeled as a low-pass filter operating
on the output of the receptive field operator,
R(t).
PARAMETERS OF THE MODEL.
The responses of the model are adjusted to fit the response of a
specific neuron by adjusting two parameters. The first parameter is
C, the scaling factor of the delay layer saturation
transformation (Eq. 2), and the second parameter is
3, the membrane time constant of the edge detector
neuron. In addition, the threshold of the edge detector neuron was
varied. However, the threshold was not manipulated independently;
instead, its value was always set to best approximate the threshold of
the neuron that was fitted. There are six additional fixed parameters
of the model; three of them are parameters of the I&F model. These
parameters and their values are listed in full in APPENDIX
A. Their specific values have only minor or redundant effect on
the responses of the model. For example, changing the value of
1 or the range of
2 that are used in the
delay layer can be in large extent be compensated by adjusting the
value of
3.
Physiological methods
ANIMALS AND PREPARATION.
Neurons have been recorded in primary auditory cortex (AI) and medial
geniculate body (MGB) of two halothane-anesthetized adult cats. The
methods have been described in details elsewhere (Nelken et al.
1999
). In short, the cats were premedicated with xylazine (0.1 ml im), and anesthesia was induced by ketamine (30 mg/kg im). The
radial vein, the femoral artery, and the trachea were cannulated. Blood
pressure and CO2 levels in the trachea were continuously
monitored. The cat was respirated with a mixture of
O2/N2O (30%/70%) and halothane (0.2-1.5%,
as needed). Halothane level was set so that arterial blood pressure was
kept around 100 mmHg on the average. Under these conditions, the cat
usually could be respirated without the use of muscle relaxants. In
case muscle relaxants were required, the depth of anesthesia was
evaluated by testing paw withdrawal reflexes before administering low
levels (pancuronium bromide, 0.05-0.1 mg iv, typically once every 2-3 h). Lactated ringer was continuously given through the venous catheter
(10 ml/h). Every 8-12 h a chemical analysis of arterial blood was
performed. When the cat developed acidosis, bicarbonate was given
(typically 5 ml iv, every 8 h).
DATA ACQUISITION. Glass-coated tungsten electrodes (locally made) were used for recording neuronal activity. The activity from the electrodes was amplified (MCP8 Plus, Alpha-Omega), and spikes were detected on-line by a spike sorter (MSD, Alpha-Omega). The times of the spikes were recorded (ET1, TDT) and written into a file for off-line analysis.
ACOUSTIC STIMULATION.
Stimuli were generated digitally converted to analog waveforms and
attenuated using TDT equipment. All stimuli were tone bursts, 230 ms
long including the symmetrical onset and offset ramps. Six types of
onset/offset window shapes were used, cos2 (t),
cos4 (t), t,
t2, t4, and squared
exponential. By denoting the plateau peak pressure in Pascal units with
P, and the onset rise time in milliseconds with
D, the peak pressure (in Pa) during the onset is given by
|
(3) |
|
(4) |
Psychoacoustical methods
The main goal of our psychoacoustical experiments was to test whether the perception of amplitude changes is determined by the gradient of the change, or by some other combination of its duration and magnitude. A secondary goal was to rule out the possibility that the sensitivity of the auditory system to amplitude changes is due to a spectral splatter that may be induced by the sudden amplitude change. In order to accomplish these goals we used a direct measure of the way in which the amplitude change is being perceived, rather than measuring amplitude change effect on higher perceptual tasks. This enabled us to isolate the perception of the amplitude transient from the context of more elaborate auditory phenomena such as auditory source segregation, in order to avoid high-level cognitive influences. Two sets of experiments were conducted; the first measured the discontinuity perception of ramped sinusoids (experiment 1), while the second measured the perception of ramped noise bursts (experiment 2).
PARTICIPANTS. All participants were normal hearing volunteer adults, who participated with full informed consent. Data for experiment 1 were obtained from 10 participants. All except for one, who is one of the authors (YY), had no previous listening experience in psychoacoustical experiments. Data for experiment 2 were obtained from five participants. None had participated in experiment 1, and none had previous listening experience in psychoacoustic experiments.
STIMULI.
Experiment 1 stimuli are pure tones with an amplitude
envelope as illustrated in Fig. 2 (solid
line). Onset and offset times are 150 ms, and both plateau amplitude
periods are 1 s. The first plateau level
(A1), the amplitude ramp size (
A)
and duration (
T), and the frequency of the tone were
manipulated. The values used appear in Table
1. The set of stimuli is a full
combination of the variable's values, thus forming a set of 224 unique
stimuli, each of which was presented once. The stimuli were generated
digitally and played over a Silicon-Graphics Indigo workstation at
sampling rate of 16,000 Hz at 16-bit resolution.
|
|
|
PROCEDURE. An identical procedure was used in both experiments. The stimuli were presented binaurally through Yamaha HP-2 earphones to the participants who were seated in a soundproof room. The psychophysical task was to judge whether the transition between the two plateau amplitude levels was a continuous or discontinuous one. The participants were asked to indicate their choice for each of the stimuli using a two-alternative forced choice procedure. A random training subset of 40 trials was presented to the listeners, followed by the entire set presented in random order. The listeners were unaware of the fact that the first trials were training trials. Participants had unlimited time to respond after each trial and were presented with the next trial 2 s after their response.
| |
RESULTS |
|---|
|
|
|---|
Neural model: general observations
The model was capable of reproducing all the physiological characteristics of onset responses in AI neurons. In particular, the model was capable to produce the shortening of latencies with increase in tone level, and was capable of generating both monotonic and non-monotonic rate-level functions.
Figure 3 illustrates the way the model responds to amplitude transients and the effect of the delay layer's saturation on the timing and strength of the responses. The log-compressed envelopes of linearly shaped 30-dB SPL and 90-dB SPL tone bursts are shown in Fig. 3A. The response of the model components to these stimuli is considered in two different saturation conditions. A model with a highly saturated delay layer, which yields non-monotonic responses, is described in Fig. 3, B, D, and F, while a model with only weakly saturated delay layer is described in Fig. 3, C, E, and G. For clarity, we consider a simplified delay layer that consists of only two neurons with time constants of 3 and 6 ms. Figure 3, B and C, demonstrates the different delays of the stimulus envelope that are being induced by the two neurons. The outputs of the two neurons are subtracted by connecting them to the edge detector neuron with weights of equal magnitude and opposite signs (Fig. 3, D and E). The prominent effect of the amount of saturation on the model responses emerges at this stage. For example, the total current (the integrated presynaptic input) that is being injected to the edge detector neuron in the highly saturated model (Fig. 3D) is higher in response to the 30-dB tone than to the 90-dB tone (155 vs. 89.7 in arbitrary units, respectively). In the weakly saturated model (Fig. 3E), the integrated presynaptic input is lower in response to the 30-dB tone that the 90-dB tone (81.9 vs. 246.8, respectively). The non-monotonicity of the highly saturated model is enhanced by the low-pass properties of the membrane potential of the edge detector neuron (Fig. 3F). The effect of the delay layer's saturation on the non-monotonicity of the model is being mathematically analyzed in APPENDIX B. Another effect of the saturation is decreasing the first-spike latency and shortening the period of neural activity. For the purpose of mathematical treatment, it can be reasonably assumed that a neuron starts to fire when its membrane potential hits a fixed threshold and that its spike count is proportional to the area enclosed by this threshold and the neuron's membrane potential (Fig. 3G).
|
Evaluation of the neural model: single-neuron data
We evaluated the adequacy of the model to match reported neural response to sound bursts by feeding the model with the amplitude envelope of the stimuli and comparing several aspects of the model output with those of the reported responses. The properties of the output examined were the first spike latency of the response, the response strength measured by the number of spikes that followed a stimulus, and the relationships between the two.
LATENCY.
Heil and his co-workers (Heil 1997a
; Heil and
Irvine 1996
) studied the latency of primary auditory cortex
neurons (AI) as a function of the shape, amplitude, and duration of the
rise time of a best frequency tone. Two kinds of onset envelope
functions were used, linear and cosine-squared. The peak amplitude
during a linear onset is described by a power function as described in Eq. 3 with n = 1. The peak amplitude during
a cosine-squared onset is described by Eq. 4, with
n = 2.
|
(5) |
|
(6) |
2P/2D2 stands for the
maximal acceleration of the envelope, which occurs at the beginning of
the onset. Heil fit global scaling factors Al
and Ac over the entire neural population that
was recorded and set them to 1,277 and 12,719 ms, respectively.
We fitted the model parameters to match the responses of 13 AI neurons
for which both latency and spike-count data are fully reported by
Heil (1997a
|
|
FIXED-THRESHOLD MODEL DOES NOT FIT THE DATA.
A possible explanation for the latency phenomena is that the neuron
first spike occurs when the input stimuli level hits a fixed threshold
(Kitzes et al. 1978
; Phillips 1988
;
Suga 1971
). Indeed, it is easy to show that such a
simple model predicts a reciprocal relation between the first-spike
latency of a neuron and the rate (P/D) of linear
onsets and maximum acceleration
(
2P/2D2) of
cosine-squared onsets. While these predictions roughly approximate the
experimental results, the later systematically deviate from the
predictions. On these grounds, Heil and Irvine (1996)
argue against the simple threshold model. Their claims can be
summarized by two main points that are illustrated in Fig.
6.
|
MATHEMATICAL ANALYSIS OF LATENCY PHENOMENA.
In our analysis we use the formulations given in Fig. 1, and we assume
that the amplitude envelope of the input stimulus, E(t), can be approximated during the onset (for
t
D) by a power function such as
described in Eq. 3 for any n > 0. For
simplicity sake we will restrict our analysis to t
D; this assumption is equivalent to the statement that the
first spike occurred during the onset ramp (after taking into account
constant latency components that are independent of the sound level).
D (1st spike generation occurring during
the onset ramp). For near-threshold levels of P,
t* may exceed D, which results in longer
latencies than predicted. This presumably is the cause of the
departures from the invariant relationship between first spike latency
and P/Dn at low levels of
P in both experimental and simulated data (e.g., Figs.
4C and 5).
Another phenomenon that can be explained by the implicit form of
t* is of Heil and Irvine (1996)COMPARING MODEL PREDICTIONS WITH LATENCY RESULTS OF PHYSIOLOGICAL
EXPERIMENTS.
Figure 7 shows the latency data of one AI
unit in response to three types of onset windows, linear (Fig.
7A), cosine squared (Fig. 7C), and squared
exponential (Fig. 7E). The latency for each window is
plotted as a function of the predicted invariant measure, and the
alignment of the latency data along a single curve for each rise
function validates our predictions. Numerical simulations reproduce
these phenomena (Fig. 7, B, D, and F). Figure 8A shows the latency of a MGB
neuron in response to four types of amplitude rise function,
cos2 (t), cos4 (t),
t2, and t4. The latency
of each rise function is plotted as a function of the predicted
invariant measure, which is P/Dn for
the tn rise functions and
nP/2nDn
for the cosn (t) rise functions
{Taylor's series approximation of cosn
[(
/2)t + (
/2)] is
(
n/2n)tn + o(tn+2) for even n}.
This way the latency data collected with the t2
and the cos2 (t) rise function aligns along a
single curve, and the latency data collected with the
t4 and the cos4 (t) rise
function aligns along another curve. The model predictions also hold
for the responses of a neuron in primary auditory cortex (Fig.
8C) and are being reproduced by the numerical simulations of
the model (Fig. 8, B and D).
|
|
SPIKE COUNT.
Neurons in AI of anesthetized cat show a low spontaneous rate of
fire, and their typical response to sound bursts is a single spike or a
short burst of a few spikes immediately following the onset of the
stimulus (e.g., Heil 1997b
). Examining the spike count
as a function of plateau peak pressure alone reveals a non-monotonic pattern that is shared by many AI neurons to various degrees (e.g., Heil 1997b
; Heil and Irvine 1998a
;
Phillips 1988
; Schreiner and Mendelson
1990
). Furthermore, the non-monotonicity is enhanced at the
shorter rise times. Figure 9 demonstrates
the typical response patterns of two types of neurons, as replotted
from Heil's (1997b)
data. Figure 9A shows a
highly non-monotonic neuron, whereas Fig. 9C shows a more
monotonic neuron. The spike-count data are plotted as a function of
plateau peak pressure and are organized along iso-rise-time curves. The
model reproduces these phenomena over a wide range of degrees of
monotonicity. Figure 9, B and D, demonstrates a
good correspondence between experimental and simulated results. The
correspondence is apparent for curve shapes as well as for order of
displacement of the iso-rise-time curves, although the displacement of
the model curves along the abscissa are much larger than those of the
neural curves.
|
|
Evaluation of the neural model: evoked auditory brain stem responses
The ability of the model to match reported evoked auditory brain
stem responses in humans (Barth and Burkard 1993
) and
inferior colliculus potential (ICP) in the awake chinchilla
(Phillips and Burkard 1999
) in response to sound bursts,
was tested by feeding the model with the amplitude envelope of the
stimuli and comparing the model output to the reported responses. The
membrane potential of our modeled edge detector neuron (Fig.
1E) was used as an estimate of the combined activity of a
large population of brain stem neurons (Gerstner 1999b
).
The model activity was then differentiated to mimic the analogue
highpass filter (with a slope of 6 dB/oct) used in these experiments.
Figure 11A shows a typical
measure of the inferior colliculus potential in response to a tone
burst as replotted from Barth and Burkard (1993)
. Figure
11B shows the differentiated membrane potential of the edge
detector neuron of the model. This figure also illustrates the
definitions of the latency and amplitude of the response. The two
adjustable parameters that shape the model's response to amplitude
transients (C and
3) were adjusted to fit the
latency and amplitude of the experimental responses.
|
In contrast to the stimuli that were used in single-cell recordings,
whose total durations were 50-100 ms (Phillips 1998
) or
400 ms (Heil 1997a
,b
), the stimuli that were used by Barth and
Burkard (1993)
and by Phillips and Burkard
(1999)
were much shorter and included plateau-level
durations of 2-5 ms. For the model to accurately reproduce the
experimental responses to these very short bursts, we had to reduce the
time constant of the delay layer units from a range of 3-5 ms to a
range of 0.5-1 ms, since higher time constants oversmoothed the
envelope. The problem of using very short time constants when modeling
mammalian inferior colliculus neurons has also been encountered in
other modeling studies (Hewitt and Meddis 1994
).
LATENCY.
Phillips and Burkard (1999)
measured the latency of the
ICP in the awake chinchilla in response to cosine-squared onsets of various rise times and amplitude levels. Although Phillips and Burkard
reported that there were strong similarities between the latency
behavior of the ICP and that of cortical single cells, they did not use
Heil's functional expression (see Eq. 6) to match the
latency data according to the maximum acceleration of the onset
envelope. Figure 12A shows
that replotting the ICP latency data as a function of maximum
acceleration of the envelope brings the iso-rise-time curves to
converge along a single curve that can be fitted using Eq. 6
and by using the same value of the constant parameter
(Ac) that was used by Heil
(1997a)
. Figure 12B shows that the model reproduces
the ICP latency data.
|
RESPONSE AMPLITUDE.
The effect of onset rise time and amplitude level on the ICP and on
wave V of BAER response amplitude are similar to their effect on the
spike count of monotonic cortical single cells. The response amplitude
increased with ascending amplitude levels and with descending onset
rise times. Figure 13 replots
Phillips and Burkard's (1999)
ICP amplitude response
(Fig. 13A) and Barth and Burkard's (1993)
BAER wave V response amplitude (Fig. 13C); both are plotted
as a function of the plateau peak level. The simulated response
amplitudes are presented in Fig. 13, B and D, and
are scaled in order to match the experimental measurements.
|
Results of the psychoacoustic experiments
The results of the two experiments were analyzed using a stepwise logistic regression. The dependent variable was set to be the probability of eliciting a discontinuous response, and the independent variables included the stimuli parameters used in each experiment (as detailed in Tables 1 and 2, respectively). In addition, motivated by our model, we added to the two sets of independent variables: the logarithm of the normalized rate of change of the ramp peak pressure re the base peak pressure (this is the invariant measure for the stimuli used here, see next section).
EXPERIMENT 1.
The regression results show that the variable that accounts for most of
the variance is the normalized rate of the ramp peak pressure
[F(1,2238) = 1,948.6, P < 10
15]. Other significant variables are the duration of
the change, [F(1,2237) = 60.8, P < 10
12]; and the tone frequency
[F(1,2236) = 32.5, P < 10
7].
EXPERIMENT 2.
The results of the second experiment also found the normalized rate of
peak pressure to be the variable that accounts for most of the variance
[F(1,898) = 509.6, P < 10
15]. Other significant variables were the first
plateau amplitude level, [F(1,897) = 29.2, P < 10
7]; the step amplitude
[F(1,896) = 11.5, P < 0.0007] and the step duration [F(1,895) = 11.07, P < 0.0009].
|
Evaluation of the neural model: psychoacoustic data
In the following section we will compare the model responses with
the results of three psychoacoustical experiments. These experiments
include the experiment reported above that tested the perception of
amplitude discontinuity; an experiment that tested the effect of
amplitude transients on auditory segregation (Bregman et al.
1994b
); and a forward masking experiment (Turner et al.
1994
) that tested the effect of the probe rise time on the
degree of masking. Although these experiments investigate different
auditory phenomena, we demonstrate that by identifying the
psychoacoustical measures with the responses of the neural model to the
amplitude transients presented in the experiments, the model is able to
reasonably reproduce the psychoacoustical results.
In two of these experiments (Bregman et al. 1994b
and
the experiment reported here) the stimuli contained an amplitude ramp rising above a pedestal. The invariant measure for these stimuli is not
the rate of rise of the amplitude ramp per se, but rather the
normalized rate of rise re the pedestal,
P*/Dn, where P* is the
plateau peak pressure of the ramp normalized by the ratio between the
pedestal peak pressure and P0 (see Fig. 1B). Intuitively, this follows from the fact that the
essential operation of the model is differentiating the log-compressed
amplitude envelope. Therefore the output of the receptive field (Fig.
1D) is not changed by multiplying the input stimuli by a
constant factor. In consequence, the response to a ramp rising above a pedestal is identical to the response to the onset of a sound with the
same size in dB re P0 and with the same shape.
Note that we arbitrarily set the value of P0 to
0 dB SPL for simplicity sake. Using different P0
values can be compensated by adjusting the threshold value of the edge
detector neuron. P0 value is significant only
when fitting the model responses with the responses of a specific
neuron to both the onset of a sound and to a ramp rising above a
pedestal. In these cases P0 may be adjusted to
best fit the neural responses to both types of stimuli.
PERCEPTION OF AMPLITUDE DISCONTINUITY. To compare our psychophysical results and the model predictions, a function of the neural response compatible with the dichotic nature of the psychophysical responses is required. As mentioned earlier, the modeled neurons have low spontaneous activity, and their responses to sound bursts consist of a short burst of 1-3 spikes. Therefore it seemed plausible to define a response to a stimulus as one or more spikes, and to identify the probability of response as the probability that a participant would report a discontinuous amplitude change in the psychophysical experiment. This measure did in fact yield a good match between the simulated (Fig. 14B) and the experimental results.
EFFECT OF AMPLITUDE TRANSIENTS ON AUDITORY SEGREGATION.
One of the few studies that tested the effect of both the duration and
magnitude of amplitude changes on auditory segregation tasks has been
reported in Bregman et al. (1994b)
. They presented a
3.5-s long complex tone consisting of five harmonics of 500 Hz. The
amplitudes of an adjacent pair of the three middle frequencies (1,000, 1,500, and 2,000 Hz) were incremented in succession in random order. A
sufficiently large amplitude increment caused the partials to be
segregated from the complex tone, and to be perceived as separate
tones. To measure the degree of segregation, the participants had to
judge whether the perceived pitch pattern, caused by the segregated
partials, went up or down. Three levels of increments were used (1, 3, and 6 dB) and six increment durations (30, 90, 270, 730, 910, and 970),
resulting in a total of 18 experimental conditions. The overall
amplitude level of the complex tone in its steady state was 65 dB SPL.
Bregman et al. reported that both the amplitude increment level and the
increment duration had a significant effect on the participants'
performance. Longer increment duration resulted in poorer
discrimination performance, while larger increment levels led to better
discrimination. These results suggest that the gradient of the
increment had a dominant effect on discrimination performance. However,
Bregman et al. did not include the gradient of the increment in their
statistical analysis, and therefore it is impossible to determine the
exact influence of the amplitude gradient of a tone on the ability to
segregate it from a mixture of tones. When the results of Bregman et
al. are replotted as a function of the normalized rate of peak pressure of the amplitude increment, the data fall along a single curve (Fig.
14C).
EFFECT OF AMPLITUDE TRANSIENTS ON RELEASE FROM FORWARD MASKING.
In forward masking, the masker (which can be a tone or a noise burst)
masks a target tone that appears just after the masker ends. The degree
of masking depends on many factors such as masker level, bandwidth,
duration, and the inter-stimulus interval. Turner et al.
(1994)
studied the effect of the target tone rise time and
duration on forward masking levels. They used two types of target
tones, one with a total duration of 25 ms including 2-ms cosine-squared
rise/fall ramps, and the second with a total duration of 22 ms
including 10-ms cosine-squared rise/fall ramps. Growth of masking (GOM)
functions were measured using noise maskers at levels of 10-90 dB SPL.
Their results show that targets with 10-ms rise time were masked more
than targets of 2-ms rise time. In addition, Turner et al. showed that
in contrast with the psychoacoustical results, there was no significant
effect of the target rise time on the amount of masking that was
measured in single auditory-nerve fibers of the chinchilla. This
s