|
|
||||||||
Computational Neurophysics Laboratory, Physics and Astronomy Department, University of North Carolina, Chapel Hill, North Carolina
Submitted 9 September 2007; accepted in final form 14 February 2008
|
|
ABSTRACT |
|---|
|
|
|
INTRODUCTION |
|---|
|
Cortical area V4 is one of the best places to start the investigation of this link. The receptive field (RF) of a V4 neuron is large enough so that it fits multiple stimuli, only one of which may be behaviorally relevant at a given time. Stimulus selection by selective attention should therefore cause changes at the level of V4, both in terms of firing rate as well as coherence. The response of V4 neurons is the outcome of a competition between bottom-up salience, interaction with other neurons in V4 responding to the same stimuli, and the effect of top-down projections mediating selective attention (Ogawa and Komatsu 2004
; Reynolds and Desimone 2003
). Experiments have provided an extensive, yet incomplete, quantitative characterization of response modulation for a variety of stimulus configurations and attention conditions. Phenomenological models have been constructed to account quantitatively for these results (Boynton 2005
; Reynolds et al. 1999
). However, a mechanistic understanding of how these changes are achieved at the circuit level is still lacking. With the advent of experimental techniques to record from multiple neurons simultaneously during a behavioral task, this lack of understanding is rapidly becoming a serious impediment to further progress.
We study the mechanism for attentional modulation in a biophysical network of spiking neurons based on the hypothesis that attention effects are mediated by interneurons (Tiesinga and Sejnowski 2004
; Tiesinga et al. 2004a
,b
). Our goal is to determine what types of interneurons are involved in attention and predict their behavior under various tasks and stimulus conditions.
Our model simulations suggest that at least two types of interneurons are involved in attention, referred to as feedforward interneurons (FFI) and top-down interneurons (TDI). They are differentially modulated by attention as follows. The firing rate of the FFI increases with spatial attention (SA) and decreases with feature-based attention (FBA), whereas the TDI increase their firing rate with FBA and shift the network synchrony from the beta to the gamma frequency range. The phase lag between interneurons and excitatory cells also increases with FBA.
|
|
METHODS |
|---|
|
To keep the model simple, only the necessary synaptic connections were simulated. These were as follows (see Fig. 1 ).
|
Second, there were cross-columnar excitatory projections to the FFI: E1 to FFI2 and E2 to FFI1; and there was local feedforward (FF) inhibition: FFI1 to E1 and FFI2 to E2. The label E1 stands for the E cells in the first column, the rest of the labels, E2, FFI1 and FFI2, are defined accordingly. These two projections together, E1 to FFI2 to E2 and E2 to FFI1 to E1, mediated stimulus competition. The excitatory projection activated a mixture of AMPA and N-methyl-D-aspartate (NMDA) receptors, whereas the inhibition was mediated by GABAA receptors (Shepherd 1998
).
Last, the TDI projected fast GABAergic inhibition to the FFI and the E cells in their column. The combination of the direct pathway, TDI1 to E1 (TDI2 to E2) and the indirect pathway, TDI1 to FFI1 to E1 (TDI2 to FFI2 to E2) mediated FBA on the preferred feature of column 1 (column 2).
Sensory information entered the columns via a FF projection implemented as a driving current to the E and FFI neurons (the TDI did not receive direct stimulus-related inputs). The expression for this current is (using the same convention for subscripts as in the preceding paragraph)
![]() | (1) |
Ec1 and
FFIc1 in Eq. 1 for the E and FFI neurons, respectively. This implements the contrast gain model (Reynolds and Desimone 2003
|
|
For the excitatory neurons, we used the model in (Golomb 1998
; Golomb and Amitai 1997
), whereas for the TDI and FFI, we used the model given in (Tiesinga and Jose 2000
; Wang and Buzsaki 1996
). Full details of the model setup and its implementation are given in the APPENDIX.
The simulation output was analyzed using custom-written programs in Matlab (The Mathworks, Natick, MA). Spike times were detected when the membrane potential crossed 0 and –20 mV from below for the inhibitory and excitatory neurons, respectively. For each group, the firing rate was calculated as the spike count divided by the measurement period, and it was averaged across all neurons in the group. A typical simulation was 1,000 ms long, of which the first 200 ms was discarded as a transient. To determine coherence (see following text), longer runs with a duration of 10 s were sometimes used. The spike time histogram was the number of spikes in a time bin from all neurons in the group, normalized by the number of neurons and the bin width in seconds (typical value: 0.001 s). This yielded the mean firing rate of a single neuron as a function of time.
Linear relationships between attention-induced changes in firing rate and other quantities were quantified using the Matlab routine polyfit. The strength of linear correlation and the significance thereof were determined using the Matlab routine corrcoef.
The local field potential (LFP) was modeled as the spike time histogram of the E cells. The multi-taper power spectrum of the E-cell, FFI, and TDI histogram was calculated using the Matlab routine mtm (with time-bandwidth product NW = 3.5). We extracted the power in the beta and gamma band by averaging the power spectrum in a 10-Hz interval around the strongest beta peak (this peak usually was between 15 and 30 Hz) and around either 40 or 45 Hz for the gamma band. To calculate the coherence, the spike train of each neuron was binned at a resolution of 1 ms. A pair of binned spike trains was passed to the Matlab routine coherencypb which was part of the CHRONUX toolbox (parameters: NW = 3, the FFT padding parameter was 1, and we averaged across 5 tapers). The coherency between two groups, or within a group, was averaged across 10 pairs randomly picked from all possible distinct pairs. In addition, we determined the coherence between the spike time histograms of the respective cell groups. Significance was reached when the coherence exceeded the shift-predicted coherence by 3 SE. The shift predictor was obtained by calculating the coherence between histograms obtained from different simulation runs. The SE was estimated using ten independent simulation runs (which were started from different initial conditions and using different seeds for the white noise currents, see APPENDIX).
The strength of stimulus competition was measured using the parameter
= [R(cp,cnp) – R(0,cnp)]/[R(cp,0) – R(0,cnp). Here R(cp,cnp) is the firing rate of the excitatory neurons in column 1 in response to stimulus 1 at P contrast cp and stimulus 2 at NP contrast cnp. Stimulus competition occurred when 0
1, with lower values indicating stronger stimulus competition because then the NP stimulus had a stronger suppressive effect. Problems arise with this expression when the denominator is zero or when the response to the NP stimulus exceeds that to the P stimulus. These data points were not included in the analyses reported here.
|
|
RESULTS |
|---|
|
Our goal is to construct a model that reproduces experimental results on the attentional modulation of the response of V4 neurons with one or two stimuli in their RFs; predicts the corresponding response of interneurons and the modulation of their coherence; and provides quantitative insight into what model features are responsible for the strength and frequency of emergent oscillations. To help the reader, the experimental data are summarized in two tables (Tables 3 and 4). They can also be summarized in words using phenomenological theories that have been proposed to account for these data (see also DISCUSSION). For a single stimulus, spatial attention approximately results in a change in either the contrast gain or the response gain, whereas feature-based attention results in a response gain (also referred to as feature gain). A quantitative definition is given in Tables 3 and 4. For multiple stimuli, the biased competition framework predicts that the response to two stimuli is less than the response to the strongest single stimulus and that attention drives this response toward the response to the attended stimulus by itself. Rather than discuss the underlying experiments in RESULTS, we use the predictions of the phenomenological frameworks to constrain the model. To facilitate our description of the model results, we abbreviate several frequently appearing phrases: spatial attention (SA), feature-based attention (FBA), preferred (P), nonpreferred (NP), and feedforward (FF).
|
|
The model is driven by two distinct stimuli. The P stimulus strongly activates the E cells in the first column. It is denoted by a rectangle in the lower right corner of the box that represents the neuron's RF (Fig. 2 Ac). The NP stimulus is less effective in driving the E cells in the first column, but it does strongly activate the ones in the second column. It is denoted by a circle in the upper-left corner of the RF square (Fig. 2Ab). When these two stimuli are either presented at full contrast or not at all, there are four different stimulus conditions as shown in Fig. 2A, subpanels a–d. In the model, stimuli can be presented at various values for the contrast, denoted by P contrast and NP contrast, respectively. The NP-P contrast plane is spanned by a 9 x 9 grid (which corresponds to a contrast resolution of 0.125), yielding 81 contrast pairs. The four stimulus conditions (Fig. 2A, a–d) correspond to the four corners of the grid.
|
The baseline conditions, in which there is no SA (Fig. 2Ba) or FBA (Fig. 2Ca), are considered the same in the model. This may not be the same in experiment because it would depend on whether the behavioral task is the same. For instance, for SA you would compare attend into the RF to the attend-away condition. But for FBA you may instead use a task where you attend to a particular orientation and compare the responses of visual neurons to their baseline response when attending a different modality. Thus in total, we consider 20 different combinations of four stimulus and five attention conditions. To make the figures easier to interpret, these conditions are represented by icons, which are placed at only two possible positions: either just below a bar in a bar graph or next to the corresponding curve in a contrast-response-function graph.
Overview of the model mechanisms
To guide the reader through RESULTS, we briefly summarize the model mechanisms using Fig. 3. The model network (Fig. 1) is described in METHODS and contains E cells and two types of interneurons, the FFI and TDI.
|
FBA to a feature increases the response of a neuron when it is the P feature and decreases the response, otherwise (see summary in Table 4). In the model, we hypothesize that this is mediated by a top-down activation of all columns that prefer the attended feature (Fig. 3B). This increases the E-cell rate via disinhibition (TDI1 to FFI1 to E1, projections 4 and 2), and the network will display an oscillation in the gamma frequency range. The suppressive effects of FBA to a NP feature originate in the second column and are mediated by the cross-columnar projection (not shown).
SA to a location within the RF is mediated by a change in contrast gain of the stimulus at the attended location, which changes the FF input to the E cells and the FFI (Fig. 3C).
The quantitative results of these hypothesized mechanisms are illustrated using only one parameter setting of the model. Simulations conducted to test the robustness of the model and oscillation frequencies against parameter changes will also be summarized in RESULTS.
Stimulus competition
As the results will be presented from the point of view of column 1, unless stated otherwise, the column number (for instance, 1 in E1) will be suppressed for notational simplicity. Furthermore, unless stated otherwise, results are for the E and FFI subpopulation, without including the Eb and FFIb subpopulation (see METHODS).
Stimulus competition was mediated by cross-columnar activation of the FFI
The model was designed to display stimulus competition in the E-cell rate when both stimuli were presented at full contrast (Fig. 4). Here we determine how the interneurons behave under these conditions. When the P stimulus or NP stimulus was presented by itself, it activated the E cells, although the former did so more than the latter. However, when both were presented simultaneously, the E-cell rate was less than that in response to the P stimulus by itself (Fig. 4C) even though the FF inputs corresponding to the P and NP stimulus were added (Fig. 4D). By design, the firing rate of the TDI did not vary with stimulus condition (Fig. 4A); hence, their activity was not responsible for stimulus competition. The FFI were not activated by the NP stimulus presented by itself (compared with their rate without a stimulus, as indicated by the solid line in Fig. 4B), but they were activated by the P stimulus (Fig. 4B). When both the FF projection and the cross-columnar excitatory projection were fully activated, the FFI fired at their highest rate so that the resulting E-cell rate was suppressed, thus yielding stimulus competition. In the bar graph, Fig. 4B, the combined activity of the FFI and FFIb in a given column is shown. The FFI received cross-columnar excitatory inputs but were not spontaneously active. The FFIb were spontaneously active, irrespective of stimulus condition. Hence the FFI and FFIb population together had a nonzero firing rate even when there was no stimulus present. In the other figures (Fig. 5, 6, and 11), we show only the FFI rate because it varies as a function of contrast.
|
|
|
|
E-cell firing rate varied nonmonotonously with stimulus contrast
The cross-columnar excitatory projection, which mediates stimulus competition, is only effective when the P stimulus is presented at sufficient contrast, which has consequences for the behavior of the E-cell firing rate as a function of contrast. First, consider the response to a single stimulus. The E-cell firing rate increased with NP contrast (Fig. 5A), without any sign of saturation because the FFI were not activated (the FFI activity is plotted in Fig. 5C). By contrast, for the P stimulus by itself, the E-cell firing rate increased rapidly with contrast (Fig. 5B) but saturated for larger contrast because the FF projection activated the FFI (Fig. 5D). Second, consider the response to a pair of stimuli. When the P stimulus was present at full contrast and the NP contrast was varied, the E-cell firing rate decreased with NP contrast (Fig. 5A), showing that the NP stimulus was suppressive in that case. When the NP stimulus was at full contrast and the P contrast was varied instead, there was a switch from facilitatory to suppressive effects. For low P contrast, adding the NP stimulus increased the E-cell firing rate (Fig. 5B,
), whereas, when the P contrast was sufficiently high, adding it decreased the rate (Fig. 5B,
).
The model predicts that stimulus interactions switch from facilitatory for low P contrasts to suppressive for high contrast values. The biased competition framework predicts only suppressive effects.
During stimulus competition the model response was dominated by FFI activity
The FFI mediate suppressive interactions, which would imply a correlation between FFI activity and the degree of stimulus competition. The strength of suppressive interaction is measured by
(see METHODS). For stimulus competition, the response to the pair is higher than the response to the NP stimulus and lower than the response to the P stimulus. This range of firing rates is mapped to
values between 0 and 1, respectively. Thus 0 corresponds to the strongest competition and 1 to the weakest competition in which case the response is equal to the maximum of the individual responses. For given values of the contrast, it is possible that the response to the NP stimulus is larger than that to the P stimulus, yielding a negative value for
. However, in that case, the stimulus interaction in the model was facilitatory, and it was not included in our analysis. It is possible that
is not defined because the terms in the denominator are equal, but this did not occur in our simulations except for the no-stimulus condition.
The strongest suppression of E-cell rate was obtained when both stimuli were present at high contrast (indicated by the arrow in Fig. 6A), which corresponded to the highest level of FFI activity (arrow in Fig. 6B). We therefore analyzed how the strength of suppression increased with FFI rate for all contrast pairs satisfying 0 <
< 1. Indeed,
decreased linearly with FFI rate (Fig. 6C). The strength of competitive interactions could also be represented by a weighted contrast with more weight given to the P contrast than to the NP contrast. The FFI rate was strongly correlated with the weighted contrast (Fig. 6D, NP weight was 32%, P weight was 68%, and the correlation coefficient was 0.97). The E-cell rate decreased with a weighted contrast, but a linear relationship explained less of the variance than for the FFI (correlation coefficient: –0.72). For lower values of the weighted contrast, there were facilitatory interactions, such as those illustrated in Fig. 5B, but these contrast pairs were not included in Fig. 6D.
The model predicts a relationship between the strength of stimulus competition (
) and the FFI rate, which was approximately linear for the parameter settings used here.
Feature-based attention
EXCITATORY FIRING RATE EFFECTS OF FBA WERE MEDIATED BY DISINHIBITION. Our hypothesis is that FBA to the P feature of a column activates the TDI in that column (Fig. 3B). This means that FBA to the NP feature does not directly affect the TDI in the column, rather the effect on the E cells is indirect and involves the cross-columnar projection from the column for which the attended feature is preferred. The model (Fig. 7) reproduced the predictions of the biased competition framework as follows (Table 4). FBA to the P feature led to an increased TDI rate (Fig. 7A), which reduced the FFI rate (Fig. 7B), which in turn led to an increase in E-cell rate (Fig. 7C). The activity of the FF projection was not modified by FBA (Fig. 7D). FBA to the NP feature did not change the TDI rate in column 1 (Fig. 7A), rather the FFI rate was increased (Fig. 7B) by way of the cross-columnar projection, which resulted in a decreased E-cell rate.
|
SUPPRESSIVE EFFECTS OF FBA WERE ONLY PRESENT AT SUFFICIENTLY HIGH STIMULUS CONTRAST. The excitatory and suppressive effects of FBA both involved the FFI, which limits the contrast pairs for which these effects can be obtained. One prediction, common to both the contrast gain and the response gain model (Table 4), is that FBA to the P-feature does not decrease the E-cell firing rate. In the model this implies that in the single stimulus condition, for all values of the contrast, the disinhibition should be stronger than the direct inhibition (Fig. 3B). This required two subtypes of FFI in the model: those that were spontaneously active without any stimulus (FFIb) and those that required the presence of the P stimulus to be active (FFI) with both types receiving inputs from the TDI. It is important to emphasize that the FFIb were not necessary to obtain the effects of biased competition for when the P stimulus was presented at full contrast. The CRF for a P stimulus presented by itself is shown in Fig. 8 A for the baseline (—) and FBA to P condition (- - -). For low contrast, there is an approximately constant increase in firing rate due to a constant disinhibition mediated by the FFI1b population. The strength depends primarily on the spontaneous firing rate of the FFIb and also on the strength of both the TDI to FFIb and FFIb to E projection. This dependence makes it possible to modulate the low-contrast response change via the spontaneous firing rate of the FFIb. For high contrasts, when the FFI were active and saturation was present in the baseline condition, the increase in firing rate with FBA was larger. Because the increase in firing rate with FBA was higher for higher firing rates than it was for lower firing rates, we label this effect as a response gain (see DISCUSSION). In the presence of a weak (low contrast) NP stimulus, the same happens except that both the saturation as well as the large effects of FBA started at slightly lower values of the contrast (Fig. 8B).
|
). This is still consistent with response gain because the attentional modulation was strongest when the firing rate was highest. There was no effect at low contrast because the FFI were not active, and the FFIb were not driven by the cross-columnar projection. Overall, increases in E-cell rate with FBA to the P feature were obtained for all contrast values, but significant decreases with FBA to NP were only obtained for high enough contrasts (Fig. 8D). Significant means that the difference between means exceeds two SDs when calculated based on 10 independent simulation runs.
The model predicts that FBA is more similar to a response gain with an independent low and high contrast component. Furthermore, it predicts that suppressive interactions only occur for higher values of the contrast.
Spatial attention
SA WAS MEDIATED BY A CHANGE IN CONTRAST GAIN OF THE FF INPUT. Our hypothesis is that spatial attention at a resolution less than the size of the typical RF is mediated by an increase in the FF input corresponding to the stimulus at the locus of attention (Fig. 3C). The increase in FF input with SA was higher for the P stimulus than for the NP stimulus. The model reproduced the effects predicted by the biased competition framework (Table 3, Fig. 9 C). The issue addressed here is how the FFI rate changes with SA.
|
The model predicts that the firing rate of the FFI increases with SA, irrespective of whether SA is directed to the location of the P or NP stimulus.
IN THE SINGLE STIMULUS CONDITION, SA RESULTED APPROXIMATELY IN A CHANGE OF CONTRAST GAIN.
In the model, there was no saturation in the FF input and saturation arose because of the normalization provided by the FFI neurons (solid lines in Fig. 5, B and D). SA was implemented as a change in contrast gain for the stimulus at the attended location, for the FF input to both the E cells and the FFI. For the single stimulus condition, the contrast gain model (Table 3) suggests that the firing rate does not need to increase with SA at high contrast. Furthermore (Table 3), neither the response gain nor the contrast gain model predicts that the firing rate actually decreases with SA. In the model, the suppressive effects due to the FFI dominated during saturation. This implies that the change in contrast gain with attention should be less for the FFI than that for the E cells. The model therefore predicts that for low P contrast, and for all values of NP contrast, when the FFI are not active, the effects of attention are exactly that of a change in contrast gain (Fig. 10, A and C). For higher contrast, when the FFI are active, the effective contrast for the FFI is lower than that for the E cells, and the change is not exactly a contrast gain. Nevertheless, the largest change in rate occurred below the contrast value with the highest firing rate (Fig. 10A,
).
|
SUPPRESSIVE EFFECTS OF SA WERE ONLY PRESENT FOR A LIMITED NUMBER OF CONTRAST PAIRS.
In the model, suppressive effects on the E-cell rate were mediated through the cross-columnar projection, which involved the FFI, thus limiting the contrast pairs for which these effects can be obtained. The excitatory effects reflect a balance between the FF activation of the E cells and the FFI, thereby also limiting the contrast pairs for which excitatory effects are present. To further investigate these issues, we determined how SA affected the pair response. When the NP stimulus was presented at full contrast and the P contrast was varied, the rate change with attention appeared to be nonmonotonic (Fig. 10B, ···). Specifically, the largest change was not obtained for the largest firing rate, implying that it was different from a simple response gain. Overall, SA to the P location increased firing rate for all contrast pairs (Fig. 10D,
) except when there was no P stimulus present (that is, a NP stimulus by itself). In contrast, SA to the NP location decreased the firing rate only in a narrow band of contrast pairs (Fig. 10D,
). For a single NP stimulus and as well as for some pair conditions, the firing rate even increased (results not shown), which is inconsistent with the predictions of the biased competition framework.
The model predicts that suppressive effects of SA are only obtained for a limited range of contrast values.
ATTENTION-INDUCED CHANGES IN FIRING RATE WERE SOMETIMES CORRELATED WITH THE STRENGTH OF STIMULUS COMPETITION.
Attention-induced changes in E-cell and FFI rate were correlated because of the FFI to E-cell projection. The coordinated changes in E-cell and FFI rate were studied for the case when there was stimulus competition, that is, 0 <
< 1 (Fig. 11, A and B). For FBA, the magnitude of the changes in the FFI and E-cell rate was correlated: an increased change in FFI rate was associated with an increased change in E-cell rate (Fig. 11A). The sign of the change in firing rate was opposite: FBA to the NP feature led to increases in the FFI rate and decreases in the E-cell rate. Likewise, for FBA to the P feature, the FFI rate decreased and E-cell rate increased. In both cases, the linear correlations were almost perfect, with correlation coefficients of –0.99 and –1.00, respectively. For SA, the FFI firing rate always increased with SA (Fig. 11B). The relationship between FFI and E-cell rate changes was noisier than compared with FBA (the correlation coefficients were –0.46 and –0.77 for SA to the NP and to the P stimulus, respectively).
A correlation between attention-induced firing rate changes and the degree of stimulus competition is also expected because both involve FFI activity. For FBA, the correlation coefficients between either the E-cell or the FFI rate changes and
were small and not significant (Fig. 11C). For SA, there was a strong and significant correlation: the E-cell rate change was highest for the strongest stimulus competition, whereas the opposite was true for FFI rate changes (Fig. 11D).
The biased competition framework (Table 3) makes predictions for how the pair response is related to the responses to component stimuli and how this response changes with attention. We investigated how difficult it was within the context of the model to satisfy all the constraints implied by the framework. Contrast pairs satisfy the predictions of biased competition when FBA to the P feature increases the E-cell rate and when FBA to the NP feature decreases it. For SA, it means that SA to the P location increases the rate and SA to the NP location decreases the rate. In addition, the pair response should be in between the response to the NP and P stimulus when they are presented singly. In terms of the number of contrast pairs for which the predictions were satisfied, FBA was easiest to achieve (Fig. 11E,
), followed by stimulus competition (Fig. 11E,
), with SA being the most difficult to achieve (Fig. 11E,
). For the parameter settings used, there were only 5 of 81 pairs for which all conditions were satisfied.
The effect of attention on stimulus competition can be studied by determining how it affects the distribution of
values. Starting from all contrast pairs with 0 <
< 1 in the baseline condition, SA to the location of the P stimulus made the distribution sharper and shifted its mean to a higher value (results not shown). As a result, the few
values closest to one actually decreased. For FBA on the P-feature, the distribution broadened and
values larger than one were obtained (results not shown). For these contrast pairs, there was stimulus competition in the baseline condition, but with FBA, this had disappeared. Overall, SA to the location of the P stimulus or FBA to the P feature reduced the degree of stimulus competition.
The model predicts correlations between attention-induced rate changes and the degree of stimulus competition, which are different for FBA compared with SA. This makes it possible to distinguish the effects of FBA from those of SA based on these correlations.
GAMMA AND BETA OSCILLATIONS EMERGED IN THE NETWORK MODEL.
The model network displayed two types of coherent oscillations: in the beta and gamma frequency range. The peak beta frequency ranged from
15 to 30 Hz depending on the P and NP contrast values. The peak gamma frequency was either 40 or 45 Hz. We briefly describe how these two oscillations emerge. In the subsection that follows, we show how FBA changes the balance between the beta and gamma oscillations, which is followed by a description of how the various model parameters affect oscillation strength and frequency.
The TDI synchronize by way of mutual inhibition, commonly referred to as ING (Borgers and Kopell 2003
, 2005
; Whittington et al. 2000
). Conditions for synchronization by mutual inhibition have been extensively studied theoretically and computationally (see DISCUSSION). For a network with identical neurons and without noise currents, synchrony can be obtained for any oscillation frequency. However, when there is heterogeneity so that the firing rate of uncoupled neurons varies (Tiesinga and Jose 2000
) and when there is noise so that the spike train of an uncoupled neuron is not exactly periodic (Tiesinga 2002
; Tiesinga and Jose 2000
), the network will only robustly synchronize at specific oscillation frequencies related to the inhibitory time constant. This is reviewed in one of our previous publications (Tiesinga and Jose 2000
). The key parameter is the driving current to the TDI neurons: only when the current is such that the firing rate of individual neurons matches a harmonic or subharmonic of these oscillation frequencies will synchrony be obtained. The parameter setting of the network was such that for the baseline state the current was too low. Hence only a weak and noisy gamma oscillation was obtained. The top-down activation of the TDI increased the driving current to a value where the network synchronized.
The beta oscillation emerged via different mechanism, which is related to the PING mechanism (PING stands for pyramidal-interneuron-gamma) (see Borgers and Kopell 2003
). It starts when a synchronous volley from the E2 cells recruits a synchronous volley from the FFI1. This temporarily shuts down the E1 cells, but on recovering, they produce a synchronous volley that in turn recruits a synchronous FFI2 volley. This shuts down the E2 cells for a while, but on recovery of the E2 cells, the sequence starts over again. The oscillation is thus a consequence of a competition in which each stimulus tries to shut down the column for which it is not preferred.
FBA SHIFTED THE NETWORK OSCILLATION FREQUENCY FROM BETA TO GAMMA. The beta oscillation was strongest in the pair condition, where two stimuli were presented at high and equal contrast. The beta oscillations led to spike alignments in the E-cell rastergrams (Fig. 12 Aa, box) and were visible as peaks at the beta frequency in the E-cell spectral density (Ab, oblique arrow) and also in the coherence between E cells in the same column (results not shown). The spectrum of the FFI cells also had a small peak at the beta frequency (Fig. 12Ab). In addition, there were small peaks in the gamma frequency range, at 45 Hz, in the TDI and E spectra (Fig. 12Ab, vertical arrow) but not in the FFI spectrum (Ab).
|
25 ms apart) but had alternating long and short intervals between spike alignments (Fig. 12Ba, box). The model thus showed competition between two oscillations. The relative strength of beta and gamma oscillations also depended critically on the nature of the excitatory synapses (see following text). As there was no direct connection between TDI cells of different columns, the gamma synchrony could only reach the other column via the cross-columnar excitatory projection, which was only effective when the FFI were active. In that case, beta oscillations were also present.
TDI SYNCHRONIZED THE E CELLS VIA THE DIRECT AND INDIRECT PATHWAY. During FBA to the P feature, the E cells received inhibitory inputs, synchronous in the gamma frequency range, from two sources, the FFI and TDI (Fig. 3B). Which of these two projections is most important to the synchronization of the E cells? To assess the contribution of each of these projections to the FBA-induced synchronization, we first introduced a constant delay in the synaptic connection. This did not change the results appreciably. Then a jitter (SD 10 ms) was introduced in the delays for the TDI to E connection but not in the FFI to E connection. This abolished the gamma coherence in response to the P stimulus presented by itself at full contrast but only weakly reduced the coherence in the pair condition when both stimuli were at full contrast. Note that for the single stimulus condition, the FFI rate was low, so that it only contributed a small fraction of the total inhibitory conductance that the E cells received. Only when the FFI to E connection was also jittered by the same amount was the coherence completely abolished in the pair condition. Thus both projections, when active, contribute to the observed synchronization of the principal cells.
OSCILLATION FREQUENCY AND POWER OF THE GAMMA OSCILLATIONS DEPENDED ON THE TIME SCALE OF INHIBITORY SYNAPSES.
The mechanism for beta and gamma is different but both depend critically on the inhibitory time scale. As mentioned before, gamma is generated by activation of the TDI by way of the ING mechanism, which works through mutual inhibition. The other cell groups in the column lock to this rhythm. Slice experiments in hippocampus show that pharmacological manipulations that increase the time constant of inhibition, reduce the frequency of gamma oscillations, whereas those that decrease the time constant, increase the oscillation frequency (Whittington et al. 1995
). We explored whether the same was true for the model network when activated by FBA to the P feature. We covaried the time constant
GABA and maximum conductance gii so that their product—an estimate of synaptic efficacy—remained constant. For time constants larger than the default, 8 ms, the oscillation frequency decreased as expected. For lower values of
GABA, the oscillation frequency jumped from 40 to
60 Hz. The peak frequencies in that regime varied between 60 and 65 Hz with
GABA. The low-synchrony baseline state (no FBA) was stable against small changes in synaptic time scale. However, for large
GABA>10 ms, a synchronized oscillation at beta frequencies (30 Hz) appeared.
Taken together, the results show that the network can support FBA-mediated transitions to oscillations in the gamma frequency range for a range of parameter values.
OSCILLATION FREQUENCY AND POWER OF THE BETA OSCILLATIONS DEPENDED ON THE TIME SCALE OF INHIBITORY SYNAPSES.
In the model, beta oscillations were generated in a loop with four synaptic steps: E1 to FFI2 to E2 to FFI1 to E1. When excitation was mediated by NMDA only, effectively there were only two time scales: the time constant of inhibition and the delay between the emission of the inhibitory volley by the FFI and the arrival of the excitatory volley at the FFI. The latter involves both the level of depolarization of the FFI and axonal delays (with a default value of 0.05 ms). In the default parameter setting, the synaptic time scale for inhibition generated by the FFI was the same as for the TDI. Nevertheless, the beta oscillation had a longer period (lower frequency) because of the additional delays associated with the synaptic steps. We explored how the oscillation frequency obtained in response to both stimuli at full contrast was affected by manipulation of synaptic time scales and axonal delays. First, when
GABA was varied, the frequency of the beta oscillation did not change but the power did. The peak height at the oscillation frequency in the spectral density was maximal for
GABA values of
10 ms. Second, the level of depolarization of the FFI and E (varied via AFFI and AE, respectively, see METHODS) can affect the frequency by altering the delay between inhibitory spike emission and the arrival of excitatory inputs or by lengthening the interval after the inhibitory volley during which the E cells do not spike. The power as a function of AFFI was peaked with the strongest oscillation occurring at 30 Hz for AFFI = 0.7 µA/cm2 (the default value). The oscillation frequency did not vary much for AE values between 2 and 4 µA/cm2, but the height of the beta peak did, reaching a maximum for the default value of the current, AE = 3 µA/cm2. Third, when the axonal delays were varied, the oscillation frequency did not change significantly.
Thus the frequency of the beta oscillation in the pair condition was related to the time scale of inhibitory synapses and was robust against parameter variation.
STRENGTH AND FREQUENCY OF THE OSCILLATIONS DEPENDED ON STIMULUS CONTRAST. We investigated the behavior of the oscillation for all contrast pairs, by determining the fraction of power in a 10-Hz interval around gamma and beta frequencies. Because the frequency of the beta oscillation did vary with contrast, we picked the power in an interval around the highest peak present in the spectrum <35 Hz. For gamma, we calculated the fraction of the power in the 40- to 50-Hz frequency range for the baseline condition and between 35 and 45 Hz in the FBA condition. With FBA to the P feature, gamma power increased and beta power decreased for all contrast pairs (results not shown). An interesting structure becomes visible when the power is plotted as a function of firing rate (Fig. 12, C and D). The structure arises because the same E-cell firing rate is obtained in response to multiple different stimulus conditions (Fig. 6A). For instance, the response to a P stimulus at medium contrast can be the same as the response to the P and NP stimulus together at high contrast. For FBA to the P feature, the former stimulus condition has more gamma power than the latter. In the graph, this shows up as a general increase of gamma power with firing rate, but the curve then curls over to give two different gamma powers for the same firing rate. The high power branch is for the case with weak NP stimuli and the low power branch is for when the NP stimulus is stronger (box in Fig. 12D). The opposite happens for the beta power plotted as a function of the firing rate, there the high power branch of the curve corresponds to the "strong NP" pairs (Fig. 12C, box indicated by horizontal arrow).
In the baseline, or attend-away, condition there are two interesting features. First, gamma power increases with firing rate. Because, for the single stimulus condition and for low to medium contrasts in the pair condition, firing rate increases with contrast, this means that gamma power also increases with stimulus contrast. Second, beta power has a peak as a function of firing rate (Fig. 12C, box indicated by oblique arrow). The position of this peak corresponds to the firing rate obtained when two stimuli are present at high contrast, resulting in stimulus competition, with a firing rate less than that obtained in response to the P-stimulus at full contrast. There is a corresponding dip the gamma power as indicated by the oblique arrow in Fig. 12D.
We investigated the behavior of the coherence in the gamma frequency range between spike trains of individual E cells, averaged across 10 pairs. For a single P stimulus (results not shown), the coherence for FBA to the P feature exceeded the attend-away coherence when the contrast was >0.5. This difference increased with higher contrast values. This shows that behavior predicted by the model should be visible in the coherence between spike trains of two simultaneously recorded E cells when they are both in the same column. The coherence was increased even more when the NP stimulus was presented in addition to the P stimulus (with a P contrast equal to 1 and FBA to the P feature). This behavior is different from that of the gamma power shown in Fig. 12D, which decreased when the NP stimulus was added.
The model predicts that FBA to the P feature introduces a gamma oscillation that competes with the beta oscillation generated by two high contrast stimuli. Both in the baseline condition and the FBA to P condition, gamma power generally increased with contrast, but it decreased with stimulus competition. The latter was indicated by an increase in the beta power.
FBA INCREASED THE PHASE LAG BETWEEN INTERNEURONS AND E CELLS.
The coherent activity of E cells is often considered the main contribution to the LFP recorded in vivo. Recent experiments in the hippocampus show that during network oscillations different types of interneurons lock to the LFP at different phases (Klausberger et al. 2003
; Tukker et al. 2007
). In the model, this raises the issue of how the temporal response of interneurons is related to that of the E cells. In a fully synchronized network, each cell group will produce synchronized volleys. When the network oscillates at one frequency, it is possible to determine the average delay between the volleys of inhibitory and excitatory neurons as illustrated in our previous work (Buia and Tiesinga 2006
). However, for the networks studied here, it is not as simple because there is frequency content in both the beta and gamma frequency range (Fig. 12Ba, box). The coherence between two time series yields a complex number for each frequency with a magnitude between 0 and 1. For a coherence of one, the two signals are as similar as they can be for the frequency in question. The phase of the complex number represents the phase lag between the two time series. A negative phase means that the second time series lags the first. We calculated the coherence between the spike time histograms of E cells (1st time series) and FFI or TDI (2nd time series). The coherence magnitude (coherence for short) and the phase were averaged across 10 independent simulation runs. As a control, the coherence was compared with the coherence calculated between histograms obtained from different simulation runs, the so-called shift-predictor. Only coherence values that exceeded the shift-predictor by 3 SE were considered significant. When both stimuli were presented at full contrast, the FFI and E-cell responses were coherent in the beta frequency range (Fig. 13 Aa), with the FFI lagging the E cells by
90° (for a frequency of 30 Hz, this is equivalent to about a 8.3-ms delay, Fig. 13Ab). For the same situation, the coherence between E cells and TDI was significantly lower, although there were small peaks in both the beta and gamma frequency range (Fig. 13Ba).
|
The model thus predicts that FBA increases both the coherence and the phase lag between interneurons and E cells.
STRONGER STIMULUS COMPETITION LED TO A REDUCED PHASE-LAG OF THE FFI. We also analyzed the change in phase lag between FFI and E cells when stimulus contrast was varied. First, we presented the P stimulus at full contrast and varied NP contrast. In this case the E-cell firing rate decreased with NP contrast (Fig. 5A) and the FFI firing rate increased (Fig. 5C). The coherence between FFI and E also increased (black line, Fig. 14 C), whereas the magnitude of the phase lag decreased (gray line, Fig. 14C). The result that the phase lag decreased with increasing contrast seems unexpected because usually contrast increases are associated with firing rate increases and, given the preceding subsection, increasing phase lags. However, here there was stimulus competition, which actually reduced the E-cell rate.
|
The model predicts that stronger stimulus competition is indicated by a reduced phase lag between the FFI and E cells.
STRENGTH AND FREQUENCY OF COHERENT OSCILLATIONS DEPENDED ON THE TYPE OF EXCITATORY SYNAPSES. It is not exactly known how much of the excitatory current is mediated by AMPA receptors compared with that mediated by NMDA receptors. In the default parameter setting, all the current was mediated by NMDA. We explored the effect of AMPA, by varying the percentage AMPA conductance from 0 to 100% in steps of 25% (while keeping the total maximum conductance constant). There were moderate effects on the E-cell firing rate but only when the FFI were active. The following results were obtained for the pair condition with the P and NP stimulus both at full contrast. With a nonzero AMPA component, the beta oscillations obtained for the pair condition led to sharper and higher peaks in the spectrum at a frequency lower by a few hertz. The coherence between E cells within the same column increased, and a significant coherence developed between E cells in different columns. For FBA to the P feature, the presence of an AMPA component led to a decrease of the power in the gamma peak, whereas the power in the beta frequency range increased. Note that the gamma oscillations in the TDI network were not affected by the strength of the AMPA conductance, whereas gamma oscillations in the E cells were indirectly affected via the change in FFI activity.
In addition, for an AMPA-mediated component, the oscillation frequency changed more with the parameter manipulations discussed in the preceding text. For instance, when AFFI and AE were varied, beta oscillations were obtained with frequencies ranging from 20 to 35 Hz. When axonal delays were increased from their default values of 0.05 ms, the rhythm slowed as expected. It did not matter whether these delays were in one synaptic connection or whether they were spread out among the two projections (E to FFI and FFI to E). When the delay became too long, 10 ms for our parameter settings, the oscillation had a "doublet" characteristic with two E-cell spikes per oscillation cycle. The oscillation frequency was less sensitive to the value of
GABA: it ranged from 27 to 30 Hz for
GABA values between 4 and 24 ms.
These results show that beta and gamma oscillations were robust against small parameter changes but that a stronger AMPA component led to stronger beta oscillations at a frequency that was less robust to parameter changes.
|
|
DISCUSSION |
|---|
|
We briefly summarize the main predictions of the model and the corresponding figures where these predictions are documented.
First, the model reproduces the predictions of the biased competition framework, but the circuit required two types of interneurons and a cross-columnar excitatory projection. It predicts the corresponding response of interneurons in the attend-away condition (Fig. 4), and their firing rate changes with FBA (Fig. 7) and SA (Fig. 9).
Second, the model predicts that for a single stimulus, SA acts more like a change in contrast gain (Fig. 10), whereas FBA acts more like a change in response gain (Fig. 8).
Third, the model predicts the responses when the stimuli are presented at intermediate contrasts. It shows that stimulus competition is not always present (Fig. 5). Specifically, it predicts a contrast-dependent switch from facilitatory to suppressive stimulus interaction. It further shows that the predictions for attention-induced changes in firing rate based on the biased competition framework are not satisfied for all contrast values (Figs. 8 and 10).
Fourth, the model predicts whether there are correlations between the magnitude of the attention-induced firing rate changes and the degree of stimulus competition (Figs. 11).
Fifth, the model predicts that FBA shifts the network oscillation from the beta to the gamma frequency range (Fig. 12). It further predicts that the gamma power is highest in response to the P stimulus by itself, whereas the gamma coherence is highest in the pair condition with the P stimulus at full contrast.
And, sixth, the model predicts that the phase lag between the interneurons and the pyramidal cells increases with FBA (Figs. 13), whereas the phase lag decreases with the degree of stimulus competition (Figs. 14).
The DISCUSSION section is rather long; to guide the reader, we offer an outline. First, we present our conjecture on the physiological type of the interneurons in the model. Second, we highlight, motivate, and discuss the specific model assumptions. Third, we discuss some of the specific predictions the model makes. Fourth, we compare our model to other models. Fifth, we suggest specific experiments based on the model predictions and review methods with which it is possible to test the model hypothesis regarding interneuron identity. Sixth, we list the simplifications made in the model and discuss how these can be addressed in future work.
Conjecture on the physiological type of the interneurons in the model
We referred to the two interneuron types in the model as FFI and TDI to distinguish our hypothesis about the role of each interneuron in the circuit for attention from our conjecture about their anatomical/physiological type. Studies in layer 4 (L4) of rodent somatosensory cortex indicate that fast-spiking (FS) interneurons with a basket cell morphology provide FF inhibition to spiny stellate cells (Beierlein et al. 2003
; Cruikshank et al. 2007
). These cells target the soma and perisomatic dendrites (Markram et al. 2004
), which makes them effective in sculpting the spike times of the postsynaptic cells (Cobb et al. 1995
). The connectivity pattern of basket cells in L2/3 is similar, suggesting that these basket cells provide FF inhibition to L2/3 pyramidal cells (Binzegger et al. 2004
; Douglas and Martin 2004
). Basket cells typically express parvalbumin (PV), but they do not express somatostatin (SOM), calbindin (CB) or calretinin (CR). Our conjecture is that the FFI in the model correspond to PV-expressing, FS basket cells in L2/3.
The identification of TDI is more complex given the large number of possible candidates with the double bouquet cell (DBC) and martinotti cells (MC) being the more prominent. Our conjecture is that the TDI correspond to DBC for the reasons outlined in the following text. DBC have vertical axons with a shape reminiscent of a horse tail, which target the dendrites of the postsynaptic neurons (DeFelipe et al. 2006
; Markram et al. 2004
). DBC can express CB and are unique in that they sometimes coexpress CB and CR, but they do not express SOM or PV (Markram et al. 2004
). First, in the rodent, most cell bodies of CR-expressing interneurons were located in the supragranular layers (L1, L2/3), and within L2/3 they projected predominantly to other inhibitory interneurons, half of which also expressed CR (Gonchar and Burkhalter 1999
). The remainder of the synapses was on the dendrites of L2/3 pyramidal cells. Second, feedback connections terminating in L1 specifically targeted CR-expressing interneurons, in the sense that the number of synapses was higher than expected based on the number of CR cells relative to other targets (Gonchar and Burkhalter 2003
). Similar results were obtained in other brain areas where CB-expressing interneurons were preferentially targeted by top-down projections (Barbas et al. 2005
). Third, anatomical studies in rat visual cortex show that FS interneurons and pyramidal cells share common FF inputs, but low-threshold spike (LTS) interneurons do so to a lesser extent (Yoshimura and Callaway 2005
; Yoshimura et al. 2005
). Interpreted within the context of the model, it supports the notion that FFI and E cells are stimulus-tuned and that the TDI are not. These three anatomical results support our conjecture that the TDI correspond to the DBCs.
There is evidence to suggest that Martinotti cells (Markram et al. 2004
), projecting primarily to the tuft of pyramidal cells in L1 and usually containing SOM, are involved in attention. In vitro studies indicate that these neurons could mediate a highly nonlinear mechanism for gain modulation (Kapfer et al. 2007
). Freund and Meskenaite report that the GABAergic projection from the basal forebrain synapses preferentially onto interneurons containing SOM (as well as those containing PV) (Freund and Meskenaite 1992
). Because this projection is not fine grained enough to mediate FBA, it might serve as a general arousal mechanism that works via disinhibition, which might in turn also enhance gamma oscillations (Buia and Tiesinga 2006
). Support for this idea comes from data obtained from simultaneous recordings in the basal forebrain and the prefrontal cortex in rats (Lin et al. 2006
).
Model assumptions
We made a number of assumptions that need further discussion. First, we assumed that there were two groups of FFI, one group (FFI) that was stimulus tuned and another (FFIb) that was not. Second, there were two groups of E cells, one group (E) that responded to all stimuli and one group (Eb) that only responded to high contrast stimuli. Third, the model had broad excitation (example: E1 to FFI2), but no broad inhibition (example: FFI1 to E2). Fourth, the FFI and TDI were modeled to have the same spiking dynamics. Fifth, we conjectured that two populations of interneurons were necessary to satisfy the model constraints (Tables 3 and 4).
As shown in RESULTS (Fig. 8 and the corresponding text), the FFIb were necessary to achieve the firing rate increases for low contrast stimuli with FBA to the P feature. They were not necessary to achieve the FBA effects at high contrast. The basic component of normalization models (Carandini et al. 1997
; Heeger 1992
), proposed to account for saturation in the CRFs, is untuned inhibition, presumably produced by FS basket cells. Untuned inhibition can come from untuned interneurons or can be generated from inputs from a group of tuned interneurons, each selective for a different stimulus/feature. Intracellular recordings reveal that the inhibition received by cat V1 cortical cells can be tuned (Monier et al. 2003
). In some recordings from cat V1 (Hirsch et al. 2003
; Nowak et al. 2007
), complex interneurons were found that were not orientation selective, whereas another set of experiments revealed that interneurons were only slightly less orientation-tuned than principal cells (Cardin et al. 2007
). Taken at face value, experiments in V1 support the existence of tuned (FFI) and untuned (FFIb) interneurons.
In the model, stimulus competition required an effective cross-columnar excitatory projection. The NMDA-mediated projection in the model was not effective because the postsynaptic current saturated when the presynaptic rates exceeded 20 Hz. Because typical firing rates in response to full-contrast single stimuli exceeded 20 Hz, the increases in E-cell firing rate going from the single stimulus to the pair condition did not sufficiently increase the current to the FFI to lead to an adequate suppressive effect. The model therefore contained a pool of less excitable E cells (E1b and E2b), which would increase their firing rate from close to 0 to
10 Hz going from the single stimulus to the pair condition. In vivo (Olshausen and Field 2005
) a wide range of firing rates of visual cells is observed in response to visual stimulation. In the model, the two pools of E cells represent the extremes of this experimentally documented range.
The suppressive effects of stimulus competition could, in principle, also be mediated by cross-columnar (broad) inhibition. In that case, FFI1 would project to E1 and E2. Because, in the model, FBA to the P feature decreased the firing rate of the FFI in column 1, the E cells in both columns would be disinhibited. The resulting increase in firing rate of the E2 cells is inconsistent with experimental observations (Table 4). The axonal arborization of small and medium basket cells is less widespread than that of pyramidal cells (Douglas and Martin 2004
; Markram et al. 2004
), which means that an excitatory projection will have a longer range than an inhibitory projection. Therefore on anatomical grounds, a cross-columnar excitatory connection, as used here, is more likely than a cross-columnar inhibitory connection. However, the validity of this argument depends on the distance between the two columns on the cortical surface. This distance is determined by the retinotopy and the structure of the feature map(s) in V4, neither of which is known to sufficient detail.
The TDI were modeled using a model developed for FS interneurons (Tiesinga and Jose 2000
; Wang and Buzsaki 1996
), which may not be appropriate when, as is hypothesized in this paper, the TDI correspond to CR-expressing DBCs, possibly with an LTS spiking dynamics (Markram et al. 2004
). This raises the issue of whether networks of such cells can actually synchronize in the same way as shown in the model. Synchrony by mutual inhibition has almost exclusively been studied for interneuron models with a continuous firing rate versus current (f-I) characteristic (Tiesinga and Jose 2000
; Wang and Buzsaki 1996
; White et al. 1998
), such as the interneurons used here. This means that the model neuron can fire periodic spike trains at arbitrarily low frequencies in response to a constant depolarizing current. Some types of interneurons have an f-I with a step (Izhikevich 2006
), which means they transition directly from subthreshold activity to firing at a finite frequency. We studied whether a network composed of these interneurons could also synchronize in response to a current step. A network consisting of the model neurons for CR-expressing cells developed by (Wang et al. 2004
), could synchronize and increase firing rate in response to a depolarizing step. The network required some level of noise and was robust against heterogeneity in neural properties (results not shown). This shows that the dynamics of the TDI network hypothesized to underlie FBA can be obtained for a number of different types of model neurons. Furthermore, just as in the model used in this paper, the key properties determining the degree of synchronization and the oscillation frequency were the level of depolarizing current and the time-scale of inhibition (results not shown).
We assume the presence of two types of interneurons in the model. Their projection pattern, based on the hypothesized identification of the TDI with DBC and the FFI with FS basket cells, is consistent with the published anatomy. Hence there is no reason not to include the TDI in the model. However, are both types necessary to account for the constraints provided by the phenomenological models (Tables 3 and 4)? First, as explained in the following text, in some circumstances, the models predict that FBA and SA have opposite effects on the E-cell firing rate. Second, FBA corresponds to a top-down effect (Fig. 3B) and SA to a bottom-up effect (Fig. 3C). For these two reasons, it was easiest to achieve their effects via different inhibitory neurons. Because we did not try all possible model configurations with only the FFI, we have not explicitly shown that the same results cannot be obtained without the TDI.
Model predictions
The network model makes a number of predictions that will be discussed in the context of phenomenological models (Tables 3 and 4) and recent experimental results. First, how do the model predictions relate to the ongoing discussion of whether attentional modulation is better described by either a response or a contrast gain model? Second, how do the predictions for changes in interneuron firing rate with SA compare with recent experimental results (Mitchell et al. 2007
)? Third, is the synchrony observed in the model functionally relevant and is it consistent with experiment? Fourth, how do the model predictions relate to those made by the biased competition framework.
RESPONSE VERSUS CONTRAST GAIN.
In experiment, SA to the location of a stimulus increased the firing rate, but the exact mathematical form of this transformation as a function of contrast remains unclear. Researchers have argued for contrast gain models (Martinez-Trujillo and Treue 2002
; Reynolds and Desimone 2003
; Reynolds et al. 2000
), where the attended response corresponds to the attend-away response to the same stimulus but presented at a higher contrast and also for response gain models (Lee et al. 2007
; Martinez-Trujillo and Treue 2004
; Williford and Maunsell 2006
), where the attended firing rate is increased by a constant gain factor compared with the attend-away firing rate. Our model does not make an assumption regarding the quantitative nature of the attentional effects in area V2, which projects to V4, the area modeled in this paper. Attention was implemented as an increase in contrast by a constant factor (see METHODS), which, in the model, was the same as increasing the input (the V2 response) by a constant factor. However, in the general case, for which the FF input varies nonlinearly with contrast, this would not correspond to a response gain.
The model makes predictions about how attention modulates the output firing rate, as shown in Fig. 10. A large number of cells recorded in the visual system display signs of contrast saturation (Albrecht and Hamilton 1982
). For high contrast, the firing rate does not increase anymore with contrast and can even decrease (Williford and Maunsell 2006
). This means that an attention-induced change in contrast gain would yield the highest changes at intermediate contrast because the tangent of the CRF is highest there. For response gain, the largest change would occur at high contrast because there the firing rate is highest. Thus for this characteristic shape of the CRF, response gain can be heuristically distinguished from contrast gain. In the model, we find that the rate changes are neither exactly described by a change in contrast gain nor by a change in response gain. However, in the single stimulus condition, using the above-established criterion, SA acts more like a contrast gain and FBA more like a response gain.
In some sense it is not surprising that SA results in a contrast gain because that is how it is implemented. However, there is a contrast gain for both the FFI and E, which we chose to be different. Therefore SA results only approximately in a contrast gain. This approximation is likely to be less good when the FFI are active for lower contrasts. In experiment (Fig. 5C in Williford and Maunsell 2006
as well as in Sundberg et al. 2005
), there are peaked CRFs, which are suggestive of strong inhibition. Hence for those cases, the model predicts that contrast gain might not be able to fully account for the changes in firing rate with SA.
The E-cell firing rate depends on the balance between the drive to the E cells and FFI because the FFI project to the E cells. FBA changes this balance by inhibiting the FFI. Computational models can explain how this could lead to a response gain. When the FFI are asynchronous, they produce uncorrelated inhibitory Poisson spike trains that drive the E cell. Simulations show that changing the rate of inhibitory Poisson processes can change the response of the E cell to an FF input by a multiplicative gain factor (Chance et al. 2002
; Doiron et al. 2001
; Mitchell and Silver 2003
; Prescott and De Koninck 2003
; Tiesinga et al. 2000
), that is, a change in response gain. In the model, the FFI are not completely asynchronous because there is power in the beta and gamma frequency bands, so the effect of a rate change does not correspond exactly to a response gain (Tiesinga et al. 2004a
).
For both SA and FBA, the characterization as a change in contrast gain or in response gain, respectively, is only approximate. It is also fair to say that experimental response will have both a top-down (here FBA) and bottom-up (here SA) component, given the averaging interval (
200 ms) used to estimate firing rates. Hence for this situation, the model would predict neither a pure response nor a pure contrast gain. This is consistent with experiment because either phenomenological model can only explain part of the attention-induced variability (Williford and Maunsell 2006
).
EXPERIMENTS ON ATTENTIONAL MODULATION OF INTERNEURONS.
For the current parameter settings, the FFI fire at a lower rate than the E cells. This appears to contradict recent experiments (Mitchell et al. 2007
), where it was reported that the FFI fired at a higher rate and had higher absolute changes in firing rate. We ran the model for the case where the FFI received stronger FF input but with weaker unitary inhibitory synapses (results not shown). The results were similar to those shown in this paper but with about double the inhibitory firing rate. This shows that the hypothesized mechanism for SA (Fig. 3C) is consistent with the experimental results.
FUNCTIONAL ROLE OF COHERENT OSCILLATIONS.
Two types of oscillations emerged in the model network. Beta oscillations are predicted to occur in response to two high-contrast stimuli. Gamma oscillations are predicted to occur with FBA to the P feature. Furthermore, because of these oscillations, the phase lag between interneurons and E cells could be extracted from the model. The phase lag increased with FBA but decreased with increasing stimulus competition. This raises the question of whether the synchrony that emerged in the model is actually necessary for the firing rate effects and whether it is useful downstream. In our model, the effects of FBA could also be obtained with rate changes of an asynchronous TDI network because the E-cell firing rate increased mainly because of disinhibition rather than an increase in synchrony. In fact, simulations using synchronous inhibitory inputs show that too much synchrony will reduce or completely abolish stimulus competition (results not shown) (an alternative mechanism is described in Tiesinga 2005
). In terms of downstream effects, because of gamma synchrony the impact of attended stimuli will be stronger as reviewed in (Salinas and Sejnowski 2001
). Furthermore, the attention-induced phase lag would also increase the impact on neurons that receive excitatory and inhibitory inputs from this network as shown by us (Buia and Tiesinga 2006
) and others (Mishra et al. 2006
). A recent re-analysis of in vivo data suggests that modulation of phase relationships may form the basis of selective communication between brain areas (Womelsdorf et al. 2007
).
The model predicts that for FBA to the P feature, gamma power in the E-cell histogram and the coherence between individual E-cell spike trains generally increases with contrast. It further predicts that gamma power is highest for the P stimulus by itself, whereas the coherence is highest for the pair condition as long as the P stimulus is in the RF at full contrast. Both of these predictions are consistent with experiment. In a FBA task, attending to the P feature of a V4 cell led to the highest coherence when the P stimulus was also in the RF (Bichot et al. 2005
). In V1, it was shown that gamma power in the LFP increased with stimulus contrast (Henrie and Shapley 2005
).
BIASED COMPETITION IN THE MODEL.
A theoretical framework—biased competition—was formulated to account for experiments during which multiple stimuli were presented in the neuron's RF. The basic premises were as follows. First, the response to the P and NP stimulus presented together is higher than the response to the NP stimulus and less than the response to P stimulus. This can be expressed in terms of the quantity
, which measures where the pair response falls in between the NP and P response. There are two aspects of the stimulus pairs, the relative preferredness of the features, which could be shape, stimulus orientation, color or location within RF (Desimone and Schein 1987
; Gallant et al. 1993
; Pasupathy and Connor 2001
, 2002
; Pollen et al. 2002
; Schein and Desimone 1990
), and the strength at which these features are present: contrast. The firing rate in response to a single stimulus depends on both of these factors. Specifically, a P stimulus at low contrast could yield a lower firing rate than a NP stimulus at high contrast. It is not clear whether biased competition predicts a response in between the P and NP response in this case. More generally, it raises the question of on what
depends. Does it depend on the relative preferredness, on the relative contrast, or only on the single stimulus firing rates? Our model sheds light on this issue because the contrast is varied independently of the relative stimulus preferredness. It shows that for low contrast, stimuli interact facilitatory.
Second, the framework predicts how the pair response changes with attention. Overall, the firing rate should change so as to make the response more similar to the response when the attended stimulus is presented alone. Hence SA to the location of the P stimulus or FBA to the P feature of the neuron would increase the response, closer to the response to the P stimulus alone. In other words, the effective driving force of the P stimulus is increased. Likewise SA to the location of the NP stimulus or FBA to a NP feature of the neuron would reduce the response, so that it is closer to the response to the NP stimulus presented alone. In other words, the suppressive effect of the NP stimulus is increased.
It was not trivial to design a model satisfying these constraints (Tables 3 and 4). One challenge is that the same stimulus can have two opposite effects. When the NP stimulus is presented by itself, it increases the neuron's firing rate compared with when there is no stimulus. Hence it has an excitatory effect. When the NP stimulus is presented in addition to a P stimulus, it decreases the firing rate of the neuron compared with when the P stimulus is presented by itself. Hence in that case, it has a suppressive effect. The proposed circuit thus needs to contain a way of switching between an excitatory and suppressive effect of the NP stimulus. In our model, the switch came in the form of the excitability of the FFI. Only when these were driven sufficiently by the P stimulus were there suppressive interactions. This limited the range of contrast values for which suppressive effects were obtained (Fig. 11E).
A similar challenge exists for SA. SA to the location of the NP stimulus, when it is presented by itself increases the firing rate, but when both stimuli are presented simultaneously, SA should decrease the rate. We hypothesized that the context-dependent effect of SA was mediated by the same switch that mediates stimulus competition. This hypothesis explicitly links the strength of stimulus competition to the magnitude of the attentional effect, thus providing an experimentally testable hypothesis. The experimentally obtained rate changes can be plotted versus
just as shown in Fig. 11, C and D.
The change in response also depends on the type of attention. When the NP stimulus is presented by itself, SA to its location increases the firing rate, but when FBA is directed to the NP feature, the firing rate decreases. There are a number of other distinctions between FBA and SA. For FBA, the sign of the FFI rate change is opposite to that of the E cells. When the FFI increase their rate, the E cells decrease theirs and vice versa. For SA, the FFI rate always increased, but the E-cell rate could increase or decrease.
Comparison to other models
A significant number of models have been developed to study the mechanism for stimulus competition and the attentional modulation thereof. Phenomenological models predict the firing rate as a function of contrast and attention condition and are capable to reproduce experimental results (Boynton 2005
; Reynolds et al. 1999
). Their main value lies in providing a concise summary of the experimental results and a benchmark with which to compare the results of more detailed biophysical models. The firing rate models proposed by Spratling and Johnson go one step further because for each set of experiments, a model architecture is proposed that reproduces the temporal dynamics of the response (Spratling and Johnson 2004
). However, firing rate models cannot be used directly to study the effect of spike-time correlations, which recent experiments indicate are an integral part of attentional modulation (Bichot et al. 2005
; Fries et al. 2001
). Both Deco and Rolls as well as Usher and Niebur have used model networks of spiking neurons to account for biased competition (Usher and Niebur 1996
; Deco and Rolls 2005
). There are two main differences between these models and the model studied in this paper. First, they use a single inhibitory pool that projects to all the feature-selective excitatory pools. Second, FBA was mediated by a projection to the excitatory neurons.
The potential link between attention and neural correlations or synchrony in the gamma band was established in early models by Niebur and colleagues (Niebur and Koch 1994
; Niebur et al. 1993
). Gamma oscillations also emerged in a large-scale model of the visual cortex with a retinotopic map and feature-selective neurons (Kirkland and Gerstein 1999
). A key feature of the large-scale model was feature-selective inhibitory pools, which, in contrast to our model, were connected by inhibition. It was shown, using single-neuron models, that modulation of the relative phase between excitatory and inhibitory inputs, synchronous in the gamma frequency range, could reproduce attentional modulation of stimulus competition (Mishra et al. 2006
; Tiesinga 2005
). Archie and Mel took it one step further and investigated whether dendritic nonlinearities alone could account for biased competition (Archie and Mel 2000
). In their model, biased competition was achieved by spatial segregation on the neuron's dendritic tree of inhibitory and excitatory synapses with the same feature selectivity. In a very recent model (Ardid et al. 2007
), attentional modulation of stimulus competition was studied in a circuit representing the medio-temporal and prefrontal cortex. These authors did not quantify the attentional modulation as a function of contrast, nor did they study the effect of attention on gamma synchrony. Oscillations related to the beta oscillations in our model network, but with a lower frequency, have been observed experimentally in area IT (Rollenhagen and Olson 2005
) and were reproduced in a model sharing features with the one used here (Moldakarimov et al. 2005
).
The value of these models lies in the diversity of mechanisms and the different predictions that they make, so that they can be validated or disproved by experiment. Our contribution lies in proposing a role for different types of interneurons and predicting their differential modulation by spatial and feature-based attention.
Testing the model predictions
The model predicts that FFI cells behave differently for SA compared with FBA. To test these predictions, monkeys need to be trained on a task that switches between SA and FBA during the same recording session, preferably using the same stimulus configuration. In addition, FFI—FS basket cells—should be identified as such in the recordings. Monkeys have been trained on a SA task (McAdams and Maunsell 1999
; Reynolds et al. 1999
), on a FBA task (Bichot et al. 2005
; Chelazzi et al. 2001
), and a task that yielded information on either type of attention (Hayden and Gallant 2005
). Therefore a single task involving both SA and FBA is possible. In a recent experiment (Mitchell et al. 2007
), recorded cells were classified as narrow- and broad-spike cells. The former corresponded to putative FS interneurons and formed a minority of the recorded neurons. With multi-electrode recordings, the yield of thin-spike neurons can be increased. Furthermore the classification as an inhibitory neuron can be validated using cross-correlation functions (Bartho et al. 2004
; Henze et al. 2000
; Kara and Reid 2003
), which is necessary because not all interneurons have thin spikes; instead some of them are classified as regular spiking nonpyramidal neurons (Markram et al. 2004
). Interneuron classification can also be achieved by genetic means, but it would require two-photon microscopy imaging of calcium dynamics in the awake primate (Stettler et al. 2006
). Interneurons express specific proteins, such as, PV, CR, and CB. The regulatory gene sequences that drive the expression of these proteins could be used to drive expression of a green fluorescent dye (GFP) (Knopfel et al. 2006
). For example, transgenic mice have been made where the expression of GFP is coupled to GAD-67, which is only present in cells that release GABA from their synaptic terminals (Tomioka et al. 2005
). In these mice, all inhibitory cells light up and can thus be easily distinguished from excitatory cells. The difficulty lies in training mice on a behavioral task, which is likely to be resolved in the near future (Huber et al. 2008
). There are no transgenic monkeys yet, but there GFP labeling could be achieved by viral transfection (Callaway 2005
). Furthermore, it is only a matter of time before these techniques are extended to CB- or CR-expressing cells by linking GFP expression to a promoter for CB or CR.
Our hypothesis suggests that if the TDI are activated, it would locally have the same effects as FBA, for instance, changing the neurons' CRF and tuning functions. This could change the perceived contrast of stimuli (Carrasco et al. 2004
), which could be tested in monkeys using, for instance, a standard two-alternatives, forced-choice task (Green and Swets 1988
). New technology makes it possible, by linking the expression of a light-activated channel or pump to the presence of a promoter for CR or CB, to activate specific groups of cells in a noninvasive way (Han and Boyden 2007
; Zhang et al. 2007) and test for possible changes in perception (Huber et al. 2008
). Taken together, multi-electrode recordings, imaging techniques and genetic methods, make feasible a direct test of our hypothesis and corresponding predictions.
The hypothesized model mechanisms also make quantitative predictions that can be tested experimentally. For instance, the results shown in Fig. 5B suggest the following experiment. First, present the P stimulus by itself for different values of the contrast. Second, repeat this but with the NP stimulus also present at full contrast. In the pair condition, the model predicts that the firing rate will vary nonmonotonically with contrast: increasing for low contrast and decreasing for high contrast. Specifically, there will be a contrast value at which the firing rate is maximal (1st asterisk in Fig. 5B). The effect of adding the NP stimulus is obtained by comparing the firing rate in the pair condition to that of the single stimulus condition. In the model, for low P contrast, the NP stimulus has an excitatory effect, whereas for high P contrast, it has a suppressive effect (Fig. 5B). The transition from an excitatory to suppressive effect occurs at a particular value for the contrast (2nd asterisk in Fig. 5B)—generally different from the contrast value for which the firing rate in the pair condition is maximal. The two values will depend on the relative preferredness of the stimulus features and whether the relevant features are the same or different. To be specific, the P and NP stimuli could be orientated bars and have different orientations ("same feature"). Or the P stimulus could have a P color and the NP stimulus could be black and white and have a NP orientation ("different feature"). In the model, we varied the relative preferredness (β) in such a way as to keep the firing rate in the pair condition the same (results not shown). A β equal to a half means that both stimuli are equally preferred, and a β of one means that the cell is not driven by the NP stimulus. As β increases from just above a half to just below one, the firing rate peak moves to higher contrast, whereas the excitatory-to-suppressive transition moves to lower contrast, thus reducing the distance between those points.
Limitations of the model
The model was designed to be as simple as possible but with spiking neurons and conductance-based synapses. The model therefore does not include some experimentally well-documented features, the absence of which might affect the results. The potential consequences and future studies necessary to address these are discussed in the following.
Experimental studies (Galarreta and Hestrin 1999
; Gibson et al. 1999
) have shown that there are gap-junctions between groups of interneurons of the same type. In L4 of rodent cortex, LTS interneurons synchronize in response to activation by glutamatergic and cholinergic agonists, even when the GABAA receptors are blocked by picrotoxin, suggesting the direct involvement of gap-junctions. This interpretation is supported by simulations of network synchronization by way of gap junctions (Chow and Kopell 2000
; Lewis and Rinzel 2003
; Nomura et al. 2003
). The DBC (TDI) synchronization dynamics might similarly rely on gap junctions. Hence to compare with anatomical and physiological data, gap junctions as well as the appropriate spiking dynamics for DBC should be incorporated in the model. Analysis based on so-called phase-response curves could also be helpful in this regard (Mancilla et al. 2007
).
Only the changes in gamma power and coherence with FBA were studied in the model. Because the effects of SA are inherited from the upstream cortical areas, they likely also involve changes in the gamma power (Taylor et al. 2005
). Hence during SA, the FF inputs may be synchronous in the gamma range. This was not accounted for in the model because FF inputs were modeled as a constant driving current. Future studies will therefore need to incorporate coherent FF synaptic inputs. This will also allow issues related to how SA modulates response latencies to be addressed (Lee et al. 2007
).
The simulations have focused mostly on the inhibitory projections: the model included only one type of excitatory projection (from E1 to FFI2 and from E2 to FFI1). We have performed simulations where there was excitation to excitatory neurons in the other column and where there was excitation to the FFI in the same column. We found parameter settings for which stimulus competition and the attention effects listed in Tables 3 and 4 were observed. Nevertheless, more quantitative studies need to be conducted to assess the impact of these additional excitatory connections.
The model was constructed to account for attentional modulation in visual area V4, for stimulus conditions where SA is bottom-up and FBA is top-down. To what extent do these results apply to V1, where, for the same conditions, SA is top-down? A key feature of the model, which was necessary to obtain stimulus competition, was the direct excitatory projection between the columns. Because in V1 the two stimuli fall in nonoverlapping RFs, the columns are further apart on the cortical surface, reducing the strength of the direct excitatory connection. Hence at the level of V1, the model predicts that the competition effects are weaker. In the single-stimulus condition, the model predicts that SA synchronizes the TDI and increases the E-cell firing rate. By contrast, in experiment, the effects of attention on the firing rate of V1 cells are small (Luck et al. 1997
; McAdams and Reid 2005
; Motter 1993
), but there could be changes in synchrony. In previous work, we simulated a ring model with short-range excitation and long-range inhibition (Ben-Yishai et al. 1995
; Somers et al. 1995
; Tiesinga and Buia 2007
). In this model for layer 4, activation of the TDI led to small or no changes in E-cell firing rate but large increases in synchrony (Tiesinga and Buia 2007
). Interpreted within the context of the model here this implies that at the level of V1, the direct TDI to E projection is stronger than it would be in V4, resulting in the smaller firing rate increases. Nevertheless, to fully account for attention effects in V1 a model is required where space is explicitly represented (Cohen et al. 2006
, 2007
).
Conclusion
We have presented a hypothesis for how stimulus competition, FBA, and SA could be implemented in the visual cortex and illustrated this hypothesis with simulations using only one parameter set. We made of course sure that the results reported here are robust. The model based on this hypothesis makes a number of predictions for contrast combinations that have not been studied experimentally and also predicts the behavior of specific types of interneurons that have not yet been identified explicitly in recordings from awake, behaving subjects. Nevertheless, it is currently feasible to test these predictions in experiment.
|
|
APPENDIX: THE MODEL EQUATIONS |
|---|
|
The interneuron (groups FFI1, FFI1b, FFI2, FFI2b, TDI1, and TDI2) was modeled as a single compartment with Hodgkin-Huxley-type voltage-gated sodium and potassium currents and a passive leak current (Tiesinga and Jose 2000
; Wang and Buzsaki 1996
). The equation for the membrane potential of the model neuron is
![]() |
3h(V – ENa) is the sodium current, IK = gKn4(V – EK) is the potassium current, IGABA is the inhibitory synaptic current and IAMPA and INMDA are the excitatory synaptic currents. The Gaussian noise variable is denoted by
while I is the tonic drive (see following text). The gating variables are m, n, and h and they satisfy the equation
![]() |
= 5 is a dimensionless time scale that can be used to tune the temperature dependent speed with which the channels open or close. The rate constants are
![]() |
![]() |
We made the approximation that m follows the asymptotic value m
(V) instantaneously (Wang and Buzsaki 1996
).
Pyramidal neuron model
A different single compartment Hodgkin-Huxley-type model (Golomb 1998
; Golomb and Amitai 1997
) was used for the dynamics of the pyramidal neuron (groups E1, E1b, E2, and E2b). The membrane potential obeys the following differential equation
![]() |
3h(V – ENa) is the sodium current, INaP = gNaPp
(V – ENa) is the persistent sodium current, IKdr = gKdrn4(V – EK) is the delayed rectifier potassium current, IKA = gKAa
3b(V – EK) is the A-type potassium current, IK-slow = gK-slowz(V – EK) is the slow potassium current, IGABA is the inhibitory synaptic current and IAMPA and INMDA are the excitatory synaptic currents. The Gaussian noise variable is denoted by
while I is the tonic drive. The kinetic variables h, n, b and z satisfy the equation
![]() |
![]() |
, p
, and a
, respectively. The standard set of neuron parameter values used in this paper is given in Table A1.
|
(V), corresponding to the starting value, V, of the membrane potential.
The tonic drive, I, for the neurons, was the sum of a common component IX(c1,c2) (here X stands for the excitatory neurons E1, E1b, E2, E2b, or inhibitory neurons FFI1, FFI1b, FFI2, FFI2b, TDI1, TDI2, c1 and c2 are the contrast of stimulus 1 and 2, respectively) and a heterogeneous component that varied across neurons and was drawn from a uniform distribution between –
X and
X. The equations for IX as a function of stimulus contrast are given in the main text and the parameter values are listed in Table 1.
The noise
i in the current of neuron i is chosen such that 
i(t)
= 0 and 
i(t)
j(t')
= 2
(t – t')
ij. On each integration time step, the noise was drawn independently from a uniform distribution between –12
/dt and 12
/dt, where dt was the time step. (
inh,
exc) takes the value (0.02, 0.5) (expressed in mV2/ms). The differential equations were integrated using a second-order Runge-Kutta method with a time step of dt = 0.05 ms (Gerald and Wheatley 1999
; Press et al. 1992
).
Synaptic models
Each synapse is modeled using a gating variable sji, with j being the index of the postsynaptic neuron and i being the index of the presynaptic neuron. Because the gating variable is independent of the postsynaptic neuron, except for the effects of axonal conduction delays, we write sji = si. Thus siGABA, siAMPA, siNMDA are the gating variables for the GABA inhibitory and AMPA and NMDA excitatory synapses, respectively. The synapses were labeled by the presynaptic neuron i. The synaptic gating variables obey the following equation
![]() |
AMPA = 2 ms,
NMDA = 149 ms,
GABA = 8 ms are the synaptic decay times for excitatory and inhibitory synapses, respectively. We used a sum of Dirac delta functions to account for the arrival of the spikes to the postsynaptic neuron because it was computationally less expensive than similar synapses in Golomb and Amitai (1997)
The synaptic currents to the ith neuron (membrane potential Vi) take the values
![]() |
1 + exp[–(V –
s)/
s]
is the nonlinearity of the NMDA current with parameter values
s = –25 mV and
s = 12.5 mV.
|
|
|
GRANTS |
|---|
|
|
|
ACKNOWLEDGMENTS |
|---|
|
|
|
FOOTNOTES |
|---|
Address for reprint requests and other correspondence: P. H. Tiesinga, Computational Neurophysics Laboratory, Physics and Astronomy Dept., University of North Carolina, Chapel Hill, NC 27599-3255 (E-mail: tiesinga{at}physics.unc.edu)
|
|
REFERENCES |
|---|
|
Archie KA, Mel BW. Dendritic compartmentalization could underlie competition and attentional biasing of simultaneous visual stimuli. Neural Information Processing Systems, Denver, CO, 13, 2000.
Ardid S, Wang XJ, Compte A. An integrated microcircuit model of attentional processing in the neocortex. J Neurosci 27: 8486–8495, 2007.
Barbas H, Medalla M, Alade O, Suski J, Zikopoulos B, Lera P. Relationship of prefrontal connections to inhibitory systems in superior temporal areas in the rhesus monkey. Cereb Cortex 15: 1356–1370, 2005.
Bartho P, Hirase H, Monconduit L, Zugaro M, Harris KD, Buzsaki G. Characterization of neocortical principal cells and interneurons by network interactions and extracellular features. J Neurophysiol 92: 600–608, 2004.
Beierlein M, Gibson JR, Connors BW. Two dynamically distinct inhibitory networks in layer 4 of the neocortex. J Neurophysiol 90: 2987–3000, 2003.
Ben-Yishai R, Bar-Or RL, Sompolinsky H. Theory of orientation tuning in visual cortex. Proc Natl Acad Sci USA 92: 3844–3848, 1995.
Benes FM, Berretta S. GABAergic interneurons: implications for understanding schizophrenia and bipolar disorder. Neuropsychopharmacology 25: 1–27, 2001.[CrossRef][Web of Science][Medline]
Bichot NP, Rossi AF, Desimone R. Parallel and serial neural mechanisms for visual search in macaque area V4. Science 308: 529–534, 2005.
Binzegger T, Douglas RJ, Martin KA. A quantitative map of the circuit of cat primary visual cortex. J Neurosci 24: 8441–8453, 2004.
Borgers C, Kopell N. Synchronization in networks of excitatory and inhibitory neurons with sparse, random connectivity. Neural Comput 15: 509–538, 2003.[CrossRef][Web of Science][Medline]
Borgers C, Kopell N. Effects of noisy drive on rhythms in networks of excitatory and inhibitory neurons. Neural Comput 17: 557–608, 2005.[CrossRef][Web of Science][Medline]
Boynton GM. Attention and visual perception. Curr Opin Neurobiol 15: 465–469, 2005.[CrossRef][Web of Science][Medline]
Buia C, Tiesinga P. Attentional modulation of firing rate and synchrony in a model cortical network. J Computat Neurosci 20: 247–264, 2006.[CrossRef][Web of Science][Medline]
Callaway EM. A molecular and genetic arsenal for systems neuroscience. Trends Neurosci 28: 196–201, 2005.[CrossRef][Web of Science][Medline]
Carandini M, Heeger DJ, Movshon JA. Linearity and normalization in simple cells of the macaque primary visual cortex. J Neurosci 17: 8621–8644, 1997.
Cardin JA, Palmer LA, Contreras D. Stimulus feature selectivity in excitatory and inhibitory neurons in primary visual cortex. J Neurosci 27: 10333–10344, 2007.
Carrasco M, Ling S, Read S. Attention alters appearance. Nat Neurosci 7: 308–313, 2004.[CrossRef][Web of Science][Medline]
Chance FS, Abbott LF, Reyes AD. Gain modulation from background synaptic input. Neuron 35: 773–782, 2002.[CrossRef][Web of Science][Medline]
Chelazzi L, Miller EK, Duncan J, Desimone R. Responses of neurons in macaque area V4 during memory-guided visual search. Cereb Cortex 11: 761–772, 2001.
Chow CC, Kopell N. Dynamics of spiking neurons with electrical coupling. Neural Comput 12: 1643–1678, 2000.[CrossRef][Web of Science][Medline]
Cobb S, Buhl E, Halasy K, Paulsen O, Somogyi P. Synchronization of neuronal activity in hippocampus by individual GABAergic interneurons. Nature 378: 75–78, 1995.[CrossRef][Medline]
Cohen A, Buia C, Tiesinga P. Can attentional modulation of surround effects in V1 account for stimulus competition in V4? Soc Neurosci Abstr 436.3, 2006.
Cohen A, Buia C, Tiesinga P. Attentional modulation of the spatiotemporal receptive field in a large-scale model of V1. Soc Neurosci Abstr 177.4, 2007.
Cruikshank SJ, Lewis TJ, Connors BW. Synaptic basis for intense thalamocortical activation of feedforward inhibitory cells in neocortex. Nat Neurosci 10: 462–468, 2007.[Web of Science][Medline]
Deco G, Rolls ET. Neurodynamics of biased competition and cooperation for attention: a model with spiking neurons. J Neurophysiol 94: 295–313, 2005.
DeFelipe J, Ballesteros-Yanez I, Inda MC, Munoz A. Double-bouquet cells in the monkey and human cerebral cortex with special reference to areas 17 and 18. Prog Brain Res 154: 15–32, 2006.[Web of Science][Medline]
Desimone R, Duncan J. Neural mechanisms of selective visual attention. Annu Rev Neurosci 18: 193–222, 1995.[CrossRef][Web of Science][Medline]
Desimone R, Schein SJ. Visual properties of neurons in area V4 of the macaque: sensitivity to stimulus form. J Neurophysiol 57: 835–868, 1987.
Doiron B, Longtin A, Berman N, Maler L. Subtractive and divisive inhibition: effect of voltage-dependent inhibitory conductances and noise. Neural Comput 13: 227–248, 2001.[CrossRef][Web of Science][Medline]
Douglas RJ, Martin KA. Neuronal circuits of the neocortex. Annu Rev Neurosci 27: 419–451, 2004.[CrossRef][Web of Science][Medline]
Felleman DJ, Van Essen DC. Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1: 1–47, 1991.
Freund TF, Meskenaite V. Gamma-Aminobutyric acid-containing basal forebrain neurons innervate inhibitory interneurons in the neocortex. Proc Natl Acad Sci USA 89: 738–742, 1992.
Fries P, Reynolds JH, Rorie AE, Desimone R. Modulation of oscillatory neuronal synchronization by selective visual attention. Science 291: 1560–1563, 2001.
Galarreta M, Hestrin S. A network of fast-spiking cells in the neocortex connected by electrical synapses. Nature 402: 72–75, 1999.[CrossRef][Medline]
Gallant JL, Braun J, Van Essen DC. Selectivity for polar, hyperbolic, and Cartesian gratings in macaque visual cortex. Science 259: 100–103, 1993.
Gerald CF, Wheatley PO. Applied Numerical Analysis (6th ed.). Reading, CA: Addison-Wesley, 1999.
Gibson JR, Beierlein M, Connors BW. Two networks of electrically coupled inhibitory neurons in neocortex. Nature 402: 75–79, 1999.[CrossRef][Medline]
Golomb D. Models of neuronal transient synchrony during propagation of activity through neocortical circuitry. J Neurophysiol 79: 1–12, 1998.
Golomb D, Amitai Y. Propagating neuronal discharges in neocortical slices: computational and experimental study. J Neurophysiol 78: 1199–1211, 1997.
Gonchar Y, Burkhalter A. Connectivity of GABAergic calretinin-immunoreactive neurons in rat primary visual cortex. Cereb Cortex 9: 683–696, 1999.
Gonchar Y, Burkhalter A. Distinct GABAergic targets of feedforward and feedback connections between lower and higher areas of rat visual cortex. J Neurosci 23: 10904–10912, 2003.
Green DM, Swets JA. Signal Detection Theory and Psychophysics. Los Altos, CA: Peninsula, 1988.
Han X, Boyden ES. Multiple-color optical activation, silencing, and desynchronization of neural activity, with single-spike temporal resolution. PLoS ONE 2: e299, 2007.[CrossRef]
Hayden BY, Gallant JL. Time course of attention reveals different mechanisms for spatial and feature-based attention in area V4. Neuron 47: 637–643, 2005.[CrossRef][Web of Science][Medline]
Heeger DJ. Normalization of cell responses in cat striate cortex. Vis Neurosci 9: 181–197, 1992.[Web of Science][Medline]
Henrie JA, Shapley R. LFP power spectra in V1 cortex: the graded effect of stimulus contrast. J Neurophysiol 94: 479–490, 2005.
Henze DA, Borhegyi Z, Csicsvari J, Mamiya A, Harris KD, Buzsaki G. Intracellular features predicted by extracellular recordings in the hippocampus in vivo. J Neurophysiol 84: 390–400, 2000.
Hirsch JA, Martinez LM, Pillai C, Alonso JM, Wang Q, Sommer FT. Functionally distinct inhibitory neurons at the first stage of visual cortical processing. Nat Neurosci 6: 1300–1308, 2003.[CrossRef][Web of Science][Medline]
Huber D, Petreanu L, Ghitani N, Ranade S, Hromadka T, Mainen Z, Svoboda K. Sparse optical microstimulation in barrel cortex drives learned behaviour in freely moving mice. Nature 451: 61–64, 2008.[CrossRef][Medline]
Izhikevich EM. Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting. Boston: MIT Press, 2006.
Kapfer C, Glickfeld LL, Atallah BV, Scanziani M. Supralinear increase of recurrent inhibition during sparse activity in the somatosensory cortex. Nat Neurosci 10: 743–753, 2007.[CrossRef][Web of Science][Medline]
Kara P, Reid RC. Efficacy of retinal spikes in driving cortical responses. J Neurosci 23: 8547–8557, 2003.
Kirkland KL, Gerstein GL. A feedback model of attention and context dependence in visual cortical networks. J Comput Neurosci 7: 255–267, 1999.[CrossRef][Web of Science][Medline]
Klausberger T, Magill PJ, Marton LF, Roberts JD, Cobden PM, Buzsaki G, Somogyi P. Brain-state- and cell-type-specific firing of hippocampal interneurons in vivo. Nature 421: 844–848, 2003.[CrossRef][Medline]
Knopfel T, Diez-Garcia J, Akemann W. Optical probing of neuronal circuit dynamics: genetically encoded versus classical fluorescent sensors. Trends Neurosci 29: 160–166, 2006.[CrossRef][Web of Science][Medline]
Lee J, Williford T, Maunsell JH. Spatial attention and the latency of neuronal responses in macaque area V4. J Neurosci 27: 9632–9637, 2007.
Lewis TJ, Rinzel J. Dynamics of spiking neurons connected by both inhibitory and electrical coupling. J Comput Neurosci 14: 283–309, 2003.[CrossRef][Web of Science][Medline]
Lin SC, Gervasoni D, Nicolelis MA. Fast modulation of prefrontal cortex activity by basal forebrain noncholinergic neuronal ensembles. J Neurophysiol 96: 3209–3219, 2006.
Luck SJ, Chelazzi L, Hillyard SA, Desimone R. Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. J Neurophysiol 77: 24–42, 1997.
Mancilla JG, Lewis TJ, Pinto DJ, Rinzel J, Connors BW. Synchronization of electrically coupled pairs of inhibitory interneurons in neocortex. J Neurosci 27: 2058–2073, 2007.
Markram H, Toledo-Rodriguez M, Wang Y, Gupta A, Silberberg G, Wu C. Interneurons of the neocortical inhibitory system. Nat Rev Neurosci 5: 793–807, 2004.[CrossRef][Web of Science][Medline]
Martinez-Trujillo J, Treue S. Attentional modulation strength in cortical area MT depends on stimulus contrast. Neuron 35: 365–370, 2002.[CrossRef][Web of Science][Medline]
Martinez-Trujillo JC, Treue S. Feature-based attention increases the selectivity of population responses in primate visual cortex. Curr Biol 14: 744–751, 2004.[CrossRef][Web of Science][Medline]
Maunsell JH, Treue S. Feature-based attention in visual cortex. Trends Neurosci 29: 317–322, 2006.[CrossRef][Web of Science][Medline]
McAdams CJ, Maunsell JH. Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. J Neurosci 19: 431–441, 1999.
McAdams CJ, Reid RC. Attention modulates the responses of simple cells in monkey primary visual cortex. J Neurosci 25: 11023–11033, 2005.
Mishra J, Fellous JM, Sejnowski TJ. Selective attention through phase relationship of excitatory and inhibitory input synchrony in a model cortical neuron. Neural Netw 19: 1329–1346, 2006.[CrossRef][Web of Science][Medline]
Mitchell JF, Sundberg KA, Reynolds JH. Differential attention-dependent response modulation across cell classes in macaque visual area V4. Neuron 55: 131–141, 2007.[CrossRef][Medline]
Mitchell SJ, Silver RA. Shunting inhibition modulates neuronal gain during synaptic excitation. Neuron 38: 433–445, 2003.[CrossRef][Web of Science][Medline]
Moldakarimov S, Rollenhagen JE, Olson CR, Chow CC. Competitive dynamics in cortical responses to visual stimuli. J Neurophysiol 94: 3388–3396, 2005.
Monier C, Chavane F, Baudot P, Graham LJ, Fregnac Y. Orientation and direction selectivity of synaptic inputs in visual cortical neurons: a diversity of combinations produces spike tuning. Neuron 37: 663–680, 2003.[CrossRef][Web of Science][Medline]
Moore T, Armstrong KM. Selective gating of visual signals by microstimulation of frontal cortex. Nature 421: 370–373, 2003.[CrossRef][Medline]
Moran J, Desimone R. Selective attention gates visual processing in the extrastriate cortex. Science 229: 782–784, 1985.
Motter BC. Focal attention produces spatially selective processing in visual cortical areas V1, V2, and V4 in the presence of competing stimuli. J Neurophysiol 70: 909–919, 1993.
Niebur E, Koch C. A model for the neuronal implementation of selective visual attention based on temporal correlation among neurons. J Comput Neurosci 1: 141–158, 1994.[CrossRef][Medline]
Niebur E, Koch C, Rosin C. An oscillation-based model for the neuronal basis of attention. Vision Res 33: 2789–2802, 1993.[CrossRef][Web of Science][Medline]
Nomura M, Fukai T, Aoyagi T. Synchrony of fast-spiking interneurons interconnected by GABAergic and electrical synapses. Neural Comput 15: 2179–2198, 2003.[CrossRef][Web of Science][Medline]
Nowak LG, Sanchez-Vives MV, McCormick DA. Lack of orientation and direction selectivity in a subgroup of fast-spiking inhibitory interneurons: cellular and synaptic mechanisms and comparison with other electrophysiological cell types. Cereb Cortex 2007. doi:10.1093/cercor/bhm137
Ogawa T, Komatsu H. Target selection in area V4 during a multidimensional visual search task. J Neurosci 24: 6371–6382, 2004.
Olshausen BA, Field DJ. How close are we to understanding V1? Neural Comput 17: 1665–1699, 2005.[CrossRef][Web of Science][Medline]
Pasupathy A, Connor CE. Shape representation in area V4: position-specific tuning for boundary conformation. J Neurophysiol 86: 2505–2519, 2001.
Pasupathy A, Connor CE. Population coding of shape in area V4. Nat Neurosci 5: 1332–1338, 2002.[CrossRef][Web of Science][Medline]
Pollen DA, Przybyszewski AW, Rubin MA, Foote W. Spatial receptive field organization of macaque V4 neurons. Cereb Cortex 12: 601–616, 2002.
Prescott SA, De Koninck Y. Gain control of firing rate by shunting inhibition: roles of synaptic noise and dendritic saturation. Proc Natl Acad Sci USA 100: 2076–2081, 2003.
Press WH, Teukolsky SA, Vetterling WT, Flannery BP. Numerical Recipes. Cambridge, UK: Cambridge University Press, 1992.
Reynolds JH, Chelazzi L. Attentional modulation of visual processing. Annu Rev Neurosci 27: 611–647, 2004.[CrossRef][Web of Science][Medline]
Reynolds JH, Chelazzi L, Desimone R. Competitive mechanisms subserve attention in macaque areas V2 and V4. J Neurosci 19: 1736–1753, 1999.
Reynolds JH, Pasternak T, Desimone R. Attention increases sensitivity of V4 neurons. Neuron 26: 703–714, 2000.[CrossRef][Web of Science][Medline]
Reynolds JH, Desimone R. Interacting roles of attention and visual salience in V4. Neuron 37: 853–863, 2003.[CrossRef][Web of Science][Medline]
Rollenhagen JE, Olson CR. Low-frequency oscillations arising from competitive interactions between visual stimuli in macaque inferotemporal cortex. J Neurophysiol 94: 3368–3387, 2005.
Saenz M, Buracas GT, Boynton GM. Global effects of feature-based attention in human visual cortex. Nat Neurosci 5: 631–632, 2002.[CrossRef][Web of Science][Medline]
Salinas E, Sejnowski TJ. Correlated neuronal activity and the flow of neural information. Nat Rev Neurosci 2: 539–550, 2001.[CrossRef][Web of Science][Medline]
Schein SJ, Desimone R. Spectral properties of V4 neurons in the macaque. J Neurosci 10: 3369–3389, 1990.[Abstract]
Serences JT, Boynton GM. Feature-based attentional modulations in the absence of direct visual stimulation. Neuron 55: 301–312, 2007.[CrossRef][Web of Science][Medline]
Shepherd G. Synaptic Organization of the Brain, (4th ed.). New York: Oxford University Press, 1998.
Somers DC, Nelson SB, Sur M. An emergent model of orientation selectivity in cat visual cortical simple cells. J Neurosci 15: 5448–5465, 1995.[Abstract]
Spratling MW, Johnson MH. A feedback model of visual attention. J Cogn Neurosci 16: 219–237, 2004.[CrossRef][Web of Science][Medline]
Stettler DD, Yamahachi H, Li W, Denk W, Gilbert CD. Axons and synaptic boutons are highly dynamic in adult visual cortex. Neuron 49: 877–887, 2006.[CrossRef][Web of Science][Medline]
Sundberg KA, Mitchell JF, Reynolds JH. Contrast-dependent center-surround interactions in macaque array V4. Society Neurosci Abstr 389.13, 2005.
Taylor K, Mandon S, Freiwald WA, Kreiter AK. Coherent oscillatory activity in monkey area v4 predicts successful allocation of attention. Cereb Cortex 15: 1424–1437, 2005.
Tiesinga PHE. Precision and reliability of periodically and quasiperiodically driven integrate-and-fire neurons. Phys Rev E 65: 1–14, 2002.
Tiesinga PHE. Stimulus competition by inhibitory interference. Neural Computation 17: 2421–2453, 2005.[CrossRef][Web of Science][Medline]
Tiesinga P, Buia CI. Attentional modulation in layer 4 of the visual cortex could be mediated by interneurons with complex receptive field characteristics. In: Computational Neuroscience in Epilepsy, edited by Soltesz I, Staley K. San Diego, CA: Elsevier2007, p. 306–321.
Tiesinga P, Fellous JM, Sejnowski TJ. Regulation of spike timing in visual cortical circuits. Nat Rev Neurosci 9: 97–107, 2008.[CrossRef][Web of Science][Medline]
Tiesinga PH, Fellous JM, Salinas E, Jose JV, Sejnowski TJ. Inhibitory synchrony as a mechanism for attentional gain modulation. J Physiol 98: 296–314, 2004a.
Tiesinga PHE, Fellous JM, Salinas E, Jose JV, Sejnowski TJ. Synchronization as a mechanism for attentional gain modulation. Neurocomputing 58- 60: 641–646, 2004b.[CrossRef]
Tiesinga PHE, Jose JV. Robust gamma oscillations in networks of inhibitory hippocampal interneurons. Network-Computat Neural Syst 11: 1–23, 2000.[CrossRef]
Tiesinga PHE, Jose JV, Sejnowski TJ. Comparison of current-driven and conductance-driven neocortical model neurons with Hodgkin-Huxley voltage-gated channels. Phys Rev E 62: 8413–8419, 2000.[CrossRef]
Tiesinga PHE, Sejnowski TJ. Rapid temporal modulation of synchrony by competition in cortical interneuron networks. Neural Computat 16: 251–275, 2004.[CrossRef][Web of Science][Medline]
Tomioka R, Okamoto K, Furuta T, Fujiyama F, Iwasato T, Yanagawa Y, Obata K, Kaneko T, Tamamaki N. Demonstration of long-range GABAergic connections distributed throughout the mouse neocortex. Eur J Neurosci 21: 1587–1600, 2005.[Web of Science][Medline]
Treue S, Martinez Trujillo JC. Feature-based attention influences motion processing gain in macaque visual cortex. Nature 399: 575–579, 1999.[CrossRef][Medline]
Tukker JJ, Fuentealba P, Hartwich K, Somogyi P, Klausberger T. Cell type-specific tuning of hippocampal interneuron firing during gamma oscillations in vivo. J Neurosci 27: 8184–8189, 2007.
Uhlhaas PJ, Linden DE, Singer W, Haenschel C, Lindner M, Maurer K, Rodriguez E. Dysfunctional long-range coordination of neural activity during Gestalt perception in schizophrenia. J Neurosci 26: 8168–8175, 2006.
Uhlhaas PJ, Singer W. Neural synchrony in brain disorders: relevance for cognitive dysfunctions and pathophysiology. Neuron 52: 155–168, 2006.[CrossRef][Web of Science][Medline]
Usher M, Niebur E. Modeling the temporal dynamics of IT neurons in visual search: a mechanism for top-down selective attention. Journal of Cognitive Neuroscience 8: 311–327, 1996.[CrossRef][Web of Science]
Wang XJ. Synaptic basis of cortical persistent activity: the importance of NMDA receptors to working memory. J Neurosci 19: 9587–9603, 1999.
Wang XJ, Buzsaki G. Gamma oscillation by synaptic inhibition in a hippocampal interneuronal network model. J Neurosci 16: 6402–6413, 1996.
Wang XJ, Tegner J, Constantinidis C, Goldman-Rakic PS. Division of labor among distinct subtypes of inhibitory neurons in a cortical microcircuit of working memory. Proc Natl Acad Sci USA 101: 1368–1373, 2004.
White JA, Chow CC, Ritt J, Soto-Trevino C, Kopell N. Synchronization and oscillatory dynamics in heterogeneous, mutually inhibited neurons. J Comput Neurosci 5: 5–16, 1998.[CrossRef][Web of Science][Medline]
Whittington MA, Traub RD, Jefferys JG. Synchronized oscillations in interneuron networks driven by metabotropic glutamate receptor activation. Nature 373: 612–615, 1995.[CrossRef][Medline]
Whittington MA, Traub RD, Kopell N, Ermentrout B, Buhl EH. Inhibition-based rhythms: experimental and mathematical observations on network dynamics. Int J Psychophysiol 38: 315–336, 2000.[CrossRef][Web of Science][Medline]
Williford T, Maunsell JH. Effects of spatial attention on contrast response functions in macaque area V4. J Neurophysiol 96: 40–54, 2006.
Womelsdorf T, Schoffelen JM, Oostenveld R, Singer W, Desimone R, Engel AK, Fries P. Modulation of neuronal interactions through neuronal synchronization. Science 316: 1609–1612, 2007.
Yoshimura Y, Callaway EM. Fine-scale specificity of cortical networks depends on inhibitory cell type and connectivity. Nat Neurosci 8: 1552–1559, 2005.[CrossRef][Web of Science][Medline]
Yoshimura Y, Dantzker JL, Callaway EM. Excitatory cortical neurons form fine-scale functional networks. Nature 433: 868–873, 2005.[CrossRef][Medline]
Zhang F, Wang LP, Brauner M, Liewald JF, Kay K, Watzke N, Wood PG, Bamberg E, Nagel G, Gottschalk A, Deisseroth K. Multimodal fast optical interrogation of neural circuitry. Nature 446: 633–639, 2007.[CrossRef][Medline]
This article has been cited by other articles:
![]() |
C. Borgers, S. Epstein, and N. J. Kopell Gamma oscillations mediate stimulus competition and attentional selection in a cortical network model PNAS, November 18, 2008; 105(46): 18023 - 18028. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Womelsdorf, K. Anton-Erxleben, and S. Treue Receptive Field Shift and Shrinkage in Macaque Middle Temporal Area through Attentional Gain Modulation J. Neurosci., September 3, 2008; 28(36): 8934 - 8944. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |