JN Track the topics, authors and articles important to you
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Neurophysiol 100: 3244-3252, 2008. First published October 8, 2008; doi:10.1152/jn.90400.2008
0022-3077/08 $8.00
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
100/6/3244    most recent
90400.2008v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Parush, N.
Right arrow Articles by Bergman, H.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Parush, N.
Right arrow Articles by Bergman, H.

Encoding by Response Duration in the Basal Ganglia

Naama Parush1,2,3, David Arkadir2, Alon Nevet2, Genela Morris1,2, Naftali Tishby1,3, Israel Nelken1,4 and Hagai Bergman1,2

1The Interdisciplinary Center for Neural Computation; 2Department of Physiology, Hadassah Medical School; 3The School of Engineering and Computer Science; and 4Department of Neurobiology, Life Science Institute, Faculty of Sciences, The Hebrew University, Jerusalem, Israel

Submitted 25 March 2008; accepted in final form 6 October 2008


 ABSTRACT
 
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 APPENDIX
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Several models have suggested that information transmission in the basal ganglia (BG) involves gating mechanisms, where neuronal activity modulates the extent of gate aperture and its duration. Here, we demonstrate that BG response duration is informative about a highly abstract stimulus feature and show that the duration of "gate opening" can indeed be used for information transmission through the BG. We analyzed recordings from three BG locations: the external part of the globus pallidus (GPe), the substantia nigra pars reticulata (SNr), and dopaminergic neurons from the substantia nigra pars compacta (SNc) during performance of a probabilistic visuomotor task. Most (>85%) of the neurons showed significant rate modulation following the appearance of cues predicting future reward. Trial-to-trial mutual information analysis revealed that response duration encoded reward prospects in many (42%) of the responsive SNr neurons, as well as in the SNc (26.9%), and the GPe (29.3%). Whereas the low-frequency discharge SNc neurons responded with only an increase in firing rate, SNr and GPe neurons with high-frequency tonic discharge responded with both increases and decreases. Conversely, many duration-informative neurons in SNr (68%) and GPe (50%) responded with a decreased rather than an increased rate. The response duration was more informative than the extreme (minimal or maximal) amplitude or spike count in responsive bins of duration-informative neurons. Thus response duration is not simply correlated with the discharge rate and can provide additional information to the target structures of the BG.


 INTRODUCTION
 
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 APPENDIX
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
One of the most important questions in neuroscience is how neuronal activity represents different aspects of the world (Averbeck et al. 2006Go; Bialek et al. 1991Go). It is especially interesting to trace how these representations are conveyed along a particular neuronal pathway (Barlow 1959Go; Chechik et al. 2006Go; Las et al. 2005Go). To examine encoding schemes in the basal ganglia (BG), we studied neuronal activity from the external part of the globus pallidus (GPe) and the substantia nigra pars reticulata (SNr) (central and output nuclei of the BG) and from the dopaminergic neurons of the substantia nigra pars compacta (SNc) (which modulate BG responses; Bar-Gad et al. 2003Go; Bolam et al. 2000Go; McHaffie et al. 2005Go) during performance of a probabilistic visuomotor task (Arkadir et al. 2004Go; Morris et al. 2004Go; Nevet et al. 2004Go). Studying the encoding properties of neurons in these structures can shed light on their interrelated computational roles and how they are implemented.

Most BG models use firing rate for information encoding (Albin et al. 1989Go; Bar-Gad et al. 2003Go; Berns and Sejnowski 1998Go; DeLong 1990Go; Wickens 1997Go). These models rely on physiological evidence that BG neurons, as in most areas of the nervous system, change their firing rate in response to behaviorally and emotionally relevant events. However, visual examination of our data suggested that response duration is also modulated by behavioral events (Fig. 1; also see additional example in Fig. 3G of Morris et al. 2004Go). This motivated us to study the response duration as an encoding strategy of BG neurons that does not necessarily rely on firing rate alone. Response duration is an attractive encoding candidate since it naturally emerges from models of the basal ganglia that emphasize the role of information gating in BG processing (Deniau and Chevalier 1985Go; Hikosaka and Wurtz 1983Go) and the recent suggestion of duration encoding of reward omission by SNc neurons (Bayer et al. 2007Go). Unlike rate models, gating models emphasize not only the extent of the gate opening (firing rate amplitude) but also the duration of the opening (e.g., response duration). The required processing of response features, such as response duration, may result in a decrease in information. [According to the information processing inequality, processing a response feature can decrease only the amount of information that could be provided by the original feature (Cover and Thomas 1991Go).] However, in gating models, the next neuronal station will not be required to estimate the duration, but to make use of the information passed/blocked through the gate. We therefore used mutual information (MI) to quantify the modulation of response duration and to compare it quantitatively with other carriers of behavioral information in the basal ganglia. The MI is a nonparametric measure of the association between two variables: in our case, the visual stimuli (with four different future reward conditions) and the neural responses. We used the MI as a measure of the association, since the MI is able to detect statistical dependence beyond the linear relationships that are detected by the correlation coefficient. When MI = 0, the two variables are statistically independent and the neuronal activity does not encode information regarding the cues. When the MI is equal to the entropy of the stimulus set, in our case about 2 bits (depending on the actual frequency of the four cues, which varied somewhat from session to session), the stimuli can be perfectly distinguished by the response on a single-trial basis. Intermediate values correspond to intermediate resolvability of the stimuli by observation of the neural responses on a single-trial basis (Cover and Thomas 1991Go).


Figure 1
View larger version (39K):
[in this window]
[in a new window]

 
FIG. 1. Neural encoding of reward prospects by response duration in the basal ganglia: examples from recordings of 5 neurons. The visual cue was presented at time 0. For each example we present the neural recording raster plot in which the trials are sorted by the reward probability (first column from the left); the binned responses, colored as either average response (white), negative response (gray), or positive response (black) (second column); and the response duration of each trial (third column from the left). Response durations were calculated for the 150- to 500-ms period. The rows show: A: substantia nigra pars reticulata (SNr) neuron: encoding by positive response duration (112 trials). B: SNr neuron: encoding by negative (decreased) response duration (383 trials). C: substantia nigra pars compacta (SNc) neuron: encoding by positive response duration (135 trials). D: external part of globus pallidus (GPe) neuron: encoding by negative response duration (229 trials). E: GPe neuron: encoding by positive response duration (229 trials).

 

 METHODS
 
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 APPENDIX
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
We studied recordings from four monkeys (Y, E, C, and G) engaged in a probabilistic visuomotor task. In each trial one of a set of four visual cues was briefly presented to monkeys in one of two possible locations on a computer screen. After a constant delay of 2 s, a go signal instructed the monkeys to indicate the cue location by pressing one of two keys. Correct performance was rewarded in a probabilistic (P = 0.25, 0.5, 0.75, and 1) manner, depending on the preceding visual cue. The intertrial interval was 4–7 s. Our database consisted of 61 neurons from the GPe (32 from Y and 29 from C), 56 neurons from the SNr (10 from Y, 15 from E, and 31 from G), and 109 dopaminergic SNc neurons (22 from Y, 71 from E, and 16 from C). The spike waveforms of all neurons were judged to be well isolated during the experiment and the longest period with discharge rate stability was selected off-line for each neuron. In addition, in this study we included neurons that were recorded only during ≥10 correct trials of each of the possible trial types. The behavioral paradigm, recording methods, and data preprocessing are detailed in Arkadir et al. (2004)Go, Morris et al. (2004)Go, and Nevet et al. (2004)Go.

We limited our study to the first 500 ms of the cue epoch to avoid the confounding effects of the limb and the reward licking movements. To study the response on a trial-by-trial basis, we divided the spike trains into 50-ms bins aligned on the onset of the cue signal indicating future reward prospects. We then characterized the type of activity in each bin of each trial as either no response, decrease in firing rate, or increase in firing rate by comparing the number of spikes in that bin to baseline activity. The baseline activity was calculated as the mean spike count (firing rate) during intertrial intervals. In >43% of the responses, we found that the peak response deviated by >2SDs. However, the changes in firing rates could be gradual and, at the response onsets and offsets, the changes in firing rates were often substantially smaller. Therefore decreases/increases in firing rate were detected by changes of ≥1.25SD with respect to baseline activity. We repeated the same analysis with a criterion at 1.5SD, with no appreciable difference (data not shown). For each trial, we defined the duration of the negative/positive responses as the number of bins in the longest sequence during the time period between 150 and 500 ms after cue onset (allowing single or multiple gaps of no more than one bin) in which the activity was characterized as either a negative or positive response. We denoted this time period as the "firing rate response period." Figure 1 depicts this process in five different neurons from the three BG structures.

We estimated the MI between the cues and the neuronal responses using explicit bias-information loss trade-off optimization (Nelken et al. 2005Go). Four response features were used: 1) response duration (as defined earlier), 2) the response spike count (the cumulative spike count during the response period), 3) the extreme response amplitude (maximal for positive response and minimal for negative response), and 4) the total spike count (the cumulative spike count during the entire tested time period; i.e., the period between 150 and 500 ms after cue onset). Although calculating the total spike count over a shorter epoch could have produced more information in some cases it might also have induced a bias between the different events and the different neural populations. We therefore preferred the conservative choice of a fixed window that enabled better comparison of the different populations. The 150- to 500-ms time window was chosen since it captures the response in the tested data.

In the SNr and GPe, but not in the SNc, neurons responded to the future direction of movement indicated by the cue as well as to the reward probability (Arkadir et al. 2004Go; DeLong et al. 1983Go; Wichmann and Kliem 2004Go). In these structures the information on the reward probability was calculated for each of the movement directions separately and averaged according to the number of times each direction occurred. Cells were scored as response duration-informative if the information extracted from a cell's positive or negative response duration on future reward probability was significant when compared with 150 surrogate shuffled MI values. (The reward probabilities were shuffled between trials and the significance of the nonshuffled vs. shuffled results was calculated according to the Mann–Whitney test, P < 0.05.) Cells in which <20% of the trials from each type had a positive/negative response were not considered as responding by positive/negative responses. For each nucleus, we calculated the mean response duration for duration-informative neurons as a function of reward probability.

To check whether the information provided by the other response features was redundant or synergistic with the information provided by response duration and to evaluate the exclusiveness of the information to one of the different response features (duration, extreme responses, or spike count) we used a normalized synergy measure. In synergistic encoding the information provided by two response features simultaneously is greater than the sum of the information provided by each one of them separately, whereas in redundant encoding the sum of information is smaller than the information provided by both features together. The normalized synergy between the information provided by a response feature R1 on a stimulus S and the information provided by a response feature R2 on S is given by (Schneidman et al. 2003Go)

Formula
This measure tests whether the information provided by R1 is redundant or synergistic to the information provided by R2 assuming MI(S; R1, R2) != 0. It ranges from 1 [total synergy, MI(S; R1) = MI(S; R2) = 0]; through 0 [MI independent variables, when MI(S; R1) + MI(S; R2) = MI(S; R1, R2)]; to –1 [total redundancy, when MI(S; R1) = MI(S; R2) = MI(S; R1, R2)].

The synergy measurement does not indicate how the information is distributed between the two variables. For example, norm syn(R1, R2) = –0.5 can occur in a number of scenarios: 1) both variables have equal amount of information on S and they share two thirds of their information [MI(S; R1) = MI(S; R2) = 0.75MI(S; R1, R2)]. 2) R1 has twice as much information on S than R2 and all the information R2 has is already provided by R1 [MI(S; R1) = MI(S; R1, R2) = 2MI(S; R2)]. In a similar way, ambiguity exists when norm syn(R1, R2) = 0 (Fig. 2). We therefore also used a different measure: the normalized contribution. The normalized contribution of R2 to the information on S carried by the pair R1 and R2 is the fraction of information that could not have been extracted without R2

Formula
The normalized contribution ranges between 0 (observing R2 does not contribute to the information in addition to R1) and 1 (none of the information could have been extracted without observing R2). Note that Norm Contrib(S; R1; R2) + Norm Contrib(S; R2; R1) = 1 + Norm Syn(R1, R2), i.e., the sum of the norm.contributions is 0 in cases of total redundancy (all the information could be extracted with either one of the parameters alone) and 2 in total synergy (the information is totally dependent on both parameters). In addition, this measurement is not defined when MI(S; R1, R2) = 0.


Figure 2
View larger version (25K):
[in this window]
[in a new window]

 
FIG. 2. Mutual information (MI) normalized contribution vs. normalized synergy. Two examples in which the normalized synergy measure can describe multiple distributions of MI between 2 variables and the normalized contribution measure discriminates between them: A: norm.synergy = 0 can describe the case in which the information distributes evenly (left) and the case in which the information provided by one variable is greater than the other (right). B: norm.synergy = –0.5 can describe the case in which each variable has the same amount of information and 2/3 is shared by both variables (left); and the case in which the information provided by one variable is twice as great as the information provided by the other variable, and the latter variable does not add information that is not already provided by the former (right).

 
In summary, we used three measures of the information encoded in the neuronal responses regarding the prospects of future reward. The MI is a measure of the information encoded on future reward probability by each of the tested reduced response measures (duration, extreme response, and response count). The normalized synergy quantifies the overlap between information encoded by two reduced measures of the responses and the normalized contribution indicates how much each of the reduced measures contributes to the total information.


 RESULTS
 
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 APPENDIX
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
We reanalyzed recorded data from the GPe, SNr, and SNc of four behaving monkeys to assess the encoding of reward probability by response duration.

Most neurons in the SNr, SNc, and GPe showed significant spike rate responses (Mann–Whitney test on spike counts of response bins vs. intertrial-interval bins, P < 0.05) to the appearance of at least one of the four possible cues (Table 1, % responding neurons). Hereafter, we refer to the significant decreases in firing rate as "negative responses" and the increases in firing rate as "positive responses."


View this table:
[in this window]
[in a new window]

 
TABLE 1. Quantitative analysis of neural responses in different basal ganglia nuclei

 
Raster plots of neural recordings revealed that the duration of the single-trial response often varied with the cue (Fig. 1). We used the MI between cue (indicating reward probability) and neuronal response to measure the amount of information that could be extracted from the response duration and from other response features on the probability of future reward. In all three BG structures, the response duration of many neurons provided a significant amount of information on the reward probabilities (Table 1, % duration informative neurons).

All of the responding SNc neurons exhibited positive responses (increase in discharge rate) to the cue and thus all of the duration-informative neurons in the SNc showed a positive response. However, twice as many of the SNr duration-informative neurons (68%) responded with a negative rather than a positive response, whereas in the GPe the duration-informative neurons distributed evenly between positive and negative responses.

The average response duration in SNr and SNc duration-informative neurons exhibited monotonic increases/decreases with the probability of future reward (Fig. 3). Such behaviors were not observed in the average response duration of GPe duration-informative neurons. The mean duration of the SNc positive responses was longer for high reward probabilities and shorter for low reward probabilities (one-way ANOVA, P < 0.01). The mean response duration in SNr neurons presented a different behavior from the SNc responses. Whereas the SNr negative response followed the same monotonic increase as SNc neurons (duration increased for high reward probability, one-way ANOVA, P < 0.01), the positive response tended (without reaching statistical significance) to be shortened with increased reward probability. In addition, the average durations of the negative GPe responses in duration-informative neurons are significantly shorter (one-way ANOVA, P < 0.01) than the positive responses. We checked whether the negative versus positive difference seen in response duration of SNr neurons also exists in other response features discussed herein. Only the mean total spike count of negative duration-informative neurons showed a significant monotonic decrease (one-way ANOVA, P < 0.01) displaying higher values for low reward probabilities.


Figure 3
View larger version (8K):
[in this window]
[in a new window]

 
FIG. 3. Mean response duration. Mean negative and positive response durations of duration informative cells in the SNr, SNc, and GPe. The error bars indicate 1SD. Square, positive response; triangle, negative response.

 
Figure 4 compares the MI between response duration and reward probability to the information provided by other response features. Since extracting response duration required classifying each time bin in each single trial, we also derived the more standard responses (extreme response and response spike count) of each single trial, using only those bins that were classified as having a significant response. Table 2 compares the average MI values of the different response features of duration-informative neurons. In both Fig. 4 and Table 2 the results are displayed separately for each of the three structures and for positive versus negative responses. For neurons with negative responses, duration was more informative than either extreme (maximal or minimal) response or response spike count. For neurons with positive responses, extreme response and response spike count were as informative as response duration.


Figure 4
View larger version (15K):
[in this window]
[in a new window]

 
FIG. 4. Comparing the MI between reward probability and other response features to the MI between the reward probability and the response duration. For each of the structures, we illustrate the MI between the reward probability and two response features (the extreme response and the response spike count) as a function of the MI between the reward probability and the response duration.

 

View this table:
[in this window]
[in a new window]

 
TABLE 2. Comparison of information contents of the neuronal responses of duration-informative cells in different basal ganglia nuclei

 
We therefore further tested whether combining response features could increase information about reward probability (Table 2). As expected, in almost all cases, there was clear redundancy between the response features (negative normalized synergy). Thus on average the information provided by the extreme amplitude or by the response spike count was highly redundant with the information provided by the response duration. Unexpectedly, we found that the additional information supplied by extreme response and by response spike count when used in association with response duration was close to zero (see METHODS and average "norm contribution" in Table 2). Thus the information that can be decoded from response duration encompasses essentially all the information that can be decoded from response spike count or extreme amplitude.

Extracting response duration from single trials is rather complex (Fig. 1), since it involves classifying each time bin in the responses of each single trial. Different ways of decoding the neuronal responses may be more informative. The standard way of quantifying responses is by counting the total spike count in a fixed, long window. Whereas total spike count encompasses time bins that may not be really important, possibly diluting the information it carries through the addition of noise, it may also take into account the responses during time bins that were wrongly classified as nonresponsive. In practice, the second effect probably dominated since we found that total spike count carried as much information as, or more information than, the response duration. This can be seen in Fig. 4 where the MI extracted from the total spike count over the fixed 350-ms window for both positive and negative responses was typically higher than the MI carried by response duration (as also reflected in Table 2). Nevertheless, since the duration did not add significantly to the information provided by the total spike count, the information provided by both the total spike count and the duration is actually provided by the total spike count alone. Therefore the amount of information given by both features exclusive to the total spike count (see "norm contribution" in Table 2: 32%, range 20–50%) is the amount of information given by the total spike count and not by the response duration, i.e., most (68%, range 50–80%) of the information provided by the total spike count was encoded by the response duration as well. Thus the difference between response duration and total spike count as a carrier of information was not substantial. In addition, we tested more detailed temporal representations of the response (such as analyzing the activity as a sequence of responsive and nonresponsive bins). However, the bias-corrected amount of information did not significantly increase with greater detail, suggesting that there is no easily decoded additional information in the temporal pattern of the 50-ms bins of the BG responses (data not shown).


 DISCUSSION
 
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 APPENDIX
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Our results confirm previous reports of future reward probability encoding in basal ganglia neurons (Arkadir et al. 2004Go; Morris et al. 2004Go). However, previous studies tested duration encoding directly only for the negative dopaminergic responses (Bayer et al. 2007Go). The main results of this study are 1) the demonstration that response duration carries much of the information available in responses of BG neurons about future reward probability and 2) that there is a difference between encoding processes of positive and negative responses. Note that in this study, we tested the responses only to cue-predicting rewards and thus evoked only positive SNc responses. However, another study of our group failed to reveal duration encoding in the responses of SNc neurons to omission of predicted rewards (M Joshua, A Adler, R Mitelnan, E Vaadia, and H Bergman, unpublished observations).

Evidence for the importance of response duration in the nervous system (Christensen-Dalsgaard et al. 1998Go; DeBusk et al. 1997Go; Kanold and Manis 2005Go; Nagata et al. 2003Go; Rogers and Newland 2002Go; Zhang et al. 2004Go) and even specifically in the responses of striatal cholinergic neurons (Aosaki et al. 1995Go; Ravel et al. 2003Go) and in responses of pallidal neurons (Anderson and Turner 1991Go) have been reported. Recently, Steuber et al. (2007)Go found that the best criterion to distinguish between different patterns of the cerebellar parallel fibers was the duration of the pause. O'Donnell and Grace (1998)Go showed that a known psychotic modulator (phencyclidine) acts by reducing the frequency and duration of the spontaneously occurring depolarized plateaus observed in the membrane potential of accumbens neurons. In addition, Kepecs and Raghavachari (2007)Go presented a model that can account for the generation of different duration up-state activity in striatal neurons. By simulating a bursting neuron model, Kepecs and colleagues showed that bursts of different durations can code for different stimulus features (Kepecs and Lisman 2003Go; Kepecs et al. 2002Go). Moreover, they found that synapses can be tuned to preferentially respond to specific burst durations and demonstrated the decodability of a neural code based on burst duration (Kepecs and Lisman 2004Go). In addition, a study of dopaminergic neurons suggested that these neurons overcome the limited dynamic range available for encoding of negative values by modification of the duration of their negative responses (Bayer et al. 2007Go). Finally, a recent study (Person and Perkel 2005Go) revealed in zebra finch songbirds that high-frequency trains of pallidal spikes can drive activity in thalamic relay neurons by rebound excitation. The latency of this rebound is strongly affected by the duration of the pallidal spike train (their Fig. 4). Thus positive SNr responses will yield different thalamic rebound excitation as a function of the response duration and, perhaps, longer SNr pauses will cause longer and probably stronger thalamic disinhibitory effects.

Our results are in line with models of the basal ganglia in which information transmission is carried through gating mechanisms, where the neuronal activity determines the extent of gate aperture and its duration (Deniau and Chevalier 1985Go; Mink 1996Go). GPe is probably involved in gating the inputs to the subthalamic nucleus, striatum, and the output structures of the BG, whereas the SNr gates the reciprocal thalamocortical neuronal loops. Contrary to other models (Mink 1996Go), gating models suggest that the basal ganglia output enables, rather than selects or initiates (McHaffie et al. 2005Go; Mink 1996Go), movements or other voluntary behaviors. We suggest that the duration of the gate aperture might take part in the competition between possible actions (giving advantage to those BG–thalamic channels with longer opened gate duration). In addition, reward expectation has been shown to influence response latency (Lauwereyns et al. 2002Go); it is thus possible that response duration is part of the mechanism that modulates or affects the action's vigor through the multiple channels of the basal ganglia output to the reciprocal thalamocortical networks. The significant fraction of duration-informative SNr neurons with negative responses is compatible with this suggested role of the SNr. The SNr has GABAergic projections to the thalamus and to the superior colliculus (Hikosaka and Wurtz 1983Go; Redgrave et al. 1992Go); thus when SNr neurons decrease their activity, they disinhibit their targets. This may be the mechanistic implementation of the gating mechanism, where the background tonic activity and positive responses of SNr neurons close the gate, whereas negative SNr responses open the gate (Deniau and Chevalier 1985Go; Hikosaka and Wurtz 1983Go). Our finding that the mean negative response durations of duration-informative neurons monotonically increases (long durations for high probability and short durations for low probability; Fig. 3) is also compatible with the gating model. Negative SNr responses open the gate and we expect the gate to be opened for longer durations (and enable a movement) for the higher reward prospects. The positive responses show (nonsignificant) an opposite trend. This could also be explained by the gating model. Since closing the gate does not determine the movement, its duration is less significant. The monotonic decrease seen in the mean total spike count of negative duration-informative neurons—displaying higher values for low reward probabilities—is in line with the monotonic increase found in the mean response duration of those neurons. The total spike count consists of responsive and nonresponsive bins; thus long negative responses that have fewer bins with normal activity and more bins with low activity will have a low total spike count and vice versa. In addition, it has been shown that dopamine (D1 receptors) inhibits SNr activity (Kliem et al. 2007Go). Therefore in line with SNr negative responses, the mean response duration in SNc (positive) responses is long for high reward probabilities and short for low probabilities.

A negative response (i.e., response with a decrease in firing rate) has the advantage of being detectable faster than an increase of the same magnitude (APPENDIX). However, in negative responses, when the neurons decrease their firing rate to close to zero for different time lengths, the minimal firing rate and the response spike count do not differ between different probabilities and thus provide little information on the reward probability. In this situation, the response duration remains informative (consequently, the total spike count that includes time bins in which short responses return to normal activity will also be informative). On the other hand, in positive responses, when the neurons respond with an increase in firing rate for different time lengths, the response spike count varies between reward probabilities. Hence for neurons with positive responses, duration did not have a major advantage over maximal firing rate or response spike count.

Spike train analyses usually have focused on two extreme schemes of neuronal encoding. Most studies have dealt with the highly information reduced measure of spike count or rate (Ahissar et al. 2000Go; Georgopoulos et al. 1986Go; Gershon et al. 1998Go; Shadlen and Newsome 1998Go). Other studies have focused on information in spike patterns (Arabzadeh et al. 2006Go; Friedrich et al. 2004Go; Ikegaya et al. 2004Go; Jones et al. 2004Go; Panzeri et al. 2001Go; Prut et al. 1998Go; Victor and Purpura 1996Go). However, even when spike timing carries information, the use of simple reduced measures of the timing of the responses may be sufficient (Nelken et al. 2005Go). Our observations demonstrate that coding schemes based on response duration are viable and that they use much of the information available in the responses of BG neurons. Furthermore, we show that response duration encodes reward probability not only in positive (increase in firing rate, bursts) responses, but also (in the GABAeregic BG nuclei) in negative (decrease in firing rate) responses, and that duration encoding is not a simple epiphenomenon of rate encoding. Finally, we argued that response duration may be highly relevant to the effects of BG neurons on their target structures. The significant amount of information encoded in response duration makes response duration a prominent coding element that can mechanistically control the influence of the basal ganglia on its target structures.


 APPENDIX
 
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 APPENDIX
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
This APPENDIX proves that a decrease in firing rate response can be detected faster than an increase of the same magnitude in neurons with Poisson-like firing pattern.

The sequential probability ratio test (SPRT; Wald 1947Go) is a serial Bayesian test designed to determine which of two hypothesized distributions is used to generate data samples. In this test we obtain data samples and examine the log likelihood (the probability of a given distribution to generate these data points) ratio of the two distributions. The test sequentially inputs data samples until the ratio is above an acceptance or below a rejection threshold. At that time the test can determine (with a reliability that depends solely on the thresholds) which of the two distributions generated the data.

We assume that the spike trains are generated by a Poisson distribution and that an external/internal event can cause the neuron to switch from one firing rate ({lambda}1) to a different firing rate ({lambda}2). We seek to evaluate how many samples (spike counts/rates) are needed (using SPRT) to determine the neuron's firing rate after the switch has occurred. The likelihood ratio for the two hypotheses is

Formula
where xn = (x1,..., xn) are n independent and identically distributed data samples

Formula

Formula

Formula

Formula

Formula
which is also denoted as the Kullback–Leibler distance (Cover and Thomas 1991Go)

Formula

Formula

Formula

Formula
Let nR||R(1+{Delta}) denote the number of samples needed to detect a distribution switch from {lambda} = R to {lambda} = R(1 + {Delta}), nR||R(1–{Delta}) denote the number of samples needed to detect a distribution switch from {lambda} = R to {lambda} = R(1 – {Delta}), and Sth denote the ratio acceptance threshold (the threshold to detect the distribution change). We can express the required sample sizes as

Formula

Formula

Formula

Formula
The ratio between the number of samples needed to detect a distribution switch from {lambda} = R to {lambda} = R(1 + {Delta}) and the number of samples needed to detect a distribution switch from {lambda} = R to {lambda} = R(1 – {Delta}) is always >1 and reaches 2.6 as {Delta} reaches 1. Thus detecting a decrease in firing rate will require fewer data samples—i.e., less time than detecting an increase of the same magnitude.


 GRANTS
 
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 APPENDIX
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
This study was partly supported by Netherlands Friends of the Hebrew University "Fighting against Parkinson" grant to H. Bergman. I. Nelken was supported by the German–Israeli Foundation and by the VolkswagenStiftung. N. Parush and G. Morris were supported by a Horowitz fellowship and D. Arkadir and A. Nevet were supported by the MD–PhD program of the Hebrew University–Hadassah Medical School.


 ACKNOWLEDGMENTS
 
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 APPENDIX
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
We acknowledge the authors' specific contributions: N. Parush initiated and designed the study of response duration, developed the information theoretic tools, performed the data analysis, and wrote the manuscript; D. Arkadir, A. Nevet, and G. Morris trained the monkeys for the behavioral tasks and recorded the single-unit activity during the performance of the task; H. Bergman contributed to training of the monkeys, recording, and the writing of the manuscript; and N. Tishby and I. Nelken contributed to the development of the information analysis tools and writing of the manuscript.


 FOOTNOTES
 
The costs of publication of this article were defrayed in part by the payment of page charges. The article must therefore be hereby marked "advertisement" in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

Address for reprint requests and other correspondence: N. Parush, Department of Physiology, The Hebrew University–Hadassah Medical School, P.O. Box 12272, Jerusalem, Israel 91120 (E-mail: naamap{at}alice.nc.huji.ac.il)


 REFERENCES
 
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 APPENDIX
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Ahissar E, Sosnik R, Haidarliu S. Transformation from temporal to rate coding in a somatosensory thalamocortical pathway. Nature 406: 302–306, 2000.[CrossRef][Web of Science][Medline]

Albin RL, Young AB, Penney JB. The functional anatomy of basal ganglia disorders. Trends Neurosci 12: 366–375, 1989.[CrossRef][Web of Science][Medline]

Anderson ME, Turner RS. A quantitative analysis of pallidal discharge during targeted reaching movement in the monkey. Exp Brain Res 86: 623–632, 1991.[Web of Science][Medline]

Aosaki T, Kimura M, Graybiel AM. Temporal and spatial characteristics of tonically active neurons of the primate's striatum. J Neurophysiol 73: 1234–1252, 1995.[Abstract/Free Full Text]

Arabzadeh E, Panzeri S, Diamond ME. Deciphering the spike train of a sensory neuron: counts and temporal patterns in the rat whisker pathway. J Neurosci 26: 9216–9226, 2006.[Abstract/Free Full Text]

Arkadir D, Morris G, Vaadia E, Bergman H. Independent coding of movement direction and reward prediction by single pallidal neurons. J Neurosci 24: 10047–10056, 2004.[Abstract/Free Full Text]

Averbeck BB, Latham PE, Pouget A. Neural correlations, population coding and computation. Nat Rev Neurosci 7: 358–366, 2006.[CrossRef][Web of Science][Medline]

Bar-Gad I, Morris G, Bergman H. Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Prog Neurobiol 71: 439–473, 2003.[CrossRef][Web of Science][Medline]

Barlow HB. Sensory mechanisms, the reduction of redundancy, and intelligence. In: NPL Symposium on the Mechanization of Thought Processes, No. 10. London: Her Majesty's Stationery Office, 1959, p. 535–539.

Bayer HM, Lau B, Glimcher PW. Statistics of midbrain dopamine neuron spike trains in the awake primate. J Neurophysiol 98: 1428–1439, 2007.[Abstract/Free Full Text]

Berns GS, Sejnowski TJ. A computational model of how the basal ganglia produce sequences. J Cogn Neurosci 10: 108–121, 1998.[CrossRef][Web of Science][Medline]

Bialek W, Rieke F, de Ruyter van Steveninck RR, Warland D. Reading a neural code. Science 252: 1854–1857, 1991.[Abstract/Free Full Text]

Bolam JP, Hanley JJ, Booth PA, Bevan MD. Synaptic organisation of the basal ganglia. J Anat 196: 527–542, 2000.[CrossRef][Web of Science][Medline]

Chechik G, Anderson MJ, Bar-Yosef O, Young ED, Tishby N, Nelken I. Reduction of information redundancy in the ascending auditory pathway. Neuron 51: 359–368, 2006.[CrossRef][Web of Science][Medline]

Christensen-Dalsgaard J, Jorgensen MB, Kanneworff M. Basic response characteristics of auditory nerve fibers in the grassfrog (Rana temporaria). Hear Res 119: 155–163, 1998.[CrossRef][Web of Science][Medline]

Cover TM, Thomas JA. Elements of Information Theory. New York: Wiley, 1991.

DeBusk BC, Debruyn EJ, Snider RK, Kabara JF, Bonds AB. Stimulus-dependent modulation of spike burst length in cat striate cortical cells. J Neurophysiol 78: 199–213, 1997.[Abstract/Free Full Text]

DeLong MR. Primate models of movement disorders of basal ganglia origin. Trends Neurosci 13: 281–285, 1990.[CrossRef][Web of Science][Medline]

DeLong MR, Crutcher MD, Georgopoulos AP. Relations between movement and single cell discharge in the substantia nigra of the behaving monkey. J Neurosci 3: 1599–1606, 1983.[Web of Science][Medline]

Deniau JM, Chevalier G. Disinhibition as a basic process in the expression of striatal functions. II. The striato-nigral influence on thalamocortical cells of the ventromedial thalamic nucleus. Brain Res 334: 227–233, 1985.[CrossRef][Web of Science][Medline]

Friedrich RW, Habermann CJ, Laurent G. Multiplexing using synchrony in the zebrafish olfactory bulb. Nat Neurosci 7: 862–871, 2004.[CrossRef][Web of Science][Medline]

Georgopoulos AP, Schwartz AB, Kettner RE. Neuronal population coding of movement direction. Science 233: 1416–1419, 1986.[Abstract/Free Full Text]

Gershon ED, Wiener MC, Latham PE, Richmond BJ. Coding strategies in monkey V1 and inferior temporal cortices. J Neurophysiol 79: 1135–1144, 1998.[Abstract/Free Full Text]

Hikosaka O, Wurtz RH. Visual and oculomotor functions of monkey substantia nigra pars reticulata. IV. Relation of substantia nigra to superior colliculus. J Neurophysiol 49: 1285–1301, 1983.[Free Full Text]

Ikegaya Y, Aaron G, Cossart R, Aronov D, Lampl I, Ferster D, Yuste R. Synfire chains and cortical songs: temporal modules of cortical activity. Science 304: 559–564, 2004.[Abstract/Free Full Text]

Jones LM, Depireux DA, Simons DJ, Keller A. Robust temporal coding in the trigeminal system. Science 304: 1986–1989, 2004.[Abstract/Free Full Text]

Kanold PO, Manis PB. Encoding the timing of inhibitory inputs. J Neurophysiol 93: 2887–2897, 2005.[Abstract/Free Full Text]

Kepecs A, Lisman J. Information encoding and computation with spikes and bursts. Network 14: 103–118, 2003.[Web of Science][Medline]

Kepecs A, Lisman J. How to read a burst duration code. Neurocomputing 58: 1–6, 2004.[CrossRef][Web of Science]

Kepecs A, Raghavachari S. Gating information by two-state membrane potential fluctuations. J Neurophysiol 97: 3015–3023, 2007.[Abstract/Free Full Text]

Kepecs A, Wang X-J, Lisman J. Bursting neurons signal input slope. J Neurosci 22: 9053–9062, 2002.[Abstract/Free Full Text]

Kliem MA, Maidment NT, Ackerson LC, Chen S, Smith Y, Wichmann T. Activation of nigral and pallidal dopamine D1-like receptors modulates basal ganglia outflow in monkeys. J Neurophysiol 98: 1489–1500, 2007.[Abstract/Free Full Text]

Las L, Stern EA, Nelken I. Representation of tone in fluctuating maskers in the ascending auditory system. J Neurosci 25: 1503–1513, 2005.[Abstract/Free Full Text]

Lauwereyns J, Watanabe K, Coe B, Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature 418: 413–417, 2002.[CrossRef][Web of Science][Medline]

McHaffie JG, Stanford TR, Stein BE, Coizet V, Redgrave P. Subcortical loops through the basal ganglia. Trends Neurosci 28: 401–407, 2005.[CrossRef][Web of Science][Medline]

Mink JW. The basal ganglia: focused selection and inhibition of competing motor programs. Prog Neurobiol 50: 381–425, 1996.[CrossRef][Web of Science][Medline]

Morris G, Arkadir D, Nevet A, Vaadia E, Bergman H. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43: 133–143, 2004.[CrossRef][Web of Science][Medline]

Nagata T, Suzuki H, Zhang R, Ozaki M, Kawakami Y. Mechanical stimulation activates small fiber mediated nociceptive responses in the nucleus gigantocellularis. Exp Brain Res 149: 505–511, 2003.[Web of Science][Medline]

Nelken I, Chechik G, Mrsic-Flogel TD, King AJ, Schnupp JW. Encoding stimulus information by spike numbers and mean response time in primary auditory cortex. J Comput Neurosci 19: 199–221, 2005.[CrossRef][Web of Science][Medline]

Nevet A, Morris G, Saban G, Fainstein N, Bergman H. Discharge rate of substantia nigra pars reticulata neurons is reduced in non-parkinsonian monkeys with apomorphine-induced orofacial dyskinesia. J Neurophysiol 92: 1973–1981, 2004.[Abstract/Free Full Text]

O'Donnell P, Grace AA. Phencyclidine interferes with the hippocampal gating of nucleus accumbens neuronal activity in vivo. Neuroscience 87: 823–830, 1998.[CrossRef][Web of Science][Medline]

Panzeri S, Petersen RS, Schultz SR, Lebedev M, Diamond ME. The role of spike timing in the coding of stimulus location in rat somatosensory cortex. Neuron 29: 769–777, 2001.[CrossRef][Web of Science][Medline]

Person AL, Perkel DJ. Unitary IPSPs drive precise thalamic spiking in a circuit required for learning. Neuron 46: 129–140, 2005.[CrossRef][Web of Science][Medline]

Prut Y, Vaadia E, Bergman H, Haalman I, Slovin H, Abeles M. Spatiotemporal structure of cortical activity: properties and behavioral relevance. J Neurophysiol 79: 2857–2874, 1998.[Abstract/Free Full Text]

Ravel S, Legallet E, Apicella P. Responses of tonically active neurons in the monkey striatum discriminate between motivationally opposing stimuli. J Neurosci 23: 8489–8497, 2003.[Abstract/Free Full Text]

Redgrave P, Marrow L, Dean P. Topographical organization of the nigrotectal projection in rat: evidence for segregated channels. Neuroscience 50: 571–595, 1992.[CrossRef][Web of Science][Medline]

Rogers SM, Newland PL. Gustatory processing in thoracic local circuits of locusts. J Neurosci 22: 8324–8333, 2002.[Abstract/Free Full Text]

Schneidman E, Bialek W, Berry MJ. Synergy, redundancy, and independence in population codes. J Neurosci 23: 11539–11553, 2003.[Abstract/Free Full Text]

Shadlen MN, Newsome WT. The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J Neurosci 18: 3870–3896, 1998.[Abstract/Free Full Text]

Steuber V, Mittmann W, Hoebeek FE, Silver RA, De Zeeuw CI, Hausser M, De Schutter E. Cerebellar LTD and pattern recognition by Purkinje cells. Neuron 54: 121–136, 2007.[CrossRef][Medline]

Victor JD, Purpura KP. Nature and precision of temporal coding in visual cortex: a metric-space analysis. J Neurophysiol 76: 1310–1326, 1996.[Abstract/Free Full Text]

Wald A. Sequental Analysis. New York: Wiley, 1947.

Wichmann T, Kliem MA. Neuronal activity in the primate substantia nigra pars reticulata during the performance of simple and memory-guided elbow movements. J Neurophysiol 91: 815–827, 2004.[Abstract/Free Full Text]

Wickens J. Basal ganglia: structure and computation. Network Comput Neural Syst 8: R77–R109, 1997.[CrossRef]

Zhang R, Tomida M, Katayama Y, Kawakami Y. Response durations encode nociceptive stimulus intensity in the rat medial prefrontal cortex. Neuroscience 125: 777–785, 2004.[CrossRef][Web of Science][Medline]





This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
100/6/3244    most recent
90400.2008v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Parush, N.
Right arrow Articles by Bergman, H.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Parush, N.
Right arrow Articles by Bergman, H.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Visit Other APS Journals Online
Copyright © 2008 by the The American Physiological Society.