|
|
||||||||
1 Ernest Gallo Clinic and Research Center, University of California, San Francisco, Emeryville 94608 2 Graduate Program in Neuroscience, University of California, San Francisco 94143 3 Departments of Neurology and Physiology and Wheeler Center for the Neurobiology of Addiction, University of California, San Francisco, California 94143
Submitted 9 July 2003; accepted in final form 20 November 2003
|
|
ABSTRACT |
|---|
|
|
|
INTRODUCTION |
|---|
|
The mechanisms by which NAc neurons influence feeding are not fully understood. The lateral hypothalamus, an important nucleus for homeostatic regulation, projects to the NAc, and the NAc reciprocates this projection both directly and through the ventral pallidum (Saper et al. 2002
). In addition, the NAc receives direct projections from taste sensory areas, such as the nucleus of the solitary tract and the gustatory cortex (Kelley et al. 2002
). Therefore because of its projections to motor areas such as the ventral pallidum and substantia nigra (Zahm 2000
), the NAc is anatomically well situated to control consummatory motor behavior. Consistent with the idea that the NAc influences both consummatory and appetitive behavior, treatment of the NAc with a µ opioid agonist not only increases food consumption but also increases animals' willingness to work on a progressive ratio schedule for highly palatable food (Zhang et al. 2003
). This suggests that NAc neurons utilize information about the palatability of food to promote the appetitive behavior required to obtain it.
Further supporting a role for NAc neurons in consummatory behavior, a number of electrophysiological studies have identified subpopulations of NAc and ventral striatal neurons that fire phasically during reward consumption. For instance, when juice reward is delivered in cue responding tasks, many primate ventral striatal neurons are excited (Apicella et al. 1991
; Bowman et al. 1996
; Shidara et al. 1998
). These excitations are dependent on delivery of reward because no excitation is observed if the reward-associated cues are presented without the reward (Apicella et al. 1991
; Hollerman et al. 1998
) and the excitations are delayed when the reward is delayed (Apicella et al. 1991
). In addition, the excitations depend on the identity and magnitude of the reward (Cromwell and Schultz 2003
; Hassani et al. 2001
). Although the excitations are not precisely time-locked to licking behavior (Apicella et al. 1991
), it is possible that they encode some aspect of the motor behavior of reward consumption.
In rats, many studies have reported both excitations and inhibitions when animals receive several types of reward, including drugs of abuse. For instance, receipt of cocaine during self-administration results in long-lasting inhibition of many NAc neurons (Nicola and Deadwyler 2000
; Peoples and West 1996
; Peoples et al. 1998
) as well as inhibitions or excitations on a shorter time scale (Carelli and Deadwyler 1994
; Carelli et al. 1993
; Chang et al. 1994
, 1996
; Peoples and West 1996
; Peoples et al. 1997
; Uzwiak et al. 1997
). Self-administration of other drugs, such as ethanol and heroin, is also associated with excitation and inhibition after each operant response (Chang et al. 1998
; Janak et al. 1999
; Lee et al. 1999
). Several studies have attempted to determine more precisely the information encoded by the NAc neuronal firing changes that occur after the operant response for cocaine. Postoperant excitations and inhibitions have been found to reflect the stimuli associated with cocaine but not necessarily the receipt of cocaine itself (Carelli 2000
; Carelli and Deadwyler 1996
). In some cases, the magnitude of the cocaine-associated neuronal response was dependent on whether an operant response was required to obtain the cocaine (Peoples et al. 1997
). Additional studies have examined how delivery of natural reward (sucrose or water) during both fixed ratio and maze tasks affects the firing of NAc neurons. Natural reward delivery in these tasks is associated with both excitation and inhibition of NAc neurons (Carelli and Deadwyler 1994
; Carelli et al. 2000
; Hollander et al. 2002
; Lavoie and Mizumori 1994
; Miyazaki et al. 1998
; Roop et al. 2002
; Shibata et al. 2001
), but the contribution of operant behavior to the natural reward-associated firing responses has not been systematically examined. Thus although recordings from primates have used tasks in which appetitive and consummatory phases of behavior are well separated, this distinction has been more difficult to make in free-run operant tasks performed by rats working for natural reward. The primate literature has focused mainly on excitations of ventral striatal neurons during reward consumption, but the rat literature indicates that many neurons may be inhibited as well. To extend our understanding of rat NAc neuronal responses during reward consumption, we report here an analysis of their firing patterns during the consummatory phase of the discriminative stimulus (DS) task described in the companion paper (Nicola et al. 2004
).
|
|
METHODS |
|---|
|
Basic DS task
Subjects, training, surgery, recording, and data analysis techniques were identical to those described in Nicola et al. (2004
) and are summarized briefly here. In the basic DS task, two cues were presented to the animal on independent schedules with variable intervals averaging 2 min. Actual intervals between DS presentation were randomly selected by the computer from the following list: 60, 90, 104, 112, 116, 118, 119, 119.5, 120, 120.5, 121, 122, 124, 128, 136, 150, and 180 s. The first cue, the DS, indicated that, after the animal performed a nose-poke, a 10% sucrose reward (50 µl) would be delivered into a receptacle located next to the nose-poke. The DS was presented for
20 s and was terminated by a correct nose-poke. The DS consisted of a 6 kHz (12 rats) or 4 kHz (9 rats) intermittent tone which was on for 200 ms and off for 550 ms; house lights were also dimmed by turning off one of the two lamps. The second cue, the nonrewarded stimulus (NS), was presented for 20 s and responding to it had no consequence. The NS consisted of a 6- or 4-kHz intermittent tone (for each rat, the tone chosen for the NS was the tone that was not chosen to be the DS), which was on for 200 ms and off for 550 ms and accompanied by dimmed houselights. Reward was only delivered in response to nose-pokes made during the DS; uncued nose-pokes had no consequence. A photobeam across the reward receptacle indicated when the animal's head entered and exited the receptacle.
Immediately after a successful response to the DS, a conditioned stimulus (CS) was presented for 20 s. The CS consisted of an 8-kHz intermittent tone (on for 200 ms, off for 550 ms) accompanied by continued dimmed houselights. For most animals, a liquid dipper was used to deliver reward, and therefore dipper activation noise also contributed to the CS. The dipper was activated on completion of a successful nose-poke in response to the DS and remained up for the duration of the 8-kHz intermittent tone/dimmed houselights. For some animals, reward was delivered by a syringe pump into a well located in the reward receptacle; the syringe pump was located outside the sound-attenuating chamber.
Random withholding task
In this experiment, animals were trained on the basic DS task and implanted with NAc electrodes exactly as described in Nicola et al. (2004
). After several recording sessions on the basic DS task, animals were placed on the random withholding task. This task was identical to the basic DS task, with one exception. In 40% of trials (randomly chosen), no reward was delivered after the animal made a successful nose-poke response to the DS. In these trials, only the 8-kHz intermittent tone and dimmed houselights were presented; in addition, the dipper was activated for 300 ms, which was too brief to provide the animal with access to sucrose but did provide dipper activation noise. (Only dippers, not syringe pumps, were used to deliver rewards in this experiment.)
Electrophysiology and data analysis
Surgical implantation of microwire electrodes in the NAc, waveform isolation, classification of firing patterns, and data analysis were conducted as described in Nicola et al. (2004
). Briefly, electrodes were implanted in trained animals, and animals were allowed 1 wk of recovery before commencement of recording sessions. Waveforms were isolated on-line and re-sorted off-line, and firing patterns were classified according to the criteria described in the companion paper. Because firing rates were not normally distributed, ranks-based statistical tests (Wilcoxon signed-rank) were used to compare firing rate increases and decreases in different conditions. For the basic DS task, firing rate changes associated with cued versus uncued entries into the reward receptacle were compared. Cued receptacle entries refer to entries that occurred after a nose-poke response to the DS. Uncued entries refer to those occurring in the absence of the DS, NS, or CS. Uncued entries often occurred in rapid sequences. To eliminate the potential confound introduced by this, only the first entry in bursts defined by a minimum inter-burst interval of 10 s were used for this analysis. (In some sessions, no uncued receptacle entries were present. Neurons that were recorded only during such sessions were necessarily excluded from the analysis.) When firing rate increases and decreases relative to baseline were computed, the baseline we used was 10 s prior to DS presentation for cued responses and from 15 to 5 s before uncued responses.
Of the 22 rats recorded, 19 were recorded during the basic DS task only, two were recorded during both the basic DS task and the random withholding task, and one was recorded during the random withholding task only.
Histology
After completion of experiments, animals were deeply anesthetized with pentobarbital, and the position of each electrode was marked by passing current through it. This causes an iron deposit that can be visualized with the Prussian Blue stain (Green 1958
). After electrode marking, rats were perfused first with saline, then with 10% formalin and last with 3% potassium ferrocyanide/10% formalin to develop the Prussian Blue deposits. Sections (40 µm) were cut on a microtome and stained with Neutral Red, and the location of electrodes determined.
|
|
RESULTS |
|---|
|
BEHAVIOR. In the basic DS task, the animal performs a nose-poke response to the DS, which activates the delivery of a sucrose reward into a receptacle nearby. This task is diagrammed in Fig. 1A. In the companion paper (Nicola et al. 2004
), we examined NAc firing patterns correlated with DS onset and the nose-poke response. In this paper, we analyze the firing patterns correlated with receptacle entry and exit. These were excitations during receptacle entry, sustained excitation and inhibition during the animal's stay in the receptacle, and excitations after exit from the reward receptacle. The analysis windows used to classify these firing patterns are shown in Table 1 of Nicola et al. (2004
), the proportion of neurons exhibiting each firing pattern is described in Table 2 of that paper, and the distribution of these firing patterns in relation to other firing patterns is shown in Table 3 of that paper. During performance of the basic DS task, animals often (roughly once every 23 min) made uncued (in the absence of DS, NS, or CS) nose-pokes and entries into the reward receptacle, which were never rewarded. These uncued responses allowed us to determine the degree to which NAc neuronal firing associated with receptacle entry and exit is influenced by whether reward was explicitly predicted by the cue and/or by the presence of reward itself.
|
FIRING PATTERNS. Receptacle entry excitations. Approximately 8.3% of NAc neurons were excited during the act of entering the reward receptacle. These excitations were defined by increased firing from 0.5 s before to 0.5 s after the animal broke the photobeam across the reward receptacle. The excitations depended strongly on whether the entry was uncued or occurred after a nose-poke response to the DS (Fig. 2). The example neuron shown in Fig. 2A exhibited a brief excitation beginning
0.5 s before the receptacle entry, peaking just after the entry, and receding to baseline
1 s after the entry [while the animal was still in the receptacle; circles on the raster plot indicate receptacle exits (symbols used in raster figures are explained in Table 1.)]. No excitation at all was observed if the receptacle entry was uncued (Fig. 2A2). These results are confirmed by the analysis of median firing rates across 49 neurons with entry excitations (Fig. 2, B and C). The median increase in firing in the 1-s window around the receptacle entry relative to baseline was substantially larger for entries after a response to the DS than for uncued entries (P < 0.001, n = 49; Fig. 2C). Therefore the degree of receptacle entry excitation depended on the presence of either the predictive cue or reward in the receptacle. These possibilities are explicitly differentiated with the random withholding task (see Fig. 7).
|
|
|
Sustained receptacle excitations. In addition to excitations that accompanied the animal's entry into the reward receptacle, we also observed sustained excitations that began soon after entry into the receptacle and continued until the animal exited (Fig. 3, A and B). These excitations were observed in 2.8% of neurons and were defined by excitation from 1 to 5 s after entry into the reward receptacle. Some of these excitations (31.1%) began within 0.5 s of receptacle entry, and therefore these neurons also exhibited receptacle entry excitations; an example is shown in Fig. 3A1. Sustained excitations in neurons that did not also exhibit receptacle entry excitation began later, between 0.5 and 1 s after entry into the reward receptacle (e.g., Fig. 3B1). To avoid including firing that occurred during receptacle entry (i.e., that part of the excitation defined as receptacle entry excitation) in the analysis of sustained excitations, we set the analysis window for sustained excitation to begin 1 s after receptacle entry.
|
|
0.51 s after entry into the reward receptacle (e.g., Fig. 4B1), but in many neurons, the inhibitions began earlier: a large proportion (23.5%) of the neurons with sustained inhibitions also had operant inhibitions (see Nicola et al. 2004
|
|
|
BEHAVIOR. The excitations and inhibitions described in the preceding text were all significantly smaller when the response was uncued (and unrewarded) compared with when it was cued by the DS (and rewarded). The smaller firing change could be due to the fact that reward was not presented after uncued receptacle entries or to the fact that no cue indicated the presence of reward. To distinguish between these possibilities, we subjected three animals to a task identical to the basic DS task, except that reward was withheld from the animal following a random 40% of successful responses to the DS. This task is diagrammed in Fig. 6A. The animals' behavior demonstrated that they could not determine until after entry into the reward receptacle which trials would not be rewarded. First, the proportion of nose-pokes in response to the DS that were followed by receptacle entry was identical whether or not the nose-poke resulted in reward delivery (t34 = 1.5, P > 0.1; Fig. 6B). Second, the latencies between the nose-poke and receptacle entry were also indistinguishable in the two conditions (t34 = 2.0, P > 0.05; Fig. 6C). These results contrast strongly with the comparison of rewarded receptacle entries and uncued entries (Fig. 1, B and C), in which many fewer receptacle entries followed uncued than cued nose-pokes, and the latency between nose-pokes and entries was higher for uncued nose-pokes. Therefore in the random withholding task, animals were unable to determine until after entry into the reward receptacle whether reward was delivered after a DS-cued nose-poke.
|
Reward withholding task
FIRING PATTERNS. Receptacle entry excitations. Consistent with the behavioral evidence that animals could not determine prior to entry whether reward would be withheld, receptacle entry excitations were identical on rewarded and unrewarded trials of the random withholding task (P > 0.3, n = 10, Fig. 7). Because excitation was equivalent whether or not reward was present, the reduced excitation observed (in the basic DS task) during uncued entries compared with entries after a DS-cued nose-poke (Fig. 2) was not due to the absence of reward in the receptacle in uncued trials. Instead, receptacle entry excitations are dependent on reward-predictive cues.
Operant inhibitions. In Nicola et al. (2004
), we showed that the magnitude of operant inhibitions was affected by the predictive value of the cue that elicited the operant response. Inhibitions were greatest when the operant response was to the DS, smaller when it was in response to the NS, and smallest when the operant response was uncued. Because operant inhibition is defined by inhibition between the operant response and receptacle entry and because these inhibitions usually continued until well past receptacle entry, it is conceivable that one reason why the inhibition is smaller after uncued responses is because reward is absent from the receptacle. To test this, we compared operant inhibition during rewarded and unrewarded trials of the random withholding task (Fig. 8). A typical neuron with operant inhibition exhibited no difference in this inhibition in rewarded and unrewarded trials (Fig. 8A). However, comparison of the median inhibition in the 1 s around receptacle entry (relative to the pre-DS baseline) showed a significant difference between these trial types (P < 0.04, n = 15, Fig. 8, B and C). The difference in median inhibition was exceedingly small (.15 Hz). Therefore operant inhibitions do not strongly encode the presence of reward, but depend on the degree to which reward is predicted by environmental stimuli.
|
Sustained receptacle inhibitions. Similar results were obtained for sustained inhibitions as for sustained excitations. Figure 10, A and B, shows that in typical neurons with sustained inhibitions, the inhibitions were reduced in duration in unrewarded trials due to the earlier exit from the receptacle. The magnitude of the inhibition was, however, indistinguishable for rewarded and unrewarded trials. These results are confirmed by the median histogram (Fig. 10C), which again shows that the magnitude of the inhibition is unchanged, but the time course is substantially shorter for unrewarded trials. When the median firing rate decrease from 1 s after receptacle entry to receptacle exit was compared, no significant difference was found between rewarded and unrewarded trials (P > 0.1, n = 17; Fig. 10D). Therefore similar to sustained receptacle excitations, the magnitude of sustained receptacle inhibitions was not affected by the presence of reward in the receptacle or the animal's location during receptacle entry. Rather inhibitions are likely a function of the motor behavior of reward consumption. Like sustained excitations, the sustained inhibitions may also reflect combinations of cues (i.e., the tone CS coupled with the reward receptacle itself, neither of which alone is sufficient to drive the inhibition).
|
Sustained receptacle exit excitations are correlated with reduced uncued operant responding
Although receptacle exit excitations were defined by excitation in the 1 s after receptacle exits, many receptacle exit excitations continued for substantially longer periods. This is illustrated by the histograms in Figs. 5C and 11C, which show that the median firing rate of these neurons does not return to the pre-DS baseline until many seconds after the receptacle exit. We therefore isolated a subpopulation of receptacle exit excited neurons with sustained excitations. This subpopulation was defined by significant (paired t-test P < 0.05 across trials) excitation from 10 to 11 s after the receptacle exit, relative to the 10 s pre-DS baseline; 27 neurons matched this criterion. An example of such a neuron recorded during the basic DS task is shown in Fig. 12A. In this case, the excitation remained above the pre-DS baseline for >60 s after receptacle exit.
|
35 s after receptacle exit (Fig. 12B). To determine the behavioral correlate of sustained receptacle exit excitation, we reasoned that uncued operant and receptacle entry behavior may be influenced by the timing of DS presentation. Figure 12C shows that the rate of uncued nose-poke responses across all basic DS task sessions was sharply reduced immediately after the receptacle exit compared with the period just before DS presentation. The uncued nose-poke rate then gradually increased to reach a peak before the next DS. This pattern can also be observed in the rasters in Fig. 12A (open triangles denote uncued nose-pokes; these are nearly absent in the minute or so after receptacle exit but occur with relatively high frequency in the minute before DS presentation). The rate of uncued receptacle entries tended to be somewhat higher just before the DS and after exits from the reward receptacle after DS-cued nose-poke-entry sequences (Fig. 12D). To determine if sustained receptacle exit excitation was correlated with the rate of uncued nose-poking or uncued receptacle entries, we computed the median firing rate of neurons with these excitations in 10-s bins in the 90 s after receptacle exits and the 90 s before DS presentation. We also computed the average rate of uncued nose-pokes and receptacle entries in the same 10-s bins across all sessions of the basic DS task. We found a strong linear correlation between the interval between uncued nose-pokes (the inverse of the average nose-poke rate in each bin) and firing rate (r2 = 0.66, P < 0.001; Fig. 12E). There was a weaker correlation in the opposite direction between the firing rate of these neurons and the interval between uncued receptacle entries (r2 = 0.32, P < 0.02; Fig. 12F). These results raise the possibility that sustained receptacle exit excitations inhibit nose-poking and facilitate receptacle entries after reward has been obtained. Histology
Figure 13 shows the approximate center of the electrode arrays; the arrays extended for
0.5 mm in both the anterior and posterior directions and
0.25 mm in the both medial and lateral directions from the center point. All electrodes were verified to be in the NAc.
|
|
|
DISCUSSION |
|---|
|
Information encoded by receptacle entry excitations and operant inhibitions
Receptacle entry excitations began just before receptacle entries and usually ended within 1 s afterward (although some excitations that began at receptacle entry continued until receptacle exit). Operant inhibitions, which were described in Nicola et al. (2004
), were maximal near receptacle entry as well. Both of these firing patterns were smaller in magnitude for uncued receptacle entries than for DS-cued entries. In contrast, neither were substantially different for rewarded and unrewarded receptacle entries in the random withholding task. Both rewarded and unrewarded entries in the random withholding task were elicited by the same cue. Therefore receptacle entry excitations and operant inhibitions are not well correlated with whether reward is present in the receptacle. Rather they depend strongly on the degree to which a cue has predicted that reward will be available in the receptacle.
Information encoded by sustained receptacle excitations and inhibitions
Sustained receptacle excitations and inhibitions began within 1 s of entry into the reward receptacle and continued until exit from the receptacle. These firing patterns therefore occurred precisely when the animal was engaged in consummatory behavior. The magnitude of the excitations and inhibitions cannot be accounted for by the sensory stimulus of reward (e.g., its taste) because the magnitude was the same in both rewarded and unrewarded trials of the random withholding task. It is possible that some residual, unconsumed sucrose remained in the receptacle and that the sensory stimulus resulting from consumption of this reward drove the excitations and inhibitions when we did not deliver reward. However, the magnitude of the firing rate change was much smaller during uncued stays in the reward receptacle even though residual sucrose could have been present in these cases as well. This finding rules out the possibility that certain sensory cues drove the firing patterns, such as the animal's location (i.e., in the reward receptacle) or the odor of sucrose in the dipper reservoir located below the reward receptacle. Unrewarded entries in the random withholding task differed from uncued entries in the basic DS task in two ways: an explicit tone CS was present during all entries in the random withholding task and the animal remained in the receptacle for substantially longer periods of time during unrewarded entries in the random withholding task even though in neither case was any reward available for consumption. Although the fact that the CS was always present when the firing changes were observed raises the possibility that sustained receptacle excitations and inhibitions depend on the presence of the CS, the excitations and inhibitions ended when the animal exited the receptacle even though the CS continued well past this point in most trials.
Another possible explanation is that these firing patterns encode information about the motor behavior of reward consumption. This is supported by the evidence that animals remained longer in the receptacle during unrewarded (but cued) trials than uncued (and unrewarded) trials. It is possible that the longer stay in the receptacle was due to attempts to consume reward (for instance, by licking the area of the receptacle where sucrose would otherwise have been delivered). Whether or not animals actively engaged in consummatory behavior during unrewarded entries, the longer stay is certainly a function of the fact that reward was predicted by the DS, of the animal's earlier operant response to it, and/or of the continuing CS. The sustained receptacle excitations and inhibitions may therefore also be influenced by these same factors. One possibility is that these firing patterns facilitate or drive attempts to consume reward based on the information that reward should be present. In this sense, the firing patterns present during reward consumption may be similar to the excitations and inhibitions elicited by cues such as the DS, which are significantly larger when the cue predicts reward than when it does not, even when the behavioral latency to respond to the cue is the same (Nicola et al. 2004
). Additional experiments showing a direct relationship between NAc neuronal firing and specific consummatory muscle movements (and showing an impact of predictive cues on this relationship) are required to support this suggestion. Nevertheless, this interpretation is consistent with the idea that one general function of NAc neurons is to facilitate specific motor behaviors in response to the environmental stimuli that predict that those behaviors will result in reward (Chang et al. 1994
; Mizumori et al. 1999
; Nicola et al. 2004
; Shidara et al. 1998
).
Our findings extend those of others who have recorded from rat NAc neurons during the performance of fixed ratio tasks. When the behavior was reinforced with natural reward (sucrose solution, food pellets, or water), both excitations and inhibitions immediately after the operant response were found (Carelli and Deadwyler 1994
; Carelli et al. 2000
; Hollander et al. 2002
; Roop et al. 2002
), consistent with our observations. However, the earlier studies did not determine when animals began and ended reward consumption, and therefore it is difficult to determine whether the neural responses were more related to operant responding or consumption. We find that different populations of NAc neurons are excited or inhibited during operant responding, entry into the reward receptacle, and reward consumption. Combinations of these firing patterns are often observed in the same neuron, suggesting that the postoperant excitations and inhibitions described by Carelli and colleagues were composed of both operant- and reward-related firing. Postoperant excitations and inhibitions often lasted for several sec (Carelli et al. 2000
; Roop et al. 2002
), and others have observed similar long-lasting firing changes time-locked to delivery of (and presumably consumption of) ethanol reward (Janak et al. 1999
). These findings suggest that the later stages of the firing changes observed after operant responses in FR1 tasks may in large part reflect reward consumption.
Interestingly, previous studies showed that neurons that displayed one type of phasic firing (e.g., excitation after the operant response) for one reward (sucrose, food, or water) tended to display the same phasic firing pattern for the other types of reward even though responses on different levers were required, different CS's accompanied delivery of each reward, and different motor actions (licking vs. chewing) were required to consume reward (Carelli et al. 2000
; Roop et al. 2002
). On the other hand, completely different populations of NAc neurons were excited and inhibited after operant responses for intravenous cocaine than for food or water (Carelli and Deadwyler 1994
; Carelli et al. 2000
). Because one of the key differences between cocaine and natural reward is that the animal must perform consummatory behavior after the operant response only for natural reward, the findings of Carelli and colleagues are most consistent with the idea that the postoperant phasic firing they observed in natural-reward tasks encoded information about the motor activity of reward consumption. Even though the specific motor behaviors required to consume food and water (but not liquid sucrose and water) are different, much of the required behavior was similar: for all of these natural rewards (but not for cocaine), the animal had to turn, move to the reward delivery site, stop, begin consumption, swallow, and maintain the posture required for obtaining reward. Consistent with this interpretation is the finding that postoperant excitations and inhibitions were absent during extinction (Hollander et al. 2002
), when consummatory behavior should be absent or much reduced. However, reward itself is also absent during extinction, leaving open the possibility that postoperant firing encoded detection of the different rewards rather than consummatory motor behavior.
The idea that excitations and inhibitions during the animal's stay in the reward receptacle encode information about consummatory motor behavior is supported by a large number of behavioral pharmacology studies in which consumption or consummatory behaviors were measured after local injection of drugs into the NAc. Inhibition of the NAc with GABA receptor agonists (Basso and Kelley 1999
; Reynolds and Berridge 2001
; Soderpalm and Berridge 2000
; Ward et al. 2000
) or glutamate receptor antagonists (Kelley and Swanson 1997
; Stratford et al. 1998
) strongly increases consumption of freely available food or sucrose solution, whereas excitation of the NAc with a glutamate agonist decreases consumption in food-deprived animals (Stratford et al. 1998
). Furthermore, µ opioid receptor agonists, which have generally been found to inhibit NAc neurons (Chieng and Williams 1998
; Hjelmstad and Fields 2001
; Hoffman and Lupica 2001
; Yuan et al. 1992
), also cause increased feeding when injected into the NAc (Kelley et al. 2002
). These results indicate that the firing of some NAc neurons exerts an inhibitory effect on consumption that can be released by inhibition of these neurons. In our rats, many more NAc neurons were inhibited during consumption than were excited. A suggestive hypothesis is therefore that the firing of these neurons inhibits consummatory behavior; when their firing is reduced (either by injection of NAc-inhibiting compounds or when the animal encounters a situation where environmental cues indicate that reward should be available), consummatory behavior is disinhibited. Testing this hypothesis would require determining whether receptacle-associated inhibitions do in fact promote consummatory behavior.
The possibility that the firing of neurons with sustained receptacle inhibitions inhibits consumption has implications for how the firing of neurons active during appetitive behavior is interpreted. This is because about half of the neurons that were excited by cues and during the operant response were inhibited during reward consumption (Nicola et al. 2004
, Table 3). Thus the firing of neurons with both appetitive excitation and consummatory inhibition may serve two roles: the increase in firing promotes a specific appetitive behavior and inhibits consummatory behaviors, whereas the decrease in firing inhibits the appetitive behavior and promotes (or disinhibits) consummatory behavior. This biphasic pattern of activity could facilitate switching from appetitive to consummatory behaviors. Interestingly, one of the most prevalent firing patterns in the NAc of rats during cocaine self-administration is a long-lasting inhibition that begins on cocaine delivery and slowly recovers before the animal begins to work for the next injection (Nicola and Deadwyler 2000
; Peoples and West 1996
; Peoples et al. 1998
). The time course of inhibition parallels that of cocaine metabolism and is dependent on dopamine (Nicola and Deadwyler 2000
), and the same neurons tend to show excitations just before and during operant behavior (Nicola and Deadwyler 2000
; Peoples and West 1996
). Inhibition of NAc neurons by cocaine may therefore mimic the inhibition that occurs during natural reward consumption and could explain how goal-directed behaviors other than cocaine-taking are inhibited during self-administration: the decreased firing of many NAc neurons after cocaine delivery may inhibit a broad range of possible appetitive behaviors.
The electrophysiological and pharmacological evidence from studies using rats supports the idea that the phasic firing of NAc neurons (particularly inhibitions) correlated with reward consumption promotes consummatory motor behavior. Inhibitions during consumption in primate ventral striatum have not been reported in detail, although striatal tonically active neurons (TANs) can be inhibited by reward delivery, particularly if the reward is unexpected (Apicella et al. 1997
). Recordings from primate dorsal and ventral striatum suggest that reward-related excitations of phasically active neurons are influenced by the sensory stimulus of reward. For instance, presenting no reward or only the cues associated with juice reward resulted in much less excitation (Apicella et al. 1991
; Bowman et al. 1996
; Hollerman et al. 1998
), in contrast to our finding of equivalent firing changes in rewarded and unrewarded trials of the random withholding task. A potential explanation for the discrepancy is that our animals may have engaged in attempts to consume reward when reward was predicted but not delivered as suggested by the greater time spent in the receptacle after cued/unrewarded receptacle entries (random withholding task) than uncued/unrewarded receptacle entries (basic DS task). This behavior contrasts with that reported in at least one primate study, in which the animal clearly did not engage in consummatory behavior as measured by muscle activity when reward was not delivered (Apicella et al. 1991
). The findings of Apicella et al. are therefore consistent with the possibility that the reward-related excitation may have encoded consummatory motor behavior instead of or in addition to the presence of reward. Apicella et al. (1991
) did find that excitation was absent when the animal continued to lick the delivery tube after reward was consumed, suggesting that the firing does not simply encode licking behavior. However, based on our interpretation of our results, we propose that these neurons may promote licks in response to the information (provided by predictive cues) that reward should be available; licks after reward is no longer present may be driven by other neurons in other nuclei. In summary, the primate results suggest that excitations during consumption are influenced by information that reward is present. Although the magnitude of excitation and inhibition in our experiments was the same whether or not reward was present, the duration of the firing changes was clearly longer when reward was present than when it was not. Thus our sustained receptacle excitations and inhibitions are likely also to have been influenced directly or indirectly by the sensory stimulus of reward.
Further supporting the hypothesis that the reward-associated firing of primate striatal neurons encodes reward sensory information, changing the magnitude or type of juice reward also resulted in changes in reward-associated excitation in primate striatal neurons; the firing was different despite apparently similar licking behavior (Cromwell and Schultz 2003
; Hassani et al. 2001
). However, the reward magnitude and identity were fully predicted by cues, meaning that this information as well as direct sensory information about the reward could have influenced firing during consumption. Therefore a number of studies suggest that reward-associated excitation of primate striatal neurons encodes reward sensory information. Although the firing was not well correlated with the measured consummatory motor behavior in that licking could occur in the absence of excitation, these studies do not rule out the possibility that the excitations promoted some aspect of consummatory behavior because licking is only one part of consumption. An intriguing possibility is that reward-associated excitations and inhibitions in rat NAc neurons also encode reward sensory information but that other information (such as that reward is predicted by cues) is sufficient to induce maximal increases or decreases in the rate of firing, but not in the duration of the firing change. Thus sensory information that reward should be present may control the onset of excitation and inhibition, but sensory information that reward is present may control firing during sustained consummatory activity.
Information encoded by receptacle exit excitations
Neurons that were excited in the 1 s after exit from the reward receptacle were less excited if the receptacle entry was uncued than if it was part of the nose-poke-receptacle entry sequence cued by the DS. However, the excitation was equivalent after rewarded and unrewarded trials of the random withholding task. These results suggest that the firing does not simply encode the behavior of exit from the reward receptacle nor does it encode whether reward has just been received. Rather the firing encodes whether the animal has made a nose-poke-receptacle entry response to the DS. This firing pattern may therefore signal that no DS is likely to be presented in the near future, indicating a window of opportunity for behaviors unrelated to responding to the DS. The fact that many receptacle exit excitations lasted for many tens of seconds supports this hypothesis. Further supporting the hypothesis is the finding of a strong inverse correlation between the rate of uncued nose-poking (which is lower after the animal has responded to the DS and completed consumption than just before DS presentation) and the firing rate of these neurons. A weaker, positive correlation between the firing of these neurons and the rate of uncued receptacle entries suggests that the firing may promote this behavior, although the rate of uncued receptacle entries was also high just before DS presentation when the firing was at its lowest. Although the finding of a correlation does not necessarily mean that increased firing causes decreased nose-poking, the correlation is consistent with the idea that the firing of these neurons inhibits this behavior. One possibility is that the excitation promotes a behavior other than nose-poking (e.g., grooming, exploring, receptacle entry), thereby making nose-poking unlikely. Further experiments are required to understand more completely the relationship between the firing of these neurons and uncued operant behavior.
Summary
The NAc is involved in both appetitive and consummatory behaviors. A common finding in electrophysiological studies of the NAc and ventral striatum in behaving animals is that subpopulations of neurons respond phasically to each identifiable component of both appetitive and consummatory phases of the task. The present work extends this concept by suggesting some commonalities in the information encoded by NAc firing patterns. All of the firing patterns related to the consummatory phase of the DS task were only minimally affected, if at all, by withholding reward. In contrast, all of them were strongly influenced by whether the reward was predicted by the presence of cues such as the DS and CS. The firing patterns during consummatory behavior are therefore similar to those during appetitive behavior in that the presence of predictive cues is a critical determinant of almost all the phasic firing patterns of NAc neurons. Therefore as we proposed in the companion paper (Nicola et al. 2004
), a general function of NAc neurons may be to promote a specific motor behavior in response to the specific cues that indicate that the behavior will result in reward. This hypothesis is consistent with similar ideas that NAc neurons participate in guiding sequences of behavior in response to changing environmental stimuli (Chang et al. 1994
; Mizumori et al. 1999
; Shidara et al. 1998
). These concepts may be important for understanding not just the many behaviors that are obviously cue-driven and dependent on (or modulated by) the NAc (Cardinal et al. 2002
) but may also explain why the NAc affects behaviors that seem to be independent of investigator-imposed, temporally restricted cues, such as consumption of freely available food. Because many more NAc neurons are inhibited during consumption than are excited, manipulations that inhibit the NAc may enhance food consumption not because the NAc is generally inactivated but because the specific population of neurons whose firing inhibits consumption is silenced by such manipulations. Many of the same neurons whose inhibition may drive consumption are also excited by cues or during operant responding, behaviors that are incompatible with consumption. Our results are consistent with the idea that the firing of subpopulations of NAc neurons promotes some behaviors and simultaneously inhibits others and that competition among these neurons produces the optimal behavioral response to the salient and predictive cues in the environment.
|
|
ACKNOWLEDGMENTS |
|---|
|
GRANTS
This work was supported by funds provided by the State of California for medical research on alcohol and substance abuse through the University of California, San Francisco; by the Wheeler Center for the Neurobiology of Addiction; by the Ernest Gallo Clinic and Research Center; by National Institute of Drug Abuse grants to S. M. Nicola and H. L. Fields; and by a National Science Foundation Predoctoral Training Consortium in Affective Science fellowship to I. A. Yun.
|
|
FOOTNOTES |
|---|
Address for reprint requests and other correspondence: S. Nicola, Ernest Gallo Clinic and Research Center, University of California, San Francisco, 5858 Horton St., Ste. 200, Emeryville, CA 94608 (E-mail: nicola{at}phy.ucsf.edu).
|
|
REFERENCES |
|---|
|
Apicella P, Ljungberg T, Scarnati E, and Schultz W. Responses to reward in monkey dorsal and ventral striatum. Exp Brain Res 85: 491500, 1991.[Web of Science][Medline]
Basso AM and Kelley AE. Feeding induced by GABA(A) receptor stimulation within the nucleus accumbens shell: regional mapping and characterization of macronutrient and taste preference. Behav Neurosci 113: 324336, 1999.[CrossRef][Web of Science][Medline]
Berridge KC. Food reward: brain substrates of wanting and liking. Neurosci Biobehav Rev 20: 125, 1996.[CrossRef][Web of Science][Medline]
Berridge KC and Robinson TE. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28: 309369, 1998.[CrossRef][Medline]
Bowman EM, Aigner TG, and Richmond BJ. Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J Neurophysiol 75: 10611073, 1996.
Cardinal RN, Parkinson JA, Hall J, and Everitt BJ. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev 26: 321352, 2002.[CrossRef][Web of Science][Medline]
Carelli RM. Activation of accumbens cell firing by stimuli associated with cocaine delivery during self-administration. Synapse 35: 238242, 2000.[CrossRef][Web of Science][Medline]
Carelli RM and Deadwyler SA. A comparison of nucleus accumbens neuronal firing patterns during cocaine self-administration and water reinforcement in rats. J Neurosci 14: 77357746, 1994.[Abstract]
Carelli RM and Deadwyler SA. Dual factors controlling activity of nucleus accumbens cell-firing during cocaine self-administration. Synapse 24: 308311, 1996.[CrossRef][Web of Science][Medline]
Carelli RM, Ijames SG, and Crumling AJ. Evidence that separate neural circuits in the nucleus accumbens encode cocaine versus "natural" (water and food) reward. J Neurosci 20: 42554266, 2000.
Carelli RM, King VC, Hampson RE, and Deadwyler SA. Firing patterns of nucleus accumbens neurons during cocaine self-administration in rats. Brain Res 626: 1422, 1993.[CrossRef][Web of Science][Medline]
Chang JY, Janak PH, and Woodward DJ. Comparison of mesocorticolimbic neuronal responses during cocaine and heroin self-administration in freely moving rats. J Neurosci 18: 30983115, 1998.
Chang JY, Paris JM, Sawyer SF, Kirillov AB, and Woodward DJ. Neuronal spike activity in rat nucleus accumbens during cocaine self-administration under different fixed-ratio schedules. Neuroscience 74: 483497, 1996.[CrossRef][Web of Science][Medline]
Chang JY, Sawyer SF, Lee RS, and Woodward DJ. Electrophysiological and pharmacological evidence for the role of the nucleus accumbens in cocaine self-administration in freely moving rats. J Neurosci 14: 12241244, 1994.[Abstract]
Chieng B and Williams JT. Increased opioid inhibition of GABA release in nucleus accumbens during morphine withdrawal. J Neurosci 18: 70337039, 1998.
Cromwell HC and Schultz W. Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol 89: 28232838, 2003.
Green JD. A simple microelectrode for recording from the central nervous system. Nature 182: 962, 1958.[CrossRef][Medline]
Hassani OK, Cromwell HC, and Schultz W. Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J Neurophysiol 85: 24772489, 2001.
Hjelmstad GO and Fields HL. Kappa opioid receptor inhibition of glutamatergic transmission in the nucleus accumbens shell. J Neurophysiol 85: 11531158, 2001.
Hoffman AF and Lupica CR. Direct actions of cannabinoids on synaptic transmission in the nucleus accumbens: a comparison with opioids. J Neurophysiol 85: 7283, 2001.
Hollander JA, Ijames SG, Roop RG, and Carelli RM. An examination of nucleus accumbens cell firing during extinction and reinstatement of water reinforcement behavior in rats. Brain Res 929: 226235, 2002.[CrossRef][Web of Science][Medline]
Hollerman JR, Tremblay L, and Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80: 947963, 1998.
Ikemoto S and Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res Brain Res Rev 31: 641, 1999.[CrossRef][Medline]
Janak PH, Chang JY, and Woodward DJ. Neuronal spike activity in the nucleus accumbens of behaving rats during ethanol self-administration. Brain Res 817: 172184, 1999.[CrossRef][Web of Science][Medline]
Kelley AE, Bakshi VP, Haber SN, Steininger TL, Will MJ, and Zhang M. Opioid modulation of taste hedonics within the ventral striatum. Physiol Behav 76: 365377, 2002.[CrossRef][Medline]
Kelley AE and Swanson CJ. Feeding induced by blockade of AMPA and kainate receptors within the ventral striatum: a microinfusion mapping study. Behav Brain Res 89: 107113, 1997.[CrossRef][Web of Science][Medline]
Lavoie AM and Mizumori SJ. Spatial, movement- and reward-sensitive discharge by medial ventral striatum neurons of rats. Brain Res 638: 157168, 1994.[CrossRef][Web of Science][Medline]
Lee RS, Criado JR, Koob GF, and Henriksen SJ. Cellular responses of nucleus accumbens neurons to opiate-seeking behavior. I. Sustained responding during heroin self-administration. Synapse 33: 4958, 1999.[CrossRef][Web of Science][Medline]
Miyazaki K, Mogi E, Araki N, and Matsumoto G. Reward-quality dependent anticipation in rat nucleus accumbens. Neuroreport 9: 39433948, 1998.[Web of Science][Medline]
Mizumori SJ, Pratt WE, and Ragozzino KE. Function of the nucleus accumbens within the context of the larger striatal system. Psychbiol 27: 214224, 1999.
Nicola SM and Deadwyler SA. Firing rate of nucleus accumbens neurons is dopamine-dependent and reflects the timing of cocaine-seeking behavior in rats on a progressive ratio schedule of reinforcement. J Neurosci 20: 55265537, 2000.
Nicola SM, Yun IA, Wakabayashi KT, and Fields HL. Cue-evoked firing of nucleus accumbens neurons encodes motivational significance during a discriminative stimulus task. J Neurophysiol 91: 18401865, 2004.
Paxinos G and Watson C. The Rat Brain in Stereotaxic Coordinates. San Diego, CA: Academic, 1998.
Peoples LL, Gee F, Bibi R, and West MO. Phasic firing time locked to cocaine self-infusion and locomotion: dissociable firing patterns of single nucleus accumbens neurons in the rat. J Neurosci 18: 75887598, 1998.
Peoples LL, Uzwiak AJ, Gee F, and West MO. Operant behavior during sessions of intravenous cocaine infusion is necessary and sufficient for phasic firing of single nucleus accumbens neurons. Brain Res 757: 280284, 1997.[CrossRef][Web of Science][Medline]
Peoples LL and West MO. Phasic firing of single neurons in the rat nucleus accumbens correlated with the timing of intravenous cocaine self-administration. J Neurosci 16: 34593473, 1996.
Reynolds SM and Berridge KC. Fear and feeding in the nucleus accumbens shell: rostrocaudal segregation of GABA-elicited defensive behavior versus eating behavior. J Neurosci 21: 32613270, 2001.
Roop RG, Hollander JA, and Carelli RM. Accumbens activity during a multiple schedule for water and sucrose reinforcement in rats. Synapse 43: 223226, 2002.[CrossRef][Web of Science][Medline]
Salamone JD. Functional significance of nucleus accumbens dopamine: behavior, pharmacology and neurochemistry. Behav Brain Res 137: 1, 2002.[CrossRef][Web of Science][Medline]
Saper CB, Chou TC, and Elmquist JK. The need to feed: homeostatic and hedonic control of eating. Neuron 36: 199211, 2002.[CrossRef][Web of Science][Medline]
Shibata R, Mulder AB, Trullier O, and Wiener SI. Position sensitivity in phasically discharging nucleus accumbens neurons of rats alternating between tasks requiring complementary types of spatial cues. Neuroscience 108: 391411, 2001.[CrossRef][Web of Science][Medline]
Shidara M, Aigner TG, and Richmond BJ. Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J Neurosci 18: 26132625, 1998.
Soderpalm AH and Berridge KC. Food intake after diazepam, morphine or muscimol: microinjections In the nucleus accumbens shell. Pharmacol Biochem Behav 66: 429434, 2000.[CrossRef][Web of Science][Medline]
Stratford TR, Swanson CJ, and Kelley A. Specific changes in food intake elicited by blockade or activation of glutamate receptors in the nucleus accumbens shell. Behav Brain Res 93: 4350, 1998.[CrossRef][Web of Science][Medline]
Uzwiak AJ, Guyette FX, West MO, and Peoples LL. Neurons in accumbens subterritories of the rat: phasic firing time-locked within seconds of intravenous cocaine self-infusion. Brain Res 767: 363369, 1997.[CrossRef][Web of Science][Medline]
Ward BO, Somerville EM, and Clifton PG. Intraaccumbens baclofen selectively enhances feeding behavior in the rat. Physiol Behav 68: 463468, 2000.[CrossRef][Medline]
Yuan XR, Madamba S, and Siggins GR. Opioid peptides reduce synaptic transmission in the nucleus accumbens. Neurosci Lett 134: 223228, 1992.[CrossRef][Web of Science][Medline]
Zahm DS. An integrative neuroanatomical perspective on some subcortical substrates of adaptive responding with emphasis on the nucleus accumbens. Neurosci Biobehav Rev 24: 85105, 2000.[CrossRef][Web of Science][Medline]
Zhang M, Balmadrid C, and Kelley AE. Nucleus accumbens opioid, GABaergic, and dopaminergic modulation of palatable food motivation: contrasting effects revealed by a progressive ratio study in the rat. Behav Neurosci 117: 202211, 2003.[CrossRef][Web of Science][Medline]
This article has been cited by other articles:
![]() |
M. Ito and K. Doya Validation of Decision-Making Models and Analysis of Decision Variables in the Rat Basal Ganglia J. Neurosci., August 5, 2009; 29(31): 9861 - 9874. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. M. Botvinick, S. Huffstetler, and J. T. McGuire Effort discounting in human nucleus accumbens Cogn Affect Behav Neurosci, March 1, 2009; 9(1): 16 - 27. [Abstract] [PDF] |
||||
![]() |
A. Ishikawa, F. Ambroggi, S. M. Nicola, and H. L. Fields Dorsomedial Prefrontal Cortex Contribution to Behavioral and Nucleus Accumbens Neuronal Responses to Incentive Cues J. Neurosci., May 7, 2008; 28(19): 5088 - 5098. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. J. Day and R. M. Carelli The Nucleus Accumbens and Pavlovian Reward Learning Neuroscientist, April 1, 2007; 13(2): 148 - 159. [Abstract] [PDF] |
||||
![]() |
P. W. German and H. L. Fields Rat Nucleus Accumbens Neurons Persistently Encode Locations Associated With Morphine Reward J Neurophysiol, March 1, 2007; 97(3): 2094 - 2106. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. A. Wheeler and R. M. Carelli The Neuroscience of Pleasure. Focus on "Ventral Pallidum Firing Codes Hedonic Reward: When a Bad Taste Turns Good" J Neurophysiol, November 1, 2006; 96(5): 2175 - 2176. [Full Text] [PDF] |
||||
![]() |
X. Wan and L. L. Peoples Firing Patterns of Accumbal Neurons During a Pavlovian-Conditioned Approach Task J Neurophysiol, August 1, 2006; 96(2): 652 - 660. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. A. Taha and H. L. Fields Inhibitions of Nucleus Accumbens Neurons Encode a Gating Signal for Reward-Directed Behavior J. Neurosci., January 4, 2006; 26(1): 217 - 222. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. I. G. Wilson and E. M. Bowman Rat Nucleus Accumbens Neurons Predominantly Respond to the Outcome-Related Properties of Conditioned Stimuli Rather Than Their Behavioral-Switching Properties J Neurophysiol, July 1, 2005; 94(1): 49 - 61. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. A. Taha and H. L. Fields Encoding of Palatability and Appetitive Behaviors by Distinct Neuronal Populations in the Nucleus Accumbens J. Neurosci., February 2, 2005; 25(5): 1193 - 1202. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Nicola, I. A. Yun, K. T. Wakabayashi, and H. L. Fields Cue-Evoked Firing of Nucleus Accumbens Neurons Encodes Motivational Significance During a Discriminative Stimulus Task J Neurophysiol, April 1, 2004; 91(4): 1840 - 1865. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. A. Yun, K. T. Wakabayashi, H. L. Fields, and S. M. Nicola The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues J. Neurosci., March 24, 2004; 24(12): 2923 - 2933. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |