|
|
||||||||
1Department of Mathematics and Center for BioDynamics, Boston University; 2Department of Neurology, Beth Israel Deaconess Medical Center; and 3 Department of Anesthesia and Critical Care, Massachusetts General Hospital, Boston, Massachusetts
Submitted 7 November 2006; accepted in final form 2 April 2007
|
|
ABSTRACT |
|---|
|
|
|
INTRODUCTION |
|---|
|
When addressing the control of wake and sleep at the neuronal level, properties of neuronal firing and the resulting structure of sleepwake behavior must be considered on a fine scale. This structure can be characterized by the number, duration, and organization of bouts of each state in addition to the total percentage of time spent in each state. In contrast to the single consolidated nighttime sleep period typically experienced by adult humans, adult mice exhibit polyphasic sleepwake behavior (Fig. 1). In addition, many species, including mice and humans, normally experience brief awakenings from sleep as well as sustained bouts of wakefulness associated with feeding and locomotor behavior. In the past, brief awakenings were often discounted as "noise," but they are now recognized as an essential element of sleep architecture (Dijk and Kronauer 1999
; Halasz et al. 2004
; Lo et al. 2002
, 2004
).
|
To examine the dynamics inherent to this circuitry, we developed a deterministic model based on interactions among wake-, sleep-, and REM-active populations. By considering sleepwake behavior in the context of neuronal population activity, we incorporate tenets derived from previous modeling of neuronal populations and sleepwake behavior (Borbely 1982
; McCarley and Hobson 1975
; McCarley and Massaquoi 1986
; Tobler et al. 1992
; Wilson and Cowan 1972
) while targeting the role of network dynamics in behavioral state control. This model provides a novel framework for exploring dynamical principles that underlie normal sleepwake physiology as well as physiology that may be altered with aging or in pathologic states like narcolepsy.
|
|
METHODS |
|---|
|
Although much of the physiology of sleepwake control is similar across mammalian species, the dynamics of interaction may vary. Therefore we restrict our attention to the mouse sleepwake network. The neuronal populations included in our definition of this network are the locus coeruleus (LC), tuberomammillary nucleus (TMN), dorsal raphe (DR), extended ventrolateral preoptic nucleus (eVLPO), ventrolateral preoptic cluster (VLPO), laterodorsal tegmental nucleus (LDT), and pedunculopontine tegmental nucleus (PPT). Each of these neuronal populations, summarized in Table 1, demonstrates state-dependent firing profiles; causal relationships between the activity of a given population and a particular behavioral state were previously established through extensive experimentation with site-specific lesions and neurotransmitter agonists and antagonists (Saper et al. 2005
).
|
LC, DR, and TMN are associated with the modeled wake-promoting population. The LC and DR are monoaminergic neuronal nuclei located in the brain stem that have long been associated with promoting vigilance and maintaining muscle tone (Aston-Jones and Bloom 1981
; Aston-Jones et al. 1986
; Hobson et al. 1975
; McGinty and Harper 1976
; Wu et al. 2003
). The TMN is a wake-promoting hypothalamic nucleus that represents the sole source of histamine in the brain (Sherin et al. 1998
; Takahashi et al. 2006
). Although orexin neurons are wake-active (Lee et al. 2005
; Mileykovskiy et al. 2004
) other aspects of their firing profiles and properties differ from the LC, DR, and TMN (Eggermann et al. 2003
; Li et al. 2002
). Therefore we model the effects of orexin signaling during wakefulness by state-dependently increasing the strength of inhibition from the wake- to the sleep-active populations.
The GABAergic/galaninergic VLPO and eVLPO (Chou et al. 2002
; Lu et al. 2000
; Sherin et al. 1998
) are associated with the modeled sleep-promoting population. Although the distinction between the VLPO cluster and eVLPO is not unanimously recognized, Saper, Lu, and colleagues previously reported anatomic and functional differences between the two: anatomic differences are based on cell density and efferent projections, whereas functional differences suggest that activity (as measured by the expression of fos) in the VLPO core is highly correlated with NREM sleep and activity in the eVLPO is highly correlated with REM sleep (Lu et al. 2000
, 2002
).
Cholinergic signaling from neurons in LDT/PPT has been directly linked to REM sleep in multiple experiments (Datta and Siwek 1997
; Siegel 2005
; Steriade et al. 1990
; Thakkar et al. 1998
). Subpopulations in the LDT/PPT that are mainly active during REM sleep are associated with the modeled REM-promoting population. Although we do not include a separate population of GABAergic REM-active neurons in our model, we include a mechanism for increasing the strength of (GABAergic) inhibition to the wake-active populations immediately preceding and during each REM bout. We attribute this increased inhibition to activation of the eVLPO, but other GABAergic populations (Lu et al. 2006
; Maloney et al. 1999
) could be responsible.
Because we are focusing on the dynamics of network interactions, the changes in state-dependent activity within these populations are important. Experimental data suggest that transitions in neuronal firing rates are slower than the changes in the electroencephalogram (EEG). For example, in LC neurons, the mean firing rate decreases over the 100 s preceding NREM sleep; the transition from low firing rates during NREM sleep to essentially silent behavior during REM sleep occurs gradually; and firing rates jump quickly at the onset of (or a few seconds before) wakefulness (Aston-Jones and Bloom 1981
; Hobson et al. 1975
). Transition periods have been considered in other populations in the sleepwake network [DR (Lydic et al. 1983
), TMN (Takahashi et al. 2006
), VLPO (Szymusiak et al. 1998
), LDT/PPT (Steriade et al. 1990
)], but complete time course data have not been reported. Because each of the abstract wake-, sleep-, and REM sleep-promoting populations in the current model combines the features of several physiologic neuronal populations, our model does not reproduce firing rate or time course data. Instead, our model describes heuristic activity levels ranging between 0 and 1 and transitions between levels of high and low activity are fast, similar to the changes observed in the EEG.
Model formulation
From the physiology reviewed earlier, we extracted a reduced network of three coupled wake-, sleep-, and REM-active neuronal populations (denoted W, S, and R, respectively) as shown in Fig. 2. Individual neurons in these populations demonstrate spontaneous firing (Morairty et al. 2004
; Sakai and Crochet 2000
; Steriade et al. 1990
; Taddese and Bean 2002
; Williams et al. 1984
); because the populations tend to exhibit cohesive activity, this suggests spontaneous activity of the population as a whole. In addition, cyclic attributes of brief awakenings and REM bouts were previously reported (Endo et al. 1998
; Halasz et al. 2004
). Based on these oscillatory and excitable properties, a heuristic level of activity of each population in the reduced network is modeled by relaxation oscillator equations (Morris and Lecar 1981
; see APPENDIX for details).
|
For population j = W, S, and R, the variables vj and uj are governed by relaxation oscillator equations
![]() |
![]() |
<< 1; the full model equations are presented in the APPENDIX. Population-dependent parameters (Table A1 in the APPENDIX) determine slightly different intrinsic properties for W, S, and R. The "smallness" of
quantifies the order of magnitude separating rates of change in vj and uj and introduces two timescales: t and
t. This permits the model to describe activity on multiple timescales: as previously described, population activity levels change quickly between states and slowly within states.
|
![]() |
![]() |
Nullclines of this form may assume three possible distinct relative configurations (Fig. 3). It is known from standard stability theory (Guckenheimer and Holmes 1983
) that under these conditions, the trajectory associated with network behavior will remain close to the point p at which Nv and Nu intersect if p is on the left or right branch of Nv; if p is on the middle branch of Nv, the trajectory will oscillate around p. Thus the location of p specifies default behavior of the associated population and varies with behavioral state:
|
Connectivity of the model network
As previously mentioned, connectivity of the reduced network in Fig. 2 is based on anatomical connectivity of the neuronal populations of the sleepwake network. For example, the experimentally identified GABAergic projection from VLPO to TMN (Sherin et al. 1998
) is represented as an inhibitory connection from S to W in the reduced network. Population-specific coupling effects, denoted by cj, are introduced into the model equations through the dvj/dt equations as follows
![]() |
![]() |
![]() |
![]() |
W aLC) reflects the self-inhibition present in the wake-promoting populations (McCarley and Hobson 1975The saturating functions gW(tW) and gS(tS) describe the activation of inhibition as a function of time elapsed since the onset of the wake (tW) or sleep (tS) bout, respectively. These functions describe the mutual inhibition between W and S as well as the inhibition of R by both W and S. The form of these functions enforces the state dependency of coupling effects: activation of the function is initiated by a high level of activity in the presynaptic population because neuronal activity drives neurotransmitter release. The time course of activation of these saturating functions captures the hypothesized time course of population recruitment; this effect is absent from the relaxation oscillation equations themselves. The saturating function gOX(tW) describes the activation of orexinergic effects as a function of time elapsed since the onset of the wake bout. The exact form of these equations is given in the APPENDIX.
Coupling terms determine the state-dependent nullcline configurations of each population. During NREM sleep, the initial inhibition from S to W causes the nullclines associated with W to assume an oscillatory (rather than inactive) configuration. This is consistent with the spontaneous (intrinsic) activity exhibited by these populations (Taddese and Bean 2002
; Williams et al. 1984
). All other coupling terms impose an inactive configuration on the nullclines associated with the postsynaptic population. Our choice of parameters is based on achieving this state-dependent geometry.
The behavioral state of the network is classified by the heuristic activity level of W, S, and R. If vW or vR exceeds the "activity threshold" delimiting the onset of population activity, then the network is assumed to be in wake or REM sleep, respectively. The network enters NREM sleep when vS exceeds the activity threshold and vW and vR do not. By imposing additional conditions for NREM sleep, we eliminate ambiguity in scoring simulated behavioral states. For the simulation results we report, 0.5 is taken to be the "activity threshold"; however, because onset and offset of activity in these populations are fast, there is minimal dependence on the choice of threshold separating active and inactive states.
Homeostatic sleep drives and scaling variables
Initiation and consolidation of human sleep has been modeled as the interaction of circadian and homeostatic drives known as process C and process S, respectively (Borbely 1982
). Circadian drive influences behavior according to time of day, whereas homeostatic sleep drives help maintain fixed daily amounts of NREM and REM sleep by promoting sleep in proportion to preceding waking behavior. The two-process model has been adapted to other mammals (Tobler et al. 1992
), including those with polyphasic sleepwake behavior, by identifying species-specific time courses for homeostatic sleep drive and modifying effects of circadian drive.
Because sleepwake behavior persists in the absence of a functional circadian pacemaker, we make the simplifying assumption that circadian drives constitute a modulation, rather than an intrinsic dynamic element, of behavioral state control. Therefore in the present study, we restrict our focus to network dynamics driven by homeostatic effects.
Selective sleep-deprivation protocols suggest the existence of separate homeostatic sleep drives for NREM and REM sleep. Agents of REM sleep homeostasis remain unknown, but several factors have been proposed to mediate NREM homeostatic drive (Porkka-Heiskanen et al. 2000
; Strecker et al. 2000
). The best studied of these is adenosine. Adenosine concentrations rise during both spontaneous waking and waking during sleep deprivation; during sleep these concentrations fall in several brain regions including the preoptic area of the hypothalamus (Porkka-Heiskanen et al. 2000
). High adenosine levels reduce the frequency of inhibitory postsynaptic potentials (IPSPs) on VLPO neurons (Chamberlin et al. 2003
; Morairty et al. 2004
), thus providing a mechanism for the production of sleep. Adenosine may also act through other mechanisms (Scammell et al. 2001
), particularly in basal forebrain (Porkka-Heiskanen et al. 1997
; Strecker et al. 2000
), and much remains to be learned about sleep-promoting factors in general.
Based on our current understanding of adenosine, we model homeostatic sleep drive with a variable h that rises during wakefulness, falls during sleep, and scales the strength of inhibition from W to S. Such a mechanism is also consistent with adenosine acting in the basal forebrain (Porkka-Heiskanen et al. 1997
). The behavior of h is effectively described by
![]() |
hW and
hS are time constants controlling the growth and decay of h during wake and sleep, respectively; and nh is a noise term. To obtain the appropriate reduction in inhibition from W to S, gW(tW) is multiplied by (1 h) in cW; thus the strength of inhibition from W to S varies inversely with h.
In the absence of an identified agent of REM homeostasis, our implementation of homeostatic REM drive is based on phenomenological observations pertaining to REM sleep (Benington 2002
; Endo et al. 1997
, 1998
; Franken 2002
; Le Bon et al. 2002
; McCarley and Hobson 1975
). Experiments suggest that the occurrence of REM sleep is associated with both excitation (or disinhibition) of REM-active populations and a gating mechanism involving a reduction of activity in wake-active populations (Franken 2002
; McCarley and Hobson 1975
). Therefore the initiation of REM sleep in our model depends on a REM-promoting force r and a scaling variable eV that increases the strength of r when W is inactive. Based on a model proposed by Franken (2002)
, the variable r is composed of two processes, rf and rs, acting on different timescales: r = rf + rs. The fast process, denoted rf in our model, is involved in timing REM sleep within a sleep bout and is governed by
![]() |
and
rf are parameters describing the maximal value and time constant of rf, respectively; rf is reset to zero by the occurrence of a REM bout.
The slow process, denoted rs in our model, regulates the daily amount of REM sleep and is governed by the equation
![]() |
The gating mechanism involving reduced activity in wake-active populations is modeled with the variable eV: this variable scales both inhibition to W and excitation to R (refer to definition of cW and cR). Our implementation of an eV-scaled excitation to R is based on observations that eVLPO fos expression is correlated with REM sleep (Lu et al. 2002
) and represents disinhibition of R through indirect pathways: eVLPO neurons inhibit monoaminergic populations represented by W and other populations (e.g., GABAergic neurons in ventrolateral periaqueductal gray matter) that inhibit LDT/PPT (Lu et al. 2002
). The variable eV is governed by the equation
![]() |
eV is a parameter controlling the rate of growth of eV; the occurrence of a REM bout resets eV to 0. Numerical implementation
The resulting model consists of 12 differential equations and 40 parameters. To reproduce the "noisiness" inherent in any biological system, we introduced stochastic terms into four of the differential equations in our system: dh/dt and dvj/dt for j = W, S, and R. The stochastic terms were normally distributed with mean 0 and variance 0.25, 1, 1, and 20, respectively; at each time step, new values were generated for the stochastic terms and the differential equations were modified accordingly.
All simulations were run on a Linux workstation using the ordinary differential equation (ODE) solver XPPAUT (developed by GB Ermentrout and available at (ftp://ftp.math.pitt.edu/pub/bardware). A RungeKutta integration method with step size 0.01 (min) was used for all simulations. Simulation output was analyzed using code written in MATLAB (The MathWorks, Natick, MA).
|
|
RESULTS |
|---|
|
|
To better understand dynamic principles of the network and mechanisms of transitions between states, we analyzed the mathematical structure of the network equations in the absence of noise. Complete mathematical details are beyond the scope of this paper, although the METHODS section provides an overview of our approach. By exploiting both the separation of timescales within the network equations and the state-dependent relevance of variables, we were able to reduce the dimension of the system in a state- and population-dependent manner. Through this reduction, we identified a sequence of low-dimensional systems that approximated the behavior of the full system and provided a structured framework for understanding mechanisms of state transitions and parameter dependency in our model.
Mechanisms for state transitions
Each low-dimensional system includes the population variables (vj and uj) associated with one of the wake-, sleep-, or REM-active populations. Thus within these systems we could examine network dynamics in terms of nullclines associated with population variables. This analysis resulted in the following predicted mechanisms for each state transition.
The transition from wake to (NREM) sleep is initiated by the homeostatic NREM sleep drive, described by the variable h. During wakefulness h increases and the strength of inhibition from W to S varies inversely with h. When the strength of inhibition is no longer sufficient to prevent the onset of activity in S, the "flip-flop" switch flips: activation of S initiates inhibition from S to W and transitions the network from sustained wake to sleep (Fig. 5). In the coupled oscillator literature, this mechanism is known as "intrinsic escape" (Skinner et al. 1994
; Wang and Rinzel 1992
).
|
As the sleep bout progresses, short-term homeostatic REM pressure increases the strength of inhibition to W and the excitation to R. When inhibition to W is sufficiently strong, the W nullclines move to an inactive configuration and oscillation in W activity ceases. The complete cessation of activity in W results in further disinhibition of R; if homeostatic REM sleep drive is sufficiently strong, a REM bout occurs.
In our model, a REM bout corresponds to a single excursion (of relaxation oscillation-type) in R; thus the form and duration of the REM bout result from intrinsic properties of REM-active populations. A combination of excitation and disinhibition permits the intrinsic escape of R; however, the activation of R completely discharges short-term REM pressure and reduces long-term REM pressure: the resulting drop in total REM pressure reverses both the excitation to R and the disinhibition of W. Thus R returns to relative inactivity after its excursion and the REM bout activates W: depending on the state of the network, this may generate a post-REM brief awakening or a full transition to sustained wake.
The transition from NREM sleep to wake involves a more subtle mechanism than those associated with other state transitions. As previously described, brief episodes of activity in W result in pulses of inhibition from W to S. In contrast to the expected behavior of a pure flip-flop switch, this activity does not necessarily transition the network from sleep to sustained wake: instead, switching between states depends on the strength of this pulse. If the pulse sufficiently depresses activity in S, the network will transition from sleep to wake; otherwise, the activity in W self-terminates with the falling phase of the oscillation and the sleep bout continues. These possibilities are illustrated in Fig. 6.
|
Model sensitivity to parameters
Our model parameters fall into three categories based on the variables they modify: parameters associated with intrinsic properties of W, S, or R; parameters involved in coupling effects; and parameters associated with homeostatic sleep drives. Parameters and their typical values are listed in Tables A1 and A2 of the APPENDIX.
|
As long as the geometry of the equations is preserved, parameter changes have relatively minor effects on network behavior. Changes to the first category of parameters alter the shape of the nullclines associated with each population; nullcline shape (both cubic and sigmoidal), and thus model behavior, is very robust to minor changes in these parameters. The second and third categories of parameters determine state-dependent nullcline configurations and intrastate changes to these configurations. Minor variation of these parameters does not significantly alter network dynamics; however, if parameter variation results in a significant change in the number of brief awakenings observed in a stereotypical sequence of behavior, quantitative measures of sleepwake behavior will be affected.
For example, the number of brief awakenings in simulated sleepwake behavior varies inversely with the maximal strength of inhibition from S to W (gSmax); network behavior is less sensitive to changes in the maximal strength of inhibition from W to S (gWmax). If gSmax is increased or decreased by >2 or 3%, altered sleepwake behavior will be reflected by changes in a range of measures: distributions of wake and NREM bout durations (fewer brief awakenings results in consolidation of NREM bouts), the number and mean durations of wake and NREM bouts, and percentage of time spent in each state. If the increase in gSmax is sufficient (>10% of baseline value) to eliminate all brief awakenings, then the network loses its transition mechanism from sleep to sustained wake and exhibits constant sleep.
Similarly, changing the rate of activation of inhibition from W to S (
W) affects the number of brief awakenings in each stereotypical sequence of behavior. If activation is instantaneous or the rate is increased by >40% of its baseline value, brief awakenings (with concurrent activity in W and S) are eliminated and the network rapidly oscillates between wake and NREM sleep. If the rate is decreased, additional brief awakenings occur. Network behavior is not sensitive to changes in the rate of activation from S to W (
S).
Most of the parameters associated with homeostatic sleep drives (suggestively denoted
i) are time constants describing the evolution of variables that scale coupling strengths in the network. Based on the mechanisms of transitions previously discussed, we expect all transitions, with the exception of the transition from the extended sleep bout to the sustained wake bout, to depend smoothly on these parameters. Simulation results support this conclusion: numbers of all bout types and mean durations of sustained wake and NREM bouts vary with parameters associated with coupling and homeostatic sleep drives.
The exception in smooth dependency arises because, in the absence of noise, the transition from sleep to sustained wake depends on activation of W in the form of a brief awakening. This brief awakening may be intrinsic or may occur following REM sleep; however, transitions to sustained wake are most often caused by post-REM brief awakenings (in both simulated and experimental data). Therefore the duration of extended sleep bouts tends to change in (discrete) units of sleep cycles rather than continuously with varying parameters.
Simulated mouse sleepwake behavior
With the addition of noise, our model circuitry reproduces experimentally observed sleepwake behavior including proportions of wake, NREM sleep, and REM sleep; number and duration of bouts; and realistic sleep architecture as measured by transition probabilities. Figure 7 summarizes 2 h of simulated mouse behavior and can be qualitatively compared with Fig. 1. In Figs. 8 and 9, we compare the simulated sleepwake behavior described by our model with previously published experimental data from eight male C57BL/6J mice (Mochizuki et al. 2004
); a discussion of methods used to collect these data is described in the original paper. Simulated behavior was generated with eight runs of the model under a single set of parameters with different initial conditions and random noise.
|
|
|
Our model reproduces experimentally observed daily (24-h) percentages of time spent in wake, NREM sleep, and REM sleep (Fig. 8A). By considering percentages of time spent in each behavioral state over 24 h, we mitigate circadian dependency to reveal underlying homeostatic equilibria. The model produces slightly less REM sleep than is observed experimentally; the source of this difference is a discrepancy in the duration, rather than the raw number, of REM bouts between the model and the experimental data. The close agreement between our model results and experimental data for daily percentages of wake, NREM sleep, and REM sleep suggests that the time constants of homeostatic drives in the model are tuned to biophysically reasonable values.
Number and duration of bouts
Because mouse sleepwake behavior is polyphasic, daily amounts of wake, NREM sleep, and REM sleep are composed of many bouts of varying lengths. Scoring behavior in 10-s epochs, Mochizuki and colleagues identified mean numbers and durations for bouts of each behavioral type. As described in the INTRODUCTION, we will consider brief and sustained wake bouts separately.
The mean durations (Fig. 8B) and average numbers (Fig. 8C) of bouts of each behavioral type show good agreement between the model and the experimental data, although the model has fewer brief wake bouts than the experimental data. The discrepancy between the simulated and experimental mean durations of sustained wake bouts probably occurs because our model lacks circadian effects that promote very long wake bouts. Mean bout durations for the other behavioral states show close agreement.
Because bout durations are nonnormally distributed (Lo et al. 2004
), we compare the distributions of simulated and experimentally observed bout lengths (Fig. 9). The model captures the relative frequency of each type of wake bout. We measure durations in minutes instead of seconds because very extended wake bout durations occur during the dark period. The slightly lower number of brief (0- to 2-min) wake bouts in model data could be explained by the absence of brief awakenings triggered by uncontrolled environmental factors (occasional noise, vibration, etc.).
There was good qualitative agreement between the model and experimental data in the distribution of NREM bout durations: bouts of NREM sleep were most likely to be <2 min in duration and nearly all bouts of NREM sleep fell in the range from 0 to 8 min in duration. There was a lower incidence of NREM bouts of 2- to 4-min duration and a higher incidence of NREM bouts of 4- to 8-min duration in the model compared with the experimental data; additional noise in the model, particularly random external stimuli, may fracture some of these longer bouts into bouts of shorter duration.
Most REM bouts fall in the first two bins (040 and 4080 s) in both the model output and the experimental data. The absence in model output of longer REM bouts observed in the experimental data accounts for the discrepancy between the percentage of REM sleep in the simulated and experimental data. This clustering of REM bout durations occurs because REM bouts are modeled as a single excursion of the variable vR; thus the duration of the excursion is controlled robustly by intrinsic properties of the equations governing vR and uR.
Organization of sleepwake behavior
To quantify the organization of sleepwake behavior, we computed probabilities of transitioning from one behavioral state to another (given that a state transition occurred). Stereotyped sleepwake patterns that emerge are often conserved across species: some transitions (e.g., wake
REM sleep) are never seen in normal behavior and can be considered "inappropriate," whereas others (e.g., NREM sleep
REM sleep) are common. Transition probabilities for simulated and experimental data (Fig. 8D) show similar structure; no inappropriate state transitions are produced by the model.
In addition to specific transitions from one state to another, stereotypical sequences of behavior are observed experimentally and clinically. One such sequence is the progression from NREM sleep to REM sleep to brief wakefulness and back to NREM sleep (Dijk and Kronauer 1999
). This sequence is observed repeatedly in our simulated behavior.
|
|
DISCUSSION |
|---|
|
Fine architecture of sleepwake behavior
A major feature of our model is its ability to describe the fine architecture of sleepwake behavior and, in particular, the incidence of brief awakenings. Brief awakenings are an important indicator of sleep quality and abnormal numbers and durations of brief awakenings have been associated with insomnia (Anderson et al. 2005
), sleep apnea (Loredo et al. 1999
), and compromised histamine H1 receptor signaling (Huang et al. 2006
). Although some brief awakenings occur in response to short, random sensory stimuli from uncontrolled environmental factors, the high incidence of brief awakenings throughout sleep suggests that environmental factors are not exclusively responsible.
Previous sleep modeling approaches did not address the occurrence of brief awakenings in sleepwake behavior. In classical two-process models (Borbely 1982
; Tobler et al. 1992
), the durations of wake and sleep bouts were governed by the time constants of homeostatic sleep drive and circadian phase; because the durations of brief awakenings cannot be linked logically to sleep homeostasis, they could not occur in this framework. The Chou (2003)
stochastic firing rate model of the sleepwake switch included brief awakenings but used a modeling approach that could not shed light on the dynamic mechanisms associated with the simulated behavior.
Tamakawa and colleagues (2006)
recently proposed a model of rat sleepwake behavior based on the physiology of sleepwake circuitry. Using formal neuron models of ten neuronal populations, including those described in our model, they produced simulated rat sleepwake behavior that matched experimentally determined mean durations of wake and sleep bouts. Based on the observation that simulated activity in the ten populations is essentially identical within state-dependent groups corresponding to wake, NREM sleep, REM sleep, and both wake and REM sleep, this is described as a "quartet model." As previously mentioned, we found it unnecessary to include a population with high levels of activity during wake and REM sleep. Both the quartet model and our model include two different homeostatic sleep drives: their SS1 variable is similar to our h variable, although it acts directly on the VLPO population; their SS2 variable increases during wake and REM sleep and modulates the population representing NREM sleep-active GABAergic neurons in the median preoptic area, thus functioning differently from our rs and rf variables. Although the quartet model is consistent with general measures of sleepwake behavior, such as mean duration and percentage of time in each state, additional work was needed to develop a modeling framework that could describe the fine architecture of sleepwake behavior.
By specifying an oscillatory regime for the equations associated with wake-active neuronal populations, our model includes a mechanism for wake bouts with durations that are governed by intrinsic properties of the population rather than homeostatic sleep drive. Thus simulated sleepwake behavior reflects the structure and organization of mouse sleepwake behavior; in particular, distributions of bout durations and the distinction between brief and sustained wake bouts are reproduced by the model. The absence of environmentally induced brief awakenings in our model may be responsible for the slightly lower number of brief awakenings in the simulated behavior compared with the experimental data.
Concurrent activity in wake- and sleep-active populations
By implementing the mutual inhibition of the flip-flop switch in the context of coupled relaxation oscillators, our approach captures the key feature of a sleepwake switchtwo stable states with minimal time spent in intermediate states (Saper et al. 2001
). A pure flip-flop switch mechanism is subject to inappropriate transitions in the presence of noise; in behaving animals, such inappropriate transitions would translate to potentially dangerous switches between wake and sleep. Our model also includes time courses associated with inhibition onset that maintain the robustness and stability necessary in a physiological system.
In our model there are certain conditions under which concurrent activity in wake- and sleep-active populations can occur. In particular, simulated brief awakenings occur when W becomes active for a short time during an extended sleep bout, but high homeostatic sleep drive prevents a transition into sustained wake. This theoretical mechanism for brief awakenings predicts that wake-promoting and VLPO neurons may be active concurrently during brief awakenings in mice.
Unfortunately, existing experimental data do not address the issue of concurrent activity in wake- and sleep-active populations. Unit recordings (Szymusiak et al. 1998
) and fos immunostaining (Sherin et al. 1996
) established that VLPO neurons are active during sleep, although the long half-life of fos cannot resolve VLPO activity during brief awakenings and unit recordings have been analyzed only during stable wake. Thus VLPO neurons may remain active during brief awakenings and additional experiments are needed to test this prediction.
A NREMREM flip-flop switch?
Lu and colleagues (2006)
recently proposed a conceptual model for NREMREM alternation involving mutual inhibition between GABAergic REM-on (sublaterodorsal nucleus) and REM-off (ventrolateral part of the periaqueductal gray matter and the lateral pontine tegmentum) populations. In this framework, increased activity in eVLPO inhibits monoaminergic populations, thereby removing excitation from REM-off populations. The resulting decrease of activity in REM-off populations results in disinhibition (and activation) of REM-on populations.
Our approach to NREMREM alternation during a sleep cycle is based on the classical view of interacting (REM-off) monoaminergic populations (W) and REM-on cholinergic populations (R) (McCarley and Hobson 1975
). However, our implementation is consistent with the theory that increased activity in the eVLPO results in disinhibition of REM-on neurons because we model increased inhibition of W over the course of the sleep cycle as a result of increased eVLPO activity.
In contrast to the idea of the NREMREM flip-flop switch, the disinhibition of R in our model is not mediated through REM-off neurons. Although the intermediate REM-off population is not necessary for modeling normal sleepwake behavior, REM-off neurons may be involved in other regulatory aspects of REM phenomena (Lu et al. 2006
). Therefore we may need to extend our model to include a REM-off intermediary population in future work.
Technical considerations and future directions
By using relaxation oscillator equations to model each population, we imposed an assumption of fast transitions between high- and low-activity levels as demarcated by the knees of the cubic nullclines associated with v-variables. Although the model predicts some gradual changes in activity, such as the slow increase in activity of VLPO neurons preceding a transition to NREM sleep, it does not capture the timescales of changes on the level of single- or multiunit firing rates. As additional experiments establish time courses of activity for every population in the sleepwake network, future models of the network could incorporate these refinements. By describing the time courses of transitions, such models would represent increasingly complex network dynamics and may offer an important framework for exploring the relative dynamics and causal implications of firing rate changes among these populations.
The period of relaxation oscillations is relatively robust to noise, so the durations of simulated brief awakenings and REM bouts tend to be normally distributed around the characteristic period of the oscillations associated with the W and R equations, respectively. In experimental data, the durations of brief awakenings and REM bouts follow power law and exponential distributions, respectively. Therefore although our simple implementation of noise was sufficient to reproduce the major statistical features of mouse sleepwake behavior, relaxation oscillator formalism limits our ability to fully capture all the properties of the distributions of bout durations. Formal analysis of the implementation of noise including an assessment of the type of noise used and the placement of stochastic terms in the model equationsmight improve some of these statistical features of the simulated data.
The interaction between the circadian system and sleepwake behavior has been studied extensively and recent experiments established some of the neural circuitry involved in this interaction. Our model does not yet capture circadian effects, such as hourly variations in the amounts of wake and sleep, extended wake bouts at the onset of the dark period, and nonuniform distribution of REM sleep (Mochizuki et al. 2004
). Future studies will integrate circadian effects into this model and should provide an excellent opportunity to explore how the circadian system modulates sleepwake dynamics.
Our model provides a novel framework for understanding dynamics observed in altered sleepwake behavior, especially when physiologic observations have analogs in the model parameters. For example, disruption of sleep with aging may be linked to a loss of VLPO neurons (Gaus et al. 2002
). In our model, this would correspond to a decrease in the parameter gSmax representing the maximal strength of inhibition from S to W, and we find that decreasing gSmax increases the number of brief awakenings in simulations. As another example, it remains unclear how a loss of orexin signaling causes the behavioral state instability associated with narcolepsy (Mochizuki et al. 2004
). Because narcolepsy is essentially a disorder of sleepwake dynamics, our model framework is well suited for investigating the functional role of orexin neurons. A full theoretical understanding of the dynamic effects of changes in the model may suggest mechanisms of age- and orexin-related changes in sleepwake behavior.
In summary, we have shown that a model of three coupled relaxation oscillators can generate the network dynamics associated with behavioral state control to realistically simulate mouse sleepwake behavior. By directly addressing the dynamics of the sleepwake network, this modeling approach may provide predictions and insights that improve our understanding of normal and pathologic sleepwake behavior and its underlying physiology.
|
|
APPENDIX |
|---|
|
![]() |
![]() |
are constant parameters (Morris and Lecar 1981
, u
, and
ui are functions defined below. Because we are describing population activity rather than membrane voltage, we rescaled these equations with the affine transformation A(v) = (v + 65)/130 =
. Then
assumes values between 0 and 1, and
![]() |
![]() |
![]() |
i,
i,
i,
i,
i, and
i are constant parameters (parameter values are listed in Table A1); the coupling terms ci are given in the text; and the functions u
u As previously described, we chose MorrisLecar relaxation oscillation equations for the geometry of the nullclines associated with vi and ui for i = W, S, R. Because these equations are usually associated with single-cell activity rather than population activity, the timescales associated with our modified relaxation oscillator equations are much slower than the timescales involved in the original MorrisLecar equations.
The saturating functions describing the onset of inhibition from S and W, respectively, are given by the following equations
![]() |
![]() |
S, and
W. The variables ts and tw measure time elapsed since the onset of the current wake or sleep bout and are governed by
![]() |
![]() |
![]() |
The equations for m
(vi), u
(vi), and
u(vi) are given, respectively, by
![]() |
![]() |
![]() |
{u,uw},
{m,u,uw}, and
{m,u,uw}. The state-dependent equations for h, rs, rf, and eV were given in the main text. The parameter values used to generate simulated behavioral data are listed in Tables A1 and A2.
|
|
GRANTS |
|---|
|
|
|
ACKNOWLEDGMENTS |
|---|
|
Present address of C. Diniz Behn: Division of Sleep Medicine, Harvard Medical School, and the Department of Neurology, Beth Israel Deaconess Medical Center, Boston, MA.
|
|
FOOTNOTES |
|---|
Address for reprint requests and other correspondence: C. Diniz Behn, Department of Neurology, Beth Israel Deaconess Medical Center, 77 Avenue Louis Pasteur, Boston, MA 02115 (E-mail: cbehn{at}bidmc.harvard.edu)
|
|
REFERENCES |
|---|
|
Aston-Jones G, Bloom F. Activity of norepinephrine-containing locus coeruleus neurons in behaving rats anticipates fluctuations in the sleep-waking cycle. J Neurosci 1: 876886, 1981.[Abstract]
Aston-Jones G, Ennis M, Pieribone V, Nickell WT, Shipley M. The brain nucleus locus coeruleus: restricted afferent control of a broad efferent network. Science 234: 734737, 1986.
Benington J.Debating how REM sleep in regulated (and by what). J Sleep Res 11: 2933, 2002.[CrossRef][Web of Science][Medline]
Blumberg M, Seelke A, Lowen S, Karlsson KA. Dynamics of sleep-wake cyclicity in developing rats. Proc Natl Acad Sci USA 102: 1486014864, 2005.
Borbely A. A two process model of sleep regulation. Hum Neurobiol 1: 195204, 1982.[Medline]
Chamberlin N, Arrigoni E, Chou T, Scammell T, Greene R, Saper C. Effects of adenosine on GABAergic synaptic inputs to identified ventrolateral preoptic neurons. Neuroscience 119: 913918, 2003.[CrossRef][Web of Science][Medline]
Chou T. Regulation of SleepWake Timing: Circadian Rhythms and Bistability of SleepWake States (PhD thesis). Cambridge, MA: Harvard Univ, 2003, p. 8299.
Chou T, Bjorkum A, Gaus S, Lu J, Scammell T, Saper C. Afferents to the ventrolateral preoptic nucleus. J Neurosci 22: 977990, 2002.
Datta S, Siwek D. Excitation of the brain stem pedunculopontine tegmentum cholinergic cells induces wakefulness and REM sleep. J Neurophysiol 77: 29752988, 1997.
Datta S, Siwek D. Single cell activity patterns of pedunculopontine tegmentum neurons across the sleep-wake cycle in the freely moving rats. J Neurosci Res 70: 611621, 2002.[CrossRef][Web of Science][Medline]
Dijk DJ, Kronauer R. Commentary. Models of sleep regulation: successes and continuing challenges. J Biol Rhythms 14: 569573, 1999.
Eggermann E, Bayer L, Seraffin M, Saint-Mleux B, Bernheim L, Machard D, Jones B, Muhlethaler M. The wake-promoting hypocretin-orexin neurons are in an intrinsic state of membrane depolarization. J Neurosci 23: 15571562, 2003.
Endo T, Roth C, Landolt H,Werth E, Aeschbach D, Achermann P, Borbely A. Selective REMS deprivation in humans: effects on sleep and sleep EEG. Am J Physiol Regul Integr Comp Physiol 274: R1186R1189, 1998.
Endo T, Schwierin B, Borbely A, Tobler I. Selective and total sleep deprivation : effect on the sleep EEG in the rat. J Psychiatry Res 66: 97110, 1997.[CrossRef]
Franken P. Long-term vs. short-term processes regulating REM sleep. J Sleep Res 11: 1728, 2002.[CrossRef][Web of Science][Medline]
Gaus S, Strecker R, Tate B, Parker R, Saper C. Ventrolateral preoptic nucleus contains sleep-active, galaninergic neurons in multiple mammalian species. Neuroscience 115: 285294, 2002.[CrossRef][Web of Science][Medline]
Guckenheimer J, Holmes P.Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields. New York: Springer-Verlag, 1983.
Halasz P, Terzano M, Parrino L, Bodizs R.The nature of arousal in sleep. J Sleep Res 13: 123, 2004.[CrossRef][Web of Science][Medline]
Hobson J, McCarley R, Wyzinski P. Sleep cycle oscillation: reciprocal discharge by two brainstem neuronal groups. Science 189: 5558, 1975.
Hodgkin A, Huxley A.A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol 117: 500544, 1952.
Huang Z-L, Mochizuki T, Qu W-M, Hong Z-Y, Watanabe T, Urade Y, Hayaishi O. Altered sleep-wake characteristics and lack of arousal response to H3 receptor antagonist in histamine H1 receptor knockout mice. Proc Natl Acad Sci USA 103: 46874692, 2006.
Le Bon O, Staner L, Rivelli S, Hoffmann G, Pelc I, Linkowski P. Correlations using the NREM-REM sleep cycle frequency support distinct regulation mechanisms for REM and NREM sleep. J Appl Physiol 93: 141146, 2002.
Lee M, Hassani O, Jones B. Discharge of identified orexin/hypocretin neurons across the sleep-waking cycle. J Neurosci 25: 67166720, 2005.
Li Y, Gao XB, Sakurai T, van den Pol A. Hypocretin/orexin excites hypocretin neurons via a local glutamate neurona potential mechanism for orchestrating the hypothalamic arousal system. Neuron 36: 11691181, 2002.[CrossRef][Web of Science][Medline]
Lo C, Amaral L, Havlin S, Ivanov P, Penzel T, Peter J, Stanley H. Dynamics of sleep-wake transitions during sleep. Europhys Lett 57: 625631, 2002.[CrossRef][Web of Science]
Lo C, Ivanov P, Chou T, Penzel T, Scammell T, Strecker R, Stanley H. Common scale-invariant pattern of sleep-wake transitions across mammalian species. Proc Natl Acad Sci USA 101: 1754517548, 2004.
Loredo J, Ziegler M, Ancoli-Israel S, Clausen J, Dimsdale J. Relationship of arousals from sleep to sympathetic nervous system activity and BP in obstructive sleep apnea. Chest 116: 655659, 1999.[CrossRef][Web of Science][Medline]
Lu J, Bjorkum A, Xu M, Gaus S, Shiromani P, Saper C. Selective activation of the extended ventrolateral preoptic nucleus during rapid eye movement sleep. J Neurosci 22: 45684576, 2002.
Lu J, Greco M, Shiromani P, Saper C. Effect of lesions of the ventrolateral preoptic nucleus on NREM and REM sleep. J Neurosci 20: 38303842, 2000.
Lu J, Sherman D, Devor M, Saper C. A putative flip-flop switch for control of REM sleep. Nature 441: 589594, 2006.[CrossRef][Medline]
Lydic R, McCarley R, Hobson J. The time-course of dorsal raphe discharge, PGO waves, and muscle tone averaged across multiple sleep cycles. Brain Res 274: 365370, 1983.[CrossRef][Web of Science][Medline]
Maloney K, Mainville L, Jones B. Differential c-fos expression in cholinergic, monoaminergic, and GABAergic cell groups of the pontomes-encephalic tegmentum after paradoxical sleep deprivation and recovery. J Neurosci 19: 30573072, 1999.
McCarley R, Hobson J. Neuronal excitability modulation over the sleep cycle: a structural and mathematical model. Science 189: 5860, 1975.
McCarley R, Massaquoi S. A limit cycle mathematical model of the REM sleep oscillator system. Am J Physiol Regul Integr Comp Physiol 251: R1011R1029, 1986.
McGinty D, Harper R. Dorsal raphe neurons: depression of firing during sleep in cats. Brain Res 101: 569575, 1976.[CrossRef][Web of Science][Medline]
Mileykovskiy B, Kiyashchenko L, Siegel J. Behavioral correlates of activity in identified hypocretin/orexin neurons. Neuron 46: 787798, 2004.[CrossRef][Web of Science]
Mochizuki T, Crocker A, McCormack S, Yanagisawa M, Sakurai T, Scammell T. Behavioral state instability in orexin knock-out mice. J Neurosci 24: 62916300, 2004.
Morairty S, Rainnie D, McCarley R, Greene R. Disinhibition of ventrolateral preoptic area sleep-active neurons by adenosine: a new mechanism for sleep promotion. Neuroscience 123: 451457, 2004.[CrossRef][Web of Science][Medline]
Morris C, Lecar H. Voltage oscillations in the barnacle giant muscle fiber. J Biophysiol 35: 193213, 1981.[CrossRef]
Porkka-Heiskanen T, Strecker R, McCarley R. Brain site-specificity of extracellular adenosine concentration changes during sleep deprivation and spontaneous sleep: an in vivo microdialysis study. Neuroscience 99: 507517, 2000.[CrossRef][Web of Science][Medline]
Porkka-Heiskanen T, Strecker R, Thakkar M, Bjorkum A, Greene R, McCarley R. Adenosine: a mediator of the sleep-inducing effects of prolonged wakefulness. Science 276: 12651269, 1997.
Sakai K, Crochet S. Serotonergic dorsal raphe neurons cease firing by disfacilitation during paradoxical sleep. Neuroreport 11: 32373241, 2000.[Web of Science][Medline]
Saper C, Chou T, Scammell T. The sleep switch: hypothalamic control of sleep and wakefulness. Trends Neurosci 24: 726731, 2001.[CrossRef][Web of Science][Medline]
Saper C, Scammell T, Lu J. Hypothalamic regulation of sleep and circadian rhythms. Nature 437: 12571263, 2005.[CrossRef][Medline]
Scammell T, Gerashchenko D, Mochizuki T, McCarthy M, Estabrooke I, Sears C, Saper C, Urade Y, Hayaishi O. An adenosine a2a agonist increases sleep and induces fos in ventrolateral preoptic neurons. Neuroscience 107: 653663, 2001.[CrossRef][Web of Science][Medline]
Sherin J, Elmquist J, Torrealba F, Saper C. Innervation of histaminergic tuberomammillary neurons by GABAergic and galaninergic neurons in the ventrolateral preoptic nucleus of the rat. J Neurosci 18: 47054721, 1998.
Sherin J, Shiromani P, McCarley R, Saper C. Activation of ventrolateral preoptic neurons during sleep. Science 196: 678680, 1996.[CrossRef]
Siegel J. Clues to the functions of mammalian sleep. Nature 437: 12641271, 2005.[CrossRef][Medline]
Skinner F, Kopell N, Marder E. Mechanisms for oscillation and frequency control in reciprocally inhibitory model neural networks. J Comput Neurosci 1: 6987, 1994.[CrossRef][Medline]
Steriade M, Datta S, Paré D, Oakson G, Curro Dossi R. Neuronal activities in brain-stem cholinergic nuclei related to tonic activation processes in thalamocortical systems. J Neurosci 10: 25412559, 1990.[Abstract]
Strecker R, Morairty S, Thakkar M, Porkka-Heiskanen T, Basheer R, Dauphin L, Rainnie D, Portas C, Greene R, McCarley R. Adenosinergic modulation of basal forebrain and preoptic/anterior hypothalamic neuronal activity in the control of behavioral state. Behav Brain Res 115: 183204, 2000.[CrossRef][Web of Science][Medline]
Szymusiak R, Alam N, Steininger T, McGinty D. Sleep-waking discharge patterns of ventrolateral preoptic/anterior hypothalamic neurons in rats. Brain Res 803: 178188, 1998.[CrossRef][Web of Science][Medline]
Taddese A, Bean B. Subthreshold sodium current from rapidly inactivating sodium channels drives spontaneous firing of tuberomammillary neurons. Neuron 33: 587600, 2002.[CrossRef][Web of Science][Medline]
Takahashi K, Lin J-S, Sakai K. Neuronal activity of histaminergic tuberomammillary neurons during wake-sleep states in the mouse. J Neurosci 26: 1029210298, 2006.
Tamakawa Y, Karashima A, Koyama Y, Katayama N, Nakao M. A quartet neural system model orchestrating sleep and wakefulness mechanisms. J Neurophysiol 95: 20552069, 2006.
Thakkar M, Strecker R, McCarley R. Behavioral state control through differential serotonergic inhibition in the mesopontine cholinergic nuclei: a simultaneous unit recording and microdialysis study. J Neurosci 18: 54905497, 1998.
Tobler I, Franken P, Trachsel L, Borbely A. Models of sleep regulation in mammals. J Sleep Res 1: 125127, 1992.[Medline]
Wang XJ, Rinzel J. Alternating and synchronous rhythms in reciprocally inhibitory model neurons. Neural Comput 4: 8497, 1992.[CrossRef][Web of Science]
Williams J, North R, Shefner S, Nishi S, Egan T. Membrane properties of rat locus coeruleus neurons. Neuroscience 13: 137156, 1984.[CrossRef][Web of Science][Medline]
Wilson HR, Cowan JD. Excitatory and inhibitory interactions in localized populations of model neurons. Biophys J 12: 124, 1972.[Web of Science][Medline]
Wu M, John J, Boehmer L, Yau D, Nguyen G, Siegel J. Activity of dorsal raphe cells across the sleep-waking cycle and during cataplexy in narcoleptic dogs. J Physiol 554: 202215, 2003.[CrossRef][Web of Science]
This article has been cited by other articles:
![]() |
S. Postnova, K. Voigt, and H. A. Braun A Mathematical Model of Homeostatic Regulation of Sleep-Wake Cycles by Hypocretin/Orexin J Biol Rhythms, December 1, 2009; 24(6): 523 - 535. [Abstract] [PDF] |
||||
![]() |
C.-y. T. Li, M.-m. Poo, and Y. Dan Burst Spiking of a Single Cortical Neuron Modifies Global Brain State Science, May 1, 2009; 324(5927): 643 - 646. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. D. Eban-Rothschild and G. Bloch Differences in the sleep architecture of forager and young honeybees (Apis mellifera) J. Exp. Biol., August 1, 2008; 211(15): 2408 - 2416. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. G. Diniz Behn, N. Kopell, E. N. Brown, T. Mochizuki, and T. E. Scammell Delayed Orexin Signaling Consolidates Wakefulness and Sleep: Physiology and Modeling J Neurophysiol, June 1, 2008; 99(6): 3090 - 3103. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |