UP-DOWN cortical dynamics reflect state transitions in a bistable network

1A ubiquitous pattern of spontaneous cortical activity during synchronized brain states consists of the alternation between periods of tonic firing (UP states) and periods of quiescence (DOWN states). Cortical UP and DOWN dynamics take place during slow-wave-sleep (SWS) and can also be induced by a number of anesthetics. More recently however, similar synchronous cortical dynamics have been observed not only in awake rodents during quiescence, but also in animals performing a perceptual task, both rodents and monkeys.

2Spontaneous activity resembling UP and DOWN states has been found in cortical slices in vitro, in slabs and in vivo under extensive thalamic lesions. This suggests that the underlying mechanism has an intracortical origin. In such scenario, the standard hypothesis postulates that during UP periods a fatigue mechanism of cellular origin – e.g. spike frequency adaptation currents or synaptic short-term depression – decreases network excitability until the state of tonic firing can no longer be sustained and the cortical network switches into a DOWN state. During DOWN periods, in the absence of firing, the fatigue variables recover until the circuit becomes self-excitable and autonomously transitions into an UP state. This mechanism of activity dependent negative feedback causing oscillatory UP-DOWN dynamics has been implemented by several computational models. However, although commonly described as a slow oscillation, the rhythmicity of UP-DOWN dynamics has not been systematically quantified and seems to depend on the details of the preparation.

3Alternatively, there is strong evidence suggesting that UP-DOWN transitions in neocortical circuits are coupled with activity in subcortical and limbic areas. Thalamocortical neurons for instance can endogenously oscillate at low frequencies, cause cortical UP states when stimulated or modulate the UP-DOWN dynamics when suppressed and their spontaneous activity correlates with UP state onset. Moreover, the timing of hippocampal sharp-wave ripples, or basal ganglia activity also tends to precede DOWN to UP transitions. Finally, intracortical stimulation can effectively cause UP-DOWN transitions even when only a few dozen neurons are stimulated. In total, these findings describe a system whose macroscopic UP-DOWN dynamics are sensitive to temporal fluctuations of both external inputs and local circuit activity. Such a network would in principle generate unpredictable and therefore irregular UP-DOWN dynamics, since transitions are no longer dependent exclusively on local cortical internal dynamics.

4The interplay of fatigue mechanisms and fluctuations causing transitions between two states has been theoretically studied in the developing spinal cord, and in the context of UP-DOWN dynamics mostly in networks composed of excitatory units. Most models of spontaneous activity are however theoretically founded on the balance between excitatory (E) and inhibitory (I) populations, a dynamic state that can quantitatively mimic population spiking activity during desynchronized states. Analysis of cortical responses in the visual cortex suggest that cortical networks operate in the inhibition-stabilized regime, in which recurrent excitatory feedback alone is strong enough to destabilize the network activity but feedback inhibition maintains stability. In spite of growing evidence showing that the interaction between E and I populations is critical in generating spontaneous activity, the conditions under which an EI network model can exhibit a robust bistability between a low-rate inhibition-stabilized state and a quiescent state are still not well understood. To develop such a model, we first performed population recordings of ongoing cortical activity during synchronized brain state epochs in rats under urethane anesthesia. Analysis of population single-unit spiking dynamics, showed irregular UP and DOWN periods and no decay of the average rate during UPs. Given these constraints, we built an EI network model that, capitalizing on the firing threshold non-linearity and the asymmetry of the E and I transfer functions, exhibited a novel type of bistability with a quiescent (DOWN) and a low-rate state (UP). External input fluctuations into the network caused the irregular UP-DOWN transitions. Adaptation in E cells in contrast, did not cause transitions and had a different effect on the E rate in each of the two states: while it exhibited recovery during DOWN periods, it showed almost no decay during UP periods due to the balanced nature of the UP dynamics. In addition, a spiking network implementation of the model revealed that external input fluctuations to neurons in the network cannot respond to simple independent Gaussian statistics but must include stochastic, synchronous high-amplitude events that can trigger DOWN-to-UP transitions. Our model provides the first EI network that exhibits stochastic transitions between a silent and a low rate inhibition-stabilized attractor matching the statistics of UP and DOWN periods and population rate time-courses observed in the cortex.

5To investigate the mechanisms underlying the generation of spontaneous cortical activity, we recorded the spiking activity from large populations of neurons (mean ±SD = 64±23 cells) in deep layers of somatosensory cortex of urethane-anesthetized rats (n = 7 animals). Because brain state under urethane can vary spontaneously, we selected the most clearly synchronized epochs characterized by the stable presence of high-amplitude, slow fluctuations in cortical local field potential (LFP) signals (Figure 1A; see Materials and methods). During these epochs, the instantaneous population rate, calculated by merging all the recorded individual spike trains, displayed alternations between periods of tonic firing and periods of silence, a signature of UP and DOWN states from an extracellular standpoint (Figure 1B–C). Despite the clear presence of UP and DOWN states, the population activity displayed no clear traces of rhythmicity as revealed by strongly damped oscillatory structure in both autocorrelograms of LFP and (Figure 1D and E, respectively). Motivated by this, we hypothesized that the cortical circuit might transition between two network states in a random manner. Using a probabilistic hidden semi-Markov model, we inferred the instantaneous state of the circuit from the population rate by extracting the sequence of putative UP (U) and DOWN (D) periods (Figure 1C, Materials and methods).

6The statistics of U and D period durations showed skewed gamma-like distributions (Figure 2A and B right; Figure 2—figure supplement 1). The mean duration across different experiments displayed a wide range of values (Figure 2B left; mean ±SD:<U>= 0.43 ± 0.19 s, <D> = 0.46 ± 0.1 s, n = 7), whereas the coefficients of variation CV(U) and CV(D) of U and D periods, defined as the standard deviation divided by the mean of the period durations within experiments, were systematically high (Figure 2B middle, mean ±SD: CV(U) = 0.68 ± 0.09, CV(D) = 0.69 ± 0.1; median CV(U) = 0.64, CV(D) = 0.71). The irregularity in the U and D periods did not result from slow drifts in the mean U or D durations caused by variations of brain state as confirmed by computing the CV2, a local measure of irregularity that is less affected by slow variations in the statistics (mean ±SD: CV2(U) = 0.86 ± 0.13, CV2(D) = 0.75 ± 0.17; see Materials and methods). The high variability of U and D periods is consistent with the non-periodicity of the dynamics revealed in the autocorrelation function (Figure 1D–E).

7We then asked whether the lengths of U and D periods were independent, as if the transitions between the two network states would reset the circuit's memory, or if in contrast they were correlated by a process impacting the variability of several consecutive periods. We computed the linear cross-correlation (Figure 2C left, for k = 0) between pairs of periods separated in the D-U sequence by a lag k (Figure 2C, right). The cross-correlation displayed consistently non-zero values for k = 0 and k = 1 (mean ±SD: 0.21 ± 0.09, 0.17 ± 0.09, respectively; significant cross-correlation in 6/7 animals, p<0.05 permutation test), whereas it remained close to zero for the rest of lags, showing that period duration correlation is limited to adjacent periods (Figure 2C–D). The positive correlation between adjacent periods was not due to slow changes in their duration, as we corrected by the correlation obtained from surrogate D-U sequences obtained from shuffling the original sequence within 30 s windows (see Materials and methods). Positive correlations between consecutive periods of activity and silence can be generated when fluctuation driven transitions are combined with an adaptive process such as activity-dependent adaptation currents: if a fluctuation terminates a U period prematurely without much build-up in adaptation, the consecutive D period also tends to be shorter as there is little adaptation to recover from. However, a major role of adaptation currents in dictating UP-DOWN dynamics seems at odds with the lack of rhythmicity and the highly variable U and D durations, indicative of a stochastic mechanism causing the transitions between network states.

8We next searched for more direct evidence of an adaptive process by examining the time course of the population firing rate during U and D periods (see Figure 1C; see Materials and methods). The mean firing rate in U periods was low (mean ±SD: 3.72 ± 0.9 spikes/s, n = 7). Moreover, D periods displayed occasional spiking (mean ±SD rate 0.018 ± 0.007 spikes/s; see e.g. Figure 3A–B and Figure 3—figure supplement 1), in contrast with the idea that DOWN periods do not display spiking activity, but see. Thus, our hypothesis was that adaptation currents, if present, would induce a decay in during Us and an increase during Ds, and this impact on dynamics should be more evident during longer periods due to a larger accumulation (during Us) or recovery (during Ds) of the adaptation. For each experiment, we aligned the rate at the DOWN-to-UP (DU) and UP-to-DOWN (UD) transition times (Figure 3A). We then computed the average rates and across all DU and UD transitions, respectively, with representing the transition time (Figure 3B-C; mean across experiments = 598 transitions; range 472–768). Because Us and Ds had different durations, we selected long periods (U, D > 0.5 s) and compared and at the beginning and end of each period (mean number of Us 181, range 61–307; Ds 202, range 55–331). To specifically assess a change in rate during the U period, we compared the average in the time window τ = (50, 200) ms (beginning of U) with the average in the window τ = (−200,–50) ms (end of U), which we referred to as U-onset and U-offset windows, respectively. The windows were chosen 50 ms away from τ = 0 to avoid the transient change due to the state transitions (Figure 3C–D). We found no significant mean difference between population average rate at U-onset and U-offset windows across our experiments (mean ±SD onset minus offset population rate 0.04 ± 0.40 spikes/s, p=1, Wilcoxon signed rank, n = 7 animals). The equivalent analysis performed on D periods yielded a small but significant mean increase in the population rate between the D-onset and D-offset windows (mean ±SD −0.014 ± 0.013 spikes/s, p=0.047, Wilcoxon signed rank test). To examine in more detail the lack of population rate change during Us, we looked at the modulation of individual neuron rates normalized by the overall temporal average of each unit (Figure 3E). We found that the change between U-onset and U-offset averaged across all our neurons (n = 448 cells) was not significantly different from zero (Figure 3E right, mean ±SD of the onset vs offset difference of normalized rates 0.057 ± 1.163, p=0.12, Wilcoxon signed rank test) but that the recovery during D periods was significant (Figure 3E left; mean ±SD −0.015 ± 0.087, p=0.0002, Wilcoxon signed rank test). Some individual neurons however did show a significant modulation between U-onset and U-offset, but the decrease found in a fraction of the neurons was compensated with a comparable increase in another fraction of neurons (Figure 3E right). Thus, at the population level, spiking activity during U periods displayed a sustained time course with no significant traces of rate adaptation.

9To understand the network and cellular mechanisms underlying the generation of stochastic U-D dynamics, showing U-D serial correlations and sustained rates during U periods, we analyzed a computational rate model composed of an excitatory (E) population recurrently coupled with an inhibitory (I) population. The excitatory-inhibitory (EI) network model described the dynamics of the mean instantaneous rates rE and rI of each population in the presence of fluctuating external inputs. In addition, the E population included an adaptation mechanism, an additive hyperpolarizing current a that grew linearly with the rate rE (Figure 4A; see Materials and methods). We did not consider adaptation in the inhibitory population for simplicity, and because inhibitory neurons show little or no spike-frequency adaptation when depolarized with injected current. Our aim was to search for a regime in which, in the absence of adaptation and external input fluctuations, the network exhibited bistability between a quiescent (D) and a low-rate state (U) fixed point. Although bistability in low-dimensional EI networks has been described since the seminal work of, previous models primarily sought to explain bistability between a low-rate and a high-rate state, and exploited the combination of expansive and contractive non-linearities produced by the transfer function, short-term synaptic plasticity or the divisive effect of inhibitory conductances (see Discussion). We found that the expansive nonlinearity of the transfer function alone was sufficient to obtain bistability between D and U states. Given this, we chose the simplest possible transfer function with a threshold: a threshold-linear function (Figure 4B, see Materials and methods). Our choice to only use an expansive threshold non-linearity constrained strongly the way in which the network could exhibit bistability as can be deduced by plotting the nullclines of the rates rE and rI (Figure 4C): only when the I nullcline was shifted to the right and had a larger slope than the E nullcline, the system exhibited two stable attractors (Equation 20 in Materials and methods). This configuration of the nullclines was readily obtained by setting the threshold and the gain of the I transfer function larger than those of the E transfer function (Figure 4B), a distinctive feature previously reported when intracellularly characterizing the f - I curve of pyramidal and fast spiking interneurons in the absence of background synaptic activity. This difference in gains and thresholds in the E and I populations was not a necessary condition to obtain the bistability: alternatively, a proper selection of connectivity parameters with identical E and I transfer functions could satisfy the conditions to obtain similar bistable function (see Materials and methods, Equations [20-22]). This novel bistable regime yielded a quiescent D state, and arbitrarily low firing rates for both E and I populations during U states, depending on the values of the thresholds and the synaptic weights (Figure 4C). This is remarkable as in most bistable network models the rate of the sustained activity state is constrained to be above certain lower bound (see Discussion). Moreover, in this bistable regime, the U state is an inhibition-stabilized state, a network dynamical condition in which the excitatory feedback is so strong that would alone be unstable, but is balanced with fast and strong inhibitory feedback to maintain the rates stable (see Materials and methods).

10There are two ways in which transitions between U and D states can occur. On the one hand, transitions could be driven by external input fluctuations, which were modeled as a stochastic process with zero mean and short time constant (Figure 4D). This fluctuating input reflected either afferents coming from other brain areas whose neuronal activity was stochastic and uncorrelated with the cortical circuit internal dynamics or the stochasticity of the spiking happening during U periods which was not captured by the dynamics of the rates. On the other hand, in the absence of fluctuations, state transitions could also occur solely driven by adaptation currents (Figure 4E). Because the adaptation time constant was much longer than the time constants of the E and I rates, the dynamics of the rates rE(t) and rI(t) relaxing rapidly to their steady-state can be decoupled from the slow changes in a(t). The network dynamics can be described in the phase plane (rE(t), rI(t)) with variations in a(t) causing a displacement of the E-nullcline. In particular, during U periods the build-up in adaptation produced a downward displacement of the E-nullcline (Figure 4E). If adaptation strength β was sufficiently large the displacement increased until the U state was no longer a fixed point and the network transitioned to the only stable fixed point D. Recovery of adaptation during D periods shifted the E-nullcline upwards until the D state disappeared and there was a transition to the U state (Figure 4E). In this limit cycle regime the network exhibited an oscillatory behavior with a frequency close to the inverse of the adaptation recovery time constant. When the two types of transitions are combined, two types of stability in U and D states can be distinguished: (1) metastable, referred to a state that was stable to the dynamics of both the rates and the adaptation but could transition away due to input fluctuations; (2) quasi-stable, referred to a state that was stable for the fast rate dynamics but unstable for the slow adaptation dynamics, plus it was also susceptible to fluctuation-driven transitions.

11To quantify the relative impact of activity fluctuations and adaptation in causing U-D transitions in the data, we compared the dynamics of the model for different adaptation strengths β and different values of the E-cell effective threshold θE (defined as the difference between the activation threshold and the mean external current). The (θE,β) plane was divided into four regions with UD alternations, corresponding to the four combinations of metastability and quasi-stability (Figure 5A). Since only metastable states tend to give exponentially distributed durations with CV ~1, the large variability found in both U and D durations (Figure 2B) constrained the model to the subregion where both states were metastable and UD and DU transitions were driven by fluctuations (red area in Figure 5A). The existence of serial correlations between consecutive U and D in the data (Figure 2C–D) discarded an adaptation-free regime (β = 0), in which transitions were solely driven by fluctuations and the duration of each period was independent of previous durations (Figure 5B right). Thus, we explored a regime with β >0 but still in the region where both states were metastable (Figure 5B, green square) and the input fluctuations produced alternation dynamics (Figure 5C top) with broad U and D duration distributions and relatively high CVs (Figure 5D top). The magnitude of the fluctuations was adjusted to obtain frequent transitions in this region and serial correlations quantitatively comparable with the data (Figure 5—figure supplement 1). Moreover, the rates showed an autocorrelation function qualitatively similar to the data, with negative side-lobes but no clear traces of rhythmicity (Figure 5E). Adaptation introduced correlations across consecutive periods (Figure 5D bottom) because at the transition times the system kept a memory of the previous period in the adaptation value a(t). For adaptation to introduce substantial correlations, had to be variable at the transition times, a condition that required adaptation to be fast, to vary within one period, but not too fast to prevent reaching the equilibrium (Figure 5C bottom trace). Thus, when a strong fluctuation caused a premature UD transition, i.e. a short, adaptation had no time to build up and tended to be small, increasing the probability of a premature DU transition in the following D period, i.e. a short. Conversely, a long recruited strong adaptation that required a long to recover (see highlighted examples in Figure 5C). In this regime, the dynamics of adaptation a(t) alone did not cause transitions but did strongly modulate the probability that an external fluctuation would cause a transition. Altogether, this analysis suggests that the observed U-D dynamics occurred in a regime with strong random fluctuations, that these fluctuations were necessary to cause the transitions, and that adaptation modulated the timing of the transitions and consequently introduced correlations between the duration of consecutive periods.

12According to the model, adaptation currents in the E population can parsimoniously account for the U-D serial correlations but this is in apparent contradiction with the fact that the population rate in the data did not decrease significantly during U periods (Figure 3C–E). To reconcile these two seemingly contradictory observations we used the model with the parameters that matched the data’s U and D statistics (Figure 5C–E) to characterize the time course of the rates rE(t) and rI(t) averaged across DU and UD transitions. Interestingly, the average rE(t) at the beginning and at the end of U periods did not show much difference whereas the average rI(t) showed a larger decrease over the U period (Figure 6A). Thus, although only the E and not the I population included intrinsic adaptation mechanisms, it was rI(t) the one that exhibited the most pronounced decay during U periods. This was a direct consequence of the specific conditions that gave rise to bistability in our model: the difference in thresholds, that is, θI > θE, and the fact that the I-nullcline has a higher slope than the E-nullcline (Equation 21 in Materials and methods). These features imposed that as adaptation built up during U periods, the downward displacement of the E-nullcline caused a greater decrease in rI(t) than in rE(t) (compare ‘decay’ colored bands in Figure 6B). With this arrangement the drop in rE(t) could be made arbitrarily small by increasing the slope of the I-nullcline (Figure 6B). Note that this feature of the model is not dependent on its specific regime of operation, as it would similarly apply in an adaptation-driven regime (Figure 4E). During D periods the average rE(t) did show a substantial increase due to the recovery of adaptation, whereas the rI(t) did not. This was because in the D state, the quiescent network behaved as isolated neurons reflecting the dynamics of intrinsic adaptation which was only present on E cells. In sum, if the majority of the neurons that we recorded experimentally were excitatory, the model could explain why adaptation currents did not cause a significant decrease in the average rate during U periods (Figure 3C–D). The model in addition predicts that the rate of inhibitory neurons should exhibit a noticeable decrease during U periods.

13Motivated by this prediction, we investigated the dynamics of the rates of excitatory and inhibitory neurons during U and D periods in the experimental data. Based on spike waveforms, isolated units from n = 5 experiments were classified into putative interneurons (I) and putative excitatory neurons (E), following previously described procedures. The average rate for E and I populations ( and, respectively) displayed similar profiles across UD alternations, although higher values were observed for I cells during Us (see example experiment in Figure 6C). To assess the modulation of the rates during U periods, we looked at the normalized individual rates of all the E and I neurons (n = 330 and 21, respectively). As predicted by the model (Figure 6A-B), I cells displayed a significant rate decay during U periods that was not observed in E cells (Figure 6D; mixed-effects ANOVA with factors neuron type (E/I), onset/offset and neuron identity and experiment as random factors: interaction neuron type x onset/offset F(1,349)=6.3, p=0.013). During D periods, E cells also showed a significant increase in rate (Wilcoxon signed rank test p=0.0092), just like that observed in the whole cell population, whereas no rate change was found in I cells (not shown). Although these changes observed during D periods were also predicted by the model, properly testing the significance of this interaction would require a larger data set with more I cells. The validation of the prediction on the counter-intuitive emergent dynamics of E and I rates during U periods strongly suggests that the mechanism dissected by the model underlies the putative bistability observed in cortical circuit dynamics.

14To assess whether the mechanism for state transitions proposed by the rate model could generate UP-DOWN dynamics in a more biophysically realistic circuit we built a network composed of NE = 4000 excitatory and NI = 1000 inhibitory leaky integrate-and-fire spiking units (all-to-all connectivity). We used current-based synapses and introduced a spike-based after-hyperpolarization (AHP) current in E cells. The EI asymmetry in spike threshold and f - I gain described in the rate model was implemented and, using standard mean-field methods, we revealed the same network bistability described above (compare Figures 7A and 4C): a saddle node bifurcation gave rise to a quiescent branch (DOWN) co-existing with a low-rate branch (UP; Figure 7B). Numerical simulations showed that while the network was in the UP state the AHP current increased moving the system along the upper branch towards the saddle-node and just causing a small decrease in rE. However, because we chose a small AHP amplitude so that the network operated in the bistable regime (see fixed points in Figure 7B), the adaptation buildup alone did not trigger an UP to DOWN transition. It was the current fluctuations produced by the irregular activity during UP periods that triggered UP to DOWN transitions. However, once the network was in the DOWN state the external independent Gaussian inputs only caused subthreshold membrane fluctuations in E cells that sat far away from the spiking threshold (voltage std. dev. 2.5 mV with distance from resting voltage to threshold of 12.4 mV). In these conditions, there was no spiking activity during DOWN periods and the network could not transition to the UP state (not shown). To make these subthreshold fluctuations effective in driving transitions, we first depolarized neurons so that their resting potential during the D state was closer to threshold and the recovery from adaptation alone was almost sufficient to cause the transitions (Figure 7—figure supplement 2A–E). This ad hoc depolarization was sufficient to generate UP-DOWN alternations but prevented the membrane potential from showing bi-modality (Figure 7—figure supplement 2F), the intracellular signature of UP and DOWN states. Moreover, the alternations had a very small serial correlation between consecutive D and U periods, Corr(D,U), (Figure 7—figure supplement 2I) because adaptation at the time of the DOWN-to-UP transition was narrowly distributed, did not retain information about the length of the DOWN period, and could thus not constrain the duration of the following U period.

15We thus reasoned that the most parsimonious way to cause a DOWN to UP transition without disrupting the bi-modality of the membrane potential was to maintain resting neurons hyperpolarized and to introduce stochastic brief external excitatory synchronous inputs that caused large amplitude depolarizing voltage bumps in a targeted subpopulation of E and I neurons. The statistics of occurrence times of these bumps were Poisson and their frequency (~2–3 Hz) and amplitude (~10–15 mV) were set so that (i) they could cause DOWN to UP transitions (Figure 7C–E) with non-rhythmic structure (Figure 7G) and yield U and D interval distributions similar to the data (Figure 7H) and (ii) the effectiveness in causing a transition was not all-or-none but depended on the population average AHP current amplitude (Figure 7—figure supplement 1E). This dependence occurs because the distance to the saddle point limiting the basin of attraction of the DOWN state decreases with (Figure 7B, red dashed line). This meant that some kicks during DOWN periods failed to cause a transition, giving rise to sporadic sparse firing during DOWN periods also seen as large bumps in the membrane potential of the targeted cells (see asterisks in Figure 7C; see Discussion). Because of this dependence of the transition probability on the recovery of the AHP current, the transition dynamics displayed serial correlations Corr(D, U) (Figure 7I), as observed in the data (Figure 2C-D). Once in the UP state, the external kicks caused an excess of excitatory and especially inhibitory activity that destabilized the UP state and generated a transition to the DOWN state. Because the effectiveness of the kicks causing these transitions also depended on the average AHP current (Figure 7—figure supplement 1F), there were significant serial correlations Corr(U,D) quantitatively comparable to the data (Figure 7I). As explained by the rate model, the averaged population rate rE(t) showed very weak decrease along the UP period whereas rI(t) decayed much more strongly, until the overshoot caused by kicks at the UP offset (Figure 7J). Neurons displayed a bi-modal distribution of the membrane potential (Figure 7F; Figure 7—figure supplement 1E) and during UP periods they fired low rate irregular spike trains (CV of the Inter-spike-interval was 0.74 for E cells and 0.94 for I cells). In sum, a spiking network model was able to reproduce the results described in the rate model given there exists a mechanism to generate stochastic, synchronous large-amplitude bumps.

16Using cortical population recordings we have shown that UP and DOWN period durations are irregular and show positive serial correlation, but there is no significant decrease of population rate during UP periods. These findings seem inconsistent with one another, as some support, while other challenge the idea that UP-DOWN dynamics are caused by cell or synaptic adaptive mechanisms. Using a standard EI rate model network, we have proposed a novel bistable regime based only on the expansive threshold non-linearity of the transfer function and on a reported difference between E and I spiking thresholds. While fluctuations produce transitions between the quiescent state (D) and the inhibition-stabilized state of arbitrarily low rate (U), adaptation acting on the E population facilitates the effect of fluctuations causing the transitions. Paradoxically, because of the difference in E and I thresholds, adaptation causes a marginal decay of E rates but a significant decay of I rates during UP periods. This counterintuitive prediction, specific to our model, was validated in the experimental data.

17Adaptive processes constitute the mechanistic hallmark for the generation of cortical UP and DOWN dynamics. This principle has been used in several computational models, by implementing synaptic short-term depression, or activity-dependent adaptation currents. Consistent with an adaptive process generating the dynamics, UP and DOWN states observed in vitro display clear rhythmicity with Gaussian shaped UP and DOWN duration distributions. An in vivo study using ketamine anesthesia in mice reported reduced UP and DOWN duration variability across multiple cortical areas with CVs around 0.2–0.4. Moreover, a comparison of the UP and DOWN dynamics in the cat observed under ketamine anesthesia and those found in slow wave sleep (SWS) showed that the alternations were more rhythmic under ketamine. In contrast, our data displayed large variability (mean CV(U)~CV(D) ≃0.7) and skewed distributions of UP and DOWN period durations (Figure 2B), in agreement with previous studies using urethane anesthesia. Although a direct comparison between the UP-DOWN dynamics under urethane anesthesia and during natural sleep has not been made, urethane seems to mimic sleep in several aspects. First, it induces spontaneous alternations between synchronized and desynchronized states, resembling the alternations between SWS and REM sleep. Second, the irregular UP-DOWN transitions observed under urethane anesthesia seem to resemble the variability observed in SWS. Preliminary analysis of rat and mouse prefrontal cortex during SWS with the same population-based U-D detection methods used here (Materials and methods) showed that U periods had comparable mean length but were more irregular (CV ~1) than under urethane anesthesia (Figure 1B) whereas D periods were shorter (mean ~150 ms) and slightly more regular (CV ~0.5) (unpublished observations). Such an asymmetry in the duration and irregularity of U-D periods can be easily reproduced in our model by choosing parameters in the mixed region where U is meta-stable and D is quasi-stable (Figure 5A light orange).

18In addition, we found non-zero correlations between consecutive D-U and U-D period durations, a feature that was not observed previously in similar experimental conditions. Reduced statistical power (~30 U-D/D-U pairs were considered by versus a range of 462–758 pairs in our n = 7 experiments) and different U-D detection methods (intracellular membrane potential thresholding) could be the reasons for this discrepancy.

19Bistability in a dynamical system refers to the coexistence of two possible steady states between which the system can alternate. This principle has been used to interpret UP and DOWN states as two attractors of cortical circuits and it seems to underlie higher cognitive functions. In particular, multi-stability in recurrent cortical networks has been postulated to underlie the persistent activity observed during the delay period in working memory tasks. Extensive theoretical work has shown that based on the change in curvature of the neuronal f - I curve, that is, from expansive to contractive, recurrent network models generate two types of co-existing attractors: a spontaneous state with arbitrarily low rates (falling in the expansive part of the f - I curve) and a sustained activity attractor where the reverberant activity of a subpopulation of neurons could be maintained at a rate on the contractive part of the f - I curve. Thus, unless additional mechanisms are included, e.g. synaptic short-term depression and facilitation or fined-tuned EI balance, the rate of persistent states is lower-bounded by the rate where the f - I curve changes from convex to concave (~10–20 spikes/s). Moreover, because of this the sustained attractor operates in an unbalanced supra-threshold regime where spike trains tend to be more regular (i.e. lower inter-spike-interval CV,) than those observed in the data.

20UP and DOWN states represent in contrast transitions between very different levels of activity: a quiescent state and a very low rate state. Given that we recorded neurons extracellularly, our estimate of the mean firing rate during UP periods (3.7 spikes/s) is most likely an overestimation. Whole cell intracellular recordings have reported rates in the range 1–2 spikes/s, 0.4 spikes/s in Pyramidal L2/3 of the somatosensory cortex of awake mice, 0.1 spikes/s in Pyramidal L2/3 cells in somatosensory cortex during UP periods in anesthetized rats, or 0.1–0.3 spikes/s in V1 neurons of awake mice. Juxtacellular recordings have found values near 4–5 spikes/s whereas Calcium imaging experiments report spontaneous rates < 0.1 spikes/s. Despite UP rates being so low, rate models have commonly used the change in curvature of the transfer function to generate UP and DOWN dynamics. It is also for this reason that most spiking network models generating UP and DOWN transitions exhibit unrealistically high rates during U periods (in the range 10–40 spikes/s) with relatively regular firing.

21An alternative mechanism to generate bistability between UP and DOWN states has been the shunting or divisive effect of inhibitory synaptic conductances, a mechanism that can produce non-monotonic transfer functions and yield bistability between a zero rate state and a state of very low rate. Latham and colleagues addressed the question of how to obtain a state of low firing rate (i.e. <1 spikes/s) in a recurrent EI network and concluded that there were two alternative mechanisms: the most robust was to have a single attractor that relied on the excitatory drive from endogenously active neurons in the network or from external inputs. In fact, excitatory external inputs have been widely used to model low rate tonic spontaneous activity (i.e. no DOWN states) in EI networks of current-based spiking units. Alternatively, in the absence of endogenous or external drive, a silent attractor appears and a second attractor can emerge at a low rate over a limited range of parameters if inhibition exerts a strong divisive influence on the excitatory transfer function. Based on this, a spiking network of conductance-based point neurons with no external/endogenous activity could alternate between UP (0.2 spikes/s) and DOWN (0 spikes/s) periods via spike frequency adaptation currents. Although the authors did not characterize the statistics of UP and DOWN periods, this network could in principle generate positive correlations between consecutive U and D period durations, Corr(U,D), as long as rate fluctuations caused UP to DOWN transitions for sufficiently different adaptation values. However, since DOWN to UP transitions were caused by recovery from adaptation, the duration of a D period could not influence the duration of the following U period and their network could not produce correlations between consecutive D-U periods (i.e. Corr(D,U)~0, as in the network shown in Figure 7—figure supplement 2). The model moreover lacked bi-modality in the membrane voltage and did not specifically predict a distinct decay of rE and rI during UP periods.

22Our model proposes a more parsimonious mechanism underlying UP-DOWN bistability: the ubiquitous expansive threshold non-linearity of the transfer function plus the asymmetry in threshold (θI > θE) and gain (larger for I than E cells). We used a threshold-linear function for simplicity but other more realistic choices (e.g. threshold-quadratic) produced the same qualitative results. The threshold asymmetry is supported by in vitro patch clamp experiments revealing that firing threshold of inhibitory fast-spiking neurons, measured as the lowest injected current causing spike firing, is higher than that of excitatory regular-spiking neurons. Inhibition in this model becomes active when external inputs onto E cells during the DOWN state are strong enough to push the system above the separatrix (Figure 4C) and ignite the UP state. Once recruited, inhibition is necessary to stabilize the activity because, in its absence, the positive feedback would make the UP state unstable, a condition known as an Inhibition-Stabilized Network. In this regime, excitatory currents are supra-threshold but when combined with inhibition result in a net subthreshold input current yielding low-rate irregular firing (Figure 7—figure supplement 2).

23A direct implication of the specific mechanism of bistability in our model was that intrinsic adaptation of excitatory neurons did not cause a noticeable decrease in rE during the UP periods but instead produced a significant decay in the inhibitory rate rI. We confirmed this prediction in our data (Figure 6C–D). Interestingly, the same effect was also observed in ketamine anesthetized animals from both extracellular and intracellular recordings resolving synaptic conductances. During DOWN periods, in contrast, the network is not in a balanced state and recovery from adaptation caused a significant increase in the rate of putative excitatory neurons, as predicted by the model. In sum, our results present the first EI network model with linearly summed inputs exhibiting bistability between a quiescent state and a inhibition-stabilized state with arbitrary low rate.

24Our findings stress the role of input fluctuations inducing transitions between the UP and DOWN network attractors because noise-induced alternations generate periods with large variability as found in the data (Figure 2A–B). Adaptation was also necessary to introduce positive serial correlations and to reproduce the observed gamma-like UP-DOWN distributions (compare Figure 2A–B with Figures 5D and 7H) because it caused a soft refractory period after each transition decreasing the duration CVs below one (Figure 2B). In our rate model fluctuations were simply introduced by a time-varying Gaussian input so that in both DU and UD transitions the noise had the same external origin. In cortical circuits however these two transitions are very different: while in UP-DOWN transitions the fluctuations can originate in the stochasticity of the spiking activity during the UP period, DU transitions depend on either local circuit mechanisms that do not need spiking activity or on external inputs to escape from a quiescent state. Our spiking EI network model could use the stochasticity of the recurrent spiking activity to cause transitions from a low-rate UP state to a quiescent DOWN state but needed synchronous input bumps to cause DOWN to UP transitions (Figure 7). Other models have proposed that synaptic noise (e.g. spontaneous miniatures) could cause the transitions from the quiescent state (i.e. DOWN to UP). Our analysis shows however that to cause noise-driven transitions from a quiescent state using independent synaptic fluctuations into each cell (1) neurons need to be depolarized unrealistically close to threshold and hence do not display bi-modal voltage distributions, and (2) the magnitude of adaptation must be tuned such that it brings neurons close to threshold allowing the sparse firing to trigger a transition. In this condition moreover, the network does not generate positive correlations between D and consecutive U intervals (Figure 7—figure supplement 2). For this reason we used instead synchronous external input kicks as the inducers of DOWN-to-UP transitions. These input kicks were also effective driving UP to DOWN transitions but they caused an excess of E and especially I activity at the UP offset (see UP-offset peaks in Figure 7J). This feature was not observed in our data but has been observed when triggering UP to DOWN transitions with electrical stimulation. When kicks were suppressed during UP periods, UP-to-DOWN transitions could be triggered by intrinsically generated fluctuations in the spiking activity and the offset peaks in the E and I rates could be largely reduced (not shown). This seems to suggest that the two type of transitions could be triggered by different types of events: DOWN to UP would be triggered by synchronous bumps whereas UP to DOWN by fluctuations in the rates of the two populations. Modeling such a mixed-factors network would require considering more realistic connectivity patterns (e.g. sparse and spatially organized) in order for the network to intrinsically generate more realistic spiking variability in the population. For simplicity, we opted for an all-to-all connected network (as opposed to e.g. sparse connectivity) because it was simpler to analyze theoretically and simulate numerically. In particular, the fluctuations of synaptic input in an all-to-all network are set as a fixed parameter, independent of the recurrent activity. This allowed us to find the appropriate network states and determine their stability using standard mean field techniques and then adjust the magnitude of the fluctuations and kicks to reproduce the transition dynamics using numerical simulations. We leave for future study the extension of these results to more realistic sparse connectivity patterns. In a sparse randomly connected EI network for instance, it would be of interest to study the behavior of this type of bistability as the network size N increases and synaptic couplings are scaled as in a balanced network, that is,. In the large N limit, balanced networks linearly transform external inputs into population average output rate. This implies that, the larger the network, the more fine tuning of the parameters would be necessary in order to generate this type of bistability.

25Evidence for temporally sparse synchronous inputs comes from intracellular membrane potential recordings under some types of anesthesia (pentobarbital or halothane) showing «presynaptic inputs [...] organized into quiescent periods punctuated by brief highly synchronous volleys, or ‘bumps’». We postulate that these spontaneous bumps (1) are caused by synchronous external inputs impinging on the neocortex, possibly from thalamocortical neurons, since spontaneous bumps resemble sensory evoked responses or from hippocampal Sharp Wave Ripples; (2) their timing resembles a Poisson stochastic process rather than a rhythmic input; (3) they lie at the origin of the DOWN-to-UP transitions that we observe. Despite the fact that UP-DOWN-like activity can emerge in cortical slices in vitro the intact brain can generate more complex UP-DOWN patterns than the isolated cortex, with subcortical activity in many areas correlating with transition times. A recent study however reported very large (>20 mV) non-periodic synchronous bumps in cortical in vitro slices suggesting that these events could also be generated within local cortical circuits.

26These arguments suggest that DOWN to UP transitions are, at least in part, caused by punctuated external synchronous inputs, with slow intrinsic adaptation mechanisms contributing to modulate the probability that these events trigger a transition. This complements the view that UP-DOWN dynamics reflect an endogenous oscillation of the neocortex and connects to the role of UP-DOWN states in memory consolidation: because in the active attractor (UP) the stationary activity is irregular and asynchronous, the existence of a silent attractor enables synchronous transient dynamics in the form of DOWN to UP transitions. These transients generate precise temporal relations among neurons in a cortical circuit, which can cause synaptic plasticity underlying learning and memory. We speculate that, while the transient dynamics are triggered by external inputs, adaptation, by introducing refractoriness in this process, parses transition events preventing the temporal overlap of information packets.

27This study involved analysis of previously published and new data. Previously published data was obtained under a protocol approved by the Rutgers University Animal Care and Use Committee. One new data set was performed in accordance with a protocol approved by the Animal Welfare Committee at University of Lethbridge (protocol # 0907). All surgeries were performed under anesthesia, and every effort was made to minimize suffering. Adult, male Sprague-Dawley rats (250–400 g) were anesthetized with urethane (1.5 g/kg) and supplemental doses of 0.15 g/kg were given when necessary after several hours since the initial dose. We also used an initial dose of Ketamine (15–25 mg/kg) before the surgery to induce the anesthetized state quickly. We then performed a craniotomy over the somatosensory cortex, whose position was determined using stereotaxic coordinates. Next 32 or 64 channels silicon microelectrodes (Neuronexus technologies, Ann Arbor MI) were slowly inserted into in deep layers of the cortex (depth 600–1200 μm; lowering speed ~1 mm/hour). Probes had either eight shanks each with eight staggered recording sites per shank (model Buzsaki64-A64), or four shanks with two tetrode configurations in each (model A4 × 2-tet-5mm-150-200-312-A32). Neuronal signals were high-pass filtered (1 Hz) and amplified (1,000X) using a 64-channel amplifier (Sensorium Inc., Charlotte, VT), recorded at 20 kHz sampling rate with 16-bit resolution using a PC-based data acquisition system (United Electronic Industries, Canton, MA) and custom written software (Matlab Data Acquisition Toolbox, MathWorks) and stored on disk for further analysis.

28Spike sorting was performed using previously described methods. Briefly, units were isolated by a semiautomatic algorithm (http://klustakwik.sourceforge.net) followed by manual clustering procedures (http://klusters.sourceforge.net). We defined the Population activity as the merge of the spike trains from all the well isolated units.

29Isolated units were classified into narrow-spiking (I) and broad-spiking (E) cells based on three features extracted from their mean spike waveforms: spike width, asymmetry and trough-to-peak distance. The two classes were grouped in the space of features by k-means clustering.

30We classified the brain state based on the silence density defined as the fraction of 20 ms bins with zero spikes in the Population activity in 10 s windows. Epochs with consecutive windows of silence density above 0.4, standard deviation below 0.1 and longer than 5 min, were considered as sustained synchronized brain state and were used for further analysis (synchronized states durations mean ±SD: 494 ± 58 s, n = 7 epochs).

31UP-DOWN phases have been commonly defined from intracellular recordings by detecting the crossing times of a heuristic threshold set on the membrane potential of individual neurons, or from local field potential signals or combined together with the information provided by multi-unit activity. Defining UP-DOWN phases from single-unit recordings is more challenging because individual neurons fire at low rates discharging very few action potentials on each UP phase. However, pooling the spiking activity of many neurons into a population spike train reveals the presence of co-fluctuations in the firing activity of the individual neurons and allows accurate detection of UP-DOWN phases. We used a discrete-time hidden semi-Markov probabilistic model (HMM) to infer the discrete two-state process that most likely generated the population activity. Thus, the population activity spike count was considered as a single stochastic point process whose rate was modulated by the discrete hidden state and the firing history of the ensemble of neurons recorded. In order to estimate the hidden state at each time, the method used the expectation maximization (EM) algorithm for the estimation of the parameters from the statistical model. Although the discrete-time HMM provides a reasonable state estimate with a rather fast computing speed, the method is restricted to locate the UP and DOWN transition with a time resolution given by the bin size (T) for the population activity spike count (10 ms in our case). The initial parameters used for the detection were: Bin-size T = 10 ms, number of history bins J = 2 (sets the length of the memory, i.e. J = 0 is a pure Markov process); history-dependence weight β = 0.01 (i.e. β = 0 for a pure Markov process); transition matrix PDU = PUD = 0.9, PDD = PUU = 0.1; rate during UP periods α = 3, and rate difference during DOWN and UP periods μ = −2. The algorithm gives an estimate of the state of the network on each bin T. Adjacent bins in the same state are then merged to obtain the series of putative UP (U) and DOWN (D) periods. The series is defined by the onset and offset times of the Us, where M is the total number of Us, that determine the i-th UP and DOWN period durations as (see Figure 1C):

32The mean and the coefficient of variation of Ui were defined as

33where:

34and equivalently for and. We controlled whether variability in Ui was produced by slow drifts by computing CV2 a measure of variability not contaminated by non-stationarities of the data.

35The serial correlation between and, with k setting the lag in the U-D series, e.g. k = 0 (k = 1) refers to the immediately previous (consecutive) DOWN period, was quantified with the Pearson correlation coefficient defined as:

36where the covariance was defined as:

37Values of and differing more than 3 standard deviations from the mean were discarded from the correlation analysis (circles in Figure 2C). To remove correlations between and produced by slow drifts in the durations we used resampling methods developed to remove slow correlations among spike trains. We generated the - shuffled series of U periods by randomly shuffling the order of the Us in the original series within intervals of 30 s. The same was done to define the shuffled series of D periods. The two shuffled series lack any correlation except that introduced by co-variations in the statistics with a time-scale slower than 30 s. We generated L = 1000 independent shuffled series and with =1,2,...L, computed the covariance for each and the averaged over the ensemble. Finally, the correlation due to co-fluctuations of Us and Ds faster than 30 s was computed by subtracting from in Equation 5. Significance of the correlation function was assessed by computing a point-wise confidence interval from a distribution of L correlograms, for l = 1...L (L = 10000), computed from each shuffled series the same way as for the original series (gray dashed bands in Figure 2C). To take into account multiple comparisons introduced by the range in lag k, we obtained global confidence intervals (black dashed bands in Figure 2C) by finding the P of the pointwise intervals for which only a fraction of the correlograms crosses the interval bands at any lag k= −7...7 (see for details).

38Gamma parameter estimates for distributions of U and D durations were computed using the Matlab built-in function gamfit.

39We divided the time in bins of dt = 1 ms and defined the spike train of the j-th neuron as:

40The spike count of the j-th neuron over the time window (t-T/2, t+T/2) was obtained from

41where refers to a discrete convolution and is a square kernel which equals one in (-T/2,T/2) and zero otherwise.

42The instantaneous rate of the j-th neuron was defined as:

43and therefore the instantaneous population rate was defined as:

44where N is the total number of well isolated and simultaneously recorded neurons. We have dropped the dependence on from and to ease the notation. We also defined the instantaneous E-population and I-populations rates, and respectively, as those computed using cells in the E and I subpopulations separately.

45The instantaneous population rate averaged across Us and Ds and aligned at the D to U transition (DU) was defined as:

46where is the time to the DU transition. Because Us had different durations, for each, the sum only included the onset time if the subsequent period was longer than. By doing this we remove the trivial decay we would observe in as increases due to the increasing probability to transition into a consecutive period. For, reflecting the population averaged rate during the Ds, is obtained as in Equation 10 but including the times in the sum if the previous D was longer than. Similarly, the average population rate aligned at the offset was defined equivalently by replacing by the series of offset times. We also defined the onset and offset-aligned averaged population rate for excitatory (E) and inhibitory (I) populations, termed and for the E case and similarly for the I case. Moreover, the onset and offset-aligned averaged rate of the i-th neuron and were defined similarly using the individual rate defined in Equation 8.

47The autocorrelogram of the instantaneous population rate was defined as:

48with the sum in t running over the L time bins in a window of size W. The average and variance were performed across time in the same window. To avoid averaging out a rhythmic structure in the instantaneous population rate due to slow drift in the oscillation frequency, we computed in small windows W = 20 s thus having a more instantaneous estimate of the temporal structure. With the normalization used, the autocorrelograms give and the values with can be interpreted as the Pearson correlation between the population rate at time t and the population rate at time (Figure 1D).

49To compare the population rates at the U-onset and U-offset (Figures 3 and 6), we computed for each neuron the mean of over the window = (50,200) s (U-onset) and the mean of over the window = (−200,–50) s (U-offset). We positioned the windows 50 ms away of the DU and UD transitions in order to preclude the possibility of contamination in the mean rate estimations due to possible misalignments from the U and D period detections. In the averaging we used U and D periods longer than 0.5 s, so that onset and offset windows were always non-overlapping. Equivalent D-onset and D-offset windows were defined in order to compare individual rates during D periods. To make the distribution of mean rates across the cell population Gaussian, we normalized each of the rates and by the overall time-averaged rate of the neuron finally obtaining onset and offset-aligned normalized averaged rates (e.g. ). Despite this normalization, the distribution of the normalized rates in the D-onset and D-offset was non-Gaussian (most neurons fired no spikes). Thus we used the non-parametric two-sided Wilcoxon signed rank test to compare onset and offset rates (Figure 3E). To test the rates changes during U periods in E and I neurons we used a four-way mixed-effects ANOVA with fixed factors onset/offset, E/I and random factors neuron index and animal. We compared the distribution of normalized averaged rate difference at the U-onset minus the U -offset (Figure 3E right, dark gray histogram) with a distribution obtained from the same neurons but randomly shuffling the onset and offset labels of the spike counts but preserving trial and neuron indices (Figure 3E right, light gray bands show 95% C.I. of the mean histograms across 1000 shuffles). This surrogate data set represents the hypothesis in which none of the neurons shows any onset vs offset modulation. The comparison shows that there are significant fractions of neurons showing a rate decrease and increase that compensate to yield no significant difference on the population averaged rate. The same procedure was followed with the normalized rates in the D-onset and D-offset but the limited number of non-zero spike counts limited the analysis yielding inconclusive results (Figure 3E left).

50We built a model describing the rate dynamics of an excitatory and inhibitory population recurrently connected that received external inputs. In addition, the excitatory population had an additive negative feedback term, representing the firing adaptation experienced by excitatory cells. The model dynamics were given by:

51The time constants of the rates were = 10 ms and = 2 ms, while the adaptation time constant was = 500 ms. The synaptic couplings JXY > 0 (with X,Y = E, I), describing the strength of the connections from Y to X, were = 5, = 1, = 10, = 0.5 s. Because we are modeling low rates, the adaptation grows linearly with with strength = 0.5 s. The fluctuating part of the external inputs was modeled as two independent Ornstein–Uhlenbeck processes with zero mean, standard deviation = 3.5 and time constant 1 ms for both E and I populations. Because population averaged firing rates during spontaneous activity fell in the range 0–10 spikes/s, we modeled the transfer functions φX as threshold-linear functions:

52where the square brackets denote if and zero otherwise, the gains were = 1 Hz and = 4 Hz and the effective thresholds and represented the difference between the activation threshold minus the mean external current into each population. We took = 25 a.u. and explored varying over a range of positive and negative values (Figure 5A–B). The choice of thresholds < and gains reflecting the asymmetry in the f-I curve of regular spiking neurons (E) and fast spiking interneurons (I), facilitated that the model operated in a bistable regime (see below).

53Input-output transfer functions are typically described as sigmoidal-shaped functions, capturing the nonlinearities due to spike threshold and firing saturation effects. Since we are interested in modeling spontaneous activity where average population rates are low, we constrained the transfer functions to exhibit only an expanding non-linearity reflecting the threshold and thus avoid other effects that can only occur at higher rates (the contracting non-linearity tends to occur for rates >30 spikes/s. In particular, we modeled φX as piecewise linear but the same qualitative bistable regime can be obtained by choosing for instance a threshold-quadratic function. The model equations (Equations 12-14) were numerically integrated using a fourth-order Runge-Kutta method with integration time step dt = 0.2 ms. U and D periods in the model were detected by threshold-based method, finding the crossing of the variable rE with the boundary 1 Hz, where periods shorter than minimum period duration of 50 ms were merged with neighboring periods (small changes in threshold and period durations did not affect qualitatively the results). The computational rate model was implemented in Matlab (MathWorks) using C ++ MEX, and the source code is available at ModelDB (https://senselab.med.yale.edu/ModelDB, ).

54We start by characterizing the dynamics of the system in the absence of noise. Assuming that the rates evolve much faster than the adaptation, that is,, one can partition the dynamics of the full system into (1) the dynamics of the rates assuming adaptation is constant, (2) the slow evolution of adaptation assuming the rates are constantly at equilibrium. Thus, the equations of the nullclines of the 2D rate dynamics at fixed, can be obtained from the 2D system given by Equations 12-13. The nullclines of this reduced 2D system are obtained by setting its left hand side to zero:

55The intersection of the nullclines define the fixed points of the 2D system to which the rates evolve. Once there adaptation varies slowly assuming that the rates are maintained at until it reaches the equilibrium at.

56The network has a fixed point in if and only if θE 0 and θI 0, that is, when the mean external inputs are lower than the activation thresholds. The stability of this point, corresponding to the DOWN state, further requires θE > 0, thus preventing the activation of the network due to small (infinitesimal) fluctuations in rE. To find an UP state fixed point with non-zero rates we substitute in Equations 16-17 the value of adaptation at equilibrium, assume the arguments of+ are larger than zero and solve for (rE,rI), obtaining:

57where, and.

58The conditions for this UP state solution to exist are derived from imposing that the right hand side of Equations 18-19 is positive. The stability of this solution (Equation 21 below) implies that the determinant is positive and that if is positive, then is also positive. Thus, provided the stability (Equations 21-22), the only condition for the solution to exist is that the right hand side of Equation 19 is positive:

59Given the separation of time scales described above, this fixed point is stable if the eigenvalues of the matrix of coefficients of Equations 16 and 17 without the term a (that we assume is constant) have all negative real part. Because the coefficients matrix is 2 × 2, this is equivalent to impose that the determinant of the matrix has a positive determinant and a negative trace. These conditions yield the following inequalities, respectively:

60Equation 21 is equivalent to the condition that the I-nullclines of the 2D reduced system has a larger slope than the E-nullcline. From the U existence condition in Equation 20 and D stability condition, it can also be derived that, implying that at fixed inhibition, the E-subnetwork would be unstable (i.e. slope of the E-nullcline is positive). In sum, the conditions for the existence of two stable U and D states imply that the U state would be unstable in the absence of feedback inhibition but the strength of feedback inhibition is sufficient to stabilize it. These are precisely the conditions that define an Inhibitory Stabilized Network state.

61In this section we determine the different operational regimes of the network in the (,β)-plane (Figure 5A). In the absence of noise, given that θI 0, a stable D state exists in the semi-plane (Figure 5A, purple and red regions):

62Provided that our choice of synaptic couplings and time constants hold the stability conditions (Equations 21-22), the U state is stable in the semi-plane given by Equation 20 (Figure 5A, orange and red regions):

63In the intersection of these two semi-planes both D and U are stable (bistable region, Figure 5A red). In contrast, in the complementary region to the two semi-planes, neither U nor D are stable (Figure 5A white region). There, a rhythmic concatenation of relatively long U and D periods is observed where the network stays transiently in each state until adaptation triggers a transition (see e.g. Figure 4E). Because of the separation of time-scales, we refer to this stability to the rate dynamics but not to the adaptation dynamics as quasi-stable states.

64The addition of noise makes that some of the stable solutions now become meta-stable, meaning that the network can switch to a different state by the action of the noise (i.e. the external fluctuations in our model). This is the case of the bistable region (Figure 5A red) where fluctuations generate stochastic transitions between the two metastable U and D states (Figure 4D). In the region of D stability, we find a new subregion with noise-driven transitions from a metastable D state to a quasi-stable U state, and back to D by the action of adaptation (Figure 5A light purple). This subregion is delimited by the condition that U is not stable (i.e. Equation 24 does not hold) but just because of the existence of adaptation. This can be written by saying that Equation 24 holds if β = 0:

65Equivalently, within the region of U stability, noise creates a new subregion with noise-driven transitions from a metastable U state to a quasi-stable D state, and back to U by the recovery from adaptation (Figure 5A light orange). This subregion is given by the condition that there is a negative effective threshold (i.e. caused by a supra-threshold mean external drive) but the adaptation recruited in the U state is sufficient to counterbalance it:. This makes the D transiently stable until adaptation decays back to zero. Substituting (Equation 14) and by the equilibrium rate at the U state given by Equation 18, the limit of this subregion can be expressed as (Figure 5A, light orange region):

66We used a network model of leaky integrate-and-fire neurons, with =4000 excitatory and =1000 inhibitory neurons ‘all-to-all’ connected. The membrane potential of a neuron from population and obeys

67Whenever the membrane voltage of a neuron exceeds the threshold at time, a spike is emitted and the membrane voltage is reset to, that is, whenever then. We used = -51 mV, = −49.9 mV and a leak potential of = −57.4 mV. The thresholds were = −45 mV and = −43.9 mV, and we used no spike refractory time. The membrane time constants were = 20 ms and = 10 ms. The external input current is composed of: (1) a Gaussian white noise term with std. dev. = 2.5 mV which is independent from neuron to neuron, that is, and was necessary to generate uncorrelated firing across neurons given the all-to-all connectivity. (2) A separate source of randomly occurring input pulses, also called ‘kicks’, impinging coherently on 10% of both E and I neurons in the network (pi is a binary random variable with probability p=0.1):

68with K being the pulses amplitude (220 mV during D, 110 mV during U for E cells; 88 mV during D, 44 mV during U for I cells), the rise time (0.5 ms) of the pulses and the step function defined as 1 in the interval (0, Δ) and zero otherwise. We used duration Δ = 2 ms and amplitude K causing a depolarization of 16.1 mV (6.44 mV) during D (U) periods in E-kicked neurons, and 12.4 mV (4.9 mV) during D (U) periods in I-kicked neurons. These kicks were necessary to generate synchronous bumps in the membrane potential that would yield transitions to the UP state during DOWN periods in the absence of background activity (see Discussion). The amplitude of these events was constant for the sake of simplicity.

69The recurrent input term consisted of inhibitory and excitatory synaptic currents, that is,, where and is the synaptic strength from neurons in population to neurons in population. The synaptic variable obeyed the following differential equation

70where the summation is over all spikes emitted by all neurons in population (all-to-all connectivity) and the factor ms ensures that the area under the unitary synaptic event is constant regardless of the rise and decay time-constants. The synaptic couplings were = 1.4, = −0.35, = 5 and = −1 mV and the rise and decay times of inhibitory synapses were both 1 ms, while those of excitation were 8 and 23 ms, respectively. These synaptic kinetic constants were chosen in order to reduce the magnitude of the fast oscillations during UPs. The delays were the same for all the postsynaptic synapses belonging to the same neuron and uniformly distributed between 0 and 1 ms (0 and 0.5 ms) across E (I) neurons.

71In addition, the excitatory neurons displayed an after hyperpolarization (AHP) current that follows

72with a slow adaptation time constant = 500 ms and adaptation strength = 300 mVms.

73The population averaged AHP current is defined as

74The E and I nullclines of the population averaged rates and, respectively, are obtained from the equilibrium firing rate, which is given by the self consistent mean-field equation

75where the average input current to a neuron in population is given by

76and the standard deviation of the current is given by the external white noise std. dev.. For this analysis the AHP current Ia was assumed to be constant at the averaged values observed either at the UP onset and offset (see dark and light red E-nullclines in Figure 7A, respectively). The bifurcation diagrams (Figure 7B and Figure 7—figure supplement 2B) were obtained by solving the stationary states of the network from the Fokker Planck equation describing the population dynamics and determining their stability using linear perturbation analysis.

77The spiking network model was implemented in C++, and the code is available at ModelDB (https://senselab.med.yale.edu/ModelDB, ). Model equations were numerically integrated using second-order Runge Kutta, where integration step was defined as dt = 0.05 ms and the total simulation length was 5000 s (50 simulations of 100 s each, where data from first D and U detected periods for each simulation was discarded to eliminate possible initial transient effects). For the analysis of U and D statistics and the rate dynamics in the spiking network simulations we used methods analogous to those applied on the experimental data. In addition, U and D period detection was obtained by applying the HMM on 100 randomly selected neurons, using the same parameters as for the experimental data. Onset and offset aligned population rates and (Figure 7J) were computed using randomly sampled 90 E and 10 I neurons, respectively, with a minimum U/D period duration of 0.8 s.

78In order to study the statistics of UP and DOWN dynamics in the spiking network, where transitions are caused by independent noise among cells (Figure 7—figure supplement 2), external kicks were not included and E cells were depolarized by 5.6 mV to keep their voltage right below their spike threshold. In addition, to keep the UP firing rate stabilized at low values, I cells were depolarized by 6 mV and synaptic decay time constant for excitatory synapses were set to = 2 ms and = 3 ms. In addition, adaptation strength was set to = 200 mVms, and HMM detection parameters chosen as α = 2 and μ = −1. The rest of the parameters are the same as those used in main Figure 7.