Decorrelation of Neural-Network Activity by Inhibitory Feedback

Abstract

Correlations in spike-train ensembles can seriously impair the encoding of information by their spatio-temporal structure. An inevitable source of correlation in finite neural networks is common presynaptic input to pairs of neurons. Recent studies demonstrate that spike correlations in recurrent neural networks are considerably smaller than expected based on the amount of shared presynaptic input. Here, we explain this observation by means of a linear network model and simulations of networks of leaky integrate-and-fire neurons. We show that inhibitory feedback efficiently suppresses pairwise correlations and, hence, population-rate fluctuations, thereby assigning inhibitory neurons the new role of active decorrelation. We quantify this decorrelation by comparing the responses of the intact recurrent network (feedback system) and systems where the statistics of the feedback channel is perturbed (feedforward system). Manipulations of the feedback statistics can lead to a significant increase in the power and coherence of the population response. In particular, neglecting correlations within the ensemble of feedback channels or between the external stimulus and the feedback amplifies population-rate fluctuations by orders of magnitude. The fluctuation suppression in homogeneous inhibitory networks is explained by a negative feedback loop in the one-dimensional dynamics of the compound activity. Similarly, a change of coordinates exposes an effective negative feedback loop in the compound dynamics of stable excitatory-inhibitory networks. The suppression of input correlations in finite networks is explained by the population averaged correlations in the linear network model: In purely inhibitory networks, shared-input correlations are canceled by negative spike-train correlations. In excitatory-inhibitory networks, spike-train correlations are typically positive. Here, the suppression of input correlations is not a result of the mere existence of correlations between excitatory (E) and inhibitory (I) neurons, but a consequence of a particular structure of correlations among the three possible pairings (EE, EI, II).

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 87

1. 1.

   Tripp B, Eliasmith C (2007 ) Neural populations can induce reliable postsynaptic currents without observable spike rate changes or precise spike timing. Cereb Cortex 17: 1830–1840.

   Not in our library10.1093/cercor/bhl092

2. 2.

   Zohary E, Shadlen MN, Newsome WT (1994 ) Correlated neuronal discharge rate and its implications for psychophysical performance. Nature 370: 140–143.

   Not in our library10.1038/370140a0

3. 3.

   Shadlen MN, Newsome WT (1998 ) The variable discharge of cortical neurons: Implications for connectivity, computation, and information coding. J Neurosci 18: 3870–3896.

   Not in our library10.1523/jneurosci.18-10-03870.1998

4. 4.

   Salinas E, Sejnowski TJ (2001 ) Correlated neuronal activity and the ow of neural information. Nat Rev Neurosci 2: 539–550.

   Not in our library10.1038/35086012

5. 5.

   von der Malsburg C (1981) The correlation theory of brain function. Internal report 81-2, Department of Neurobiology, Max-Planck-Institute for Biophysical Chemistry, Göttingen, Germany.

   Not in our library

6. 6.

   Bienenstock E (1995 ) A model of neocortex. Network: Comput Neural Sys 6: 179–224.

   Not in our library

7. 7.

   Abeles M (1991) Corticonics: Neural Circuits of the Cerebral Cortex. Cambridge: Cambridge University Press, 1st edition.

   Not in our library

8. 8.

   Diesmann M, Gewaltig MO, Aertsen A (1999 ) Stable propagation of synchronous spiking in cortical neural networks. Nature 402: 529–533.

   Not in our library10.1038/990101

9. 9.

   Tetzlaff T, Morrison A, Geisel T, Diesmann M (2004 ) Consequences of realistic network size on the stability of embedded synfire chains. Neurocomputing 58–60: 117–121.

   Not in our library

10. 10.

    Ecker AS, Berens P, Keliris GA, Bethge M, Logothetis NK (2010 ) Decorrelated neuronal firing in cortical microcircuits. Science 327: 584–587.

    Not in our library10.1126/science.1179867

11. 11.

    van Vreeswijk C, Sompolinsky H (1996 ) Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274: 1724–1726.

    Not in our library10.1126/science.274.5293.1724

12. 12.

    Brunel N (2000 ) Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J Comput Neurosci 8: 183–208.

    Not in our library10.1023/a:1008925309027

13. 13.

    Gerstner W (2000 ) Population dynamics of spiking neurons: fast transients, asynchronous states, and locking. Neural Comput 12: 43–89.

    Not in our library10.1162/089976600300015899

14. 14.

    Tetzlaff T, Rotter S, Stark E, Abeles M, Aertsen A, et al (2008 ) Dependence of neuronal correlations on filter characteristics and marginal spike-train statistics. Neural Comput 20: 2133–2184.

    Not in our library10.1162/neco.2008.05-07-525

15. 15.

    Kriener B, Tetzlaff T, Aertsen A, Diesmann M, Rotter S (2008 ) Correlations and population dynamics in cortical networks. Neural Comput 20: 2185–2226.

    Not in our library10.1162/neco.2008.02-07-474

16. 16.

    Hertz J (2010 ) Cross-correlations in high-conductance states of a model cortical network. Neural Comput 22: 427–447.

    Not in our library10.1162/neco.2009.06-08-806

17. 17.

    Renart A, De La Rocha J, Bartho P, Hollender L, Parga N, et al (2010 ) The asynchronous state in cortical cicuits. Science 327: 587–590.

    Not in our library10.1126/science.1179850

18. 18.

    Stroeve S, Gielen S (2001 ) Correlation between uncoupled conductance-based integrate-and-fire neurons due to common and synchronous presynaptic firing. Neural Comput 13: 2005–2029.

    Not in our library10.1162/089976601750399281

19. 19.

    Tetzlaff T, Buschermöhle M, Geisel T, Diesmann M (2003 ) The spread of rate and correlation in stationary cortical networks. Neurocomputing 52–54: 949–954.

    Not in our library

20. 20.

    Moreno-Bote R, Parga N (2006 ) Auto- and crosscorrelograms for the spike response of leaky integrate-and-fire neurons with slow synapses. Phys Rev Lett 96: 028101.

    Not in our library10.1103/physrevlett.96.028101

21. 21.

    De la Rocha J, Doiron B, Shea-Brown E, Kresimir J, Reyes A (2007 ) Correlation between neural spike trains increases with firing rate. Nature 448: 802–807.

    Not in our library10.1038/nature06028

22. 22.

    Rosenbaum R, Josic K (2011 ) Mechanisms that modulate the transfer of spiking correlations. Neural Comput 23: 1261–1305.

    Not in our library10.1162/neco_a_00116

23. 23.

    Battaglia D, Brunel N, Hansel D (2007 ) Temporal decorrelation of collective oscillations in neural networks with local inhibition and long-range excitation. Phys Rev Lett 99: 238106.

    Not in our library10.1103/physrevlett.99.238106

24. 24.

    Monteforte M, Wolf F (2010 ) Dynamical entropy production in spiking neuron networks in the balanced state. Phys Rev Lett 105 doi: 268104.

    Not in our library10.1103/physrevlett.105.268104

25. 25.

    Jahnke S, Memmesheimer RM, Timme M (2009 ) How chaotic is the balanced state? Front Comput Neurosci 3: 1–15.

    Not in our library10.3389/neuro.10.013.2009

26. 26.

    Legenstein R, Maass W (2007 ) Edge of chaos and prediction of computational performance for neural circuit models. Neural Netw 20: 323–334.

    Not in our library10.1016/j.neunet.2007.04.017

27. 27.

    Jahnke S, Memmesheimer R, Timme M (2008 ) Stable irregular dynamics in complex neural networks. Phys Rev Lett 100: 048102.

    Not in our library10.1103/physrevlett.100.048102

28. 28.

    Toyoizumi T, Abbott LF (2010 ) Beyond the edge: Amplification and temporal integration by recurrent networks in the chaotic regime. Front Neurosci doi: 10.3389/conf.fnins.2010.03.00155.

    Not in our library10.1103/physreve.84.051908

29. 29.

    Zillmer R, Livi R, Politi A, Torcini A (2006 ) Desynchronization in diluted neural networks. Phys Rev E 74: 036203.

    Not in our library10.1103/physreve.74.036203

30. 30.

    Ginzburg I, Sompolinsky H (1994 ) Theory of correlations in stochastic neural networks. Phys Rev E 50: 3171–3191.

    Not in our library10.1103/physreve.50.3171

31. 31.

    Brunel N, Hakim V (1999 ) Fast global oscillations in networks of integrate-and-_re neurons with low firing rates. Neural Comput 11: 1621–1671.

    Not in our library10.1162/089976699300016179

32. 32.

    Harris KD, Thiele A (2011 ) Cortical state and attention. Nat Rev Neurosci 12: 509–523.

    Not in our library10.1038/nrn3084

33. 33.
    Instantaneous non-linear processing by pulse-coupled threshold units. · 2010

    Not checked
34. 34.

    Richardson MJE, Swarbrick R (2010 ) Firing-rate response of a neuron receiving excitatory and inhibitory synaptic shot noise. Phys Rev Lett 105: 178102.

    Not in our library10.1103/physrevlett.105.178102

35. 35.

    Fourcaud-Trocmé N, Hansel D, van Vreeswijk C (2003 ) Brunel (2003 ) How spike generation mechanisms determine the neuronal response to uctuating inputs. J Neurosci 23: 11628–11640.

    Not in our library10.1523/jneurosci.23-37-11628.2003

36. 36.

    Naundorf B, Geisel T, Wolf F (2005 ) Action potential onset dynamics and the response speed of neuronal populations. J Comput Neurosci 18: 297–309.

    Not in our library10.1007/s10827-005-0329-8

37. 37.

    Brunel N, Chance FS, Fourcaud N, Abbott LF (2001 ) Effects of synaptic noise and filtering on the frequency response of spiking neurons. Phys Rev Lett 86: 2186–2189.

    Not in our library10.1103/physrevlett.86.2186

38. 38.

    Nordlie E, Tetzlaff T, Einevoll GT (2010 ) Rate dynamics of leaky integrate-and-fire neurons with strong synapses. Front Comput Neurosci 4: 149.

    Not in our library10.3389/fncom.2010.00149

39. 39.

    Pressley J, Troyer TW (2009 ) Complementary responses to mean and variance modulations in the perfect integrate-and-fire model. Biol Cybern 101: 63–70.

    Not in our library10.1007/s00422-009-0317-6

40. 40.

    Knight BW (1972 ) The relationship between the firing rate of a single neuron and the level of activity in a population of neurons. J Gen Physiol 59: 767–778.

    Not in our library10.1085/jgp.59.6.767

Cited by papers we hold 11

• The Interplay Between Cortical State and Perceptual Learning: A Focused Review · 2018
  Not checked
• The Dynamical Regime of Sensory Cortex: Stable Dynamics around a Single Stimulus-Tuned Attractor Account for Patterns of Noise Variability · 2018
  No notice
• Parvalbumin+ interneurons obey unique connectivity rules and establish a powerful lateral-inhibition microcircuit in dentate gyrus · 2018
  No notice
• A stochastic-field description of finite-size spiking neural networks. · 2017
  Not checked
• 26th Annual Computational Neuroscience Meeting (CNS*2017): Part 2 · 2017
  Not checked
• Bistability, non-ergodicity, and inhibition in pairwise maximum-entropy models. · 2017
  Not checked
• Sparse synaptic connectivity is required for decorrelation and pattern separation in feedforward networks · 2017
  No notice
• Dynamic Balance of Excitation and Inhibition in Human and Monkey Neocortex · 2016
  No notice
• Small modifications to network topology can induce stochastic bistable spiking dynamics in a balanced cortical model. · 2014
  Not checked
• Power laws from linear neuronal cable theory: power spectral densities of the soma potential, soma membrane current and single-neuron contribution to the EEG. · 2014
  Not checked
• How Structure Determines Correlations in Neuronal Networks · 2011
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.