Decorrelation of Neural-Network Activity by Inhibitory Feedback

Abstract

Correlations in spike-train ensembles can seriously impair the encoding of information by their spatio-temporal structure. An inevitable source of correlation in finite neural networks is common presynaptic input to pairs of neurons. Recent studies demonstrate that spike correlations in recurrent neural networks are considerably smaller than expected based on the amount of shared presynaptic input. Here, we explain this observation by means of a linear network model and simulations of networks of leaky integrate-and-fire neurons. We show that inhibitory feedback efficiently suppresses pairwise correlations and, hence, population-rate fluctuations, thereby assigning inhibitory neurons the new role of active decorrelation. We quantify this decorrelation by comparing the responses of the intact recurrent network (feedback system) and systems where the statistics of the feedback channel is perturbed (feedforward system). Manipulations of the feedback statistics can lead to a significant increase in the power and coherence of the population response. In particular, neglecting correlations within the ensemble of feedback channels or between the external stimulus and the feedback amplifies population-rate fluctuations by orders of magnitude. The fluctuation suppression in homogeneous inhibitory networks is explained by a negative feedback loop in the one-dimensional dynamics of the compound activity. Similarly, a change of coordinates exposes an effective negative feedback loop in the compound dynamics of stable excitatory-inhibitory networks. The suppression of input correlations in finite networks is explained by the population averaged correlations in the linear network model: In purely inhibitory networks, shared-input correlations are canceled by negative spike-train correlations. In excitatory-inhibitory networks, spike-train correlations are typically positive. Here, the suppression of input correlations is not a result of the mere existence of correlations between excitatory (E) and inhibitory (I) neurons, but a consequence of a particular structure of correlations among the three possible pairings (EE, EI, II).

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 87

1. 1.

   Tripp B, Eliasmith C (2007 ) Neural populations can induce reliable postsynaptic currents without observable spike rate changes or precise spike timing. Cereb Cortex 17: 1830–1840.

   Not in our library10.1093/cercor/bhl092

2. 2.

   Zohary E, Shadlen MN, Newsome WT (1994 ) Correlated neuronal discharge rate and its implications for psychophysical performance. Nature 370: 140–143.

   Not in our library10.1038/370140a0

3. 3.

   Shadlen MN, Newsome WT (1998 ) The variable discharge of cortical neurons: Implications for connectivity, computation, and information coding. J Neurosci 18: 3870–3896.

   Not in our library10.1523/jneurosci.18-10-03870.1998

4. 4.

   Salinas E, Sejnowski TJ (2001 ) Correlated neuronal activity and the ow of neural information. Nat Rev Neurosci 2: 539–550.

   Not in our library10.1038/35086012

5. 5.

   von der Malsburg C (1981) The correlation theory of brain function. Internal report 81-2, Department of Neurobiology, Max-Planck-Institute for Biophysical Chemistry, Göttingen, Germany.

   Not in our library

6. 6.

   Bienenstock E (1995 ) A model of neocortex. Network: Comput Neural Sys 6: 179–224.

   Not in our library

7. 7.

   Abeles M (1991) Corticonics: Neural Circuits of the Cerebral Cortex. Cambridge: Cambridge University Press, 1st edition.

   Not in our library

8. 8.

   Diesmann M, Gewaltig MO, Aertsen A (1999 ) Stable propagation of synchronous spiking in cortical neural networks. Nature 402: 529–533.

   Not in our library10.1038/990101

9. 9.

   Tetzlaff T, Morrison A, Geisel T, Diesmann M (2004 ) Consequences of realistic network size on the stability of embedded synfire chains. Neurocomputing 58–60: 117–121.

   Not in our library

10. 10.

    Ecker AS, Berens P, Keliris GA, Bethge M, Logothetis NK (2010 ) Decorrelated neuronal firing in cortical microcircuits. Science 327: 584–587.

    Not in our library10.1126/science.1179867

11. 11.

    van Vreeswijk C, Sompolinsky H (1996 ) Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274: 1724–1726.

    Not in our library10.1126/science.274.5293.1724

12. 12.

    Brunel N (2000 ) Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J Comput Neurosci 8: 183–208.

    Not in our library10.1023/a:1008925309027

13. 13.

    Gerstner W (2000 ) Population dynamics of spiking neurons: fast transients, asynchronous states, and locking. Neural Comput 12: 43–89.

    Not in our library10.1162/089976600300015899

14. 14.

    Tetzlaff T, Rotter S, Stark E, Abeles M, Aertsen A, et al (2008 ) Dependence of neuronal correlations on filter characteristics and marginal spike-train statistics. Neural Comput 20: 2133–2184.

    Not in our library10.1162/neco.2008.05-07-525

15. 15.

    Kriener B, Tetzlaff T, Aertsen A, Diesmann M, Rotter S (2008 ) Correlations and population dynamics in cortical networks. Neural Comput 20: 2185–2226.

    Not in our library10.1162/neco.2008.02-07-474

16. 16.

    Hertz J (2010 ) Cross-correlations in high-conductance states of a model cortical network. Neural Comput 22: 427–447.

    Not in our library10.1162/neco.2009.06-08-806

17. 17.

    Renart A, De La Rocha J, Bartho P, Hollender L, Parga N, et al (2010 ) The asynchronous state in cortical cicuits. Science 327: 587–590.

    Not in our library10.1126/science.1179850

18. 18.

    Stroeve S, Gielen S (2001 ) Correlation between uncoupled conductance-based integrate-and-fire neurons due to common and synchronous presynaptic firing. Neural Comput 13: 2005–2029.

    Not in our library10.1162/089976601750399281

19. 19.

    Tetzlaff T, Buschermöhle M, Geisel T, Diesmann M (2003 ) The spread of rate and correlation in stationary cortical networks. Neurocomputing 52–54: 949–954.

    Not in our library

20. 20.

    Moreno-Bote R, Parga N (2006 ) Auto- and crosscorrelograms for the spike response of leaky integrate-and-fire neurons with slow synapses. Phys Rev Lett 96: 028101.

    Not in our library10.1103/physrevlett.96.028101

21. 21.

    De la Rocha J, Doiron B, Shea-Brown E, Kresimir J, Reyes A (2007 ) Correlation between neural spike trains increases with firing rate. Nature 448: 802–807.

    Not in our library10.1038/nature06028

22. 22.

    Rosenbaum R, Josic K (2011 ) Mechanisms that modulate the transfer of spiking correlations. Neural Comput 23: 1261–1305.

    Not in our library10.1162/neco_a_00116

23. 23.

    Battaglia D, Brunel N, Hansel D (2007 ) Temporal decorrelation of collective oscillations in neural networks with local inhibition and long-range excitation. Phys Rev Lett 99: 238106.

    Not in our library10.1103/physrevlett.99.238106

24. 24.

    Monteforte M, Wolf F (2010 ) Dynamical entropy production in spiking neuron networks in the balanced state. Phys Rev Lett 105 doi: 268104.

    Not in our library10.1103/physrevlett.105.268104

25. 25.

    Jahnke S, Memmesheimer RM, Timme M (2009 ) How chaotic is the balanced state? Front Comput Neurosci 3: 1–15.

    Not in our library10.3389/neuro.10.013.2009

26. 26.

    Legenstein R, Maass W (2007 ) Edge of chaos and prediction of computational performance for neural circuit models. Neural Netw 20: 323–334.

    Not in our library10.1016/j.neunet.2007.04.017

27. 27.

    Jahnke S, Memmesheimer R, Timme M (2008 ) Stable irregular dynamics in complex neural networks. Phys Rev Lett 100: 048102.

    Not in our library10.1103/physrevlett.100.048102

28. 28.

    Toyoizumi T, Abbott LF (2010 ) Beyond the edge: Amplification and temporal integration by recurrent networks in the chaotic regime. Front Neurosci doi: 10.3389/conf.fnins.2010.03.00155.

    Not in our library10.1103/physreve.84.051908

29. 29.

    Zillmer R, Livi R, Politi A, Torcini A (2006 ) Desynchronization in diluted neural networks. Phys Rev E 74: 036203.

    Not in our library10.1103/physreve.74.036203

30. 30.

    Ginzburg I, Sompolinsky H (1994 ) Theory of correlations in stochastic neural networks. Phys Rev E 50: 3171–3191.

    Not in our library10.1103/physreve.50.3171

31. 31.

    Brunel N, Hakim V (1999 ) Fast global oscillations in networks of integrate-and-_re neurons with low firing rates. Neural Comput 11: 1621–1671.

    Not in our library10.1162/089976699300016179

32. 32.

    Harris KD, Thiele A (2011 ) Cortical state and attention. Nat Rev Neurosci 12: 509–523.

    Not in our library10.1038/nrn3084

33. 33.
    Instantaneous non-linear processing by pulse-coupled threshold units. · 2010

    Not checked
34. 34.

    Richardson MJE, Swarbrick R (2010 ) Firing-rate response of a neuron receiving excitatory and inhibitory synaptic shot noise. Phys Rev Lett 105: 178102.

    Not in our library10.1103/physrevlett.105.178102

35. 35.

    Fourcaud-Trocmé N, Hansel D, van Vreeswijk C (2003 ) Brunel (2003 ) How spike generation mechanisms determine the neuronal response to uctuating inputs. J Neurosci 23: 11628–11640.

    Not in our library10.1523/jneurosci.23-37-11628.2003

36. 36.

    Naundorf B, Geisel T, Wolf F (2005 ) Action potential onset dynamics and the response speed of neuronal populations. J Comput Neurosci 18: 297–309.

    Not in our library10.1007/s10827-005-0329-8

37. 37.

    Brunel N, Chance FS, Fourcaud N, Abbott LF (2001 ) Effects of synaptic noise and filtering on the frequency response of spiking neurons. Phys Rev Lett 86: 2186–2189.

    Not in our library10.1103/physrevlett.86.2186

38. 38.

    Nordlie E, Tetzlaff T, Einevoll GT (2010 ) Rate dynamics of leaky integrate-and-fire neurons with strong synapses. Front Comput Neurosci 4: 149.

    Not in our library10.3389/fncom.2010.00149

39. 39.

    Pressley J, Troyer TW (2009 ) Complementary responses to mean and variance modulations in the perfect integrate-and-fire model. Biol Cybern 101: 63–70.

    Not in our library10.1007/s00422-009-0317-6

40. 40.

    Knight BW (1972 ) The relationship between the firing rate of a single neuron and the level of activity in a population of neurons. J Gen Physiol 59: 767–778.

    Not in our library10.1085/jgp.59.6.767

41. 41.

    Köndgen H, Geisler C, Fusi S, Wang XJ, Lüscher HR, et al (2008 ) The dynamical response properties of neocortical neurons to temporally modulated noisy inputs in vitro. Cereb Cortex 18: 2086–2097.

    Not in our library10.1093/cercor/bhm235

42. 42.

    Boucsein C, Tetzlaff T, Meier R, Aertsen A, Naundorf B (2009 ) Dynamical response properties of neocortical neuron ensembles: multiplicative versus additive noise. J Neurosci 29: 1006–1010.

    Not in our library10.1523/jneurosci.3424-08.2009

43. 43.

    Blomquist P, Devor A, Indahl UG, Ulbert I, Einevoll GT, et al (2009 ) Estimation of thalamocortical and intracortical network models from joint thalamic single-electrode and cortical laminarelectrode recordings in the rat barrel system. PLoS Comput Biol 5: e1000328.

    Not in our library10.1371/journal.pcbi.1000328

44. 44.

    Knight BW (1972 ) Dynamics of encoding in a population of neurons. J Gen Physiol 59: 734–766.

    Not in our library10.1085/jgp.59.6.734

45. 45.

    Lindner B, Schimansky-Geier L (2001 ) Transmission of noise coded versus additive signals through a neuronal ensemble. Phys Rev Lett 86: 2934–2937.

    Not in our library10.1103/physrevlett.86.2934

46. 46.

    Fourcaud N, Brunel N (2002 ) Dynamics of the firing probability of noisy integrate-and-fire neurons. Neural Comput 14: 2057–2110.

    Not in our library10.1162/089976602320264015

47. 47.

    Oppenheim A, Wilsky A (1996) Systems and signals. Upper Saddle River, NJ: Prentice Hall.

    Not in our library

48. 48.

    Troyer TW, Krukowski AE, Miller KD (2002 ) LGN input to simple cells and contrast-invariant orientation tuning: An analysis. J Neurophysiol 87: 2741–2752.

    Not in our library10.1152/jn.2002.87.6.2741

49. 49.

    Zhaoping L, Lewis A, Scarpetta S (2004 ) Mathematical analysis and simulations of the neural circuit for locomotion in lampreys. Phys Rev Lett 92: 198106.

    Not in our library10.1103/physrevlett.92.198106

50. 50.

    Murphy BK, Miller KD (2009 ) Balanced amplification: A new mechanism of selective amplification of neural activity patterns. Neuron 61: 635–648.

    Not in our library10.1016/j.neuron.2009.02.005

51. 51.

    Moreno-Bote R, Renart A, Parga N (2008 ) Theory of input spike auto- and cross-correlations and their effect on the response of spiking neurons. Neural Comput 20: 1651–1705.

    Not in our library10.1162/neco.2008.03-07-497

52. 52.

    Shadlen MN, Newsome WT (2001 ) Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J Neurophysiol 86: 1916–1936.

    Not in our library10.1152/jn.2001.86.4.1916

53. 53.

    Gentet L, Avermann M, Matyas F, Staiger JF, Petersen CC (2010 ) Membrane potential dynamics of GABAergic neurons in the barrel cortex of behaving mice. Neuron 65: 422–435.

    Not in our library10.1016/j.neuron.2010.01.006

54. 54.
    How Structure Determines Correlations in Neuronal Networks · 2011

    No notice
55. 55.

    Pernice V, Staude B, Cardanobile S, Rotter S (2012 ) Recurrent interactions in spiking networks with arbitrary topology. Phys Rev E 85: 031916.

    Not in our library10.1103/physreve.85.031916

56. 56.
    Impact of Network Structure and Cellular Response on Spike Time Correlations · 2012

    No notice
57. 57.

    Softky WR, Koch C (1993 ) The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J Neurosci 13: 334–350.

    Not in our library10.1523/jneurosci.13-01-00334.1993

58. 58.

    Tetzlaff T, Geisel T, Diesmann M (2002 ) The ground state of cortical feed-forward networks. Neurocomputing 44–46: 673–678.

    Not in our library

59. 59.

    Mehring C, Hehl U, Kubo M, Diesmann M, Aertsen A (2003 ) Activity dynamics and propagation of synchronous spiking in locally connected random networks. Biol Cybern 88: 395–408.

    Not in our library10.1007/s00422-002-0384-4

60. 60.

    Aviel Y, Mehring C, Abeles M, Horn D (2003 ) On embedding synfire chains in a balanced network. Neural Comput 15: 1321–1340.

    Not in our library10.1162/089976603321780290

61. 61.

    Aviel Y, Horn D, Abeles M (2005 ) Memory capacity of balanced networks. Neural Comput 17: 691–713.

    Not in our library10.1162/0899766053019962

62. 62.

    Bi G, Poo M (1998 ) Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18: 10464–10472.

    Not in our library10.1523/jneurosci.18-24-10464.1998

63. 63.

    Gilson M, Burkitt AN, Grayden DB, Thomas DA, van Hemmen JL (2009 ) Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity - strengthening correlated input pathways. Biol Cybern 101: 81–102.

    Not in our library10.1007/s00422-009-0319-4

64. 64.

    Burkitt AN, Gilson M, van Hemmen J (2007 ) Spike-timing-dependent plasticity for neurons with recurrent connections. Biol Cybern 96: 533–546.

    Not in our library10.1007/s00422-007-0148-2

65. 65.

    Pfister JP, Tass PA (2010 ) Stdp in oscillatory recurrent networks: theoretical conditions for desynchronization and applications to deep brain stimulation. Front Comput Neurosci 454 doi: 10.3389/fncom.2010.00022.

    Not in our library10.3389/fncom.2010.00022

66. 66.

    Lindner B, Doiron B, Longtin A (2005 ) Theory of oscillatory firing induced by spatially correlated noise and delayed inhibitory feedback. Phys Rev E 72: 061919.

    Not in our library10.1103/physreve.72.061919

67. 67.

    Buice MA, Cowan JD, Chow CC (2009 ) Systematic uctuation expansion for neural network activity equations. Neural Comput 22: 377–426.

    Not in our library10.1162/neco.2009.02-09-960

68. 68.

    Sommers H, Crisanti A, Sompolinsky H, Stein Y (1988 ) Spectrum of large random asymmetric matrices. Phys Rev Lett 60: 1895–1898.

    Not in our library10.1103/physrevlett.60.1895

69. 69.

    Rajan K, Abbott L (2006 ) Eigenvalue spectra of random matrices for neural networks. Phys Rev Lett 97: 188104.

    Not in our library10.1103/physrevlett.97.188104

70. 70.

    Sompolinsky, Crisanti, Sommers (1988 ) Chaos in random neural networks. Phys Rev Lett 61: 259–262.

    Not in our library10.1103/physrevlett.61.259

71. 71.

    Toyoizumi T, Rad KR, Paninski L (2009 ) Mean-field approximations for coupled populations of generalized linear model spiking neurons with markov refractoriness. Neural Comput 21: 1203–1243.

    Not in our library10.1162/neco.2008.04-08-757

72. 72.

    Sirovich L, Omurtag A, Knight BW (2000 ) Dynamics of neuronal populations: The equilibrium solution. SIAM J Appl Math 60: 2009–2028.

    Not in our library

73. 73.

    Jacobsen M, Jensen AT (2007 ) Exit times for a class of piecewise exponential markov processes with two-sided jumps. Stoch Proc Appl 117: 1330–1356.

    Not in our library

74. 74.

    Cox DR (1962) Renewal Theory. Science Paperbacks. London: Chapman and Hall.

    Not in our library

75. 75.

    Nawrot MP, Boucsein C, Rodriguez Molina V, Riehle A, Aertsen A, et al (2008 ) Measurement of variability dynamics in cortical spike trains. J Neurosci Methods 169: 374–390.

    Not in our library10.1016/j.jneumeth.2007.10.013

76. 76.

    Chizhov AV, Graham LJ (2008 ) Efficient evaluation of neuron populations receiving colored-noise current based on a refractory density method. Phys Rev E 77: 011910.

    Not in our library10.1103/physreve.77.011910

77. 77.

    Meyer C, van Vreeswijk C (2002 ) Temporal correlations in stochastic networks of spiking neurons. Neural Comput 14: 369–404.

    Not in our library10.1162/08997660252741167

78. 78.

    Hebb DO (1949) The organization of behavior: A neuropsychological theory. New York: John Wiley & Sons.

    Not in our library

79. 79.
    Structural plasticity controlled by calcium based correlation detection · 2008

    Not checked
80. 80.

    Loebel A, Silberberg G, Helbig D, Markram H, Tsodyks M, et al (2009 ) Multiquantal release underlies the distribution of synaptic efficacies in the neocortex. Front Comput Neurosci 3: 27.

    Not in our library10.3389/neuro.10.027.2009

81. 81.

    Gewaltig MO, Diesmann M (2007 ) NEST (NEural Simulation Tool). Scholarpedia 2: 1430.

    Not in our library

82. 82.

    Hawkes A (1971 ) Point spectra of some mutually exciting point process. J R Statist Soc Ser B 33: 438–443.

    Not in our library

83. 83.

    Risken H (1996) The Fokker-Planck Equation. Berlin: Springer Verlag.

    Not in our library

84. 84.

    Siegert AJ (1951 ) On the first passage time probability problem. Phys Rev 81: 617–623.

    Not in our library

85. 85.
    Equilibrium and response properties of the integrate-and-fire neuron in discrete time · 2010

    Not checked
86. 86.

    Tuckwell HC (1988) Introduction to Theoretical Neurobiology, volume 1. Cambridge: Cambridge University Press.

    Not in our library

87. 87.

    Rotter S, Diesmann M (1999 ) Exact digital simulation of time-invariant linear systems with applications to neuronal modeling. Biol Cybern 81: 381–402.

    Not in our library10.1007/s004220050570

Cited by papers we hold 11

• The Interplay Between Cortical State and Perceptual Learning: A Focused Review · 2018
  Not checked
• The Dynamical Regime of Sensory Cortex: Stable Dynamics around a Single Stimulus-Tuned Attractor Account for Patterns of Noise Variability · 2018
  No notice
• Parvalbumin+ interneurons obey unique connectivity rules and establish a powerful lateral-inhibition microcircuit in dentate gyrus · 2018
  No notice
• A stochastic-field description of finite-size spiking neural networks. · 2017
  Not checked
• 26th Annual Computational Neuroscience Meeting (CNS*2017): Part 2 · 2017
  Not checked
• Bistability, non-ergodicity, and inhibition in pairwise maximum-entropy models. · 2017
  Not checked
• Sparse synaptic connectivity is required for decorrelation and pattern separation in feedforward networks · 2017
  No notice
• Dynamic Balance of Excitation and Inhibition in Human and Monkey Neocortex · 2016
  No notice
• Small modifications to network topology can induce stochastic bistable spiking dynamics in a balanced cortical model. · 2014
  Not checked
• Power laws from linear neuronal cable theory: power spectral densities of the soma potential, soma membrane current and single-neuron contribution to the EEG. · 2014
  Not checked
• How Structure Determines Correlations in Neuronal Networks · 2011
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.