Active inference on discrete state-spaces: A synthesis

Abstract

Active inference is a normative principle underwriting perception, action, planning, decision-making and learning in biological or artificial agents. From its inception, its associated process theory has grown to incorporate complex generative models, enabling simulation of a wide range of complex behaviours. Due to successive developments in active inference, it is often difficult to see how its underlying principle relates to process theories and practical implementation. In this paper, we try to bridge this gap by providing a complete mathematical synthesis of active inference on discrete state-space models. This technical summary provides an overview of the theory, derives neuronal dynamics from first principles and relates this dynamics to biological processes. Furthermore, this paper provides a fundamental building block needed to understand active inference for mixed generative models; allowing continuous sensations to inform discrete representations. This paper may be used as follows: to guide research towards outstanding challenges, a practical guide on how to implement active inference to simulate experimental behaviour, or a pointer towards various in-silico neurophysiological responses that may be used to make empirical predictions.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 191

1. 1.

   Ackley D.H., Hinton G.E., Sejnowski T.J. A learning algorithm for Boltzmann machines. Cognitive Science. 1985;9(1):147-169.

   Not in our library10.1016/s0364-0213(85)80012-4

2. 2.
   The Computational Anatomy of Psychosis · 2013

   No notice
3. 3.

   Aitchison L., Lengyel M. With or without you: Predictive coding and Bayesian inference in the brain. Current Opinion in Neurobiology. 2017;46:219-227.

   Not in our library10.1016/j.conb.2017.08.010

4. 4.

   Allenby G.M., Rossi P.E., McCulloch R.E. Hierarchical Bayes models: A practitioners guide. Journal of Bayesian Applications in Marketing. 2005.

   Not in our library

5. 5.

   Ashby W.R. Principles of the self-organizing dynamic system. The Journal of General Psychology. 1947;37(2):125-128.

   Not in our library10.1080/00221309.1947.9918144

6. 6.

   Aström K.J. Optimal control of Markov processes with incomplete state information. Journal of Mathematical Analysis and Applications. 1965;10.

   Not in our library

7. 7.

   Attias H. Planning by probabilistic inference. 9th int. workshop on artificial intelligence and statistics. 2003;8.

   Not in our library

8. 8.

   Barlow H.B. Possible principles underlying the transformations of sensory messages. 1961.

   Not in our library

9. 9.

   Barlow H. Inductive inference, coding, perception, and language. Perception. 1974;3(2):123-134.

   Not in our library10.1068/p030123

10. 10.

    Barlow H. Redundancy reduction revisited. Computation and Neural Systems. 2001;13.

    Not in our library

11. 11.
    Novelty or Surprise? · 2013

    No notice
12. 12.

    Barto A., Sutton R. Reinforcement learning: An introduction. 1992.

    Not in our library

13. 13.

    Bastos A.M., Usrey W.M., Adams R.A., Mangun G.R., Fries P., Friston K.J. Canonical microcircuits for predictive coding. Neuron. 2012;76(4):695-711.

    Not in our library10.1016/j.neuron.2012.10.038

14. 14.

    Beal M.J. Variational algorithms for approximate Bayesian inference. 2003;281.

    Not in our library

15. 15.

    Benrimoh D., Parr T., Vincent P., Adams R.A., Friston K. Active inference and auditory hallucinations. Computational Psychiatry. 2018;2:183-204.

    Not in our library10.1162/cpsy˙a˙00022

16. 16.

    Berger J.O. Statistical decision theory and Bayesian analysis. 1985.

    Not in our library10.1007/978-1-4757-4286-2

17. 17.

    Bernard C. Lectures on the phenomena of life common to animals and plants. 1974.

    Not in our library

18. 18.

    Berns G.S., Sejnowski T.J., Damasio A.R., Damasio H., Christen Y. How the basal ganglia make decisions. Neurobiology of decision-making. 1996;101-113.

    Not in our library10.1007/978-3-642-79928-0˙6

19. 19.

    Bishop C.M. Pattern recognition and machine learning. 2006.

    Not in our library

20. 20.

    Blei D.M., Kucukelbir A., McAuliffe J.D. Variational inference: A review for statisticians. Journal of the American Statistical Association. 2017;112(518):859-877.

    Not in our library10.1080/01621459.2017.1285773

21. 21.
    A tutorial on the free-energy framework for modelling perception and learning · 2017

    No notice
22. 22.

    Bossaerts P., Murawski C. From behavioural economics to neuroeconomics to decision neuroscience: The ascent of biology in research on human decision making. Current Opinion in Behavioral Sciences. 2015;5:37-42.

    Not in our library10.1016/j.cobeha.2015.07.001

23. 23.

    Botvinick M., Toussaint M. Planning as inference. Trends in Cognitive Sciences. 2012;16(10):485-488.

    Not in our library10.1016/j.tics.2012.08.006

24. 24.

    Box G.E.P., Tiao G.C. Multiparameter problems from a Bayesian point of view. The Annals of Mathematical Statistics. 1965.

    Not in our library

25. 25.

    Bruineberg J., Rietveld E., Parr T., van Maanen L., Friston K.J. Free-energy minimization in joint agent-environment systems: A niche construction perspective. Journal of Theoretical Biology. 2018;455:161-178.

    Not in our library10.1016/j.jtbi.2018.07.002

26. 26.

    Buckley C.L., Kim C.S., McGregor S., Seth A.K. The free energy principle for action and perception: A mathematical review. Journal of Mathematical Psychology. 2017;81:55-79.

    Not in our library10.1016/j.jmp.2017.09.004

27. 27.

    Buschman T.J., Miller E.K. Shifting the spotlight of attention: Evidence for discrete computations in cognition. Frontiers in Human Neuroscience. 2010;4.

    Not in our library10.3389/fnhum.2010.00194

28. 28.

    Carpenter G.A., Grossberg S. A massively parallel architecture for a self-organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing. 1987;37(1):54-115.

    Not in our library10.1016/s0734-189x(87)80014-2

29. 29.

    Çatal O., Nauta J., Verbelen T., Simoens P., Dhoedt B. Bayesian policy selection using active inference. 2019.

    Not in our library

30. 30.

    Chao Z.C., Takaura K., Wang L., Fujii N., Dehaene S. Large-scale cortical networks for hierarchical prediction and prediction error in the primate brain. Neuron. 2018;100(5):1252-1266.e3.

    Not in our library10.1016/j.neuron.2018.10.004

31. 31.

    Claeskens G., Hjort N.L. Model selection and model averaging. 2006.

    Not in our library

32. 32.

    Conant R.C., Ashby W.R. Every good regulator of a system must be a model of that system. International Journal of Systems Science. 1970;1(2):89-97.

    Not in our library

33. 33.

    Constant A., Ramstead M., Veissière S.P.L., Campbell J.O., Friston K. A variational approach to niche construction. Journal of the Royal Society Interface. 2018;15(141).

    Not in our library10.1098/rsif.2017.0685

34. 34.

    Constant A., Ramstead M.J.D., Veissière S.P.L., Friston K. Regimes of expectations: an active inference model of social conformity and human decision making. Frontiers in Psychology. 2019;10.

    Not in our library10.3389/fpsyg.2019.00679

35. 35.

    Cullen M., Davey B., Friston K.J., Moran R.J. Active inference in openai gym: A paradigm for computational investigations into psychiatric illness. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging. 2018;3(9):809-818.

    Not in our library10.1016/j.bpsc.2018.06.010

36. 36.

    Da Costa L., Sajid N., Parr T., Friston K., Smith R. The relationship between dynamic programming and active inference: The discrete, finite horizon case. 2020.

    Not in our library

37. 37.

    Dan Y., Atick J.J., Reid R.C. Efficient coding of natural scenes in the lateral geniculate nucleus: Experimental test of a computational theory. Journal of Neuroscience. 1996;16(10):3351-3362.

    Not in our library10.1523/jneurosci.16-10-03351.1996

38. 38.

    Dauwels J. On variational message passing on factor graphs. 2007 IEEE international symposium on information theory. 2007;2546-2550.

    Not in our library10.1109/isit.2007.4557602

39. 39.

    Dauwels J., Vialatte F., Rutkowski T., Cichocki A. Measuring neural synchrony by message passing. NIPS. 2007.

    Not in our library

40. 40.
    Model-Based Influences on Humans' Choices and Striatal Prediction Errors · 2011

    No notice

Cited by papers we hold 1

• A Bayesian computational model reveals a failure to adapt interoceptive precision estimates across depression, anxiety, eating, and substance use disorders · 2020
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.