Skip to content
naulon
Not checkedNot checked for notices yet.

Exploration, Novelty, Surprise and Free Energy Minimisation

Philipp eSchwartenbeck, Thomas eFitzGerald, Ray eDolan and 1 more

Frontiers in Psychology · 2013

doi:10.3389/fpsyg.2013.00710 (opens in a new tab)

We email you when a new notice or a question about this paper appears.

Abstract

This paper reviews recent developments under the free energy principle that introduce a normative perspective on classical economic (utilitarian) decision-making based on (active) Bayesian inference. It has been suggested that the free energy principle precludes novelty and complexity, because it assumes that biological systems – like ourselves - try to minimise the long-term average of surprise to maintain their homeostasis. However, recent formulations show that minimising surprise leads naturally to concepts such as exploration and novelty bonuses. In this approach, agents infer a policy that minimises surprise by minimising the difference (or relative entropy) between likely and desired outcomes, which involves both pursuing the goal-state that has the highest expected utility (often termed ‘exploitation’) and visiting a number of different goal-states (‘exploration’). Crucially, the opportunity to visit new states increases the value of the current state. Casting decision-making problems within a variational framework, therefore, predicts that our behaviour is governed by both the entropy and expected utility of future states. This dissolves any dialectic between minimising surprise and exploration or novelty seeking.

Abstract licence: CC BY

Cited by papers we hold5

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.