entropy-logo

Journal Browser

Journal Browser

From Functional Imaging to Free Energy—Dedicated to Professor Karl Friston on the Occasion of His 65th Birthday

A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Entropy and Biology".

Deadline for manuscript submissions: 31 October 2024 | Viewed by 28071

Special Issue Editors


E-Mail Website
Guest Editor
Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, UK
Interests: active inference; Bayesian mechanics; theoretical neurobiology; computational neurology
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
Institute of Cognitive Sciences and Technologies, National Research Council, 00185 Rome, Italy
Interests: cognitive science; cognitive robotics; probabilistic models of brain and cognition

E-Mail Website
Guest Editor
1. Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London SE5 8AF, UK
2. Stanhope AI, London SW10 0JG, UK
Interests: computational neuroscience; Bayesian inference (variational principles)

E-Mail Website
Guest Editor
1. VERSES AI Research Lab, Los Angeles, CA 90016, USA
2. Wellcome Centre for Human Neuroimaging, University College London, London WC1E 6BT, UK
Interests: active inference; philosophy of psychiatry; cognitive science; ecological cognition; hermeneutics
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
School of Engineering and Informatics, The University of Sussex, Brighton BN1 9RH, UK
Interests: computational, evolutionary, and cultural psychiatry; evolutionary computation; human social cognition

E-Mail Website
Guest Editor
Wellcome Centre for Human Neuroimaging, University College London, London WC1E 6BT, UK
Interests: neuroscience

Special Issue Information

Dear Colleagues,

Karl Friston’s contributions to the brain sciences are difficult to overstate. From the development of statistical parametric mapping—a ubiquitous technique employed in the analysis of functional neuroimaging data—to the free energy principle and active inference, his ideas have changed the way in which many of us engage with neuroscience, psychology, biology, and the philosophy of the mind. As if his unparalleled influence in understanding how the brain works were not enough, Friston’s work dissolved interdisciplinary boundaries (or perhaps blankets) and has informed fields as diverse as statistics, epidemiology, morphogenesis, climate science, the physics of sentience, evolution, and artificial intelligence.

This Special Issue—on the occasion of Karl Friston's 65th birthday—aims to celebrate his body of work and the many directions of research—and the many researchers—young or more experienced—who it continues to inspire. We welcome submissions that illustrate how collective generative models have been optimised through the application of dynamic causal modelling (to neural circuits, pandemics, or climates) through the study of predictive coding and active inference in the brain, as well as through structure learning by curious machines.

Dr. Thomas Parr
Dr. Giovanni Pezzulo
Prof. Dr. Rosalyn Moran
Dr. Maxwell Ramstead
Dr. Axel Constant
Dr. Anjali Bhat 
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • active inference
  • free-energy principle
  • Bayesian
  • variational inference
  • functional imaging
  • predictive coding

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • e-Book format: Special Issues with more than 10 articles can be published as dedicated e-books, ensuring wide and rapid dissemination.

Further information on MDPI's Special Issue polices can be found here.

Published Papers (20 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

Jump to: Review, Other

18 pages, 3495 KiB  
Article
A Broken Duet: Multistable Dynamics in Dyadic Interactions
by Johan Medrano and Noor Sajid
Entropy 2024, 26(9), 731; https://doi.org/10.3390/e26090731 - 28 Aug 2024
Viewed by 274
Abstract
Misunderstandings in dyadic interactions often persist despite our best efforts, particularly between native and non-native speakers, resembling a broken duet that refuses to harmonise. This paper delves into the computational mechanisms underpinning these misunderstandings through the lens of the broken Lorenz system—a continuous [...] Read more.
Misunderstandings in dyadic interactions often persist despite our best efforts, particularly between native and non-native speakers, resembling a broken duet that refuses to harmonise. This paper delves into the computational mechanisms underpinning these misunderstandings through the lens of the broken Lorenz system—a continuous dynamical model. By manipulating a specific parameter regime, we induce bistability within the Lorenz equations, thereby confining trajectories to distinct attractors based on initial conditions. This mirrors the persistence of divergent interpretations that often result in misunderstandings. Our simulations reveal that differing prior beliefs between interlocutors result in misaligned generative models, leading to stable yet divergent states of understanding when exposed to the same percept. Specifically, native speakers equipped with precise (i.e., overconfident) priors expect inputs to align closely with their internal models, thus struggling with unexpected variations. Conversely, non-native speakers with imprecise (i.e., less confident) priors exhibit a greater capacity to adjust and accommodate unforeseen inputs. Our results underscore the important role of generative models in facilitating mutual understanding (i.e., establishing a shared narrative) and highlight the necessity of accounting for multistable dynamics in dyadic interactions. Full article
Show Figures

Figure 1

18 pages, 264 KiB  
Article
Hacking the Predictive Mind
by Andy Clark
Entropy 2024, 26(8), 677; https://doi.org/10.3390/e26080677 - 10 Aug 2024
Viewed by 1532
Abstract
According to active inference, constantly running prediction engines in our brain play a large role in delivering all human experience. These predictions help deliver everything we see, hear, touch, and feel. In this paper, I pursue one apparent consequence of this increasingly well-supported [...] Read more.
According to active inference, constantly running prediction engines in our brain play a large role in delivering all human experience. These predictions help deliver everything we see, hear, touch, and feel. In this paper, I pursue one apparent consequence of this increasingly well-supported view. Given the constant influence of hidden predictions on human experience, can we leverage the power of prediction in the service of human flourishing? Can we learn to hack our own predictive regimes in ways that better serve our needs and purposes? Asking this question rapidly reveals a landscape that is at once familiar and new. It is also challenging, suggesting important questions about scope and dangers while casting further doubt (as if any was needed) on old assumptions about a firm mind/body divide. I review a range of possible hacks, starting with the careful use of placebos, moving on to look at chronic pain and functional disorders, and ending with some speculations concerning the complex role of genetic influences on the predictive brain. Full article
24 pages, 4967 KiB  
Article
Support for the Time-Varying Drift Rate Model of Perceptual Discrimination in Dynamic and Static Noise Using Bayesian Model-Fitting Methodology
by Jordan Deakin, Andrew Schofield and Dietmar Heinke
Entropy 2024, 26(8), 642; https://doi.org/10.3390/e26080642 - 28 Jul 2024
Viewed by 630
Abstract
The drift-diffusion model (DDM) is a common approach to understanding human decision making. It considers decision making as accumulation of evidence about visual stimuli until sufficient evidence is reached to make a decision (decision boundary). Recently, Smith and colleagues proposed an extension of [...] Read more.
The drift-diffusion model (DDM) is a common approach to understanding human decision making. It considers decision making as accumulation of evidence about visual stimuli until sufficient evidence is reached to make a decision (decision boundary). Recently, Smith and colleagues proposed an extension of DDM, the time-varying DDM (TV-DDM). Here, the standard simplification that evidence accumulation operates on a fully formed representation of perceptual information is replaced with a perceptual integration stage modulating evidence accumulation. They suggested that this model particularly captures decision making regarding stimuli with dynamic noise. We tested this new model in two studies by using Bayesian parameter estimation and model comparison with marginal likelihoods. The first study replicated Smith and colleagues’ findings by utilizing the classical random-dot kinomatogram (RDK) task, which requires judging the motion direction of randomly moving dots (motion discrimination task). In the second study, we used a novel type of stimulus designed to be like RDKs but with randomized hue of stationary dots (color discrimination task). This study also found TV-DDM to be superior, suggesting that perceptual integration is also relevant for static noise possibly where integration over space is required. We also found support for within-trial changes in decision boundaries (“collapsing boundaries”). Interestingly, and in contrast to most studies, the boundaries increased with increasing task difficulty (amount of noise). Future studies will need to test this finding in a formal model. Full article
Show Figures

Figure 1

10 pages, 3626 KiB  
Article
Evolution of Telencephalon Anterior–Posterior Patterning through Core Endogenous Network Bifurcation
by Chen Sun, Mengchao Yao, Ruiqi Xiong, Yang Su, Binglin Zhu, Yong-Cong Chen and Ping Ao
Entropy 2024, 26(8), 631; https://doi.org/10.3390/e26080631 - 26 Jul 2024
Viewed by 612
Abstract
How did the complex structure of the telencephalon evolve? Existing explanations are based on phenomena and lack a first-principles account. The Darwinian dynamics and endogenous network theory—established decades ago—provides a mathematical and theoretical framework and a general constitutive structure for theory–experiment coupling for [...] Read more.
How did the complex structure of the telencephalon evolve? Existing explanations are based on phenomena and lack a first-principles account. The Darwinian dynamics and endogenous network theory—established decades ago—provides a mathematical and theoretical framework and a general constitutive structure for theory–experiment coupling for answering this question from a first-principles perspective. By revisiting a gene network that explains the anterior–posterior patterning of the vertebrate telencephalon, we found that upon increasing the cooperative effect within this network, fixed points gradually evolve, accompanied by the occurrence of two bifurcations. The dynamic behavior of this network is informed by the knowledge obtained from experiments on telencephalic evolution. Our work provides a quantitative explanation for how telencephalon anterior–posterior patterning evolved from the pre-vertebrate chordate to the vertebrate and provides a series of verifiable predictions from a first-principles perspective. Full article
Show Figures

Figure 1

12 pages, 437 KiB  
Article
Making the Thermodynamic Cost of Active Inference Explicit
by Chris Fields, Adam Goldstein and Lars Sandved-Smith
Entropy 2024, 26(8), 622; https://doi.org/10.3390/e26080622 - 24 Jul 2024
Viewed by 956
Abstract
When describing Active Inference Agents (AIAs), the term “energy” can have two distinct meanings. One is the energy that is utilized by the AIA (e.g., electrical energy or chemical energy). The second meaning is so-called Variational Free Energy (VFE), a statistical quantity which [...] Read more.
When describing Active Inference Agents (AIAs), the term “energy” can have two distinct meanings. One is the energy that is utilized by the AIA (e.g., electrical energy or chemical energy). The second meaning is so-called Variational Free Energy (VFE), a statistical quantity which provides an upper bound on surprisal. In this paper, we develop an account of the former quantity—the Thermodynamic Free Energy (TFE)—and its relationship with the latter. We highlight the necessary tradeoffs between these two in a generic, quantum information-theoretic formulation, and the macroscopic consequences of those tradeoffs for the ways that organisms approach their environments. By making this tradeoff explicit, we provide a theoretical basis for the different metabolic strategies that organisms from plants to predators use to survive. Full article
Show Figures

Figure 1

34 pages, 4307 KiB  
Article
An Active Inference Agent for Modeling Human Translation Processes
by Michael Carl
Entropy 2024, 26(8), 616; https://doi.org/10.3390/e26080616 - 23 Jul 2024
Viewed by 937
Abstract
This paper develops an outline for a hierarchically embedded architecture of an artificial agent that models human translation processes based on principles of active inference (AIF) and predictive processing (PP). AIF and PP posit that the mind constructs a model of the environment [...] Read more.
This paper develops an outline for a hierarchically embedded architecture of an artificial agent that models human translation processes based on principles of active inference (AIF) and predictive processing (PP). AIF and PP posit that the mind constructs a model of the environment which guides behavior by continually generating and integrating predictions and sensory input. The proposed model of the translation agent consists of three processing strata: a sensorimotor layer, a cognitive layer, and a phenomenal layer. Each layer consists of a network of states and transitions that interact on different time scales. Following the AIF framework, states are conditioned on observations which may originate from the environment and/or the embedded processing layer, while transitions between states are conditioned on actions that implement plans to optimize goal-oriented behavior. The AIF agent aims at simulating the variation in translational behavior under various conditions and to facilitate investigating the underlying mental mechanisms. It provides a novel framework for generating and testing new hypotheses of the translating mind. Full article
Show Figures

Figure 1

25 pages, 2996 KiB  
Article
Causalized Convergent Cross Mapping and Its Implementation in Causality Analysis
by Boxin Sun, Jinxian Deng, Norman Scheel, David C. Zhu, Jian Ren, Rong Zhang and Tongtong Li
Entropy 2024, 26(7), 539; https://doi.org/10.3390/e26070539 - 24 Jun 2024
Viewed by 844
Abstract
Rooted in dynamic systems theory, convergent cross mapping (CCM) has attracted increased attention recently due to its capability in detecting linear and nonlinear causal coupling in both random and deterministic settings. One limitation with CCM is that it uses both past and future [...] Read more.
Rooted in dynamic systems theory, convergent cross mapping (CCM) has attracted increased attention recently due to its capability in detecting linear and nonlinear causal coupling in both random and deterministic settings. One limitation with CCM is that it uses both past and future values to predict the current value, which is inconsistent with the widely accepted definition of causality, where it is assumed that the future values of one process cannot influence the past of another. To overcome this obstacle, in our previous research, we introduced the concept of causalized convergent cross mapping (cCCM), where future values are no longer used to predict the current value. In this paper, we focus on the implementation of cCCM in causality analysis. More specifically, we demonstrate the effectiveness of cCCM in identifying both linear and nonlinear causal coupling in various settings through a large number of examples, including Gaussian random variables with additive noise, sinusoidal waveforms, autoregressive models, stochastic processes with a dominant spectral component embedded in noise, deterministic chaotic maps, and systems with memory, as well as experimental fMRI data. In particular, we analyze the impact of shadow manifold construction on the performance of cCCM and provide detailed guidelines on how to configure the key parameters of cCCM in different applications. Overall, our analysis indicates that cCCM is a promising and easy-to-implement tool for causality analysis in a wide spectrum of applications. Full article
Show Figures

Figure 1

12 pages, 845 KiB  
Article
The Universal Optimism of the Self-Evidencing Mind
by Elizabeth L. Fisher and Jakob Hohwy
Entropy 2024, 26(6), 518; https://doi.org/10.3390/e26060518 - 17 Jun 2024
Viewed by 855
Abstract
Karl Friston’s free-energy principle casts agents as self-evidencing through active inference. This implies that decision-making, planning and information-seeking are, in a generic sense, ‘wishful’. We take an interdisciplinary perspective on this perplexing aspect of the free-energy principle and unpack the epistemological implications of [...] Read more.
Karl Friston’s free-energy principle casts agents as self-evidencing through active inference. This implies that decision-making, planning and information-seeking are, in a generic sense, ‘wishful’. We take an interdisciplinary perspective on this perplexing aspect of the free-energy principle and unpack the epistemological implications of wishful thinking under the free-energy principle. We use this epistemic framing to discuss the emergence of biases for self-evidencing agents. In particular, we argue that this elucidates an optimism bias as a foundational tenet of self-evidencing. We allude to a historical precursor to some of these themes, interestingly found in Machiavelli’s oeuvre, to contextualise the universal optimism of the free-energy principle. Full article
Show Figures

Figure 1

14 pages, 2749 KiB  
Article
On Predictive Planning and Counterfactual Learning in Active Inference
by Aswin Paul, Takuya Isomura and Adeel Razi
Entropy 2024, 26(6), 484; https://doi.org/10.3390/e26060484 - 31 May 2024
Viewed by 864
Abstract
Given the rapid advancement of artificial intelligence, understanding the foundations of intelligent behaviour is increasingly important. Active inference, regarded as a general theory of behaviour, offers a principled approach to probing the basis of sophistication in planning and decision-making. This paper examines two [...] Read more.
Given the rapid advancement of artificial intelligence, understanding the foundations of intelligent behaviour is increasingly important. Active inference, regarded as a general theory of behaviour, offers a principled approach to probing the basis of sophistication in planning and decision-making. This paper examines two decision-making schemes in active inference based on “planning” and “learning from experience”. Furthermore, we also introduce a mixed model that navigates the data complexity trade-off between these strategies, leveraging the strengths of both to facilitate balanced decision-making. We evaluate our proposed model in a challenging grid-world scenario that requires adaptability from the agent. Additionally, our model provides the opportunity to analyse the evolution of various parameters, offering valuable insights and contributing to an explainable framework for intelligent decision-making. Full article
Show Figures

Figure 1

17 pages, 318 KiB  
Article
Shared Protentions in Multi-Agent Active Inference
by Mahault Albarracin, Riddhi J. Pitliya, Toby St. Clere Smithe, Daniel Ari Friedman, Karl Friston and Maxwell J. D. Ramstead
Entropy 2024, 26(4), 303; https://doi.org/10.3390/e26040303 - 29 Mar 2024
Cited by 1 | Viewed by 4603
Abstract
In this paper, we unite concepts from Husserlian phenomenology, the active inference framework in theoretical biology, and category theory in mathematics to develop a comprehensive framework for understanding social action premised on shared goals. We begin with an overview of Husserlian phenomenology, focusing [...] Read more.
In this paper, we unite concepts from Husserlian phenomenology, the active inference framework in theoretical biology, and category theory in mathematics to develop a comprehensive framework for understanding social action premised on shared goals. We begin with an overview of Husserlian phenomenology, focusing on aspects of inner time-consciousness, namely, retention, primal impression, and protention. We then review active inference as a formal approach to modeling agent behavior based on variational (approximate Bayesian) inference. Expanding upon Husserl’s model of time consciousness, we consider collective goal-directed behavior, emphasizing shared protentions among agents and their connection to the shared generative models of active inference. This integrated framework aims to formalize shared goals in terms of shared protentions, and thereby shed light on the emergence of group intentionality. Building on this foundation, we incorporate mathematical tools from category theory, in particular, sheaf and topos theory, to furnish a mathematical image of individual and group interactions within a stochastic environment. Specifically, we employ morphisms between polynomial representations of individual agent models, allowing predictions not only of their own behaviors but also those of other agents and environmental responses. Sheaf and topos theory facilitates the construction of coherent agent worldviews and provides a way of representing consensus or shared understanding. We explore the emergence of shared protentions, bridging the phenomenology of temporal structure, multi-agent active inference systems, and category theory. Shared protentions are highlighted as pivotal for coordination and achieving common objectives. We conclude by acknowledging the intricacies stemming from stochastic systems and uncertainties in realizing shared goals. Full article
17 pages, 2823 KiB  
Article
Markov Blankets and Mirror Symmetries—Free Energy Minimization and Mesocortical Anatomy
by James Wright and Paul Bourke
Entropy 2024, 26(4), 287; https://doi.org/10.3390/e26040287 - 27 Mar 2024
Viewed by 1759
Abstract
A theoretical account of development in mesocortical anatomy is derived from the free energy principle, operating in a neural field with both Hebbian and anti-Hebbian neural plasticity. An elementary structural unit is proposed, in which synaptic connections at mesoscale are arranged in paired [...] Read more.
A theoretical account of development in mesocortical anatomy is derived from the free energy principle, operating in a neural field with both Hebbian and anti-Hebbian neural plasticity. An elementary structural unit is proposed, in which synaptic connections at mesoscale are arranged in paired patterns with mirror symmetry. Exchanges of synaptic flux in each pattern form coupled spatial eigenmodes, and the line of mirror reflection between the paired patterns operates as a Markov blanket, so that prediction errors in exchanges between the pairs are minimized. The theoretical analysis is then compared to the outcomes from a biological model of neocortical development, in which neuron precursors are selected by apoptosis for cell body and synaptic connections maximizing synchrony and also minimizing axonal length. It is shown that this model results in patterns of connection with the anticipated mirror symmetries, at micro-, meso- and inter-arial scales, among lateral connections, and in cortical depth. This explains the spatial organization and functional significance of neuron response preferences, and is compatible with the structural form of both columnar and noncolumnar cortex. Multi-way interactions of mirrored representations can provide a preliminary anatomically realistic model of cortical information processing. Full article
Show Figures

Figure 1

16 pages, 609 KiB  
Article
Principled Limitations on Self-Representation for Generic Physical Systems
by Chris Fields, James F. Glazebrook and Michael Levin
Entropy 2024, 26(3), 194; https://doi.org/10.3390/e26030194 - 24 Feb 2024
Cited by 3 | Viewed by 4208
Abstract
The ideas of self-observation and self-representation, and the concomitant idea of self-control, pervade both the cognitive and life sciences, arising in domains as diverse as immunology and robotics. Here, we ask in a very general way whether, and to what extent, these ideas [...] Read more.
The ideas of self-observation and self-representation, and the concomitant idea of self-control, pervade both the cognitive and life sciences, arising in domains as diverse as immunology and robotics. Here, we ask in a very general way whether, and to what extent, these ideas make sense. Using a generic model of physical interactions, we prove a theorem and several corollaries that severely restrict applicable notions of self-observation, self-representation, and self-control. We show, in particular, that adding observational, representational, or control capabilities to a meta-level component of a system cannot, even in principle, lead to a complete meta-level representation of the system as a whole. We conclude that self-representation can at best be heuristic, and that self models cannot, in general, be empirically tested by the systems that implement them. Full article
Show Figures

Figure 1

32 pages, 5447 KiB  
Article
Spatial and Temporal Hierarchy for Autonomous Navigation Using Active Inference in Minigrid Environment
by Daria de Tinguy, Toon Van de Maele, Tim Verbelen and Bart Dhoedt
Entropy 2024, 26(1), 83; https://doi.org/10.3390/e26010083 - 18 Jan 2024
Cited by 1 | Viewed by 1717
Abstract
Robust evidence suggests that humans explore their environment using a combination of topological landmarks and coarse-grained path integration. This approach relies on identifiable environmental features (topological landmarks) in tandem with estimations of distance and direction (coarse-grained path integration) to construct cognitive maps of [...] Read more.
Robust evidence suggests that humans explore their environment using a combination of topological landmarks and coarse-grained path integration. This approach relies on identifiable environmental features (topological landmarks) in tandem with estimations of distance and direction (coarse-grained path integration) to construct cognitive maps of the surroundings. This cognitive map is believed to exhibit a hierarchical structure, allowing efficient planning when solving complex navigation tasks. Inspired by human behaviour, this paper presents a scalable hierarchical active inference model for autonomous navigation, exploration, and goal-oriented behaviour. The model uses visual observation and motion perception to combine curiosity-driven exploration with goal-oriented behaviour. Motion is planned using different levels of reasoning, i.e., from context to place to motion. This allows for efficient navigation in new spaces and rapid progress toward a target. By incorporating these human navigational strategies and their hierarchical representation of the environment, this model proposes a new solution for autonomous navigation and exploration. The approach is validated through simulations in a mini-grid environment. Full article
Show Figures

Figure 1

34 pages, 23651 KiB  
Article
Incremental Learning of Goal-Directed Actions in a Dynamic Environment by a Robot Using Active Inference
by Takazumi Matsumoto, Wataru Ohata and Jun Tani
Entropy 2023, 25(11), 1506; https://doi.org/10.3390/e25111506 - 31 Oct 2023
Viewed by 1353
Abstract
This study investigated how a physical robot can adapt goal-directed actions in dynamically changing environments, in real-time, using an active inference-based approach with incremental learning from human tutoring examples. Using our active inference-based model, while good generalization can be achieved with appropriate parameters, [...] Read more.
This study investigated how a physical robot can adapt goal-directed actions in dynamically changing environments, in real-time, using an active inference-based approach with incremental learning from human tutoring examples. Using our active inference-based model, while good generalization can be achieved with appropriate parameters, when faced with sudden, large changes in the environment, a human may have to intervene to correct actions of the robot in order to reach the goal, as a caregiver might guide the hands of a child performing an unfamiliar task. In order for the robot to learn from the human tutor, we propose a new scheme to accomplish incremental learning from these proprioceptive–exteroceptive experiences combined with mental rehearsal of past experiences. Our experimental results demonstrate that using only a few tutoring examples, the robot using our model was able to significantly improve its performance on new tasks without catastrophic forgetting of previously learned tasks. Full article
Show Figures

Figure 1

Review

Jump to: Research, Other

21 pages, 2082 KiB  
Review
The Many Roles of Precision in Action
by Jakub Limanowski, Rick A. Adams, James Kilner and Thomas Parr
Entropy 2024, 26(9), 790; https://doi.org/10.3390/e26090790 - 14 Sep 2024
Viewed by 387
Abstract
Active inference describes (Bayes-optimal) behaviour as being motivated by the minimisation of surprise of one’s sensory observations, through the optimisation of a generative model (of the hidden causes of one’s sensory data) in the brain. One of active inference’s key appeals is its [...] Read more.
Active inference describes (Bayes-optimal) behaviour as being motivated by the minimisation of surprise of one’s sensory observations, through the optimisation of a generative model (of the hidden causes of one’s sensory data) in the brain. One of active inference’s key appeals is its conceptualisation of precision as biasing neuronal communication and, thus, inference within generative models. The importance of precision in perceptual inference is evident—many studies have demonstrated the importance of ensuring precision estimates are correct for normal (healthy) sensation and perception. Here, we highlight the many roles precision plays in action, i.e., the key processes that rely on adequate estimates of precision, from decision making and action planning to the initiation and control of muscle movement itself. Thereby, we focus on the recent development of hierarchical, “mixed” models—generative models spanning multiple levels of discrete and continuous inference. These kinds of models open up new perspectives on the unified description of hierarchical computation, and its implementation, in action. Here, we highlight how these models reflect the many roles of precision in action—from planning to execution—and the associated pathologies if precision estimation goes wrong. We also discuss the potential biological implementation of the associated message passing, focusing on the role of neuromodulatory systems in mediating different kinds of precision. Full article
Show Figures

Figure 1

19 pages, 3318 KiB  
Review
Episodic Visual Hallucinations, Inference and Free Energy
by Daniel Collerton, Ichiro Tsuda and Shigetoshi Nara
Entropy 2024, 26(7), 557; https://doi.org/10.3390/e26070557 - 28 Jun 2024
Viewed by 703
Abstract
Understandings of how visual hallucinations appear have been highly influenced by generative approaches, in particular Friston’s Active Inference conceptualization. Their core proposition is that these phenomena occur when hallucinatory expectations outweigh actual sensory data. This imbalance occurs as the brain seeks to minimize [...] Read more.
Understandings of how visual hallucinations appear have been highly influenced by generative approaches, in particular Friston’s Active Inference conceptualization. Their core proposition is that these phenomena occur when hallucinatory expectations outweigh actual sensory data. This imbalance occurs as the brain seeks to minimize informational free energy, a measure of the distance between predicted and actual sensory data in a stationary open system. We review this approach in the light of old and new information on the role of environmental factors in episodic hallucinations. In particular, we highlight the possible relationship of specific visual triggers to the onset and offset of some episodes. We use an analogy from phase transitions in physics to explore factors which might account for intermittent shifts between veridical and hallucinatory vision. In these triggered forms of hallucinations, we suggest that there is a transient disturbance in the normal one-to-one correspondence between a real object and the counterpart perception such that this correspondence becomes between the real object and a hallucination. Generative models propose that a lack of information transfer from the environment to the brain is one of the key features of hallucinations. In contrast, we submit that specific information transfer is required at onset and offset in these cases. We propose that this transient one-to-one correspondence between environment and hallucination is mediated more by aberrant discriminative than by generative inference. Discriminative inference can be conceptualized as a process for maximizing shared information between the environment and perception within a self-organizing nonstationary system. We suggest that generative inference plays the greater role in established hallucinations and in the persistence of individual hallucinatory episodes. We further explore whether thermodynamic free energy may be an additional factor in why hallucinations are temporary. Future empirical research could productively concentrate on three areas. Firstly, subjective perceptual changes and parallel variations in brain function during specific transitions between veridical and hallucinatory vision to inform models of how episodes occur. Secondly, systematic investigation of the links between environment and hallucination episodes to probe the role of information transfer in triggering transitions between veridical and hallucinatory vision. Finally, changes in hallucinatory episodes over time to elucidate the role of learning on phenomenology. These empirical data will allow the potential roles of different forms of inference in the stages of hallucinatory episodes to be elucidated. Full article
Show Figures

Figure 1

Other

Jump to: Research, Review

20 pages, 838 KiB  
Opinion
Feasibility of a Personal Neuromorphic Emulation
by Don M. Tucker and Phan Luu
Entropy 2024, 26(9), 759; https://doi.org/10.3390/e26090759 - 5 Sep 2024
Viewed by 292
Abstract
The representation of intelligence is achieved by patterns of connections among neurons in brains and machines. Brains grow continuously, such that their patterns of connections develop through activity-dependent specification, with the continuing ontogenesis of individual experience. The theory of active inference proposes that [...] Read more.
The representation of intelligence is achieved by patterns of connections among neurons in brains and machines. Brains grow continuously, such that their patterns of connections develop through activity-dependent specification, with the continuing ontogenesis of individual experience. The theory of active inference proposes that the developmental organization of sentient systems reflects general processes of informatic self-evidencing, through the minimization of free energy. We interpret this theory to imply that the mind may be described in information terms that are not dependent on a specific physical substrate. At a certain level of complexity, self-evidencing of living (self-organizing) information systems becomes hierarchical and reentrant, such that effective consciousness emerges as the consequence of a good regulator. We propose that these principles imply that an adequate reconstruction of the computational dynamics of an individual human brain/mind is possible with sufficient neuromorphic computational emulation. Full article
Show Figures

Figure 1

11 pages, 2349 KiB  
Brief Report
A Randomization-Based, Model-Free Approach to Functional Neuroimaging: A Proof of Concept
by Matan Mazor and Roy Mukamel
Entropy 2024, 26(9), 751; https://doi.org/10.3390/e26090751 - 2 Sep 2024
Viewed by 291
Abstract
Functional neuroimaging analysis takes noisy multidimensional measurements as input and produces statistical inferences regarding the functional properties of brain regions as output. Such inferences are most commonly model-based, in that they assume a model of how neural activity translates to the measured signal [...] Read more.
Functional neuroimaging analysis takes noisy multidimensional measurements as input and produces statistical inferences regarding the functional properties of brain regions as output. Such inferences are most commonly model-based, in that they assume a model of how neural activity translates to the measured signal (blood oxygenation level-dependent signal in the case of functional MRI). The use of models increases statistical sensitivity and makes it possible to ask fine-grained theoretical questions. However, this comes at the cost of making theoretical assumptions about the underlying data-generating process. An advantage of model-free approaches is that they can be used in cases where model assumptions are known not to hold. To this end, we introduce a randomization-based, model-free approach to functional neuroimaging. TWISTER randomization makes it possible to infer functional selectivity from correlations between experimental runs. We provide a proof of concept in the form of a visuomotor mapping experiment and discuss the possible strengths and limitations of this new approach in light of our empirical results. Full article
Show Figures

Figure 1

13 pages, 270 KiB  
Perspective
Active Inference for Learning and Development in Embodied Neuromorphic Agents
by Sarah Hamburg, Alejandro Jimenez Rodriguez, Aung Htet and Alessandro Di Nuovo
Entropy 2024, 26(7), 582; https://doi.org/10.3390/e26070582 - 9 Jul 2024
Viewed by 969
Abstract
Taking inspiration from humans can help catalyse embodied AI solutions for important real-world applications. Current human-inspired tools include neuromorphic systems and the developmental approach to learning. However, this developmental neurorobotics approach is currently lacking important frameworks for human-like computation and learning. We propose [...] Read more.
Taking inspiration from humans can help catalyse embodied AI solutions for important real-world applications. Current human-inspired tools include neuromorphic systems and the developmental approach to learning. However, this developmental neurorobotics approach is currently lacking important frameworks for human-like computation and learning. We propose that human-like computation is inherently embodied, with its interface to the world being neuromorphic, and its learning processes operating across different timescales. These constraints necessitate a unified framework: active inference, underpinned by the free energy principle (FEP). Herein, we describe theoretical and empirical support for leveraging this framework in embodied neuromorphic agents with autonomous mental development. We additionally outline current implementation approaches (including toolboxes) and challenges, and we provide suggestions for next steps to catalyse this important field. Full article
9 pages, 196 KiB  
Opinion
Friston, Free Energy, and Psychoanalytic Psychotherapy
by Jeremy Holmes
Entropy 2024, 26(4), 343; https://doi.org/10.3390/e26040343 - 18 Apr 2024
Viewed by 1759
Abstract
This paper outlines the ways in which Karl Friston’s work illuminates the everyday practice of psychotherapists. These include (a) how the strategic ambiguity of the therapist’s stance brings, via ‘transference’, clients’ priors to light; (b) how the unstructured and negative capability of the [...] Read more.
This paper outlines the ways in which Karl Friston’s work illuminates the everyday practice of psychotherapists. These include (a) how the strategic ambiguity of the therapist’s stance brings, via ‘transference’, clients’ priors to light; (b) how the unstructured and negative capability of the therapy session reduces the salience of priors, enabling new top-down models to be forged; (c) how fostering self-reflection provides an additional step in the free energy minimization hierarchy; and (d) how Friston and Frith’s ‘duets for one’ can be conceptualized as a relational zone in which collaborative free energy minimization takes place without sacrificing complexity. Full article
Back to TopTop