Acknowledgements
Based on ideas from Karl Friston's Active Free Energy principle and Predictive Coding formulations.
Introduction
In a highly simplified nutshell, Active Inference seeks to relate changes in the cognition of our inner world model, to changes in our sensory inputs, using several matrices of probabilities. We plan to borrow from those concepts, and from Deep Learning techniques, to explain ideas like awareness and free-will. For instance, if our cognition and choices are, indeed, governed by probabilities, which are, in their essence, determined by prior conditions, how do we explain the sense of free-will? And, is free-will "real"? My personal take on that is yes.
The journey starts by modeling some core Generative Models in Active Inference, and then trying to transport them to a Deep Learning architecture. Longer term objectives include helping to explain disorders such as Autism, and designing LLM architectures with an emphasis on sentience. Why? Because text is just a sequence of symbols, that can be used in an easily customizable environment, to further develop our understanding of the biological roots of sentience and consciousness.
Throughout our work, we will develop several simulations and list them here: