Karl Friston - 2016 CCN Workshop: Predictive Coding

Center for Cognitive Neuroscience at Dartmouth
2016 Workshop: Predictive Coding
KARL FRISTON, UNIVERSITY COLLEGE LONDON
Predictive coding, active inference and belief propagation
Abstract:
I will consider prediction and choice based upon the minimisation of expected free energy. Crucially, (negative) free energy can always be decomposed into pragmatic (extrinsic) and epistemic (intrinsic) value. Minimising expected free energy is therefore equivalent to maximising extrinsic value, while maximising information gain or intrinsic value, i.e., reducing uncertainty about the causes of sensory samples. This decomposition resolves the exploration-exploitation dilemma; where epistemic value is maximised until there is no further resolution of uncertainty, after which exploitation is assured through maximisation of extrinsic value. This is formally consistent with the principle of maximum mutual information, generalising formulations of active vision based upon salience (Bayesian surprise) and optimal decisions based on expected utility and risk sensitive (KL) control - using Hamilton's principle of least action. I will briefly review the normative theory - illustrating the minimisation of expected free energy using simulations and then turn to neuronal processes theories. In brief, the implicit (neuronally plausible) belief propagation offers a form of predictive coding, when hidden causes and outcomes are treated as discrete states.

[@CharlesVanNoland]

The content of this presentation is pure gold.

[@MirrorNeuron]

Hi all, where can I learn the math used in this presentation, like translating the real world observation into math? Is there a book, or a tutorial for a novice like me.

[@alfcnz]

Link to the slides?

[@MLDawn]

05:41 is the main part that shows why RL type approaches cannot work in certain situations. I just loved it!

[@abdurhmanalzayed9429]

this man is genuis..the implication of his revolutionary theory Free Energy principle will unfold in the near future.

[@JaGWiREE]

i couldn't agree more

[@JohnDoe-nv2op]

one year and counting

[@r.s.e.9846]

4 years@@JohnDoe-nv2op

[@olgierdborowiecki2424]

This video lacks of zooming the presentation :/

[@zhihengxu5011]

optimal action function 6:35; Baysesian suprise 10:53

[@Lleruelu]

Thanks so much for sharing

[@greyreynyn]

48:30 savage 'ahh your question is trivial'

[@valueengines2184]

The answer to the last unanswered question: "what about surprise seeking" is that when exploitation is complete, the explorer is bored. The rat then seeks surprise to avoid boredom.

[@Gerardemful]

I used to admire Mr. Friston until he outed himself as a cheap nationalist in his Guardian interview.

[@khwajawisal1220]

what did he say, i read the interview, and he was very cautious with his choice of words and just presented his results. @Hans Richter

[@snippletrap]

Cheap nationalists are the worst kind.