Jeff Hawkins: How brain science will change computing
HTML-код
- Опубликовано: 22 май 2007
- www.ted.com Treo creator Jeff Hawkins urges us to take a new look at the brain -- to see it not as a fast processor, but as a memory system that stores and plays back experiences to help us predict, intelligently, what will happen next.
TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers are invited to give the talk of their lives in 18 minutes. TED stands for Technology, Entertainment, and Design, and TEDTalks cover these topics as well as science, business, politics and the arts. Watch the Top 10 TEDTalks on TED.com, at
www.ted.com/index.php/talks/top10 
Наука
This man motivated me to study computer science and neuroscience many years ago. Great to hear his talk again
Jeff has nailed it. After 11 years (in 2018), he published it. He is preparing a new book too(Maybe a major update on his old book "On Intelligence").
It’s amazing that I’ve come across this brilliant man many years after this talk after having the same realization about myself: there is no self. “I” is just an amalgam of sensory inputs stored in an organic hard drive in the front of my skull.
To take Dr. Hawkins theory one step further, our brain isn’t only a predictive machine, it is a mixed reality headset. Our brain has the ability to purposely choose the inputs to take in the keep the predictive model accurate. To keep the game inside our heads going. That game is to create a self, and the world outside the self. This is just a theory, but I am finding plenty of cohesion based on this thought.
Truly fascinating stuff b
This guy is way ahead of his time
No, we’re just behind.
Sharp Guy.
It's great that he had the courage to follow his interests.
This instantly shot up to one of my top favorite TED talks. Love discovering older gems like this.
Hah, older.
When I saw this video 15 years ago, it gave me a solid foundation on how to think about artificial intelligence.
And with the invention of LLMs nowadays, I'm always reminded back to this video where he basically predicted this invention of LLMs.
Redzo79 Actually this guy is expressing himself freely, unbounded by communication rules, presentation theories and body language concepts.
Though it's not looking professional, but that's what makes his 'talk' special. :) People are enjoying it and are able to appreciate a novel and a complex idea like "Brain Sc.". What else shall be expected?
A lot of inspirational things to think about. Thank you so much.
"Some people have fallen into the pit of metaphysical dualism, some exceptionally smart people too, but we can reject all that." LOL.
He fell in love with his loss function.
Such an awesome point and so obvious, never crossed my mind.
Excellent! Let cognition be understood! It will change our society hugely.
"If you don't build it, you don't understand it", that was genius.
He's so passionate!
i had this thought in the mcdonalds drivethrough a while back, so its nice to see a real brainiac go to work on it.
it makes pretty good intuitive sense if you think about it; the ability to perceive, record, recall and compare patterns encountered by the senses. if you had a perfect memory (perfect recall with the required space to store it all) could one say you had a perfect intelligence (with respect to the experiences you've had) . linguistic difficulties aside, i think it would be so.
That is what he points out... It is not an algorithm it is pattern storage and recognition. In Neural networks simulation a good result of ingenuity in the pattern recognition can be obtained by introducing noise to the network. Perhaps that background noise is the what makes pattern recignition possible to come up with new ideas and patterns on it's own.
this is excellent.
thanks for that upload.!!
Lookup "Processing in Memory" that's the model that can take the computer closer to the brain. It can already be implemented : massively parallel computing can be programmed in FPGAs. Eventually we will create specialized FPGA logic blocks that will allow to map even large programs by allowing to quickly switch between contexts in memory that is evenly distributed among the programmable logic structures!
conciousness is just the centre of narrative gravity for the atcivities of your brain that are needed to effectively intuite the minds of others.
so essentially the programming for brains would be to make a program which flashes back memories of similar events, then orders them by priority based on relevance. Then it takes information from what it deems relevant and makes a future prediction. From there it compares what is the accurate, and where its predictions failed (missing the moved door handle) Then stores the event for future reference. This is how we accumulate the ability to predict ie learn I see.
excellent again. thanks.
Thank you for that.
another fundamental peice of brain theory will be explaining how we are capable of metaphor. We communicate extremely often with them and they are key to the brain forming complex theories (you use metaphors to teach)
Metaphors might also offer a way of grouping memories that are relevant to the current experience by priority, or the most contributive to forming accurate predictions.
The future prediction idea makes much more sense than the behavioral concept and frankly the best argument I ever heard against the turing test. But still does not explain consciousness and how it relates to a machine that truly understands or just mechanically always gets right predictions ?
Great edit!
This video inspired me!!
The radioactive waste from fusion processes still has to be dumped somewhere or be further processed.
Another interesting search term in this field is "Tokamak".
What a thought provoking argument.
Intelligence is to perform actions that maximize outcomes. Or atleast, that's the easiest way to measure intelligence.
One could say reacting to unmatched patterns, unknown situations, and new circumstances, successfully, requires making associations, noticing that the pattern is similar to a previously seen pattern, and reacting accordingly.
Thinking and imagining can be thought of as continually predicting things. Learning is storing patterns. Creating is a manifestation of things imagined.
Other forms of intelligence are, (Imho) Musical, Mathematical, Linguistic, Literary, Athletic, Artistic, and many more. There are, of course thousands of derivitives of those types of intelligence. Like philosophical...etc...He is very right about what he says, but he focuses on a very small spectrum of what our brains do. Its sad that TED only allows 20 minutes, though it is a blessing as well. Definitely awesome video.
It's interesting that he says that intelligence is the trait of predicting what is about to happen, and how we will begin with such things as intelligent cars. It reminds me that most creatures' predictive abilities are best-suited for linear tasks. Most creatures have very poor exponential predictive abilities. E.g., acceleration is difficult for many creatures to predict, even if it is steady. Some creatures, such as cats, are wired to intercept, even if they should be avoiding, such as cars.
Very interesting talk! Although I must say I tend to see the brain more like an antenna. NDE's are very well documented over the past few decades and whether we like it or not, memories can be stored outside the brain...
interesting, love the POV about that our brain is wrinkled because it doesn't fit otherwise 8) Aw well as little question, does our visual memory and dreams are constantly connected with each other, i.e. when we see something in a dream state that we never seen before but know it's exists, where is that coming from? Our memory fantasies or from our visual memory "glitches"?
@trivea That, I agree with. I think that attempting to understand the brain is a noble endeavor. We'll be able to actually answer some questions about what makes up a human when we understand the functioning of neural circuitry. But until then, I think we should hold our horses on the implications! Science says nothing definitive about anything outside of it's current capabilities. Jeff Hawkins certainly has a lot of influence, and I feel like he's presenting his own philosophy with his science.
Predicting isn't just what it does, though it's a part of it. It also compares current visual/other sensory perceptions (sets of it) to previous sets to see anomalies and then compares it to laws (theories) to see whether they can explain the anomaly. It might also look at all the unexplained data and see if it makes another. Haven't thought about it much, but I'm sure it does many other things. Also, telepathy happens regularly (how many times do you know just before someone calls you?)
I have done exactly that, thanks. :)
His work agrees with and extends what I'd been hypothesising and trying to do myself, but is far better. I hope to understand how his methods work exactly.
I haven't seen or read anything recent about his work. He said he hoped to solve the cat-dog problem, do you know how is he doing with this?
@FamousPhilosopher I agree, its quite refreshing.
the problem with the nobel price is that it cannot be given post-mortem. the person still needs to be alive. and there are always much more people that deserve the nobel price than nobel prices to give out. so, sometimes people get their price 30 years later, and/or shortly before they die.
his talk just makes sense, everything he says about intelligence is true.
Constant predictions based on matching patterns\ sequences.. that's storing and processing of information.. and recognizing patterns.. that's robotic intelligence.
Human intelligence is to react on unmatched patterns, unknown situations, totally new circumstances.
Ability to think, imagine, create and learn during unpredictable events is human intelligence.
Awesome.
bravo..
Haha, absolutely love his out-of-nowhere stab at dualism :)
I think intelligence is all about prediction and patter-recognition, or rather the CAPACITY to learn invariant patterns in noisy spatial and temporal data.
The ability to hold several things in your head simultaneously is also the same thing, I think.
You could also check out Numenta's website, which is the company Jeff Hawkins founded to develop his theory.
Some very interesting stuff they're working on there.
It's amazing to see how ideas seem to emerge on a global scale around the same time in different cultural contexts.
It's called Universal Consciousness. Invisible, but present. I tap into it everyday by way of precognition. If only you materialists knew about "the other side"...I will leave it at that.
Read his book "On Intelligence" which goes deeper into prediction using spacial/temporal feedforward/feedback run through 5 senses fed against invariant representations on a heirarchial structure. In addition on each of the HTM levels he goes into the 6 layers and columns of the specific level composed of billions of neurons. L1 mostly of dentrites and how L5 connects to thalamus and the function it plays. He only has 22 minutes to give a preview on this talk. You can also Google "Numenta".
Would you say it would kind of be a more advanced version of the "predictive text messeging," or somthing else entirly?
Following up on what I said earlier, intelligence actually does increase quite a bit throughout childhood due to a process called myelination, which begins from about age 3 until adulthood.
I love the example "they're going to learn, the types of cars the leave their blinkers on for half a minute probably aren't going to turn."
240p? Isn't there a higher resolution version?
cool.now i know where to send my cv!
Actually, most of what you're thinking of is our ability for abstract thought, which allows us to take lessons we learned in one area and apply them to another. We learned how to throw a baseball and so have a good idea how to toss a grapefruit to a friend. While it may seem like it's a new circumstance that requires relearning, it's really just that our brain is able to apply pattern matching at a kind of meta-level.
Although I wont adept to answer the second question I will try to explain the question with an analogy. There is one level of sight, which is bound up with the physical eye. But the sight itself is non physical. However, there is another level of sight that is not bound up with the physical eye (for example when you picture something in your mind with your eyes closed).
You asking me... I am just speculating. As you point out emotions has some part of such decision. The brain could very possibly do pattern matching of emotions as well I suppose.
What Jeff points out here is that the pattern storage, recognizion and matching is what makes us different from other animals and hence has to be a big part of intelligence.
Hard to watch at night, as the intro piece is amazingly loud compared to speeches.
Hey great work by the way!
We should not forget that something having not occured can be just as important as something that did. To say the brain is just a pattern matching storage machine is an over simplification and a way to avoid answering the important questions. How does the reptile brain interface with the storage machine?
16:17 "Oh shit" I haven't laughed so hard in months.
Same 🤣
2023 and this is so relevant today
Hawkins' theory on intelligence seems quite similar to Hecht-Nielsen's Confabulation Theory. I took his graduate neurocomputing class and we programmed systems that have similar memory/comparison/prediction to what Hawkins is saying.
He is certainly on to something. I am struggling to apply the theory to how I form my current sentence actually. I'm not predicting my own sentence am I?
I agree, when listening to others or hearing a song or walking along, it's quite similar and I'm predicting my environment based on what I've seen before.
But what about an artist painting? Me writing or typing?
I'm curious to see where he goes.
Good definition of intelligence!
@JonmanXmusic True. I guess he went about it wrong, but I think he means to say that a metaphysical approach from the outset is probably bad because it could lead us to put up false logical barriers (ie. brain can't understand itself so no use trying).
'07 @ 240p
damn this is almost nostalgic
Here is my understanding of the mind. The mind can be divided in to levels, stretching from the brain and going towards the soul and each level has sublevels and each level or sublevel could be simple or elaborate. The lowest level of the mind is logic, going step by step. The level above that is the ability to design, this is the creative ability. The level above this is the level of perception, to see the whole picture. There are levels higher then this but I'm a bit hazy on their nature.
@souravbindia However I also would say that this 'robotic intelligence' that you quote is also definitely a large part of things that we consider as intelligent. But it definitely does not deal with creativity. Actually, I'm interested in what he has to say about the issue of creativity.
you should watch his other videos. don't forget this is just a 20 min talk he had. there is a 1 hr + speech on youtube where he addresses your questions.
Human brain is the most advance and most complex system in the universe explored till date. The brain has evolved through millions of years, its built inside the womb in weeks, everything really is programmed within genome.
Philosophically, the reason to create universe is to create a intelligent creature like human!
Its like creating a robot who can create another robot!!
He is looking for an answer which many other persons have been researching on for thousand of years.
@tanthonight "For example if It wasnt for are desires we would not do anything at all" - My engine management system in my car doesn't have 'desires' but it DOES do something.
What is the difference between an emotional desire, and a goal oriented programmed device? None in regards to getting things done.
An engine management system 'feels' the car is cornering left, so it 'decides' to stiffen left hand suspension.
What constitutes intelligence is highly controversial with many believing that non- cognitive functions, e.g. impulses and emotions, play a role in "intelligent behavior.". Predictions based on a memory system are frequently flawed as are memories. It is not that "we are constantly making predictions" so much as appraisals of our perceived relationships to others and the environment. You cannot totally disengage personal interest from the pursuit of knowledge and problem-solving
activities.
Ok thanks!
@TheNeurall No, we cant expand with no limitations. One serious limitations is that any choise we make, is based on all the other choises we made before, which led as into the situastion we are in right now, as well gave as the motives, experience etc. that we have. This goes all the way back. So, there is nothing like free will.
@Wescas05. No it's Jeff Hawkins.
omg this guy is great, I could totally imagine how a synthetic brain could be built using these fundamental principles he laid out and would mimic a real mammalian brain
Having a lot of information does not always make one more intelligent.
Wat?
@@egor.okhterov If you can't process a mountain of information in a time frame that allows you take advantage of its benefits, the information is fundamentally useless to you.
John Ball's Patomic Theory actually predicts how the brain works, but it also has been used in application and may allow computers to translate better than translators.
Where does ESP come into this?
A neat book I read that might be of interest is written by George Christos its called "The Creative Mind: Memory and Dreams" or something....
16:24 my favorite part lol
MightyTiny I think to say that the mind is the brain is unfounded. I think the only reason why people say it is, is because they believe in materialism but if you can see a distinction between hardware and software why would you constrain your self to say the brain doesn't have that capacity. Especially if you realize that the more something is bound to the physical the more limited it is, compare the mechanical calculator to a modern computer
I know the difference between fusion and fission, but today fusion reactors produce radioactive Tritium, for example. It depends on the shielding material, if it withstands neutron bombarding well or not. And the search for optimal shielding materials is still going on.
At least Tritium has a low half-life of 12 years, so it radiates not as long as most fission byproducts.
"Some people say 'Brains can't understand brains'"
I agree with them.
It's not just "very zen-like." Assuming the mind and our understanding is limited to functions of the brain, unless there's some new neuroscience I don't know about the brain can be understood as a logical system. We can create our own systems of understanding understanding, but we can't understand understanding on a level greater than understanding itself.
People emit what they recieve. Most people with a lack feeling for others, do not understand what others feel. This is usually because they are not taught how to consider the emotions of others. You can blame a lack of empathy on the population. People tend to have a general lack of attentivness towards life. This behavior is expected since our desire is the persual of our own happiness. Selfishness is what we are programed to be.
And this new thing he's working on will be bigger than that, even.
It's not the Turing Machine that we've all used since the 1930s; This is something fundamentally different, and I believe Hawkins will have just as prominent a place in history as Alan Turing.
I can't escape the suspicion that even with all the new information they still don't have a clue. But that makes it more interesting.
That is what most IQ tests use as a foundation when measuring intelligence, however pattern recognition is a vastly oversimplified and narrowed view of the capabilities of the human mind. You could consider "multiple intelligences" or "crystallized vs. fluid intelligences" as another perspective.
Just because the most IQ tests test mainly pattern recognition, does not mean that Intelligence is defined as such.
Its true that McDonalds does need a physical way of getting there burgers to their customers (by the way funds are not physical) but that's not why it exists. It exists because it's a business and it doesn't matter whether a business needs physical assets and staff or not it still exists. And that's why if I have an internet business, a finance business or a dating business I can sell that business and even if I am the only physical thing in the business and I don't have to sell myself.
The world is a relational place, the being that is to solve problems, which are a consequence of such relations between things and the subjects relation to these relations, must have a way of relating itself to the things it id dealing with.
Consider a human born with a paralyzed body (thus without the sensation of touch or the capacity for movement) and without the capacity for emotion but who does possess sight and hearing. What kind of mind or problem solving capacity could we expect?
Mind summarizing it for me?
You would be surprise to learn how many still think that dualism holds some ground.
I argued with a couple of friends (students in philosophy...) for weeks about this very topic.
kto od Quebo?
it's all of lifes means of transmitting information
Very interesting, I find him fresh, well motivated and targeting the right areas.
However, it is a pitty that all nueroscientists and modern philosophers of mind that I have come accross are ignorant of the body and its relationship with the world.
A brain makes no mind without a body and the bodies existence is entirely determined by its interaction with the world.
Good Luck!
Examples of Human intelligence:
1. Ability to react to an unmatched pattern: Say, while driving on a highway, you see a drunk driver or a car with break failed or with emergency light on.
2. Empathy, Love: Only human can realize the feeling of another human.
3. Thinking, doubts: Every comments, questions, debates, blogs are result of human thinking. "I doubt therefore I am"
4. Creativity: Paintings, poetry, novels, theories, equations all are result of human creativity.
5. Imagine, plan. & so on
Just watch this on Netflix and whats eating at me is that he said motor function is controlled in the frontal lobe. Wa.. What! I could have sworn it was further back in the primary motor cortex, brodmann area 4. What motor functions are controlled in the frontal cortex specifically? This is just new to me.
chightower26 well imagine if you consciously planned a complex sequence of motor actions that would have to come from the neocortex, whatever parts of the brain actually directly control motor functions would have to translate and action that self created input.
Damn my dude is ahead of his time
Having been a Mensa Proctor, I am familiar with what is tested when IQ is determined.
IQ (if not 'intelligence') is, in fact, (mostly) pattern recognition.
All intelligence is pattern recognition
You can have an entity with out it being physical. For example a business is an entity it can be brought and sold yet it is not a physical object. So does the business exist?
I'm not sure if you are against the idea of the existence of the mind in principle or you believe it could be that it does exist but for certain reasons you believe that not to be the case.
Please clarify.
but the brain works using electricty too. . . conciousness is just the centre of narrative gravity for the atcivities of your brain that are needed to effectively intuite the minds of others.
dat beemer commercial tho
There is one level of the mind that is bound up with the physical brain, the question is does that mind exist as a nonphysical entity/thing. There is another question, which is, is there a level of the mind which is not bound up with the physical brain. The first is simple and straightforward, the second is a deep philosophical and metaphysical question. It seems that a lot of people can't understand the obvious one so I won't bother with the second, of which I have a suspicion but no proof.