THE GHOST IN THE MACHINE
HTML-код
- Опубликовано: 18 май 2024
- Noam Chomsky discusses how the "mechanical philosophy" that originated in the 17th century with thinkers like Galileo, Descartes and Newton viewed the universe as a grand machine that could in principle be understood through science. However, Newton's discovery of gravity, which involved "action at a distance" rather than direct physical contact, undermined this mechanical view.
Full title: The Ghost in the Machine and the Limits of Human Understanding.
Please support us:
Patreon: / mlst
Professor Noam Chomsky is the most significant thinker of our generation. Chomsky argues that since Newton, the goal of science has become more modest - rather than trying to understand the true nature of the universe, which may be beyond human comprehension, science aims to construct abstract models that are intelligible to us, even if the underlying reality remains a mystery. He suggests there may be inherent biological limits to human understanding, just as other animals have limits to their cognitive capacities.
The upshot is that we shouldn't necessarily expect a complete unification of scientific knowledge or for complex phenomena like mind and language to be fully explainable in terms of physics. Chomsky provocatively states that after Newton "exorcised the machine" by showing the mechanical philosophy was untenable, only the "ghost" of intelligibility was left in science, which now relies on human-constructed models rather than grasping the true essence of nature. Achieving a direct, intuitive understanding - "exorcising the ghost" - may simply lie beyond the cognitive horizons of the human species.
Panel:
Dr. Tim Scarfe
Dr. Keith Duggar
Dr. Walid Saba
Pod version: anchor.fm/machinelearningstre...
Transcript of Chomsky interview; whimsical.com/chomsky-transcr...
Original corrupt recording: share.descript.com/view/N9KNa...
00:00:00 Kick off
00:02:24 C1: LeCun's recent position paper on AI, JEPA, Schmidhuber, EBMs
00:48:38 C2: Emergent abilities in LLMs paper
00:51:32 C3: Empiricism
01:25:33 C4: Cognitive Templates
01:35:47 C5: The Ghost in the Machine
02:00:08 C6: Connectionism and Cognitive Architecture: A Critical Analysis by Fodor and Pylyshyn
02:20:12 C7: We deep-faked Chomsky
02:29:58 C8: Language
02:34:34 C9: Chomsky interview kick-off!
02:35:32 Q1: Large Language Models such as GPT-3
02:39:07 Q2: Connectionism and radical empiricism
02:44:37 Q3: Hybrid systems such as neurosymbolic
02:48:40 Q4: Computationalism silicon vs biological
02:53:21 Q5: Limits of human understanding
03:00:39 Q6: Semantics state-of-the-art
03:06:36 Q7: Universal grammar, I-Language, and language of thought
03:16:20 Q8: Profound and enduring misunderstandings
03:25:34 Q9: Greatest remaining mysteries science and philosophy
03:33:04 Debrief and 'Chuckles' from Chomsky
References;
LeCun Path to Autonomous AI paper
openreview.net/forum?id=BZ5a1...
Tim’s marked up version:
acrobat.adobe.com/link/review...
Emergent Abilities of Large Language Models [Wei et al] 2022
arxiv.org/abs/2206.07682
Connectionism and Cognitive Architecture: A Critical Analysis [Fodor, Pylyshyn] 1988
ruccs.rutgers.edu/images/perso...
Ghost in the machine
psychology.fandom.com/wiki/Gh...
forum.wordreference.com/threa...
news.ycombinator.com/item?id=... (thanks to user tikwidd for your analysis)
Noam Chomsky in Greece: Philosophies of Democracy (1994) [Language chapter]
• Noam Chomsky in Greece...
Richard Feynman clip
vimeo.com/340695809
Chomsky Bryan Magee BBC interview:
• The Ideas of Chomsky -...
Randy Gallistel's work (question 3)
Helmholtz “NNs : they’ve damn slow”
Purkinje cells
Barbara Partee
• "Math Does Not Represe...
Iris Berent
cos.northeastern.edu/people/i...
Penrose Orch OR
en.wikipedia.org/wiki/Orchest...
en.wikipedia.org/wiki/Shadows...
Fodor “The Language of Thought”
www.amazon.com/Language-Thoug...
Least Effort
materias.df.uba.ar/dnla2019c1/...
structure dependence in grammar formation
www.jstor.org/stable/415004
www.amazon.com/Minimalist-Pro...
three models
chomsky.info/wp-content/uploa...
en.wikipedia.org/wiki/Transfo...
www.amazon.com/Aspects-Theory...
Darwin's problem
chomsky.info/20140826/
Descartes's problem
en.wikipedia.org/wiki/Mind%E2...
Control Theory
en.wikipedia.org/wiki/Control...)
We just uploaded a transcript of the Chomsky conversation here: whimsical.com/chomsky-transcript-WgFJLguL7JhzyNhsdgwATy
And the original corrupt recording here: share.descript.com/view/N9KNaZTav27
👍🖤
I think I know,but what do i think i know.
Yes,but you think you are pushing but it is you who are being pushed.
Surely you know the airpods are giving you cancer in the brain etc?
At least 4 good sci-fi novels, or one great one are in this talk.
I love how people can get together and just talk and learn from each other it's absolutely beautiful.
Common sense. Don't even talk about the other examples.
Common sense is an oxymoron. Don't ever forget that!
what a take
Shame politicians don't know how to do it
Me too !
Sorry about the nightmare with the video yesterday. BBC copyright flagged us because of this Feynman quote -- see share.descript.com/view/H6SqE6F3Zip for the part we removed -- in this version I just quoted it out loud (in Ghost section 01:35:47 start and end of that section). The entire video is available at vimeo.com/340695809 -- the BBC used to make good content before 1980. #defundthebbc
Update, even the visual we have used to show Richard Feyman on this new version of the video (while I narrate audio) has got us demonitized! Apparently it's impossible to show a video of Feyman on YT. At least our video isn't blocked this time. This time a clip from an ITV show in the early 80s... should copyright apply for a 1 minute clip from a show about a scientist over 40 years ago?
@@MachineLearningStreetTalkwell since you’re asking, I don’t believe in any form of copyright whatsoever. It protects creators! Haha, like Disney? It protects the wealthy. I’m Robin Hood.
🥷
…thanks for your efforts to keep the video up for us to benefit from.
Beautifully conducted! Rare is it that Chomsky is asked and pressed on technical questions - the results are pure dynamite 🧨💥 Thank you!!!!
Op0ppop0popopoop00oo0poopop0popopoop0ooopppopooooopooppopppopopo0poppop0opmppp0pmpppmpppppmpp0mpppm0mmppppp0mppmppppppmppm0mmmpm0pp0mmp0ppmppmpp0pmppmppmmmppppppmpppmppmpp0mmmmmppppppmpmppppmmmmmm0mpppmpm0mp0pmppppmpmpppm0mmpmpm00pmpp0mppmmm0mmpm0pmmppmmmmppmmmppppmppmmmpp0pmm0mppmmmmmmmmppm0pppmm0mmp0mpmp0mpm0m0pm0pmmmm0mpmmmmmp0ppmm0mmmmm0m9mmmpmmmpmmmpmppppppmmmmmmmmpmmmp0mmmmppmpmmmmmm0mmmmmm0mmm0lmmmmmmmmpmmpmmmmmmppmmomm00mmpmmpmmmpmmmlmmpmmmmmmpmpl0mmpmmmm0mmmpp0mpmm0mm0lmmmmpmmmmmmm0mppmmmpmmommmmmmmm0ppmpmmmm0mmmm0lmmmmmmmmmmmm0mmm0mpmmmmplm0mmmmlmmpmmmmmmmpmmmm0m0lmmm0mm0m0mpmm0mmmmmm0mmm0m00mm0mm00mmpm0p0ommmm0mmmpmmmmpm0mmmmpmmmmmmmmpmmmpmm0mmlm0mp0m0mmmmmmmmmpmp0mmo0mlmmmm0mmmmmmmmm0mmppmmmmmmmmmmmmmmlmm0m0m0m0pm0l0m0mmm0m0mmmommmmmmmmmmmmm0mmmlommm0mpm0mmmmmmmpmpmmmmm00mmmlmmlm0m0mm0mmmmpmmpmmmm0olmpm0mom0mmmmpmpmmmmmppmpp0m00mmo0mmmmp0mpolmmmm00mmmmmmmmm0mmmlmmmm0mmmpmpmm0mmmmm0mmmmompmmmpmm0mp0mmmmp0pm0mmmm0mm0mm0m0m0ll00mmmm0mpmmmmmmmp0m0ommmpm0lmmlmpmmom0m0mmommmm0mmpmpmmmmm0m0lm0ppm0m0m0mm0mmmm0lm0mmm0p0mmm0mm00mmmmpmp0mmmmo0ommo00o0mpmmpmp0mp0mm0mmmlmmmmmm0l0mmommmmmmmpm0mmmm0ml0ommmmmmmp0mmpmmmppmmmmmmpmplppmmmommmm0mmmp00mmm0lpm0om0mm0mmm0mmmmmm0o0mm0mmmmpm0m0m00lmmmmmm0mmmmm0mmpmmmmmmmmmm0mmmm0lmm0mm00pmm0mmmmmmmlmom00m0mpm0mpmm0mlmpmmmmmppmpp0mpppmppmpmp0pppppmmpp0pmpppmppmmpmppp0mmp0pppppm0pppmpm00pppm0pmppppppp0pppppp0pmp0mppppmpmppp0ppmp0ppp0pppppp0mp0ppppp0pmppm0lppppppm0pmp0pmp0m0mm0m0ppmpmppmpmppmpp0pppppp0ppplp0mppmmp0p0pmmopp0ppp0pppmpm0pp0ppppmpppppppppm0mpppppppppppmpp0pmopmpp0ppmpmpmpppp00pppppppppmpppmpp0pppppppp0pmpppmppmppp0l0pppmpmpppmppmppppppppmpm0p0mpmmmpppppmm000pmppmpmppp0opp0pppmppmm0pppppp0p0ppppppp0mmpppm0ppmpp00pppmppmpppp0opppppppppp0pmmmpmpppppmpppm0mmppmpp00plppp0ppppp0mppppppppppmpp0pppppppppp0mppp0pp0ppppppm0ppppp0pppp0mpppppppppppm0ppppppppmpppppppppmpmpmppppmmppppppppp0pm0ppp0ppppppppmp0mpmppmppppppppppmppp0l0omlm0m00m0m0ppp0m0mpmp0m00l0m00mool0o9o
@@abbasssater6466 - troll
@@pkerber ib think it’s meant to be binary
@@GuinessOriginal It's meant to be a part of...and amplify a narrative.
@@dobekhil not with you
In the late 80s I was an undergrad making my spending money sitting on the floor of Dan Dennett's back office sorting through box after box of academic papers, reading them and then classifying them according to a list of subject topics (i.e., Connectionism, Chinese Room, etc) for a future library of cognitive studies. As a grown up manufacturing engineer I'm getting serious nostalgia here. I suggest you do one on the making of Do The Right Thing next just to complete the job lol. Edit: Thank you for treating Noam so respectfully, that was really heartwarming.
Heroic effort! One of the richest Chomsky interviews around. Thank you so much. :)
indeed. echoes my own thoughts on the matter too, and i love Chomsky anyway
@pencer Come on! Learn to think for yourselves.
Noam doesn't seem to have the slightest clue of what is going on.
2:36:16 "... they've achieved zero... anything goes. mmkay...."🦬💩
Gnome project (Google deep mind)
>> New materials for new technologies
To build a more sustainable future, we need new materials. GNoME has discovered 380,000 stable crystals that hold the potential to develop greener technologies - from better batteries for electric cars, to superconductors for more efficient computing. > The key ideas of GLoRe are using the ORM for when to refine, SORM for where, and combining global and local refinements for how. The SORM is critical for providing a better training signal to localize errors. Reranking drafts and refinements with the ORM gives the best results by selecting the most promising refinement.
By decomposing refinement into these three parts and using synthetic training data, GLoRe is able to significantly improve language model reasoning capabilities without any external feedback. The paper shows GLoRe can boost accuracy on math reasoning tasks by over 10% compared to strong baseline models.
I don't know why this podcast popped into my feed, but I'm very glad it did. The amount of effort your team put into this single episode is remarkable and greatly appreciated. It wasn't easy for me to wade through the jargon and concepts of a field unknown to me; even so, it was nearly impossible to quit. Thank you, gentlemen and long live Chomsky!
AI made Google do it.
how anyone could believe that the universe would cease to exist without our observation is beyond me ....
I like the idea of blind spots in human cognition. Imaging that there are knowledge in the world, that is completely accessible to us, but we cannot comprehend, simply because of structure of our brain, which can never converge in it's learning of the concept. And I'm not meaning extremely complex concepts, but simple ones that's still incomprehensible.
Neuroplasticity!!
I agree. I'm finding it a fascinating concept to ponder. At present I can see two possibilities. 1) there are blind spots or 2) once an intelligence reaches a sufficient conceptual threshold (say the Calculus of Constructions) all concepts become accessible given sufficient computational resources.
"Let's find an intelligible universe"
The universe ought to be unintelligible, [physicists search for a human unintelligable theory], you need your theories to be intelligible, if physics says that's how it is (unintelligible) then some it. Motion is what physicists tell us it is. Or we converse, each conversing thoughts sharing our thoughts in real time. The alphabet captures this in 26 letters. Galileo says "most remarkable fact". More to say. Speaking as a creative act. We're talking...[it's amazing]
ZERO, lol
Like magnetism?😊
Your respect for Chomsky and each other and your passion for clarity in this complex subject created something wonderful. This was accessible to me, and my family and we haven't stopped discussing rats in prime number mazes, the cognitive templates perhaps bestowed by survival though the action of genetics, the nature of empiricism finite points of data and useful abstractions and our symbolic approximations of the infinite, so much so that my daughter wants to know how to get onto you discord so that she can read more about all of this - much gratitude!
Wow! Ben, thank you so much for this comment. Wonderful! This is why we do MLST.
Up…………………………, 5:04 P aaa😂🔪🍒
What an incredible interview. For an outsider who knows nothing about the topic, to get a glimpse of such a beautiful mind distilling fundamental questions was revelatory. Your painstaking struggle to salvage the recording underscored your profound respect not just for Chomsky but for your audience. Thank you for this gift.
Amazing episode! The only thing better than chomskys point of view on things is the joy keiths face whenever chomsky makes a point
Phew, I was scared till the re-release!
Massive respect and thanks for keeping these conversations, guests and everything the highest quality possible!
As a serious science podcast connoisseur, I gotta say the work you guys have put together here is truly extraordinary. Very impressed and honestly deeply humbled. Thanks and kudos!
But where's Noam Chomsky?
{:o:O:}
Would you mind recommending a few more?
Thank you so much. While listening, I was wishing the scientific Paul Cisek could meet Professor Chomsky for a talk about the long evolution of the brain for motor control to survive in the environment. I will always be impressed by Noam Chomsky. Thank you so much for all you did to give us the chance to listen to this great interview!
This production has been on auto-loop replay the past 16 hours, congratulations having achieved a lifetime dream.
A lesson in the way a true scientist thinks and questions the world - over 90 - just wow ! An episode with so much content/references I'll be visiting it often. Thank you for all the teams hard work and perseverance - much appreciated !
Thanks Penny!
Chomski was never a scientist.
@@hugolindum7728 Then? Please elaborate
YES, please do an episode on the technical achievement of recovering and regenerating the recording
Prior to watching this debate I would not of thought did it the end I would have tears rolling down my face and a full heart And reinforcement in my belief of a creative creator who truly loves humanity. I thank you gentlemen with all my heart
Finally some people who actually seem to understand what Chomsky is talking about, as opposed to all the morons who talk about him all the time without any kind of understanding whatsoever. Absolutely amazing video!
Let's ask Chomsky about his "forced vaccinations in your arm."😂
He is not stupid. However the people who ask him questions out of his lane, are fools. Ask him about linguistics. The rest is cultural obstruction.
You are so far above everyone 😂
@mavrosyvannah yeah stay in your intellectual lane
Yeah much better questions 😅😮🎉
Dude, ths is absolutely incredible.
This kind of dedication is singular, and I've not seen quality of this kind on youtube in a long long time.
This is beyond stimulating, there's something deeply beautiful about the quality of the work, and I can only say thank you.
Wanted to recommend y'all to one more interesting person that the ever-industrious Chomsky recommended to me a while ago -- about "click" languages (clicking tongues" and how it lines up with universal grammar.
Riny Huybregts.
If someone has any contact info, I'd love to send the paper that was sent along to me.
Thanks so much for this show.
He speaks well
@@stephenwallace8782 Thanks for this. That might tie in with the work that Dr. Monica Gagliano has been doing in her studies of plant bio-acoustics. She has managed to record sounds from young corn plants, so far and high speed clicking would describe the sound best. Thanks for the suggestion to look up.
this is a documentary in itself great work !
What an episode!! Combining one of the worlds great public intellectuals with one of the worlds most insightful podcasts. Well done chaps.
Thank you, Noam. I've never heard Occam's razor described as Nature optimizing for simplicity, but this makes perfect sense. For me, it takes this principle out of the occult and places it into an explainable engineering domain.
Very excited for this episode!
Appreciate the Feynman impression, above and beyond
Oscar winning 🤣
What a beautiful episode. Such a cool ironic journey with the audio recovering process. I’ll echo what others have said: this channel is amazing; thank you for all the care and effort put into it. One of the best qualities is that this is not a passive empiricist channel, but in fact it is actively trying to build knowledge and construct ideas in the interaction space between you guys and the guests.
In a nutshell, who is he, what does he want? He enjoys the USA culture, free speech, job, and he is protected as a smaller man would wish to be.
In a war situation what use would he be?
This is popping on my feed everynight for a year. Im not complaining🤷♂️
I listened to this a few weeks ago and re-listened to take notes, and it's still almost beyond my grasp. Amazing you got Chomsky for an entire hour. Really great work putting this together. Thanks
Whew glad im not the only one. I Am an intellectual..but listening to chomsky or qp theorists etc i feel like a monkey sometimes and scramble to research their ideas
brilliant save! master language splicing! wicked interview and great episode. thanks very much for all the hard work 🙂
I got no words to comment on this EVENT. It is truly INTENSIONAL.
I've noticed that in the reconstruction of language by stroke survivors there is a brief, although sometimes long period, in the recovery of speech where the grammatical construction of short sentences resembles classical Latin ! Te amo.
Your efforts to recover the audio is simply superb!❤️
OMG after seeing it in full, I just can't believe this was the bad quality as you said it was...just outstanding recovery.
Great content 👍
Thank you!! It was a Herculean effort.
I have not hear Mr. Chomsky for over a decade. I know little about science and AI. However when he talks I GET IT!! I still LOVE THIS MAN! He Simplifies things so much and even proved a point I said to a friend that AI's cannot do. I just imagined that they could not and he says the same thing! I was going to bed and happy this came on and I forwarded to this part. LOVE YOU Mr. Chomsky!! I so SO HAPPY You are still here!! We KNOW so LITTLE even about our bodies and yet we think we can build AI's are smarter than we are! Loved this program!!
Well of course we can, this is a bit of a non-sequitur, because we do not understand cognition fully does not mean we cannot build machines with greater computational powers than our own, in fact, we already have this
dude thanks for sharing this roller coaster ride of a story re recovering the lost audio - wtaf with the recording providers?? absolutely stunning work - amazing guest- you guys are nailing this stuff and I'm extremely grateful for your efforts. keep up the good work.
This episode is awesome. Recently discovered you guys from a Goertzel episode. I'm a phil mind student trying to get a grip on AI. This channel is a huge help. Bringing what I learn here back to the philosophers I have on my own channel
Read Schopenhauer, ignore his pessimism, replace "representation" or "idea" with Presentation or Phenomena, replace "Will" with whatever non-spatial extra-temporal term (simulation?) you please. It is a huge help. He completely simplifies and corrects Kant. Start by finding a good translation of On The Fourfold Root of the Principle of Sufficient Reason.
Also, Aron Gurwitsch. Super important. You can read Sven Arvidson's "Sphere of Attention" if you want a simplified but empirically informed interpretation of Gurwitsch that needs to be *expanded* & has solid potential for being integrated with AI.
He seems a little behind the times on the latest in neural networks, but I can't believe he keeps up with any research at 93 as well as he does. Inspirational.
On the audio failure, do you you not also record the video calls on your side of the conversation as a backup? Most podcasters seem to use a completely separate piece of hardware to capture all their computer audio output and they can fall back to the lower quality (zoom call or whatever) version if the recording on the other side fails.
Backup recording was also corrupt. We were hoping that we were only hearing it corrupt during recording and it would be OK on playback. We were stressed and under time pressure, in retrospect we should have stopped and figured out what was going wrong.
I might suggest that the structure of the end result that emerged, a coherent whole, required destruction, or decoherence or deconstruction of the original.
But mate, well done. What a nightmare turned dream.
Tremendously enjoyable: thank you so much for making this type of content.
Superb effort put into the show! Thanks a lot!
Wonderful content! Keep up the great work as you do. I love all of your episodes. It's getting better and better every day.
This is probably the best content you've created so far, and some of the best content on AI that I've watched in a long time. Keep up the great work - those armchairs suit you! ;)
I think this is a great podcast! Thanks for your hard work. I got tickled by the rat and maze as an example of the limits of of a rat brain limitation. Take a random hundred people and let them try it. Reward is a thousand bucks.
The best thing about speaking with Chomsky is being able to tell people for the rest of your life that you spoke with Chomsky.
I kind of did too
no shit.. you can be a complete moron and in a group of intellectuals say "So..i was talking to Noam Chomsky and.." hush across the room..
How about the children he abused
@@BB-rt9nc says who?
@@BoRisMc Epstein
Exceptional work saving the interview! Thank you deeply.
I've NEVER watched a 3 hour webcast in my life; make this the first exception!
Just an amazing discussion - from about 2:34:00 (when Chomsky starts). You guys did a fantastic job!
You guys are great! Thanks for this amazing content. Cheers from Brazil.
The content you guys produce is just amazing! Keep it up!
BBC took it down first, now it doesn't have audio. But it will get fixed soon I'm sure.
This is an amazing episode of this channel! There is so much here! I keep running into things that I want to follow up on which I then forget because another one comes right after it! Gotta put this thing on an infinite loop?
I had the same thought. It takes place in a 10x or 100x size enhanced blow-up walk-in human brain. In the dark...with LEDs and wiring loops.
@@simonmasters3295 lol ... that is an imaginative and hilarious visual!
New subscriber here! This video is phenomenal. I don't think I have watched a video where the effort put into it is so apparent to me. And then to hear that you have one with Joscha Bach coming soon. Wow!
Stumbled across this, absolutely fantastic. Enjoyed every part of it ❤
I find it very insightful to watch it 11 months after it was released. It gives one a perspective of how fast the research is moving.
It's so fantastic to see the respect given to someone considered an elder when often times younger generations brush off elders as if they know more than the "old fuddy duddies" In fact so much wisdom can be gained from our elders. Of course Norm Chomsky is a legend that if anyone has the privilege to pick his brain and gain knowledge, you are fool not to do so. This was an amazing watch. There's so much wonderful content on RUclips but most people would rather watch drama which is why a majority of our youth can't score enough on an SAT to get in to college without exceptions being baked ín and then students drop out. In my opinion, it's better to force students to know that they must study and work hard if they want to succeed instead of everything being handed óut to them. Cheers 🥂
Work hard and pass your SATS is some typical dumb old boomer perspective
@@xmathmanx 🤯 😂😂
A great episode!
This is an amazing episode, more accessible than some. Watched it several times now, each time something new.
I have a very limited grasp of the concepts explored in this video but I watched all 3 1/2 hours of it, absolutely fascinating! Excellent job rescuing Prof. Chomsky's interview, he does a great job of cutting through the clutter and presenting ideas in a clear and rational way.
The great Noam chomsky! If anyone should have their consicousness scanned into an ai its him. Always a pleasure to hear from him. Honestly the world needs more of him. I'd love to see him do more shows online. I've gone through all of his works
spare us. he's not that great, actually, I think he's kind of a con man.
No really, O M F G you guys are MAAAAD, I love it
I find such comfort in listening to one of the brightest minds! Thank you always.
Thank you so much for the work you all did!
❤ Dr. Chomsky, I have been following his work for more than 26 years.
Did you follow his dealings with Epstein too? You must love those "dealings", too.
best of MLST
Looking forward to more videos. Keep up the good work
MLST might be the greatest foray into media that has ever been conducted by members of the human species. Not kidding.
Great podcast lads, Chomsky is a true legend, great conversation
m only at 31 minutes, love how honest you are with things happening , yeah , i guess those who are not interested should not be invited because we got many more good researchers in this modern time who needs exposure for their works :) Amazing content, and i have not even finished the first half.
Great discussion. I appreciate your hard work, dedication, and enthusiasm! Lots to think about.
Really enjoyed this episode. Amazing work!
I love Noam. He is a friend to the mind.
Also a friend of Jeffery Epstein
I've just discovered this channel and I am curious if large amounts of poetry have been introduced to AI. Art is so important to understanding the human experience.
How much of a difference 11 months of exponential growth in AI tech has made since this pontification feast 😮
Great video. Genuinely. As someone who's been kicking around a very long time (before the Postel shenanigans, even before HTML) it's great to see this level of public content.
I cannot thank you enough for what you did. It's an amazing work. I'm so happy you didn't give up on the recording. Incredible episode!
I have one minor feedback to share: for us non-native speakers, following the interview can be very hard due to a combination of English, voice-reconstruction and sheer complexity of what is being discussed. Could you please enable subtitles? At least for the final chapters.
Thank you very much!
What do you mean "voice reconstruction"?
@@michaelwerkov3438 I meant the output of the tool they used to synthetize the voice.
Thank you.
Brilliant.
Would love to hear this kind of discussion with the addition of someone like Lex Friedman. :)
Amazing to listen to Noam Chomsky! 'Pi, answer me in the style of Noam Chomsky!' His comments about the Language models being created today seem somewhat jaded, and perhaps there is some nugget of something in the neural nets and LLMs that has been inspired and captured some little bit of the process of human thought, thinking, and language. But one prediction I will say is that as GPT-5 is being rolled out, there will be a cottage industry making LLM produce answers in the Noam Chomsky style! 'Pi, tell me about language in Noam Chomsky style!'
Extraordinary, as always.
I find myself disagreeing a lot with what I'm hearing but I love it, all of it! Great video.
That's great! Disagreement is the engine of progress and the ability to hear what you don't agree with is the fuel.
bitter lake instead of bitter lesson, good slip up ;)
This is a gift to the world. A million thanks and well done!
Fantastic video guys! So happy you put this all together.
Thanks so much!
He's still alive. I didn't heard him for quite a time.
epic and amazing episode!! - although the hero worship after the interview had not much to do with the problems he raised - the descartes problem where everyone says its deterministic, and then go about behaving non-deterministically - and his observation that children ignore the sensor data they're presented with and rely totally on mental constructions they never perceive 🤯 this is totally mind-blowing material!! he pointed out so many avenues of research - how we've followed two dead-ends, and never pursued the third - to which he alluded. 🤨
Great job setting this up
I like how the general consensus is how deep a mystery everything is! But you guys did an awesome job, and such a wonderful interview! Cheers....
Why are we (as a community) always comparing / intersecting human minds and machine minds? Why can’t they be different and coexist, each with their own beauty and value?
Because the fundamental question we ask is, can human-like intelligence be replicated in a machine (AI).
Just a minute in, and the production quality of this video is why I don't have a Netfflix subscription.
Bought it for the first time the other day, haven’t been on, RUclips is it
You should try it, the production quality is much better than this
Great show. I have watched a few Chomsky talks and this was a very good one.
A direct conversation between Chomsky and LeCun would be fascinating.
Amazing content! Fantastic the way this discussion makes clear that even for people with such obvious intelligence and knowledge there is a point where the model of theoretical science departs from what is apprehensible from normal cognition. It is very rare and wonderful humility to escape the pretence of fully comprehending those things of which you clearly have mastery. So refreshing and so much more illuminating. So nice for somebody to simply state that at the most visceral level of human cognition the curvature of space-time is unintelligble nonsense. Of course this does not prevent the manipulation of the mathematics, but at least we can all stop feeling stupid about the fact the mathematics is another description model, that we can accept is not fuklly linkable to our hunter gatherer precepts
.
Loved watching this. Great work.
That's incredibly good. You also got the opportunity to show the techniques you talk about -- by restoring the interview itself. Chapeau. What can I say? It revitalized my intellectual curiosity and surely many others too.
I think a critical piece of the AI puzzle that doesn't get attention is a more intelligent use of graph databases. Why hasn't anyone worked with Wikidata to produce an (E2S) English to SPARQL translator? I've heard Stephen Wolfram complain, possibly hyperbolically, that only 25 people on the planet know how to write SPARQL queries. Wikidata has a service to rewrite SPARQL queries from English requests. Is that automated? I guess that it isn't. I assume that their staff rewrites those queries. I hope they've maintained all the data. Moreover, how might a program choose an encoding scheme for graph databases? Is there a better format? Something with better compression? Wikidata is a world model. It's probably the best we have. An open question-answer model that used results from an E2S translator as input would be a fascinating system.
Finally got round to giving this the uninterrupted hours it deserved.
I was welling up in the way only a fellow long-term Chomsky reader and ML researcher could when you revealed losing the recording and the effort that went into recovering it. What a beautiful act of tribute, that must've been so fulfilling when you got it right and impressed him with your work to boot.
The composition of your dialogue snippets on the part of the show before Chomsky was also really artfully and thoughtfully composed too. Fantastic and thought-provoking episode. Bravo guys.
Thank you so much for this, you guys are amazing 🌟🖖
Wow! Great work on saving the Chomsky's interview! Insightful discussion with Dr. Keith Duggar and Dr. Walid Saba! Thank you for your work!
I get very passionate about your podcasts and don't take the time to praise you for your incredible work. It's a problem I have because of my lack of mirror neurons. Nevertheless, I can analytically come to the realization eventually that I should say something human. Let me express how much I greatly appreciate and enjoy all your work. Your combined technical prowess and understanding are prodigious. Thank you for all you do to expand knowledge and create a better world.
Thank you very much, Michael! Sincere positive feedback is fuel for us to continue!
Note to everyone, we also enjoy being challenged with negative (but civil) feedback, honestly, we want to continue improving. I'd also like to say that we read all comments! Even though we cannot make the time to respond to all of them, we do read them and appreciate everyone's engagement.
First quote of LeCun in this video
"Supervised Learning sucks" 32:49
haha I definitely laughed when I heard it. But yes, SL can only get you so far, because of limited labelled data. If we can infer structure of the world by filling in missing parts, e.g. through predicting missing parts like in Masked Language Models, we can potentially learn from just observations without labels.
Deep learning sucks, supervised or self-supervised. Gradient-based learning sucks. Function optimization sucks. None of it has anything to do with intelligence. Hard lessons will be learned by LeCun et al.
You guys are great! I hope you go viral asap. I love this show!
I recently found this channel. Absolutely amazing content and sincerity. Thank you for being a beacon among the click bait and fear mongering.