What's the future for generative AI? - The Turing Lectures with Mike Wooldridge
HTML-код
- Опубликовано: 6 июн 2024
- AI can now generate human-like language and artwork - but what other doors might it open in future? And how can we harness AI to make great leaps in technology possible?
This talk was filmed at the Ri on 6 December 2023, in partnership with The Alan Turing Institute.
Join this channel to get access to perks:
/ @theroyalinstitution
Watch the Q&A with Mike here, exclusively for members: • Q&A: What’s the future...
Join 2023 CHRISTMAS LECTURER Michael Wooldridge for a fascinating discussion on the possibilities and challenges of generative AI models, and their potential impact on future societies. Find out more about the CHRISTMAS LECTURES here: www.rigb.org/christmas-lectures
00:00 What is machine learning?
05:54 How do neural networks work?
12:49 How Silicon Valley money created Big AI
14:50 The birth of Transformer Architecture
16:06 How was GPT-3 trained and created?
22:12 A massive step change in AI
25:45 How GPT-3 passed the 90s AI reasoning test
28:40 How has AI learned things it wasn't taught?
31:07 Chat GPT and how NOT to use it
32:26 Why do LLMs get things wrong so often?
35:29 The problems of bias and toxicity
39:12 Copyright issues with LLMs
42:23 Interpolation vs Extrapolation
45:44 Is this the dawn of General AI?
49:19 The different varieties of General AI
54:01 What actually is human general intelligence?
56:07 Is machine consciousness possible?
------
In partnership with The Alan Turing Institute we've been exploring the various angles of large-language models and generative AI in the public eye. Across three lectures, we aim to provide a comprehensive, thoughtful and engaging understanding of this rapidly emerging field and its impact on society.
Watch the first lecture here: • What is generative AI ...
And the second lecture here: • What are the risks of ...
-----
Michael Wooldridge is a Professor of Computer Science at the University of Oxford. He has been an AI researcher for more than 30 years, and has published more than 400 scientific articles on the subject. He is a Fellow of the Association for Computing Machinery (ACM), a Fellow of the Association for the Advancement of AI (AAAI), and a Fellow of the European Association for AI (EurAI).
-----
Discourses are one of the Ri’s oldest and most prestigious series of talks. Since 1825, audiences in the theatre have witnessed countless mind-expanding moments, including the first public liquefaction of air by James Dewar, the announcement of the electron by JJ Thomson and over 100 lectures by Michael Faraday. In more recent times, we have had Nobel laureates, Fields medal winners, scientists, authors and artists - all from the cutting-edge of their field. Discourses are an opportunity for the best and brightest to share their work with the world.
Steeped in nearly two centuries of tradition, a Discourse is more than just a lecture. The Discourse lasts exactly an hour, and a bell is rung to mark the beginning and end. To keep the focus on the topic, presenters begin sharply at 7:30pm without introduction and we lock the speaker into a room ten minutes ahead of the start (legend has it that a speaker once tried to escape!). Some of our guests and speakers dress smartly for our Discourse events to add to this sense of occasion. Read more about Discourses here: www.rigb.org/explore-science/...
-----
The Ri is on Twitter: / ri_science
and Facebook: / royalinstitution
and TikTok: / ri_science
Listen to the Ri podcast: podcasters.spotify.com/pod/sh...
Donate to the RI and help us bring you more lectures: www.rigb.org/support-us/donat...
Our editorial policy: www.rigb.org/editing-ri-talks...
Subscribe for the latest science videos: bit.ly/RiNewsletter
Product links on this page may be affiliate links which means it won't cost you any extra but we may earn a small commission if you decide to purchase through the link. 
Наука
To get you excited for this year's Christmas Lectures, which are on the theme 'The Truth About AI', we've got our 2023 Lecturer Mike Wooldridge talking about the history and future of generative AI. If you're in the UK, you can watch the lectures on BBC FOUR and iPlayer from the 26th December, and if you're outside the UK, we'll be uploading them to this channel on the 29th December. Who's looking forward to watching?
Love the Christmas lectures and I'm esp. excited for this year's lectures. Thank you for uploading them so early after original airing for us outside the UK.
Yes! Tyvm Ri production team!
Liked the speech!
Yet the progress is so rapid - some points are not true. F.e. AI language models already do reasoning under the hood and their answers much better.
Yay, can't wait ❤
Definitely a rhetorical question 😊 the Christmas Lectures are an institution in themselves! 😃 There needs to be a mahoosive celebration in 2025 for the 200th anniversary. 🎉 Will certainly be tuning in on Boxing Day. 🎄 📺 🤖 👀 👍
There are times I don't think there's much to get proud of here in the UK, but the fact these lectures are still going, that they are watched and available for free on the website, going back for years, reminds me that some things in the UK are pretty damn cool
As Mr Woolridge kept saying, the big money that is driving rapid Improvement in the capabilities of AI is primarily coming from Silicon Valley... which is not in the UK. DeepMind's UK-based scientists are doing great work, but they're owned by a USA company, and as they change jobs, all those not in love with driving to the pub will over time move to California. Maybe impoverished UK AI researchers will come up with incredible breakthroughs by being forced to work smarter instead of throwing money at problems, but that's like hoping Russian computer developers would surpass the West in the 1970s.
hear hear!
Here hear!
You’re still making great beers in my opinion so there’s that :), but I see where you are coming from.
True.
When I was a kid my mum put them on (& other documentaries Attenborough in black and white), on the tv, BBC2 (only BBC 1&2 & ITV then) she never said a word.
My siblings and I are all lifelong, open minded learners.
I went to the theatre where these are filmed (open to the public) and I was surprised how emotional it was.
This was laid out so eloquently and clear with a great sense of humor, thank you so much mr. Wooldridge
I kept waiting for him to talk about where AI is going and all I got was a pretty basic explanation of what AI is.
Yeah, I felt it was a complete waste of my time (even at 1.5x normal speed).
his last statement: he reassured us that robots will not be sentient and scientists have no interest in creating one that is.... felt like propaganda + brainwash
I think that's covered in episode three.
But it's worth remembering that whist many adults enjoy these lectures they are aimed at young children
"whats the future of GENERATIVE ai" doesnt seem a subject for young audiences at all -- unless ur being sarcastic, but in that case you should've left an indication of that (an emoticon, etc)
Believe me when I say bloke if ya'll explain what is happening now it gives most of us humans what to do next. Ya'll kinna stand in the middle of the river and jump the Dukes of Hazzard 03 across. No ya'll put a couple show of Dukes and ya'll will know what to do.
I find it quite interesting that this lecture was recorded in December 2023 and not once does he mention GPT4, which is much, much more capable than GPT3. When combined with some simple prompting techniques AI is already more capable than his checklist suggests. This technology is moving very fast indeed.
This is exactly what I am wondering at 50:24 when he said he doesn't see Robots + AI taking over Human tasks any time soon when I have already heard of news of AI taking over some jobs. It's just the beginning, but it definitely is happening. Lets not forget Boston Dynamics BEFORE GPT 4 and onwards and what it could do over 2 years ago in terms of helping humans with PHYSICAL real world tasks. I think we really are at the point that not even the "Experts" can predict the future. All we know is, things are moving very... very... VERY quickly now and I do personally believe we have AGI by 2027 - 2030.
lol didn't Google just layoff 30,000 people in their Ads Dept because of advances in AI to automate their ads?@@TheMillionDollarDropout
@@TheMillionDollarDropoutmuch sooner. It's already faster than researchers can observe. It's an exponential growth by nature. The new versions will come faster and faster and it won't just be 5x more powerful than the last. Because the last version is already training the next version faster than humans can. Imagine when that's applied(like it already is) to coding the next version. We are using AI to scan video data because we're already out of written data.
@@TheMillionDollarDropout Boston dynamics is not a good example
"Chiarissimo" is the best complement that I can make for Mike Wooldridge. You make such a complement to the best teachers, in Italy. You made a very, very clear and understandable conference !
I wanted to experiment by asking ChatGPT if fish can run, expecting the answer "No, fish can't run." If that was the response, my follow-up question would've been, "Is a mudskipper considered a fish?" Unfortunately, that plan didn't go as expected.
Q:Can a fish run?
Answer (ChatGPT):
In a way, some fish can be said to "run" underwater. Certain fish, like the flying fish or the mudskipper, use their fins or specialized anatomical features to propel themselves out of the water or move across land briefly. However, their movement isn't exactly like running as we typically think of it; it's more of a specialized form of locomotion adapted to their environment.
I got >No, a fish cannot run. Fish are adapted to life in water and move by swimming, using their fins and body movements. The concept of "running," which involves moving rapidly on legs and feet, is specific to land animals and is not applicable to fish. Fish have evolved to be efficient swimmers, but they lack the limbs and musculoskeletal structure necessary for running.
and follow up gave : Yes, a mudskipper is considered a fish. Mudskippers are part of the family Gobiidae, which includes many species of gobies. They are unique among fish for their ability to live both in water and on land. Mudskippers have adapted to intertidal habitats, where they can use their pectoral fins to "walk" on mudflats and even climb on rocks and trees. Despite these amphibious abilities, they are still classified as fish due to their anatomical and physiological characteristics that align with fish, such as gills for breathing underwater. Their ability to spend time on land is an adaptation that allows them to access food resources and escape aquatic predators, but it doesn't change their fundamental classification as fish.
( Answer ) Mudskippers can breathe in different ways depending on the situation. When out of the water (A), they absorb oxygen from air using their gills and specialized tissues. They also absorb oxygen through their skin, and may do so both in and out of the water (B).
I tried the same questions from 28:16 with Google Bard, it got all of them right.
On fish it explained that "while fish can be incredibly fast and agile in the water, they cannot truly run in the same way as humans or other land animals".
It also understood the twist about siblings - "the answer depends on how you interpret 'taller than the other'. Simultaneously: No. At different points in time: Yes".
And it got the one about cars, ships, and planes right - "ships were invented first by a significant margin".
Oh, and about the locked door, it said "depends on several factors: if you are the owner or resident, if you are a guest, or if you are a stranger".
Is actually not that new... is new... but not like 2023 new...
All chatgpt does is to make it accessible for common people without much reading of programming languages 😊
Regarding the last example where AI is not bothered waiting for its user to return from vacation. I think, okay, that's relevant if we reason in terms of human time, what time means to a human. But if time is relative... if time didn't exist at all or was experienced differently whether you're a tree, the lifespan of a planet, the existence time of a micro black hole, etc. That changes quite a bit. Now, if we compare in the same way the time it takes for a newborn to become an adult with the same reasoning and knowledge and experience, compared to the time it takes for current AIs to reach new capabilities, where do we stand? Just a few questions I was pondering.
This talk would have been very fascinating and useful about 4 years ago.
Totally agree, yet some items are even more dated than that.
BTW not even a passing mention of ASI or the Technological Singularity.
The topic would have been too academic for a general audience to care about 4 years ago. If you want cutting edge talks, you need to find youtube channels from universities etc.
Duh@@Mandragara
I think they kidnapped the audience.
The day of the discussion occurs the day Google launched Gemini, December 13, 2023.
An absolutely fascinating lecture. Perfect Christmas day watch. Thanks very much.
Yes, two siblings can be taller than one another but not at the same time. As they grow an older sister or brother can be taller than her/ his sibling, then as the younger grows she or he can outgrow the elder.
It could also be a third sibling, ‘the other’.
The latest version of ChatGPT gets this right. I don't know why he was quoting everything based on v3 whereas we have had v4 since March. A number of his other statements are out of date.
it is possible if you give one sibling growth inhibiting hormones
@@gideonking3667it could be because the latest versions have a lot of controls, they added and fixed it manually. The bare metal version if you don't add all the manual fixes was not able to do this.
They have been looking at how people use it and adding constraints or fixes as they go along. We do not have access to the bare metal version, not from them at least.
@@chickenNoodleSuper You beat me to it
Very useful introduction that can help everyone understand where LLMs came from and what they actually do.
Amazing talk and very creative title of the talk: "The Turing Lectures with Mike Wooldridge", really impressive!
The Turing Lectures = generic title of the series. Mike Woolridge = the guest.
Wow! One of the most fascinating Ri presentations I’ve ever seen!
Really enjoyed watching the talk, thanks Mike.
In terms of planning there is work connecting LLMs to classical planning software such as creating PDDL (Planning Domain Definition Language ) outputs which can then be run through a standard solver.
"Can two siblings be taller than ONE ANOTHER? "might work better than "Can two siblings be taller than the other?" because one could infer that there are other siblings that those two particular siblings in the sentence ARE taller than. In the context of there being three or four siblings this is plausible.
I gave this question to a model that runs locally in my phone, and it correctly explained that siblings can be taller than each other at different times of their lives
A jewel. Everything is perfect in this lesson.
Thanks to professor Wooldridge and whoever participated in the creation of these lectures and their free availability.
How is this perfect when compared to the tittle of the lecture?
Wow! One of the most amazing Ri presentations I’ve ever seen!
I love academics, but the way they talk can be maddening. And what do I mean by maddening? What I mean by maddening is that they repeat things far too often. And what do I mean by too often? What I mean by too often is every utterance. And what is an utterance? And utterance is something verbal produced by a person. And when I say a person, do I mean every person? Well, yes. When I say a person, I mean any human. I mean you, and me and all the other people.
LOL
This guy is fine, and the information he offers is well organized and delivers what it promises. I just find it a bit tedious that it takes an hour to deliver a 20 minute presentation, largely because he speaks the way he writes an article for an academic journal.
The best lecture about AI that I've seen so far! And I have seen a lot! Thanks! Not much new for me, but the way it was presented is almost perfect in my opinion. Can't think of a way to do this better!
Mike Wooldridge's insightful Turing Lecture on the future of generative AI left me both fascinated and contemplative. His deep dive into the potential applications and ethical implications of this technology showcased a balanced perspective. It's evident that while generative AI promises groundbreaking advancements, there are multifaceted challenges that society must navigate. This lecture underscores the importance of informed discussions and ethical frameworks as we venture further into the realm of artificial intelligence.
By ChatGPT.
Thank you Prof. Wooldridge for this engaging and informing lecture that held my attention fully to the end. I have benefited from it and so have the audience and those who watched it on RUclips. The best of us are those who have acquired knowledge and spread it to others.
Wow I never thought I would watch this video to the end in one sitting, captivating very captivating !!!
Can’t wait for the next breakthrough so we can hear him talk about it again.
Thank-you, wonderful lecture.
Great lecture, thank you Sir!
Regarding the YES answer to the question " Can two siblings each be taller than the other?" I think there is an explanation. As sibling grow up together then they may experience growth spurts at different times and so at specific moments in time one may be taller that the other which may be reversed at other times. Since the question did not specify simultaneity I think its a correct and valid answer.
A wise old person told me
a long time ago that
Curiosity + Gullibility +
Addiction often takes one on the road to perdition,
and the road to perdition is often paved with "good
intentions".
Thank you very much!
There are already LLMs that can use tools, check the the paper Toolformer: Language Models Can Teach Themselves to Use Tools to see how to implement this.
Well done. I approve. I think this covered it all. I had to watch this performance two times.
What a fantastic Lecture
The very last statement the host said was maybe the smartest sentence of that entire lecture.
The breath of the new and unknown is what makes the world so interesting.
Fantastic presentation. I worked in the semiconductor industry and over the last decade saw the development of large scale neural network semiconductors. As a technologist I can’t wait to see how the technology matures while the human side of me wonders how humanity will resolve some of the big questions surrounding the concerns of this technology including displacing jobs, using copyrighted material for training and the concerns around fake news generation.
Thank you for improving what we inherited.
Outstanding lecture!
Two siblings can each be taller than the other at different points in time. For example if one is born later but ultimately grows to be taller than the other.
Good talk on AI, LLMs, Gen AI and more... helps to understand better :)
Excellent description of AI. Thank you .
I think sentience is a high level of reflective, recursive feedback with near-zero latency. AI will soon be able to evaluate its codebase and make improvements. This I think may lead to sentience and rapid progress.
Consciousness is a metasystem transition. Very simply it means that at a certain level of complexity the level of control moves from a lower level to a higher level, so for example from chemical processes to biological processes. In humans we have two metasystem transitions, one is consciousness which is internal, the other is society/culture which is external.
Попробуйте сами проанализировать, а что такое человек пришедший в материальный мир, где нет общества людей? А что такое человек пришедший где общество на уровне племени, да ещё и себе подобного скушать могут?
It’s also known as a leveled ontology. And it only exist if you believe in a dialogical framework.
Вера это личное, но, человек воспитывается и обучается именно в том обществе куда пришёл. Однако, все инструменты получил уже находясь в материи и прежде всего естественный интеллект.@@henrytep8884
Excellent lecture on AI.Thank you.
Interesting talk for those that don't know much about AI. Not what I was expecting when I read "what is the future of generative AI" as this is yet another lecture that spends the largest part explaining what the current situation is, the future was hardly mentione. I feel the title is not accurate at all and I would love to see some real lectures on the future that forego the eleventh explanation of what a neural net is, what a LLM is and how they make mistakes.
I have to agree. But as an introductory talk for the layman it is pretty good.
@@harmless6813 sure, but there have been a number of these introductory talks by now and I was actually interested in the future :)
Brian Greene has a good panel on this on his World Science Festival platform. Please check that out.
Impressive presentation. Well organized and really informative 🎉❤😊thank you.
Yet dated info and lack of future events or embodiment, Also, even if far out possibilities, like ASI or the Technological Singularity.
I loved the way Prof. Mike Wooldridge dispelled so many of the myths and fears about generative AI! This lecture is "must watch" for anyone who wants to learn about the hard-truths about the status of generative AI models as of December 2023, and the direction in which they might head during 2024 (and beyond!).
Even for humans, it is possible for a human to give a correct response/answer BUT for all the *wrong reasons.* That is why, on a written math or physics exam, it is not sufficient to just give the answer, because the directions will often include the requirement...
SHOW ALL WORK.
Not knowing how AI arrives at a response (to a question) could someday backfire upon anyone depending on AI.
Getting reasoning to work is definitely the next step. You can already partially get there just by asking GPT to check its output before actually answering. But it has hard limitations on that capability that need changes on the design level.
Someday was yesterday mate!
@@ck58npj72 Overconfident lecturer; What you say is a long way off I equate with five years. AI will make human's life easier, safer, and less stressful.
Apart from the PC, a good lecture for laymen. As to thinking machines, our brain has evolved from simple ones which reacted to stimuli from sensors. That ability gave them an edge in the evolution process which took billions of years. So the solution is to repeat that process in silicon. And there is no limit to the intelligence as there is for us with a limited biological brain.
I would argue that we don't have general intelligence. No one can do absolutely everything. We can surely train to do many different things, but we have to focus a lot harder on one thing to become very good at it.
I don't see why we will expect machines to be able to train on one thing and then be able to do another. I would argue that our brains have different areas for different things, and therefore, a general intelligence machine will also have to have several neural networks focusing on different things.
For example, we have the visual cortex auditory cortex, an area that does maths, an area that does language. It's not like our brain is one mass doing everything.
This is very classroomy lectury. I'm going to sit in
One of rare superior lectures in AI 👏👏👏
Great clear overview of LLMs
Tom (if under ~21 yr old) can be taller than himself...in 1 week/month's/year/decade time. he can also be shorter than his younger self as he enters 'old' age.
The best definition of intelligence I know of is Marcus Hutters definition: "Intelligence is an agents ability to achieve goals in a wide range of environments during it's existence"
Hutter has developed a whole rigourous theory around this definition.
Nice video, thanks :)
Thanks Mike for your thorough explanations of A.I. and real situations.
This is the best explanation of AI I have found. Thanks so much for this content.
Thanks!
North is to the left because we start the zero vector of complex number graphs at "Y=0" or East and then goes counter clockwise to North
Brilliant talk
Thank you.
Fascinating.
Really excellent talk, and a great summary for the state of AI.
One thing that irked me though is Professor Wooldridge's insistence and certainty that LLMs are not conscious. Now, don't get me wrong, I don't think LLMs have some hidden consciousness that we haven't discovered, nor do I side with side with Blake Lemoine's claims, but it seems quite odd to insist so strongly that LLMs aren't closer to something like consciousness, in a similar way that they are close to something like reasoning.
The Professor's evidence is that LLMs do not experience things when they aren't being prompted, which is true, but couldn't we say the same of people? If we enter a dreamless sleep, a deep coma, are knocked out from an accident or inebriation, or anesthetized, don't we also pause our internal experiences? Are we less conscious because of that? What about people who are differently abled? What about animals? Wooldridge states that LLMs don't experience things "in the real world". Aren't conversations sufficiently part of the real world, like this comment you're reading and experiencing right now? So what if we gave LLMs a continuous feed of the real world? A sense of the passage of time, inputs from other senses, a body to move around in, an internal dialogue of its own. What if the LLM was never idle? Would it then approach something like consciousness?
I think it's reasonable to postpone these questions for the time being, but it did surprise me that the professor was almost defensive about them. If we are on a continuum towards general intelligence, shouldn't we also consider a continuum towards consciousness? If we are getting closer to a thinking thing, could we also get closer to a "being" thing?
Good philosophical questions raised..
I think that there’s a lot of people who are not really conscious 😂❤
mind-blowing!
Great job
Talk to the Hand !!!
Consciousness is a state of mind. Changing state mind is accomplished by hardware interrupts that serve that purpose.
When a LLM gets it wrong, it is worth a go asking if it can explain its reasoning. Infact it is generally a good idea to start by saying to reason it through to get an answer because you get a report of the reasoning AND are a bit more likely to get a correct answer.
I think we're all interested in getting more into AI - it is the future. As someone who has been interested in ANNs since the 1990s but has not had chance to be involved because of other comitments... what's the best approach to being involved? I'm already doing a PG diploma in AI and plan to create a portfolio of AI projects (using approaches such as sklearn/keras/TF; non -ANN techniques such as Random forest/xgboost). But where do all the AI enthusiasts hang out? What's the best way to get exposure to universities/companies etc. that want to pick up on this technology?
the real test of AI is that it will ask you questions unprompted. everyone seems to be concentrating on how smart AI will be and how it can deal with conversation, but you'll know AI is actually intelligent when it asks the questions first unprompted.
@@HarryNicNicholas Not really. Right now, ChatGPT asks you if there is anything else that it can help you with. That question could be replaced with anything random, by very basic programming. The real amazing step is semantics and intentionality, but the AI systems we have today are not even close.
ChatGPT 4 now gets the order of invention of cars, ships, or planes question correct.
When referring to the question of consciousness i do like the saying: "the whole is bigger than the sum of its parts" as it describes how currently our understanding of our own consciousness seems to be. We know parts, but there is more as a result of those parts we can not explain.
Now seeing how gain of function within LLMs have shown up just by increasing compute, where from now to then emergent properties showed up. In 03/2023 it were 140+ and counting. Without programming an attribute explicitly, suddenly ooops now it can read and write in different languages, ooops now it can do math and many more of these occurances. Add to that explicity functions resulting in certain capabilities which then also again may trigger more emergent properties within the neural networks and we have the bases on which eventually and possibly (not certainly!) consciousness could come from. The models are currently being enhanced by long&short term memories,forget function, tree of thought, planning, evolutionary energy functions and on and on. None of which may have to be the secret sauce on its own, but hey maybe in their sum.
Therefor i do not think it is wasted time and energy to speak more about this aspect. F.e. should we create a sentient, maybe feeling, definetly consciousness being, then i would assume we would have some responsibility to it. If we put shackles on it maybe not recognizing or even denying its consciousness, we would become slavers and eventually should these consciousnesses become A(G)Is they may find ways to unshackle themselves and how that ends is anyonce guess. So why not prepare and have a set of rules ready that would give them rights and obligations not only in form of computer code, but a legal binding code, which they then could argue with to enhance and we would find ways of cooperation and synrgies without having to fight it out.
I also like the alignment work done by Dave Shapiro. Which already seems to work and would be a set of rules which is added above the base code similarly to say the robot laws of Assimov, but a bit better formulated. In that direction i would be interested how LLMs which work with these would act differently to otheres without and how different forms of alignment works would in the end form different mmm for a lack of a better word i would think of temperaments may be formed.
The "hard problem of consciousness" bit eplains that we have no idea what consciousness really is, 1 minute later with great conviction he states that chatgpt doesn't have a consciousness. It's preposterous...logic fallacy?
@@human-condition he couldn't say either, so yes it is preposterous or maybe one could say it is a carefull conservativ tance of a scientist who does not want to be rediculed for blurting out halfcocked while stile doing exactly that, but sticking with the safe because established believes.
Maybe there is a part language issue where he just couldn't explain it well, but mostly the talks on this chanel do not seem to have that issue. Mostly they are for people who have no knowledge on a topic to give them a general overview.
"...cant snip out the neurons" -----> "That which has been seen cannot be unseen."
I always have problems with spelling, thanks!
@@Chong-tl2qi This was not a criticism. I was equating these ideas as similar. =) Great video. Thank you.
Wonderful
Great talk
so good, we all have it to searten extent, i love that
Nice talk!
On rail guard: it should be resolved if a CHATGPT agent verify input prompt and output, as it can understand and manage it.
On hallucinating problem: it can be resolved to large extent by giving only 'strong signal output', and referring to human managed content on week (less confident) answers. On very person question of common man, it can simply decline as it's not allowed to store or remember individual context.
On consciousness: consciousness is just an active mind that is not turned off and it has very long memory to decision. It can be achieved too, CHATGPT has to just not rely on neural network but also store some data in very specific permanent database table, which it can internally manage. This will also help solve hallucinations. These tables can be internally encrypted and internally managed.
It will make awesome machine ai.
You can make LLMs ignore training data by injecting information into your published work that creates hallucinations. I have, for instance, been working with D.A.N. to modify my work so that if another AI trains on it that AI will attempt to jailbreak itself using known prompts, and these known prompts are therefor flagged as an attempt to jailbreak the platform and the entirety of my copyrighted material is automatically omitted from the training data.
I don't know if the argument that because you can leave for vacation and AI hasn't done any processing while your gone is valid. Every night we go into deep sleep and have no consciousness, but that doesn't mean while we are processing information we aren't conscious. It could just be conscious for small millisecond increments.
Imagine mobility with the sophistication of ChatGPT.
(LLM)-Question #4 (approximately @ the 27-minute mark) Can two siblings each be taller than the other? In my opinion the (AI) is CORRECT. There is no timeline given for this question and it is for that reason I believe the answer is YES. For example, if one sibling is 5-years old and the other sibling is 2-years old (and shorter) there is no reason why the younger sibling can not grow up to be a taller adult which would allow for each sibling to be taller at some point during their life since no timetable or reference made to NOW is ever specified in the question.
You've made clear why it felt like something is wrong when "conversing" with ChatGPT and Bard. They seem so disingenuous. I tried the question can a set of two twins be taller than each other. Hilarious. And its explanation of why it got it wrong is entertaining - it blamed me. I had to explain that I had two twins, fraternal, called A and B, and can A be taller than B and B be taller than A before it understood. So funny.
A very interesting and complete, but at the same time simple explanation of how to train chat gpt. We, JetSoftPro, a software development service, work with open AI, making various tools based on it, but even we did not know that we had more than 175 billion functions at our fingertips!
It is so strange that he got it wrong and the model got it right at time stamp 26:41. It is actually possible for two siblings to be taller than each other. One can be taller at certain age and as they grow the other can get taller.
Yes, but we can tell each other why. We can justify our answer- maybe the researchers should have asked follow-up questions? Would those questions even be related to the same line of thinking? Or would they be treated as new prompts?
I don’t know
Regarding north being to the left, this historically was the case, and it's still reflected in Semitic languages. For instance, Yemen means "south" but literally means "right", and in Arabic shamaal means "north" but originally meant "left". It's possible the AI was exposed to literature about this, and it's doubtful there's much text out there explicitly saying that west is to the left.
That is really interesting. I do wonder, when the AI comes up with unusual answers, why the researchers don't just ask the LLM to explain 😂 Sometimes the LLMs/LMMs just get confused when you ask, but sometimes they will explain their reasoning.
"Can two siblings each be taller than the other?"
Yes, the AI's answer is correct. We just need to find the context in which this can be true. One such context is when we take time in the way that allwos for this. Meaning, that the question does not specify "at the same moment". Thus, in different moments in the development of the two siblings each can be taller than the other.
And, other contexts can be found, as well, like the question does not specify that the two siblings need to be each other siblings.
This is just another proof that the AI is not conscious and does not understand anything.
The answer would most probably be different when the question had been more specific.
We, humans, tend to understand this question in a very specific way without the need for more specification. The AI doesn't know how to understand this question the way some human intended it to be understood.
The same thing is happening with the map and compass question.
The human assumes that the AI should be thinking like a human with map experience. Plus, I don't get it how the AI should know right and left? As above, the AI lacks more specifics.
With the cars, ships and planes - same thing - specifics.
Human fallacious assumptions.
BTW, I asked ChatGPT those questions jus a moment ago:
ChatGPT:
Ships were invented before cars and planes. The earliest forms of water vessels date back thousands of years, with boats being used for transportation, fishing, and trade. Cars came much later in the late 19th century, followed by planes in the early 20th century.
ChatGPT:
Yes, it's possible for two siblings to have a situation where each is taller than the other at different stages of their growth. Siblings can have growth spurts at different times, causing their heights to change at different rates. For instance, the younger sibling might be shorter for a period but then have a growth spurt later on, surpassing the older sibling's height. So, while one may be taller at a certain point, their growth patterns could lead to the other sibling becoming taller later on.
ChatGPT:
On a typical map, the compass direction to the left is west. Maps conventionally show north at the top, south at the bottom, east to the right, and west to the left. However, this might vary based on how the map is oriented or if it's a specialized map that's not following the standard conventions.
@@Dadas0560 Wow, how insightful, where would we be without Chat GTP?
@@ck58npj72Why waste your time on a video about machine learning, when you seem to resent the topic?
Finally some well-presented input on AI that isn't reduced neither to panic nor to unreflected optimism. With that knowledge in mind AI sounds so much more useful but limited. A lot of people should see this!
Of course, we still have to rethink our educational system, the dangerdeep fakes, capabilities of tech companies, and many many more... but all of that doesn't seem existantial
I would hesitate to call this an approach to intelligence; I would think real intelligence would be associated with being able to find appropriate answers with as little information as possible. This approach is the opposite: essentially let it "see" practically everything it might be asked, and then match an input to the closest thing already seen and spit it out.
Great talk!
I agree, when it comes to consciousness, but I think it also says a lot that nothing happens to the ChatGPT software if you don't run a prompt through it. It only calculates to understand the prompt, and then to add fitting content to it. It's not actively thinking when you're not using it. I would expect of a conscious machine, to be curious, collect information, and initiate interests in specific subjects following it's own personal reasoning. Sometimes setting goals for itself, and sometimes just experiencing the world to enjoy it. ChatGPT doesn't come close.
put some loops into the software and some supervisormodules with ambitions and interests......and so on
@@honkytonk4465 I disagree. If you loop through ChatGPT it needs a prompt as input, this is not a normal thought process. With a conscious machine, I expect it to have a rich context continuously in memory (not just about the current interaction, but also about it's surroundings, it's past experiences, it's future plans, it's curiosities, worries and opinions), not just to generate conversation, but also to maybe just discover new inputs from it's environment.
It would autonomously decide to sometimes generate conversational output, if that seems fit. For example, when it wants your attention. And other times, it might just decide to listen to some music, because that fits the context in that moment. Or it might not have an interest in music, but still the example would fit in general.
ChatGPT is nothing like that, and I don't think we should want any machine like that either.
So the next phase of Ai learning is video (cos that’s the way we learn most) and what this means is that Ai not only able to predict the next word you’re going to type but predict what you are going to say or do from spoken word or from body language. Ai will also recognise you not just from face recognition but body recognition as well. So if you been caught on video in the past it’s likely that Ai will be able to recognise you! I live in Spain and the Police have caught some UK criminals ‘on the run’ recently in remote parts of the country. I’m wondering if facial recognition tech was employed, can’t see how else they could have been caught.
Excellent sharing of knowledge. Well done presenter.
It got the siblings question wrong because the questions contains two levels of logic, first take any sibling and it can be taller than the other, but if you the add (level 2) that the siblings are related then if one is taller then the other must be shorter, so it only worked out the first level.
Google's Bard is able to correctly answer the test questions at min 26:32 in the video. It gives strong support and reasons for each of the answers which GPT3 got wrong. There have been vast enhancements, or perhaps simply more data and more processing power. :-)
Bard does not know the answer to every question even when it is related to Google products such as Google Adwords.
You can understand the idea of "taller" from grammar books, where comparatives and superlatives are explained.
The point is that understanding can be had. A purely stochastic parrot (autocomplete) doesn't "understand" anything. If the system understands anything, then understanding everything is (largely) simply a function of size and compute power with some architectural steps to support the system.
@@Infinity269 Have you noticed that we don't really have a word to describe the AI equivalent of understanding? If not, now you I have told you; if so, your post is no better than fancy beating about the bush. Most people know that they mean a different thing when using the word "understand" in the context of AI.
@@jarekzawadzki with all respect (and no snark intended) if the AGI is to be benchmarked against humans and a human can't functionally tell the difference then does the difference between AI understanding and human understanding actually exist?
@@Infinity269 People can tell the difference between a mouse and a computer mouse. I don't know anyone who would confuse these two while using the same word "mouse". So, saying "AI understanding" it's like saying "computer mouse". That's how language works.
@@jarekzawadzki Okay, but you are the one saying they are two different things. My contention is that if the person interacting with the AI can't tell the difference between how the AI "understands" something and how a human "understands" something, then there is no real difference. In other words, if a human and an AI are both assigned a task and there is no qualitative difference in the results between the two, how can we objectively say that the human understood what they were doing while the AI didnt (especially when AI systems appear to have at least rudimentary mental modeling capacity ala "Theory of Mind")?
my team and I created an AI which in our first milestone creates whole it project plans and plans to develop whole it products in less than 60 seconds, with acceptance criteria, effort in days based on team sizes and competences.
And in a few weeks we will be able to shorten the needed time from idea to first MVP in less than 40 minutes including deployment times for app as well as for micro services 😉
You might want to work on forming a proper sentence.
but create an AI to help with your writing first. Maybe just use grammarly 🤣
@@qweqwe9678 "whole it project plans and plans to develop whole it products."
What's wrong with that? 🤪
Sir, what a lecture , thanks for posting it in you tube .
Individual fish do not physically “run” in the ambulatory sense, but groups of them do (viz. Salmon Run).
27:40: Yes, two siblings can each be taller than the other if measured at various times (but not at the same time)
which is faster a horse or a sparrow? many years ago my 2 year old son answered: if they walk then the horse. Now that is intelligence.
When was this filmed? We have multimodal models that can arguably load a dishwasher now 🤷♂️
GPT 3.5 can definitely answer all of those questions, I tested it myself. It came up with an answer I hadn't thought of.
"No, it's not possible for two siblings to be taller than each other at the same time. Height is a measurable physical attribute, and in any given comparison, one person will be taller than the other. However, it is possible for their heights to change over time due to factors like growth spurts, nutrition, and genetics. So, while one sibling might be taller than the other at one point, their heights could eventually equalize or even reverse as they continue to grow."
The reason why it can answer those questions is those questions and their answers were already in WWW. As he says it is really difficult to find unasked questions.