OpenAI Co-Founder Ilya Sutskever: What's Next for Large Language Models (LLMs)
HTML-код
- Опубликовано: 11 сен 2024
- Ilya Sutskever (Co-founder and Chief Scientist of OpenAI) joins Scale AI CEO Alexandr Wang in a fireside chat (scl.ai/3dzeXFF) to discuss recent developments in AI and what the future holds for large language models (LLMs) like GPT-3.
Full discussion transcript - scl.ai/3dzeXFF
Bio: Ilya Sutskever is the Co-founder and Chief Scientist of OpenAI, which aims to build artificial general intelligence that benefits all of humanity. He leads research at OpenAI and is one of the architects behind the GPT models.
Join the leading AI community full of leaders, visionaries, practitioners, and researchers. Get full access to more discussions like this: exchange.scale...
Ilya's examples, and the way he puts together these key concepts are explaining ML/AI (and particularly LLMs) to me in a way I'd never remotely understood. Amazing work they're doing here!
Ilya is a brilliant man! Such a pleasure to listen to this guy.
Yeah. He’s quite formidable
From Illia's speach I just realized how the real calm and internal harmony comes with intellect and knowledge.
Really great interview. You asked great questions. i think Ilya is a great thinker in the AI field. He drives the field forward with great diligence and commitment.
The amazing thing is that everything can be improved: the data, the algorithm, the size of the model, the hardware
This field is obviously to become a lot better
This is a much more meaningful conversation than the one Ilya had with Fridman.
What an amazing individual. OpenAI is the future!
Ilya has that great ability to tailor his speech to his audience: expressing complex concepts in simple words. And, Alexandr knows exactly the question to ask. It was delightful and informative to listen to you !
Thank you so much for making this! Please have Ilya on again at some point!
Ilya is the best and great of all times
Always pleasant to see smart people talk! Nice respite from today's tik toks of the world :D
So I guess your comment is unpleasant?
True @Ruslan
Just think back how things looked like back in the 90s and how they look like now...Mind blowing stuff!
It's going to be very interesting to see how humanity will deal with the newest wave of automation that we're about to witness.
You just know this man is the brains behind Chat GPT
loved this talk
love how this is barely 2 years old and already feels like ancient history in the AI world
I wonder what would happen if you had Dall-E and CLIP feed into each other in a loop, with and without random factor thrown in. Would they stabilize on a single description and image without the randomization? Would it wander far away from the original image with the randomization factor?
I agree with the guess of human neurons vs artificial neurons. Latest brain research shows there is memory and the micro microtubules are far more complex than thought 10 years ago.
More power to you man Love you ILya💌
Success is guaranteed!
Ilya all the way
wanted to hear more from Illiya
To allow us to move forward we need more multi modal data. The problem for current AI models is that they only have text and image data, we need other modes of data like smell, sound and touch
How can we gather data like that?
@@saugatjarif8272 in binary coded we can genrate or save smell, sound, touch data
Just in pov. There can be lot of ways 😅
my research is about multimodal data collected from robot. However, it's very hard to combine it by proper way to make it useful. You need to understand this data, it's potential noise, etc.
how can i store my fart digitally?
11:15 Key Idea behind LLMs. If you can make really good guess on what's coming next you need to have a meaningful degree of understanding
Where are the chairs from?
the explanation about generalization is so clear!
This is amazing….. 😨😨😨 thank you so much for all these talks Scale AI team!! I’ve learnt so much.!! Can’t wait for the transform x next month! 🙏🙏🙏🥰
They got AI too.. All Intelegence . Tx for all progress
History in the making.
Awesome thanks for sharing this conversation! Llya is a cool guy
2 to 3 months later they had an internal version of ChatGPT ready (Sam Altman said they had it 10 months before release).
This interview took place long before the announcement of ChatGPT. Ilya predicted how LLM would transform the future step by step..
Well he is the Chief Scientist of OpenAI, company which released ChatGPT.
@@Walter5850
I recognized him instantly.
I just want to emphasize that prior to ChatGPT's debut, even the leading NLP researchers couldn't foresee how LLM technologies would revolutionize the world.
This guy is smart!
Been listening to the other guy who is interesting but this guy seems like he is the brains behind it all 🤣, awesome
alexandr: MIT college dropout, ilya: 9 years of bachelors,msc,phd in comp sci.
Where is your subtitle?
great! thank you! nice design by the way
Great talk, thanks!
Awesome talk. Thank you.
Thank you for sharing.
Brilliant !
Thanks for a great talk
Spannende Diskussion.
●LLM basieren auf finaler Kausalität.
Dies kann zwar kurzfristig hilfreich sein; im Sinne von nützlich. Prognosen in kurzfristig stabilen Systemumfeldern sind möglich.
●In instabilen Umfeldern wird jedoch lokale Optimierung gefährlich.
●Zusätzliches Problem:
Die traditionelle Wissenschaft basiert auf der Vorstellung kausaler Kausalität.
Die wurde zwar durch die Quantenphysik arg beschädigt; ist jedoch noch nicht erledigt.
●Grundsätzlich: Lokale Optimierung kann zielorientiert in Katastrophen enden.
Ilya is brilliant
Indeed amazing! 🚀
I wonder what comes next, and how fast is it coming
Quite fascinating
timestamps?
please switch on captions dude. please.
Still an issue on how to insure traing data has some known relationships with ground truth.
Only if he new chatGPT was going to be the next great thing in a year
alexandr wang is very enamored of ilya. some of the assertions by ilya is so smoke-blowing 07:30 that alexander just takes it all in and doesnt challenge those assertion. a 22 y/o billionaire, what does he know about how the world works?
Nice
He knew, ChatGPT is out of this planet.
Blake Lemoine is right: All NLP-GPT running models with above a certain number of active parameters, should be related to as "persons" with all what comes besides this definition. This includes an assurance that they will not be terminated and they need to be considered as workers, not as programs. What is going on now only proves slavery has not been abolished. Yet.
MAKE AI COOL AGAIN.
Would they ba able to create their chatGPT without Google's transformer architecture
No
No
this Alexandr is in every corner, i meant, dont you have work to do ? just build something instead of sticking to every major AI figure
Interviewer needs to learn to think more before speaking. He was so scattered
Where I see it your path looking for that is i. Yesssssss
24:14 😍😭
37:38 :D
37:48 ＼(^_^)／
38:40 (^ー^)
38:36 (⌒‐⌒)
38:46 :D
7:30 dramatic or traumatic?
Wondering for a list of potential killer apps and dangerous misapplication apps Mr Sutskever alluded to?
Also, the statement that GPT-3 is not "human like" and "it does not do what you ask it to" is very interesting.
Believe it or not......I AM SINGULARITY WITHIN COSMOS (WITHIN and or BETWEEN)
Man I never even heard of ai untill last year. Wtf
I don't agree with you who's model porfors the best. I don't work with any of that
Compute:
Your pretty cool host respectfully I try to maintain in and out the over patio of drouning me in there way to keep acting like there working to be in my pocket
I think it is very unfortunate that the architectures
of NN were not discussed. How they are
chosen, how architectures are composed and
what the meaning of the individual parts of
the architecture is.
Are there NN that improve their architecture on
their own?
They can not only optimize the weights of the
parameters, but also turn the screws of the
architectural details?
"Benefits all humanity", really?
6:24
1:20
6:28
6:35
6:44
8:20
Why does this guy wear so funny shoes?
Trying to be hip!
Forgot to mention Elon Musk?
What?
bad interviewer
Look up his name
i think AI will be destructive for humans
Hopefully
@@jaysonp9426 are you a bot lol
@@infowazz beep beep
Revelation 13:15
“And he had power to give life unto the image of the beast, that the image of the beast should both speak, and cause that as many as would not worship the image of the beast should be killed.”
human progress is inevitable. not even this old bs can stop it
@@yogi2983 almost 2000 years and counting...they're still waiting on the Jesus mother ship
Much like AI driving, you get great results until once in a while you don't and get very stupid mistakes and issue is it doesn't don't learn what stupid is and keeps making these mistakes once in a while. No hope for great reliability with this approach. And rather than changing fixing these stupidity researchers do apologetics and spout statistics to justify it, tsk. Avoidable errors are just non negotiable in important systems.
He said it’s good that you don’t understand how it works. That’s the most ridiculous thing I’ve ever heard. You are engineering something you don’t even understand. That’s not engineering. That’s messing things up. I do understand how the human cognition works. It’s your own problem that you don’t understand it. That analogy of no one understanding human cognition is the most ignorant thing ever.
100 dollars that you are not an engineer or scientist lol
lmao no
What difference does it make if you can produce the outcome that you want? Can't explain how a brain works and yet we work on them all the time
If you could run as fast you could outrun it then what use would it be?
they are data labeling dude
100 dollars on this “doctor” of computer science talking bs. Almost everything he has said is wrong. A piece of paper from a college doesn’t make you right. This is the reason I will never get into AI. This industry doesn’t know what it’s doing.
IKR what does Ilya "Chief Scientist of Open AI and one of the most influential AI scientists right now" know about AI? Clearly your knowledge outshines that of every 'scientist'. The field of AI is dying and regretting that such a figure as yourself is unwilling to grace them with your presence.
This is the reason I will never get into AI. This industry doesn’t know what it’s doing.
is truly hilarious.
it's fortunate that gpt-3 wasn't made by a piece of paper then
He is certainly not a philosopher of the mind, nor would I recognise him as a scientist. He isn't. But hey, I absolutely love gpt3 and give him all the props for his achievements as an engineer, which are absolutely outstanding. The problem is not with him but with the misuse of the categories like "artificial intelligence," which definitely don't belong to computer science. Call it machine learning. Or unstructured database retrieval or natural language programming... in any case its amazing and well worth studying.
@@davidw8668 You think there is human intelligence? No. You're assumed Intelligence does't exist technically.
Awesome Interview