Topics Covered: 00:00 - The cost of compute 02:30 - Is this sustainable? 03:46 - The cost to train a model 05:58 - Computation requirements 09:58 - The relationship between compute, capital, and technology 13:31 - GPT4 commenting on the technology with help from ElevenLabs
Don't forget to catch Part 1 and 2 of the mini-series. Part 1: ruclips.net/video/-s_Ui5j0Guw/видео.html Part 2: ruclips.net/video/IPre5287P3I/видео.html
Hmm. I was actually expecting to hear an actual figure (not just an approximation or estimate), of exactly how much it cost the frontier models to be trained. Still, this episode was basically useful.
No doubt GPU suppliers like NVIDIA are like the suppliers of picks and shovels during the 1849 gold rush. Exciting to see what everyone's building, and to drive through Santa Clara and Sunnyvale and San Jose and see so much silicon still happening in Silicon Valley.
price of power is a real competitive factor, all the lessons from crypto mining apply to the true cost of compute. Also security as people want to steal $10,000,000 files that are less than 1TB
Topics Covered:
00:00 - The cost of compute
02:30 - Is this sustainable?
03:46 - The cost to train a model
05:58 - Computation requirements
09:58 - The relationship between compute, capital, and technology
13:31 - GPT4 commenting on the technology with help from ElevenLabs
Don't forget to catch Part 1 and 2 of the mini-series.
Part 1: ruclips.net/video/-s_Ui5j0Guw/видео.html
Part 2: ruclips.net/video/IPre5287P3I/видео.html
This was really good :-)
Thanks a lot for uploading this series!!
Good 3 episode series👏. Would be also interesting to hear your take on the different Platform services around AI centric workloads
Great topic! Incredible to see the comparation with adoption of a tech and the demand of compute
Illuminating! I wonder whether or not Moore's Law applies with respect to compute thrown at frontier models moving forward.
2:04 probably the first legit “this is not financial advice” claim I’ve ever seen
Awesome stuff!
Very informative!
Really insightful thoughts on Ai
Back to School Giveaway
Further reinforcement that at its core, this is a hardware revolution
Interesting topic. It makes me reflect on if we really need this huge amount of cputing works…
Hmm. I was actually expecting to hear an actual figure (not just an approximation or estimate), of exactly how much it cost the frontier models to be trained. Still, this episode was basically useful.
another banger about the chip ecosystem!
No doubt GPU suppliers like NVIDIA are like the suppliers of picks and shovels during the 1849 gold rush. Exciting to see what everyone's building, and to drive through Santa Clara and Sunnyvale and San Jose and see so much silicon still happening in Silicon Valley.
super fantastic content
I like how they “fact checked” the epilogue, yet the graphics (1,000,000,000 chars) doesn’t match up with the audio math (100,000,000,000 chars). 😅
price of power is a real competitive factor, all the lessons from crypto mining apply to the true cost of compute. Also security as people want to steal $10,000,000 files that are less than 1TB