Topics Covered: 00:00 - Supply and demand 03:03 - Competition for AI hardware 04:46 - Who gets access to the supply available 06:28 - How to select which hardware to use 08:59 - Cloud versus bringing infrastructure in house 13:26- What role does open source play? 16:48 - Cheaper and decentralized compute 20:16- Rebuilding the stack 21:31- Upcoming episodes on cost of compute
Good job so far on this series. Really looking for the next episode that explores the actual cost. Will likely help many founders’ with their ‘ask’ slides. Might not help since complex inferencing will be needed for next gen AI platforms.
There is a finite amount of fab house capacity, gets eaten up by big companies like Apple, etc. Can’t bring new fabs online quickly, etc. Haven’t seen any projections on how this might slow AI rollouts and work its way back to throttling the growth (and share prices) of companies like Nvidia. Next, this opens the door to competitors, gives them more time to catch up, etc.
Topics Covered:
00:00 - Supply and demand
03:03 - Competition for AI hardware
04:46 - Who gets access to the supply available
06:28 - How to select which hardware to use
08:59 - Cloud versus bringing infrastructure in house
13:26- What role does open source play?
16:48 - Cheaper and decentralized compute
20:16- Rebuilding the stack
21:31- Upcoming episodes on cost of compute
20:40 it's crazy that it's kinda what Alan Turing said in "computer machinery and intelligence". What a boss
music in the background is silly because people watch these at 2x speed and it sounds terrible and distracting 😄
Agreed. We come to listen to the speakers. Why this crappy psytrance behind?
its actually AI generated
@@fintech1378 It's still annoying.
Good job so far on this series. Really looking for the next episode that explores the actual cost. Will likely help many founders’ with their ‘ask’ slides. Might not help since complex inferencing will be needed for next gen AI platforms.
This is amazingly informative. Thanks for giving Guido this platform to share his experience!
17:12 well, this is the measure how quickly things are evolving, now we have Falcon 180B
Thanks Steph, this is really next level content!
Great job explains the situation with GPUs
amazing content! it is a fun race to watch and see how the supply chain evolves
@a16z - when is part 3 being released?
This week!
@@a16z⏳
Interesting
There is a finite amount of fab house capacity, gets eaten up by big companies like Apple, etc. Can’t bring new fabs online quickly, etc. Haven’t seen any projections on how this might slow AI rollouts and work its way back to throttling the growth (and share prices) of companies like Nvidia. Next, this opens the door to competitors, gives them more time to catch up, etc.
Catch Part 1 of the mini-series here: ruclips.net/video/-s_Ui5j0Guw/видео.html
Semis really seem like new oil, they are crucial for anything related to new technologies.
Oh noise! 😮
How about the race for DPUs and QPUs ...GPUs are getting old man.... ever since last year and the Ethereum Switch over to Proof of Steak
Tone down the absurdly annoying music.
fantastic podcast