Groq CEO Jonathan Ross - Tech Giants in the Generative AI Age
HTML-код
- Опубликовано: 9 июл 2024
- Jonathan Ross is the founder and CEO of Groq, a company that develops high performance microchips purpose built for AI and machine learning. Prior to founding Groq, Jonathan invented Google’s AI processor, the TPU. #AI #Groq #semiconductors
Looking for more data news? Follow us on Twitter @worldofdaas / worldofdaas 🌐 The trusted news feed on Data-as-a-Service (DaaS) companies and products 🌐
---------------------------------------------------------
00:00 Jonathan Ross - Founder and CEO, Groq
00:57 Transition to generative AI age
12:36 Companies with the biggest advantages in AI age
19:01 NVIDIA
31:29 Apple in the AI race
41:15 Semiconductor supply chains
40:44 Moore’s Law
57:09 Conspiracy theories
58:52 Jonathan Ross’s take for common bad advice
---------------------------------------------------------
Guest Socials:
Twitter: / jonathanross321
LinkedIn: / ross-jonathan
🎧 Listen to World of DaaS:
Spotify: bit.ly/3P6BBHL
Apple Podcasts: apple.co/3sNyjBJ
Buzzsprout: bit.ly/3LkuGJN
Host Auren Hoffman Socials:
Twitter: / auren
Substack: substack.com/@auren
World of DaaS is brought to you by SafeGraph & Flex Capital.
SafeGraph: safegraph.com
Flex Capital: flexcapital.com
Follow World of DaaS @WorldOfDaaS
Editing and post-production work for this episode was provided by The Podcast Consultant (thepodcastconsultant.com) 
Наука
Dude, stop interrupting him all the time.
Agreed 😊
Yeah lol
Host is actually _good_ at interrupting in the sense that he seems to know the best times to kill interesting lines of thought from Groq man
That was a really good episode, thank you for having it and sharing it. Jonathan Ross is really smart.
Glad you enjoyed it! Jonathan is amazing!
Really awesome guest! And while you're getting some warranted criticism on cutting off your guest too frequently, you asked some really excellent questions! But perhaps like Jonathan's point where LLM's, given more compute will produce much more beneficial responses, your questions can similarly benefit 😅. But well done, absolutely subscribed!
Love how he is challenging the concept of data gravity.
Love the energy, but let him finish a thought 😂 but great stuff !!
Thanks for watching!! Please subscribe and share :)
You can't have compute without electricity, energy (oil, nat gas, coal, nuclear, etc). It's unlikely solar, wind and hydro can provide enough power in the short term for all these data centers full of GPUs. There will be huge incentive to make these GPU more energy efficient. And smaller more efficient models. And smaller models which can run on more efficient CPUs and not even need GPU necessarily (and even run locally on your own CPU - see LLama3 8B model for example)
Agree!
100% this, the models will get more efficient, smaller and smarter, by magnitudes, it will be possible to run and train AI multiple times better than ChatGPT on computers at home. We will look back at these massive fan and water cooled GPU's we use at home now as a joke, we still will have those, they will just be that much more powerful and cutting edge.
We will run realtime extremely powerful AI models on computers at home in a year or so. They know that, and that is not their main goal really, the goal is to beat the other guy to super intelligence at all costs NOW. It's not about efficiency, not even about cost, it's just about winning the race, we have never seen anything like this. Lots of $$$ going into tech right now, things are accelerating more than ever on all fronts.
Interviewer keeps interrupting speaker just to ask basic questions or provide already obvious or sometimes flat out wrong examples. Regardless still a great interview.
is this negging?
@@worldofdaas Not negging. It's real feedback. Good interview but would be great if you let this man cook lol. Best interviewers let their guest complete their thoughts without interruption.
@@thriceborn7665 that's fair. always appreciate feedback
@@worldofdaas You got it man. I appreciate the work regardless. Great content here.
Fascinating episode!
Awesome ideas.
Everyboding saying Auren came across odd, I guess he was just trying to clarify things.
Thanks for the nice comment - appreciate it :)
stop interrupting. He was talking, and when he was about finishing to say the most important thing, you interrupt him. It makes the whole interview so annoying...
He tries to come back to what he said to conclude and interrupt him again. Apart from this, great interview..
evga was the company nvidia bankrupted
He should have named it "reality potion" of Generative AI
which research found this claim? "when they paired a human doctor with the AI the uh results were worse than just having the AI give a diagnosis"
I don’t remember, but I did see the actual chart. Look at Google‘s medical LM research: med Gemini, or something like that. I think that that was where it was, although it could’ve been a paper on GPT4 in medicine.
I still disagree with him about jobs. The distinction between coal engines and pace of change as he initially mention of AI adoption is significantly fsster. Slow change is adaptable, fast change requires a long time to balance out frictional employment.
The fact that he was dishonest w the last 2 questions proves he is a person disconnected w reality
Right now Groq's main use case, speed, is being throttled by Groq due to demand... But I suppose if you are just building and testing its okay... still really annoying though.
Groq is trying to sell itself to apple..groq is using Samsung foundry for the next gen chip. Not north American supply anymore
Actually, the Samsung foundry is based in Taylor, Texas, USA.
Great choice of Samsung over TSMC. GL XD
What a terrible host! The host is clearly insecure and tries to prove to the guest he understands what he is being told by giving out unrelated and nonsensical analogies.
Your follow up questions clear show that you are playing out of your league. Please let the guest completely present their idea instead of constantly trying to prove your capabilities!!
worst interviewer ever. just interrupts his guest the entire time. hes as bad as kara swisher