Ep 18: Petaflops to the People - with George Hotz of tinycorp

Поделиться
HTML-код
  • Опубликовано: 11 сен 2024

Комментарии • 123

  • @TheLakeJake3
    @TheLakeJake3 Год назад +81

    George knows how to make me feel like I need to give my life to working on AI

    • @realhet
      @realhet Год назад +5

      That's a closed circuit:
      You make him feel he can give his life working on whatever he wants. :D

    • @androwaydie4081
      @androwaydie4081 Год назад +3

      That's marketing for you.

  • @mrdbourke
    @mrdbourke Год назад +46

    Epic show! I love how direct George’s responses are, almost all from pure experience “I don’t like x because I tried it for 16 hours straight and it didn’t work”

    • @thsstphok7937
      @thsstphok7937 Год назад +1

      Exactly.

    • @akj3344
      @akj3344 Год назад +2

      Hey big man. Love your both courses!

  • @ahpacific
    @ahpacific Год назад +77

    I always learn so much from Hotz. Thanks guys.

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +8

      we did too. super grateful for him taking the time.

  • @bogslurp3532
    @bogslurp3532 Год назад +14

    10 minutes in and I generally have no idea what George is saying but I could listen all day.

  • @MWileY-nj1yb
    @MWileY-nj1yb 6 месяцев назад +1

    I appreciate you guys and your fresh approach to dense subject matter. Always love listening to George.

  • @JohnCooganPlus
    @JohnCooganPlus Год назад +24

    what a great episode! this show is awesome

    • @vladusa
      @vladusa Год назад +2

      Coogan's a Hotz fan?!

  • @SasskiaLudin
    @SasskiaLudin Год назад +11

    This man is such a genius. Pure delight to hear him. Thank you so much for this enlightening video!

    • @DikTrom
      @DikTrom Год назад +1

      you think that is a compliment? It is actually a curse to be a real genius

  • @shridharangp4865
    @shridharangp4865 Год назад +16

    Democratising the big tech for everyone, your efforts are really appreciated 🙏

  • @deersakamoto2167
    @deersakamoto2167 Год назад +5

    25:18 GeoHot's email to AMD's Lisa Su
    I like that email starts with "I started a company" - no "hello", no pleasantries, just straight to the point

  • @LatentSpaceTV
    @LatentSpaceTV  Год назад +14

    Writeup and show notes: www.latent.space/p/geohot

  • @420_gunna
    @420_gunna 9 месяцев назад +1

    I really like the banner that you have across the top of the video that describes the topic -- great idea on that.

  • @GThomas-qq6mp
    @GThomas-qq6mp Год назад +3

    This is actually great to dissect the progress. Along the streams it's harder to understand what George is doing. I've learned a few things from this.

  • @AshutoshSharma-ml6sv
    @AshutoshSharma-ml6sv Год назад +2

    need more podcasts like this which actually talk about tech

  • @JalaleddinElFirqi
    @JalaleddinElFirqi Год назад +4

    thank you for the episode guys, great guest and sharp hosts

  • @jaya8352
    @jaya8352 Год назад +2

    Good stuff, but please boost volume, if obs add filter in mic settings. Bt speaker on Mac volume still don't hear it all

    • @jaya8352
      @jaya8352 Год назад +1

      To clarify, hosts are plenty loud, but Geo is far quieter multiplied by he talks very quickly, he needs more volume, can barely hear him and any ambient noise he's unhearable, I'm missing at least 30% of what he's saying, mentally fatiguing.

    • @jaya8352
      @jaya8352 Год назад +1

      I subscribed and looking forward to more, but please do more thorough sound checks and monitoring the levels.

    • @jaya8352
      @jaya8352 Год назад +1

      Oh now I see he is far back from the mic often, maybe just police that more, I mean the whole point is to share audio, while if the key speaker is talking not into the mic most of the time then well....

  • @larry_the
    @larry_the Год назад +5

    Wonderful episode. Always love hearing more from George.

  • @meteorinc4259
    @meteorinc4259 Год назад +6

    How do they have only 287 subs! Best guest, animations to explain concepts (more of this please), and current topic of discussion on top. Great editing!!
    Thanks Latent Space and keep it up!

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +2

      It's our first day on RUclips! All of our past episodes are here: latent.space/. Glad you enjoyed it!

    • @recursion.
      @recursion. Год назад +1

      @@LatentSpaceTVyo I hope you'll only focus in the tech space unlike lex fridman who interviews anyone with clout.

  • @DD-ws6cu
    @DD-ws6cu Год назад +2

    I have no idea wtf he’s talking about for 90% of this but I still find it fascinating lol

  • @hd-2
    @hd-2 Год назад +1

    Listening to what George wants to do, and then getting a recommendation to watch Tenstorrent discussions from Jim Keller really makes me wonder how the two have not collaborated already.

  • @Nour-le8jn
    @Nour-le8jn Год назад +11

    great episode, very knowledgeable hosts absolutely better than Lex. George never disappoint. keep it up guys

  • @torsteinsrnes4872
    @torsteinsrnes4872 Год назад +4

    The volume is a bit too low and it is too hard to hear what you're saying sometimes. Otherwise great podcast!

  • @HassanElMghari
    @HassanElMghari Год назад +2

    What a great interview! Great job y'all

  • @andrewferguson6901
    @andrewferguson6901 Год назад +1

    Ep 18, your only vid on this channel. Nice

    • @andrewferguson6901
      @andrewferguson6901 Год назад +1

      not to like. be a hater. cause this is legit a great interview

  • @chickenwings273
    @chickenwings273 Год назад +1

    Thank you for making this!

  • @SamirPatnaik
    @SamirPatnaik Год назад +4

    Towards a end of it… George is a god-tier soul. om namo shivay

  • @oryxchannel
    @oryxchannel Год назад +1

    Soooo freakin coool. It's like a Pat Metheny concert. You just pick up on the jazz.

  • @Johnmoe_
    @Johnmoe_ Год назад +1

    Will you guys upload anymore episodes????

  • @d33w
    @d33w Год назад +2

    great episode, seems I found a good podcast in the ML field. Kudos and keep going!

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +1

      Thanks for listening! We have ~17 episodes you can catchup on as well :) latent.space/

  • @jonzo_
    @jonzo_ Год назад +1

    Great talk!

  • @jr8209
    @jr8209 Год назад +3

    audio levels low. You can tell by clicking on other videos and listening to how loud they are compared to this.

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +2

      Thanks for the feedback! We mix these for podcasts separately, we'll amp it up a bit next.

  • @kompila
    @kompila Год назад +2

    I am geohotz best fan from africa.

  • @princemredlana1198
    @princemredlana1198 Год назад +1

    I'm in awe

  • @AnthonyZboralski
    @AnthonyZboralski Год назад +1

    Subscribed! I'm annoyed I only discovered your channel today :)

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +1

      We only created it a couple days ago, but you can find all of our old episodes on latent.space! More to come!

    • @AnthonyZboralski
      @AnthonyZboralski Год назад +1

      @@LatentSpaceTV yeah I noticed and subscribed on Apple Podcast. Keep up the good work

  • @herashak
    @herashak Год назад +1

    Good vid, side note that the audio is quieter than most other youtube videos.

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +2

      Thanks for the feedback! We mix these for podcasts separately, we'll amp it up a bit next.

  • @gauthamsai7506
    @gauthamsai7506 Год назад +1

    Addressing the turing complete issue blew my mind, ml workloads are not trying to find something exact. So hardware need not be tuned to be exact, it could be a finite piece of simple operation which moves over data, and that data movement in itself would give outcome

  • @math3068
    @math3068 Год назад +1

    That's great! you guys should try to bring David Holz from midjourney next

  • @trhashthings8045
    @trhashthings8045 Год назад +2

    ok, min 8 and Hotz started to see the matrix 😂

  • @dwolrdcojp
    @dwolrdcojp Год назад +1

    George is the best

  • @Abhishekkumar-qj6hb
    @Abhishekkumar-qj6hb Год назад +1

    Aren't the compute intensive models also inference intensive models ?

  • @Shan224
    @Shan224 Год назад +1

    Thanks guys. Subbed ❤

  • @RonanMcGovern
    @RonanMcGovern Год назад +1

    Congrats, great content. Wonder what geohot thinks of the llama license being non commercial

  • @Bill-cy2cy
    @Bill-cy2cy Год назад +1

    Yessssss… thank you.

  • @psibarpsi
    @psibarpsi Год назад +1

    Where are the rest of the 17 episodes?

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад

      latent.space/ and on all podcast providers!

  • @noninvasive_rectal_probe8990
    @noninvasive_rectal_probe8990 Год назад +1

    George is the reason I don't kms :3

  • @eirickbuckley9998
    @eirickbuckley9998 Год назад

    jeez. not gonna lie, a bunch of this is wayyyy over my head.

  • @dan2250
    @dan2250 Год назад +1

    George is the programmer’s programmer

  • @nxnu2119
    @nxnu2119 Год назад +2

    Are you guys on nostr ?

  • @abemore
    @abemore Год назад +1

    Can you use AlphaDev to make fast tiny code?

  • @peter.g6
    @peter.g6 Год назад +3

    Why I always feel if I could do 1/10th of what George can do my startup would be worth billions?

  • @johnhammer8668
    @johnhammer8668 Год назад +1

    14:54 whats the differnce ? tensor dot and tensor dot??

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +2

      If you have a tensor in variable `a`, you have to do `Tensor.add(a, x)` instead of `a.add(x)`

  • @markovchainy
    @markovchainy 10 месяцев назад +1

    Great show but you need to process your audio better; remove noise, compress, normalise and high-pass filter to avoid the low thumps

    • @LatentSpaceTV
      @LatentSpaceTV  7 месяцев назад +1

      This was our old studio, we've setup a new one since then!

  • @semtex6412
    @semtex6412 Год назад +1

    great idea bringing in GeoHot! subbing to this channel. hope u bring in more awesome people

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +2

      Thank you, we had a bunch on our podcast already from OpenAI, MosaicML, Databricks, etc but no full videos: latent.space/

  • @s243a
    @s243a 7 месяцев назад +1

    Why not water cooling?

  • @vev
    @vev Год назад +1

    Great

  • @ujjwalshrestha5720
    @ujjwalshrestha5720 Год назад +1

    awesome

  • @j031t8
    @j031t8 Год назад +2

    Incredible.

  • @recursion.
    @recursion. Год назад +1

    Boys unarchive the previous episodes and looking forward to next one.

    • @recursion.
      @recursion. Год назад

      Great job on time stamps btw.😊

    • @recursion.
      @recursion. Год назад +1

      57:26 😂😂😂

    • @recursion.
      @recursion. Год назад +1

      Ai girlfriend is crazy

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад

      You can find the audio + writeup here: www.latent.space/, more to come soon on here!

  • @ScottGrunwald
    @ScottGrunwald Год назад

    I just realized listening to this how much Georgie sounds like Jason Calacanis

  • @stevenbaron358
    @stevenbaron358 Год назад +1

    Here at 1k

  • @vankram1552
    @vankram1552 Год назад +1

    Amazing show

  • @codycarse
    @codycarse Год назад +3

    GeoHOT

  • @lukaspfitscher8737
    @lukaspfitscher8737 Год назад +1

    arent FPGAs clockless?

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +2

      In theory they can be clockless; in practice, no one really builds clockless ones.

  • @losthighway4840
    @losthighway4840 Год назад

    A generalized framework is never going to match a behemoth like PyTorch on Nvidia. Reinventing the wheel here.

  • @Aedonius
    @Aedonius 2 месяца назад

    GPUs are becoming ridiculously cheap in the cloud. A 4 Petaflop H100 is about $3 per hour.
    What benefit does paying $25k for a quarter of that provide?

  • @vev
    @vev Год назад +1

    50 subscriber

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад +1

      new channel! pls like n subscribe haha

  • @edh615
    @edh615 Год назад

    I can't even search the episode

  • @NikhilKumar-fo5on
    @NikhilKumar-fo5on Год назад +1

    volume is pretty low, but good podcast otherwise!

    • @MikeTrieu
      @MikeTrieu Год назад

      Yeah, it was so low that it fell under NewPipe's silence threshold and caused it to basically speedrun through the whole interview, making Hotz's speech barely liminal 😂

  • @YuriAchermann
    @YuriAchermann Год назад

    Maybe for next guests try to expand more the topic they are talking about, instead of just throwing new questions to bring new topic cutting the last one, it's more engaging...

  • @hooxenv9692
    @hooxenv9692 Год назад

    what is this goddess of everything else thing and how did George know what that was?

  • @wolfram77
    @wolfram77 Год назад

    Why are the three of them wearing hedphones?

  • @kenw8875
    @kenw8875 Год назад

    gorge is Silicon Intelligence

  • @vev
    @vev Год назад +1

    😊🙃

  • @flareonspotify
    @flareonspotify Год назад

    Raspberry pie version of apple silicone system on board chips

  • @saint8082
    @saint8082 Год назад

    I can’t hear hotz

  • @larryabecid2819
    @larryabecid2819 Год назад

    What? Is his comment on GPT-4 true?

    • @Yuber898
      @Yuber898 Год назад

      Flip a coin, heads is yes and tails is no

  • @sunny_disposition
    @sunny_disposition 4 месяца назад

    26:35 "iTs NoT OpeN SoUrCE iF yOU duMP the sOurcE OnTo a giThUB rEpo anD thEN fORGet AbOUt iT uNTiL tHE nExT reEleSe... REEEEEEEEEE"

  • @gaussdog
    @gaussdog Год назад

    Rap Link, please..

    • @geohotarchive
      @geohotarchive Год назад

      ruclips.net/video/9iUvuaChDEg/видео.html

    • @LatentSpaceTV
      @LatentSpaceTV  Год назад

      ruclips.net/video/9iUvuaChDEg/видео.html
      You can always find all the links in the show notes: www.latent.space/p/geohot#details

  • @the_yugandharr
    @the_yugandharr 2 месяца назад

    interviewers are like robots. make it more of a conversation rather than a qna. good one tho!

  • @benjaminkaarst
    @benjaminkaarst Год назад

    Why does this feel like they are giving him a technical interview?

  • @Muaahaa
    @Muaahaa Год назад

    From their website:
    "We’re hiring software engineers to work on tinygrad. _In person_ in San Diego..." Why? Isn't this largely about contributing to OSS? Isn't the model for OSS the god father of remote work?

  • @shephusted2714
    @shephusted2714 Год назад

    his ideas are already old - time marches on - if it was such a great idea he would already be shipping but it is just cots hw - anybody can make one, why pay him for the fun?

  • @cosmicray007
    @cosmicray007 Год назад

    beware of the fast-talking man. attention is all you need !! 1:16

  • @arnaudjean1159
    @arnaudjean1159 Год назад

    I don't want only a copy of my memories in the stream I don't care a copy
    I just want me the original I just want keep on experimenting my own feelings keep my soul
    Wtf making a thing of a copy exept if your narcissic devious I don't care that bs

  • @Roblox1p5
    @Roblox1p5 Год назад

    I'm trying to understand you bro. You are not a very good teacher.

  • @ankursinghprime
    @ankursinghprime Год назад