Jay Alammar on LLMs, RAG, and AI Engineering

Поделиться
HTML-код
  • Опубликовано: 1 дек 2024

Комментарии • 30

  • @snarkyboojum
    @snarkyboojum 3 месяца назад +7

    Great to see a summary like this of how a real practitioner in the field is solving real problems with real companies. We do the same in my role and my teams. Not as sexy as the latest AGI hype or LLM research, but where the bulk of the “journeyman” GenAI work is for the next several years at least! Thanks for sharing Jay’s insights with us.

  • @manslaughterinc.9135
    @manslaughterinc.9135 3 месяца назад +2

    Roughly around 46:00 regarding layered levels of complexity in a paper. I can't emphasize enough how many times I come back to specific papers and reread them, then walk away knowing more than the first time I read them because they sent me down a path that caused me to learn more, then 3 months later, I'm coming back and finding new gems, 3 months after that, doing the same thing. Every AI researcher should be taking notes.

  • @Darkon10199
    @Darkon10199 3 месяца назад +1

    Love this guy. Great discussion as usual, unlucky it was so "short"

  • @nasrawi11
    @nasrawi11 3 месяца назад +2

    Jay is a wonderful knowledgable person. Makes things simple . Thanks you.

  • @CodexPermutatio
    @CodexPermutatio 3 месяца назад +2

    Top quality content as always. My favorite AI channel.

  • @DeniseMilaTeresa
    @DeniseMilaTeresa 2 месяца назад +26

    aistructuralreview AI fixes this. s, RAG, and AI Engineering.

  • @toadlguy
    @toadlguy 3 месяца назад +2

    Most amazing, Tim, how you seem to be right on top of what I am currently investigating 😄. I just started reading Jay's book on O'Reilly (pre-release) and you come out with this terrific interview, so I can get a more nuanced view of the author. Excited to read his latest, having gotten my earlier understanding of how transformers work from his 2017 paper. Thanks once again, Tim.

  • @muhannadobeidat
    @muhannadobeidat 3 месяца назад +1

    Excellent video, touches on many different topics, has great practical advice, pointers to education material, etc… Jay is talented and doing this purely out of passion for technology and innovation.

  • @michaelstewart529
    @michaelstewart529 3 месяца назад

    He certainly said a lot of words.

  • @saulyarhi675
    @saulyarhi675 3 месяца назад

    Thank you so much for all these knowledge so well explained 🎉❤

  • @mahmoudelaskare4982
    @mahmoudelaskare4982 3 месяца назад

    great talk

  • @arowindahouse
    @arowindahouse 3 месяца назад

    Thank you, Tim. This video brought me some illusion regarding the future uses of LLMs; sometimes is easy to think they're just stupid and useless

  • @paulk6900
    @paulk6900 3 месяца назад +6

    Can you please focus again on more complex topics that are like u previously? I still appreciate ur content but somehow it gets quite repetitive and deviates from the technical side to more and more soft topics

  • @tacticalgaryvrgamer8913
    @tacticalgaryvrgamer8913 3 месяца назад +2

    So basic is the material that while I don't think anything in here is wrong I didn't learn anything either

  • @lexer_
    @lexer_ 3 месяца назад +4

    I usually like these conversations because they allow you to meet the person instead of their sales mask. But in this one he never really took his mask off at all. I just listened to an hour of just marketing and I am honestly pretty disappointed.

  • @LuigiSimoncini
    @LuigiSimoncini 3 месяца назад +15

    Sobering content. AGI's nowhere to be seen, Cohere building a path for soft landing from the heights of the hypeness, real business cases still missing

    • @xthesayuri5756
      @xthesayuri5756 3 месяца назад +4

      We haven't even seen GPT-5, Claude-4 or Llama-4 and you are already declaring defeat based on one single generation of LLMs 😂💀

    • @Tommy31416
      @Tommy31416 3 месяца назад +2

      @LuigiSimoncini agree. Tech bros think a 60% success rate of an application with an LLM in it is great. In the corporate world that is a harbinger of death strategically, procedurally, commercially and/or legally. The idea of stable applications, enterprise grade i.e. 99.99% stability, that contains an LLM has always been a laughable concept. Tech bros gonna tech bro.

    • @Manwith6secondmemory
      @Manwith6secondmemory 3 месяца назад

      @@Tommy31416 AGI or not, current SOTA models in a much more computationally efficient and scalable/integrated format is enough to change society as a whole let alone automate large parts of most people’s jobs. Its already changing society (people becoming emotionally attached romantic bots for example)
      Also, humans operate at 99% accuracy. Are you joking? Humans are error prone to the highest degree. Everywhere, every system is riddled with inefficiencies and constant failures. Failure is fundamental to our condition we get better from it (sometimes we dont tho)
      We are also have very resource intensive logic engines that need an 8 hour reboot every 12 hours or they breakdown

    • @francisco444
      @francisco444 3 месяца назад +1

      There are so many use cases already. Have you not seen the waves of layoffs?

    • @pedro336
      @pedro336 3 месяца назад

      @@francisco444 Layoffs are mostly related to the end of low interest rates. This results in less people being hired, more layoffs etc. And this results in even more layoffs because there is now more talent on the market, for potentially lower salaries. So companies can purge their low performers and replace them with better/cheaper ones.

  • @jamesharris5256
    @jamesharris5256 День назад

    Is this guy just a sales person or customer success? just mentioning "Re-rank, RAG, agent, instruction tuning, DPO, clouds, SaaS, amazon bedrock, agentic, unit test".. and nothing concrete. My brain hurts from how low the information content is. I guess it is big business convincing companies there is a structured way to use LLMs. But really gives Cohere a negative look having Sales people instead of technical people.
    Information alpha here is very low... Amazing this guy has made a career from visualizations. Must get so used to dogmatic sales talk with enterprise.
    Just looked at Google scholar and all citations of visualizations. Didn't realise that was possible.

    • @jamesharris5256
      @jamesharris5256 День назад

      Similar people commented on how many words and how low the value it is... Is frustrating and I guess companies that use sales reps like this really harm their image.

  • @bwowekeith4472
    @bwowekeith4472 3 месяца назад +1

    Second

  • @KafkaUnderTheTree
    @KafkaUnderTheTree 3 месяца назад

    Third :D

  • @renjithravindran5018
    @renjithravindran5018 3 месяца назад +1

    First!😂

  • @AliMoeeny
    @AliMoeeny 3 месяца назад

    zeroth 😏