10 years of NLP history explained in 50 concepts | From Word2Vec, RNNs to GPT

Поделиться
HTML-код
  • Опубликовано: 5 фев 2025

Комментарии • 86

  • @avb_fj
    @avb_fj  Год назад +2

    Here's me from the future sharing a detailed analysis of Neural Attention from first principles: ruclips.net/video/frosrL1CEhw/видео.html
    And Self Attention: ruclips.net/video/4naXLhVfeho/видео.html

  • @calum.macleod
    @calum.macleod Год назад +25

    I am impressed that you managed to put so much content into 17 minutes without dumbing it down. It must have taken you a lot of time to put this together. Thank you.

    • @avb_fj
      @avb_fj  Год назад +6

      Yeah it was definitely the most challenging video I have produced on this channel in terms of the scale of the content. Thanks for recognizing that!😇

  • @groundingtiming
    @groundingtiming Год назад +3

    I hope this goes viral because it is a great video my friend!

    • @phaZZi6461
      @phaZZi6461 4 месяца назад +1

      all his videos are so god damn good

  • @rahulspoudel
    @rahulspoudel Год назад +2

    Summarization cannot be better than this. Well done, my friend. Thank you for this.

    • @avb_fj
      @avb_fj  Год назад +1

      🙌🏽thanks!

  • @krákanordic
    @krákanordic Год назад +2

    You sir are a legend, this is an outstanding overview. Thank you

    • @avb_fj
      @avb_fj  Год назад +1

      Thanks! Glad you enjoyed it!

  • @avq512h
    @avq512h Год назад +2

    Brilliantly explained, there so much negativity and lack of understanding around AI that your content is like a breath of fresh air to those who want to embrace AI. Thanks for the timeline and rational explanation.

    • @avb_fj
      @avb_fj  Год назад +1

      Much appreciated! 🙌🏼🙌🏼

  • @sanjeevjikamade
    @sanjeevjikamade Год назад +1

    Amazing video, you have taken a lot of efforts to put so much of information in this video. Thank you :)

  • @sivi3883
    @sivi3883 Год назад +1

    This is by far the best video on RUclips to learn about LLM and its history. Thanks a bunch man! Appreciate the amount of work you had put into this 17 min super informative video.

  • @animatem
    @animatem Год назад +18

    Holy cow. That was a really, really good explanation. Every 30 seconds I would stop, make sure I understood, rewind if needed. Wow. Literally the best breakdown I have seen since I started paying attention 6 months ago. Thank you!

    • @avb_fj
      @avb_fj  Год назад +3

      Thanks a lot!! That’s one of the best comments I’ve received on this channel!

    • @animatem
      @animatem Год назад +2

      @@avb_fj I wish I could give you more. If you ever need to provide someone your resume for a job, just send them a link to that video. It speaks for itself.

  • @jichaelmorgan3796
    @jichaelmorgan3796 Год назад +1

    Thank you for this video and helping me better understand ai and LLMs. Your outro really resonated with me. I'm glad to find a youtuber like yourself about this subject.

  • @dollarscholar2956
    @dollarscholar2956 Год назад +1

    Excellent video, perfect balance of breadth and depth on the history and mechanisms behind current AI technology.

  • @thorcook
    @thorcook Год назад +5

    Excellent content. Clear, coherent, and thorough but efficient survey of current AI/ML models/technologies. Well researched, not overly complex, but not dumbed-down either. A perfect balance between comprehensive and parsimonious, and very well-spoken. A refreshing find in the over-polluted AI/ML Edu sector of YT. keep up the good work!

    • @avb_fj
      @avb_fj  Год назад

      That’s the kind of balance I was intending to go for, so this comment puts a huge smile on my face. Thanks for being so kind! I’m laminating this and hanging it on the wall tomorrow. 🙏🏽🙏🏽😇

  • @jacobyoung2045
    @jacobyoung2045 Год назад +8

    Awesome video, The fact you gave a timeline to all of these models is amazing. Going through tutorials online they use any of them out of order and without explanation. Can't wait for your next video explaining RLHF in detail.

  • @rharsharaj1
    @rharsharaj1 Год назад +3

    Never seen anyone who explains the LLM depth in such simple terms and using a timeline it tells the story of past, present trends and on going visions, challenges .. i appreciate your effort buddy! It took 17mins to align my technical understanding on LLM. wish you more luck and success 👍

    • @avb_fj
      @avb_fj  Год назад

      Thanks for the kind words man! 🙌🏼🙌🏼

  • @navneetchoudhary808
    @navneetchoudhary808 Год назад +1

    Hi, it is too good content to miss out. Can you try to make a series out of this video while explaining all the concepts in a slightly detailed manner. It will really help to fully grasp the content. For summarisation what you have done in this video is really remarkable. But we got slightly hungry we want a separate series on NLP 😛

  • @JohnLeMayDragon
    @JohnLeMayDragon Год назад +1

    Thanks for the informative video. I'm probabably going to have to watch it a few times because I'm a little slow, but I feel like I'm beginning to understand and build an intuition about the subject.

    • @avb_fj
      @avb_fj  Год назад

      Awesome! Don’t worry about it, honestly the video is pretty loaded for trying to cover NLP history in just 17 minutes. Think of it more as a guiding star for the different topics to study in the field.

  • @willikappler1401
    @willikappler1401 Год назад +12

    That was a really amazing overview! Thanks a lot for the time you've put into this! Please continue, you're very good at explaining things.

  • @MrRussbutten
    @MrRussbutten Год назад +1

    Excellent summary of the history of NLP! You deserve more views!

    • @avb_fj
      @avb_fj  Год назад +1

      Thanks man! 😇😇

  • @mohamadhasanzeinali3674
    @mohamadhasanzeinali3674 Год назад +1

    Unbelievable content! Truly amazing!

  • @BigMTBrain
    @BigMTBrain Год назад +2

    Superbly done! Though I've been hovering about the field of AI for some time now, your presentation is a great review and reference for me, and I'm sure many others, so I'll be sure to share. Thanks!

  • @DrFrei
    @DrFrei Год назад +1

    Wow. That was fantastic. I'm a total novice. And this was a GREAT explanation. Foundational in nature. I'm looking to learn such things, then apply it in many ways to make the world a better place. Hopefully this will help me along that path! Thanks, AV!

  • @BobWidlefish
    @BobWidlefish Год назад +1

    This was truly excellent, thank you!

  • @ItsRyanStudios
    @ItsRyanStudios Год назад +1

    Fantastic content
    Thank you
    I'm just starting to enter the NLP space, and this is the kind of content I need

    • @avb_fj
      @avb_fj  Год назад

      Awesome! Super glad to provide some insight. 🙏🏽

  • @jeremynoble5948
    @jeremynoble5948 Год назад +1

    Thanks very much for this thorough and fair minded study. I now have a better get a better understanding of where we have come from in AI - and that context helped me process recent events more thoughtfully. Highly recommended.

    • @avb_fj
      @avb_fj  Год назад

      So happy to hear that the video helped! 😇😇

  • @Workdayrelease
    @Workdayrelease Год назад +1

    Great summary bro

  • @HazemAzim
    @HazemAzim Год назад

    Impressive and insightful . Thanks for the Journey

  • @relapse7545
    @relapse7545 Год назад +1

    Awesome video! If possible, could you please add all the papers mentioned in the description? Some viewers might find it useful :D

    • @avb_fj
      @avb_fj  Год назад +1

      Agreed. Will do soon!

  • @kevon217
    @kevon217 Год назад +1

    great overview of the history!

  • @someguy_namingly
    @someguy_namingly Год назад +1

    Great video, thanks! :)

  • @falaluibrahimlawan4222
    @falaluibrahimlawan4222 Год назад +1

    Good and concise explanation

    • @avb_fj
      @avb_fj  Год назад

      🙌🏼 glad you enjoyed it!

  • @faysoufox
    @faysoufox Год назад +1

    great video, thanks

  • @PeterAdiSaputro
    @PeterAdiSaputro Год назад

    It's a brief, short, but detail explanation. Thanks for making this content. Are you a NLP engineer ?

    • @avb_fj
      @avb_fj  Год назад +1

      Thanks! Yes, I am an NLP/ML professional.

  • @LaFragas
    @LaFragas Год назад +1

    what a great list, thanks!

    • @avb_fj
      @avb_fj  Год назад

      🙌🏼🙌🏼

  • @alialhousseini1
    @alialhousseini1 Год назад

    I am not an active person on youtube, and maybe this is my third or fourth comment on a video. This video is my first on this channel. All what I would like to say (from an AI Student) that you are amazing! I really encourage you to keep posting like these videos.
    I am excited to see your upcoming videos. Keep Learning, and Keep going! Best of luck.

    • @avb_fj
      @avb_fj  Год назад

      Thanks for the wonderful words of encouragement! Glad you found the video resourceful. 😁

  • @AnimeshPathak
    @AnimeshPathak Год назад +1

    Thanks for this very good summary!

    • @avb_fj
      @avb_fj  Год назад

      🙏🏽 thanks!!

  • @kevon217
    @kevon217 Год назад +2

    would love to see a deep dive video on the reward model and ppo

    • @avb_fj
      @avb_fj  Год назад +1

      Thanks! I’m planning to cover it either in my next or the one after.

    • @kevon217
      @kevon217 Год назад

      @@avb_fj excellent, looking forward to it!

  • @jorper98
    @jorper98 Год назад +1

    Very good - thank you!

  • @wodemamaya1889
    @wodemamaya1889 Год назад

    Good work, man.

  • @Artificialintelligencia
    @Artificialintelligencia Год назад

    nice , explanation thanks a lot 😊😊

  • @adamkadmon6339
    @adamkadmon6339 Год назад

    Good job!

  • @AWESOMEVIDESHEE
    @AWESOMEVIDESHEE Год назад +1

    AVB
    GOOD VIDEO, CREATED MORE VIDEO

  • @siriyakcr
    @siriyakcr Год назад

    🥰🥰 refreshers

  • @helloworldcsofficial
    @helloworldcsofficial 10 месяцев назад

    Great video. Could you do an update this year?

    • @avb_fj
      @avb_fj  10 месяцев назад +1

      Thanks for the idea! I might do it in a couple of months.

    • @helloworldcsofficial
      @helloworldcsofficial 10 месяцев назад +1

      @@avb_fj Thanks! And great job on these videos.

  • @notnothome
    @notnothome Год назад +1

    If you want a video editor I’d love to help you, I’m teaching low income people how to prompt in California and your video was so educational I’d be silly to not contribute to your work and publicize it to my following

    • @avb_fj
      @avb_fj  Год назад

      Man that’s such a flattering and kind gesture. Thank you so much! To be honest, I want to learn video editing myself, and slowly building my skills with each video. So I am not seeking a video editor at this point! That may change in the future, but that’s where I stand right now. Once again, thank you so much for your offer!!

  • @arielle-cheriepaterson7851
    @arielle-cheriepaterson7851 4 месяца назад

    I came across an engineer's profile on LinkedIn that said something like "post transformers are where it's at... iykyk" what does that mean in the context of a multimodal RAG?

    • @avb_fj
      @avb_fj  4 месяца назад

      It could mean multiple things honestly. Hard to tell without additional context. In general, transformers are very commonly used both for generation (creating new content) and embeddings (numerically representing existing content). Since RAG relies a lot on good embeddings, transformer based models are often used to do RAG.

    • @arielle-cheriepaterson7851
      @arielle-cheriepaterson7851 4 месяца назад

      @@avb_fj thanks for replying. I remember that his LI headline had "SSMs" in it... so I think he's working on state space models and said it from that context. Do you know what that could mean?

  • @bmomjian
    @bmomjian 5 месяцев назад +1

    "Like, Share" predicts "Subscribe" as the next word --- cute. 😀

    • @avb_fj
      @avb_fj  5 месяцев назад

      😂

  • @mohitsarpal9380
    @mohitsarpal9380 Год назад

    Can you share all these slides ?😄

  • @ScottzPlaylists
    @ScottzPlaylists Год назад

    what article did you use to get the content?

    • @avb_fj
      @avb_fj  Год назад +2

      None in particular. I’ve been involved in Deep Learning research during my graduate studies as well as during my full time job… so I was familiar enough with the field to make the blueprint myself. After that, it was about some googling to get the relevant papers, arranging the content, and filtering out extremely low level details.
      The illustrations were either from papers, google image searches, medium articles, or produced by me in PowerPoint.

  • @anirbanc88
    @anirbanc88 Год назад +1

    this is awesome, can you please do this for computer vision ? __/\__

    • @avb_fj
      @avb_fj  Год назад

      Yeah it’s definitely in my mind. Maybe one of the videos next month!

  • @ko-Daegu
    @ko-Daegu Год назад

    I would put ChatGPT in 2022 (as it came out in September)

    • @avb_fj
      @avb_fj  Год назад

      That’s a fair point. The initial release was late 2022 and the stable release was May 2023.

  • @AntoineDennison
    @AntoineDennison Год назад

    The way we learn to trust LLMs is to make them trustworthy.

  • @MichaelScharf
    @MichaelScharf Год назад

    Great video but I found the background music very distracting

    • @avb_fj
      @avb_fj  Год назад +1

      Thanks for the feedback. I’ll keep this in mind in the future!