Support Vector Machines Part 3: The Radial (RBF) Kernel (Part 3 of 3)

Поделиться
HTML-код
  • Опубликовано: 23 янв 2025

Комментарии • 618

  • @statquest
    @statquest  2 года назад +11

    Support StatQuest by buying my books The StatQuest Illustrated Guide to Machine Learning, The StatQuest Illustrated Guide to Neural Networks and AI, or a Study Guide or Merch!!! statquest.org/statquest-store/

  • @priyangkumarpatel9317
    @priyangkumarpatel9317 4 года назад +228

    You make statistics and machine learning so much fun. Your channel is binge watch worthy. Keep spreading good education in fun way. :)

  • @chemgreec
    @chemgreec 3 года назад +55

    Excellent! There is a higher dimensional space where this video is linearly seperable from anything else on youtube. What I love is that you use both math and intuition in good measure. You dont sacrifice intutition over math or math over intuition like most other attempts. This balance you ve got here is excellent.

  • @hawaiicashew3237
    @hawaiicashew3237 10 месяцев назад +19

    Holly cow this one is flying high. The guy who figured out all the maths must have been on fire!

    • @statquest
      @statquest  10 месяцев назад +4

      bam!

    • @thedinaaesh
      @thedinaaesh 4 месяца назад

      @@hawaiicashew3237 and it sets fire to everyone who wants to learn this 🥵🔥

  • @RM-zx9ee
    @RM-zx9ee 3 года назад +31

    This video deserves an Oscar. Seriously, that was incredible. Infinite BAM!

  • @EtherealMetal
    @EtherealMetal 5 лет назад +160

    This channel is so amazing。For the past few months I have been trying to catch up on concepts in statistics that my university never taught so that I have enough knowledge to go into the data science and machine learning fields。
    The way you teach concepts in clear concise and short videos is extremely valuable。I have learned much in such a short time from just watching your videos and taking handwritten notesーthank you for all the hard work you have put in delivering this invaluable knowledge!Please continue making videos!

    • @statquest
      @statquest  5 лет назад +8

      Thank you very much! :)

    • @arunavsaikia2678
      @arunavsaikia2678 5 лет назад +1

      @@statquest Hey Josh, what would be an intuitive way to understand how SVM uses the high dimensional relationship between each pair of points to make the actual classification

    • @statquest
      @statquest  5 лет назад +8

      @@arunavsaikia2678 This is a good question. The dot product between two points, which we use to create the "high-dimensional relationships," can be interpreted in a geometric way that includes the cosine of the angle between the two points multiplied by their magnitudes (the distances from the origin). With that in mind, check out slide 18 in this PDF: web.mit.edu/6.034/wwwbob/svm.pdf

    • @Illinoise888
      @Illinoise888 4 года назад +1

      My university skimmed over RBF, but then had 15 marker about it on the midterm.. Now studying for finals, and wish I had this video for the midterm.

    • @This_isNotAThing
      @This_isNotAThing 3 года назад

      Yes please

  • @SometimesMagii
    @SometimesMagii Год назад +5

    the mathematical reasoning behind the radial kernel has been plaguing me for so long, finally after many tries now it starts to click and my mind can visualize better what is happening and why. Thank you so much :)

  • @hoangtrunghaipham5999
    @hoangtrunghaipham5999 5 лет назад +13

    I have gone through 85% of the full list and found this series extremely useful. The instructions are simple to understand and give the sufficient overview into Machine learning. Highly recommend for starters like me. Looking forward to the advanced parts, e.g. Deep learning. Many thanks!

    • @statquest
      @statquest  5 лет назад +8

      SVM and the Radial is actually pretty advanced, so you've made huge progress. The current series, on XGBoost, is also very advanced. After this, I'll do deep learning and neural networks.

  • @tampopo_yukki
    @tampopo_yukki Год назад +3

    When I was struggling to understand what the use of kernel is intuitively, I found this video in StatQuest series. Now, this seems to have fixed my shaky comprehension about the kernel! Your video series are one of my favorite explanations for base of ML. I'm so glad if you'd keep making these kinds of interesting videos on your pace, BAM!

  • @yuqing3667
    @yuqing3667 3 года назад +4

    Now we can eat snacks! Thank you so much, your visual explanation makes things so much easier to understand.

    • @statquest
      @statquest  3 года назад +1

      Glad it was helpful!

  • @ayoubmarah4063
    @ayoubmarah4063 5 лет назад +141

    i bet there is a place in heaven named statquest where you gonna live an internal life there

    • @statquest
      @statquest  5 лет назад +3

      Thank you very much!!!! :)

    • @philipkopylov3058
      @philipkopylov3058 4 года назад +20

      * a place between heaven and earth with the biggest margin possible

    • @bnglr
      @bnglr 2 года назад +1

      @@philipkopylov3058 psst, in a flat affine subspace of dimension 2

  • @seahseowpeh8278
    @seahseowpeh8278 2 месяца назад +1

    You are able to make us visualize the abstract part of the mathematics. You are a genius. Thank you so much for all your amazing videos.

  • @sinkseeker
    @sinkseeker Год назад +2

    The way you explain the math is astounding! I hope you'll continue making videos like this!

  • @yulinsun8873
    @yulinsun8873 3 года назад +10

    Infinite Bam! This is the most understandable ML video I ever watched. Thank you for sharing this.

    • @statquest
      @statquest  3 года назад

      Glad it was helpful!

  • @mypure
    @mypure 3 года назад +2

    Watching Josh is like feeling like Flash of statistical concepts.. Every skipped concepts in stat class seems becoming crystal clear here..

  • @akrylic_
    @akrylic_ 5 лет назад +14

    What an interesting application of the Taylor Series. Such a beautiful explanation, thank you!

    • @statquest
      @statquest  5 лет назад +2

      This is actually the 3rd place I've seen the Taylor Series in Machine Learning - so it's a super useful trick.

  • @gautamdawar5067
    @gautamdawar5067 4 года назад +5

    A beautiful video, I had tears of joy after watching this. Sir you are amazing!

  • @richf.9211
    @richf.9211 9 месяцев назад +2

    This man just answered questions I didn’t even know I had!😂 Excellent job thank you for the videos!

    • @statquest
      @statquest  9 месяцев назад +1

      Happy to help!

  • @hashiska.5358
    @hashiska.5358 4 года назад +2

    nobody explains the concepts better than you do. I have to study ML for a project and I haven't found a channel better than yours. That is why I have a request: please make a video on Support Vector Regression.

  • @kartikbhanot4692
    @kartikbhanot4692 4 года назад +4

    I was finding it hard to understand the concept of RBF and this video helped me immensely. Thank you Josh for the amazing work that you doing.

    • @statquest
      @statquest  4 года назад

      Thank you very much! :)

  • @nabeelhasan6593
    @nabeelhasan6593 4 года назад +3

    Your videos are like magic, making such a difficult derivation look so much easy. God Bless You

    • @statquest
      @statquest  4 года назад +1

      Thanks a lot 😊!

  • @xlmentx
    @xlmentx 3 года назад +4

    Damn, good job dude. At first I felt like I was being talked down to, but eventually grew to like it lol. You're way better at teaching this stuff than my professor is.

    • @statquest
      @statquest  3 года назад +1

      Glad you like it. I try to teach the way I want to be taught myself. I'm not super good at this stuff, so I try to keep it simple.

  • @fatihboyar9697
    @fatihboyar9697 Год назад +3

    calculation noises are so realistic and horizon widening experience

  • @jeongwonkim247
    @jeongwonkim247 5 лет назад +1

    The best machine learning statistics video. Came from confused at a coursera course for data science, taught by u mich faculty, and this video does that 100000x better. Thank you so much!

    • @statquest
      @statquest  5 лет назад

      Awesome!!! I'm glad my video was helpful. :)

  • @ketkiambekar7607
    @ketkiambekar7607 4 года назад +4

    Thank you for making one of the best videos out there for understanding SVM (and log likelihood maximization, and countless other concepts). I am going to make a good contribution to your Patreon once I get start earning because you so so deserve it, omigosh.

  • @kaus0463
    @kaus0463 6 месяцев назад +2

    The math for this is very complex in the books, but watching this video helped me get a good idea about the concept and thus now that i am seeing those books, im able to understand how that math is working
    Your way of visual explanation is simply quite easy to understand! Thank you so much for these videos, they are very helpful :)

    • @statquest
      @statquest  6 месяцев назад

      Happy to help! :)

  • @조용현-f2t
    @조용현-f2t 2 года назад +1

    Every time I watch your visualized explanation, I just got amazed

  • @tonysand69
    @tonysand69 4 года назад +2

    Oh man, thanks you for your videos, i mean, you're really awesome. You don't only explain the concepts, but also you keep it real and fun. I have learned a lot from you, when i have money i will donate every penny of it.

  • @andersoneduardo749
    @andersoneduardo749 2 года назад +2

    you are the best math professor I ever had.. thanks a lot!!

  • @parthsharma8269
    @parthsharma8269 2 года назад +1

    What are you Josh? Clear - Done, Concise- Done, Amazing -Done, Infinite BAM!!

  • @abir95571
    @abir95571 3 года назад +1

    Not gonna lie , I have read a few other books understanding how RBF computes relationship between data points in infinite dimension ... none of them are as simple and comprehensive as your video.
    Thanks a lot

  • @kk___kk___kk
    @kk___kk___kk Год назад +5

    I find some beep boop sounds a bit cringe, but it's crazy how good you are at explaining and showing things step-by-step. Thank you so much !

  • @akashjain35
    @akashjain35 5 лет назад +3

    This video and in fact the whole playlist of machine learning is so amazing. Your way of teaching makes it so easy to understand the mathematics behind these concepts. Don't ever stop making these videos!

    • @statquest
      @statquest  5 лет назад +1

      Thank you very much!!!! :)

  • @devindoinmonkmode
    @devindoinmonkmode Год назад +1

    3hours lectures in 15 mins, and it's super funny. Super Bam for StatQuest

  • @clapdrix72
    @clapdrix72 5 лет назад +1

    One of the most clearly explained proofs I've seen in a while

    • @statquest
      @statquest  5 лет назад

      Thank you very much! :)

  • @trafficguy8848
    @trafficguy8848 9 месяцев назад +2

    As I continue watching your video the satisfaction of understanding BAMSS EXPONENTIALLLY!!!

  • @dome8116
    @dome8116 5 лет назад +3

    Thanks for creating this amazing video. After watching the lecture on RBF from Caltech I was so lost and felt so bad since it was the first concept that I didnt understand at all. Your video gave some good intuition why it works and how. Thank you Statquest :D

  • @tanmaymehta9696
    @tanmaymehta9696 2 года назад +2

    Thank you so much for making all these ML and stats terms so understandable! Great work!

  • @prashant4814
    @prashant4814 5 лет назад +4

    wow, god bless you
    we need good teachers like you

    • @statquest
      @statquest  5 лет назад +1

      Thank you very much! :)

  • @jeevanraajan3238
    @jeevanraajan3238 5 лет назад +9

    There is soo much of effort put into making these videos and it has come out soo welll !!
    When you die...You ll leave behind a legacy and will be known as a legend !!..

    • @statquest
      @statquest  5 лет назад +1

      Thank you very much! :)

  • @mustufakerawala1796
    @mustufakerawala1796 5 лет назад +3

    I love your videos!!! I understand this content better, even better than my data science lecture at uni. I hope you keep up the great work, I'm officially gonna get some Statquest merch to support this chanel.

  • @winstonzhang6352
    @winstonzhang6352 2 года назад +1

    Amazing video, this saved me for my ML midterm. THANK YOU.

  • @cheshtagupta7491
    @cheshtagupta7491 3 года назад +1

    this video put an instant smile on my face

  • @jiayiwu4101
    @jiayiwu4101 4 года назад +2

    Such a nice, crystal, clear explanation!! Awesome job!!!

  • @harithagayathri7185
    @harithagayathri7185 5 лет назад +1

    Very clear explanations and far better than the videos on udemy !!

  • @trenton7
    @trenton7 3 года назад +2

    The initial singing and the double, triple, quadruple bam grows on you, didn't like them much at first but it is now an essential part of the learning experience for me.

  • @maverickop4134
    @maverickop4134 4 года назад +1

    this explanation made it look too easy. Good job . Thanks for making this video.

  • @swimmingg-k2e
    @swimmingg-k2e 2 месяца назад +1

    This video is soooooo amazing, I have learned a lot from your videos and they are really funny and incredible!

  • @VivekSrinivasanDSE
    @VivekSrinivasanDSE 2 года назад +1

    Thanks!

    • @statquest
      @statquest  2 года назад

      HOORAY! Thank you so much for supporting StatQuest!!! BAM! :)

  • @henryatehortua6149
    @henryatehortua6149 4 года назад +1

    I don't understand much English but I notice that you are a lot of fun teaching.

    • @statquest
      @statquest  4 года назад

      Thank you very much! :)

  • @reformed_attempt_1
    @reformed_attempt_1 4 года назад +2

    but how underrated is this video

  • @MominSaadAltafnab
    @MominSaadAltafnab 2 года назад +5

    "pipipu pipipu" hits every time 😂

  • @buh357
    @buh357 3 года назад +5

    wow
    wow
    wow,
    the relationship between two objects in infinite dimension.
    absolutely beautiful and amazing. thanks for ML and you :)

  • @shauryavatsa595
    @shauryavatsa595 Год назад +1

    I wish I could be taught by you physically. I know nothing about machine learning and I am going through some of the topics for my internship and I cannot tell you how easy you are making things for me. Quadruple BAMM!!

    • @statquest
      @statquest  Год назад

      Bam! I'm glad you enjoy the videos. :)

  • @ilyabykov2437
    @ilyabykov2437 2 года назад

    If I ever get a job in data science, it'll be thanks to this guy.

  • @ritshpatidar
    @ritshpatidar Год назад +1

    The guy who came up with RBF is genius.

  • @רומןבורודולין-ת6ג
    @רומןבורודולין-ת6ג Год назад +1

    תודה!

    • @statquest
      @statquest  Год назад +1

      WOW! Thank you very much for supporting StatQuest!!! TRIPLE BAM! :)

  • @wangwenyu9052
    @wangwenyu9052 5 лет назад +3

    Thanks for the wonderful video! It really helps in both forming the intuitive, as well as connecting key math concept together!

  • @陳翰儒-d5m
    @陳翰儒-d5m 2 года назад +1

    Hey man, I have to thank you a lot for describing these things so well !
    Thank you very much !

  • @lauriesteveescoses590
    @lauriesteveescoses590 9 месяцев назад +1

    holy shit, i didnt expect series expansion to come at the end. so cool

  • @haochang4293
    @haochang4293 5 лет назад +1

    I benefit so much from your video. From a Chinese Ph.D.

  • @tymothylim6550
    @tymothylim6550 3 года назад +2

    Thank you very much for this video! I learnt a lot from this step-by-step math guide! Great to eat snacks too!

  • @sy3002
    @sy3002 3 года назад +1

    @15:12, you should have nuclear BAM!!!!!!! for such revelations, awesome series loved every part. Thanks for your good work.

  • @Hermioneswand1
    @Hermioneswand1 3 года назад +1

    I love this channel. Much love! :)

  • @sakshambali3040
    @sakshambali3040 3 года назад +1

    Just amazing stuff man. God bless you, love from Indian..!!

    • @statquest
      @statquest  3 года назад

      Thank you very much! :)

  • @umeshphadke6745
    @umeshphadke6745 3 года назад

    This channel is absolute gold ! Thanks for your help mate , and also you should consider teaching mathematics too.

    • @statquest
      @statquest  3 года назад +1

      I'll keep that in mind! :)

  • @peterng.
    @peterng. Год назад +1

    worth to spend times on! thank you Josh!

  • @savvasnikolaosanastasiadis5245
    @savvasnikolaosanastasiadis5245 3 года назад +1

    you deserve 100m subscribers

  • @feynmanc303
    @feynmanc303 3 года назад +1

    thank you .. you make things super easy to understand.. amazingly good

  • @95019124
    @95019124 3 года назад +1

    you saved my grades in data mining and machine learning courses

  • @skelgamingyt
    @skelgamingyt Год назад +4

    Please take our professor's job. We need you.

  • @jinyunghong
    @jinyunghong 3 года назад +1

    This is such a great lecture!!

  • @61_shivangbhardwaj46
    @61_shivangbhardwaj46 3 года назад +1

    No words for you sir
    You are great!

  • @filipfolkesson3865
    @filipfolkesson3865 Год назад +1

    This was so funny and educational, thanks man

  • @perstarke1295
    @perstarke1295 3 года назад +1

    Wow. Just WOW. Hella good explanation!

    • @statquest
      @statquest  3 года назад +1

      Glad you liked it!

  • @vncoolestguy
    @vncoolestguy Год назад +1

    + 3 views, thanks for awesome tutorials Josh.

  • @enicay7562
    @enicay7562 4 месяца назад +1

    i sure am going to eat some snacks haha
    When i finally understood what that 0.11 actually was, i was like 👁👄👁.
    Thank you for this jaw-dropping explanation Mr.Josh

  • @MsIHateMiley
    @MsIHateMiley 4 года назад +2

    god bless, this channel is amazing

  • @muskankhajuria1038
    @muskankhajuria1038 4 года назад +1

    Amazing teaching! Thank you sooo much!

    • @statquest
      @statquest  4 года назад +1

      Glad it was helpful!

  • @xuemeiwang1881
    @xuemeiwang1881 4 года назад +1

    GREAT MAN, GREAT CHANNEL.

    • @statquest
      @statquest  4 года назад

      Thank you so much 👍

  • @RH-zp1ry
    @RH-zp1ry 4 года назад +28

    15:18 I would say "INFINITE BAM!!!"

    • @statquest
      @statquest  4 года назад +7

      YES!

    • @paulovinicius5833
      @paulovinicius5833 4 года назад

      I was SO hoping for that to happen! hahaha I was expecting this part to be the largest BAM he ever did hahah

    • @statquest
      @statquest  4 года назад

      @Eyal Barazan I would recommend starting with the first video in this series: ruclips.net/video/efR1C6CvhmE/видео.html

  • @konstantinlevin8651
    @konstantinlevin8651 Год назад +1

    wow, this actually rocks but I've lost after taylor series expansion of e to the x. nice try be back here later!

    • @statquest
      @statquest  Год назад +1

      Take your time. It's a lot of material to cover.

    • @konstantinlevin8651
      @konstantinlevin8651 Год назад +1

      @@statquest definitely, thanks for the quests and also replies, you help new data scientists to grow!

  • @yavdhesh
    @yavdhesh 4 года назад +1

    Namastey, you are the best person.

  • @jasonfaustino8815
    @jasonfaustino8815 3 года назад +4

    Can’t believe I used my knowledge on Taylor series expansion. Thanks for not wasting precious brain space for that

    • @statquest
      @statquest  3 года назад +2

      BAM! The Taylor series actually pops up a bunch in machine learning (Gradient Boost and XGBoost etc.)

  • @hustler212
    @hustler212 3 года назад +1

    You're a life saver.

  • @saravananm2280
    @saravananm2280 4 года назад

    I would have ended the song like "...I know that it sounds kinda Crazy but its actually NOT THAT LOUSY." Great video

  • @siddharthpilli62
    @siddharthpilli62 4 года назад +1

    I Love the videos you make keep up the good work!! BAM!!

  • @justgame5508
    @justgame5508 3 года назад +1

    Ahhh thankyou electronic engineering for having difficult mathematics, it’s makes it easy to branch out into more statistical domains such as machine learning and still be able to keep up, also equips me with other techniques such as Fourier and Laplace transforms which can be useful in data analysis and feature extraction. Great derivation btw

  • @himanshu1056
    @himanshu1056 3 года назад +1

    Awesome explanation 👍

  • @r0cketRacoon
    @r0cketRacoon 10 месяцев назад +1

    wtf, I love that part 9:25, u enlightened me

  • @williamobando4159
    @williamobando4159 3 года назад +1

    This blew my mind lob u Josh ty

  • @yafoniahutabarat6793
    @yafoniahutabarat6793 3 года назад +1

    you should collab with Phoebe to create some StatQuest jingles!!!! love it

  • @taotaotan5671
    @taotaotan5671 3 года назад +1

    I learned RBF from the Gaussian process, and seems the idea of "kernal" has numerous applications!

  • @phongapex3741
    @phongapex3741 Год назад

    Hello,
    at the time of 14:34, you multiply both parts of dot product by the square root of the first term to make the radial kernel all in one dot product. Why do you do that? I cannot get it :(

    • @statquest
      @statquest  Год назад

      We do this to show how the RBF kernel is equivalent to a polynomial kernel with infinite dimensions.

  • @RahulSharma-tf6zk
    @RahulSharma-tf6zk 3 года назад

    You helps me understand what my professor says in ml mandarin, Thanks

  • @swarajshinde3950
    @swarajshinde3950 4 года назад +2

    Just Loved the way you explained the proof using Taylor series : ]

  • @sanjivgautam9063
    @sanjivgautam9063 4 года назад +1

    This man is genius

  • @naufalamiruddin5798
    @naufalamiruddin5798 3 года назад +1

    I love the "beep boop boop" part of this video !! 🤣

  • @ahming123
    @ahming123 5 лет назад +2

    OK got what diamension relationship means now. You the best

  • @joxa6119
    @joxa6119 2 года назад +1

    I just regret not found your channel during my degree.

    • @statquest
      @statquest  2 года назад

      better late than never! :)