What the Heck is Bayesian Stats ?? : Data Science Basics

Поделиться
HTML-код
  • Опубликовано: 21 авг 2024
  • What's all the hype about Bayesian statistics?
    My Patreon : www.patreon.co...

Комментарии • 116

  • @TarunKumar-bw9lr
    @TarunKumar-bw9lr 2 года назад +32

    I've been hearing about bayesian thinking from last 6 months and was watching multiple videos about it. I never understood priors, likelihood and posterior from rea life perspective but youtube recommended this hidden gem to me. I'm glad I came across your channel :)

  • @shiyangchen4010
    @shiyangchen4010 17 дней назад

    Excellent work!!! You've made the content SO EASY to understand!

  • @bilalozbinzet2534
    @bilalozbinzet2534 3 года назад +7

    This is the easiest, thus the best introduction to Bayesian Stat, I ever came cross. It transfer to knowledge from Frequentist Probability to Conditional Probability, then to Bayesian Probability in a concise manner. Thanks for it and the others...

  • @omarboukherys5216
    @omarboukherys5216 3 года назад +22

    I was waiting for this video, plz do a serie about bayesian statistics and explain how we can do it, estimating parameters ....!!! 🙏🙏🙏

    • @ritvikmath
      @ritvikmath  3 года назад +5

      Thanks for the suggestion!

    • @lossmoss
      @lossmoss 3 года назад +1

      @@ritvikmath Yes, please do this if you have time.

    • @erikaavanic912
      @erikaavanic912 3 года назад +1

      Agreed, that would be sooo so very helpful - your other videos make it a lot easier to understand. thank you!!

    • @adwaydas6194
      @adwaydas6194 3 года назад +1

      I agree. Please do that. 🙏🙏🙏

  • @sarahscott7878
    @sarahscott7878 Год назад +4

    Wow, i never understood how bayesian thinking revolved around updating a prior belief. it was always so obscure to me, trying to reason around three distributions (prior, likelihood, posterior) But your one sentence "prior beliefs get updated w/ new data" really puts it into perspective. I had no idea the posterior was the updated prior. Thank you for such a great video!

  • @realimaginary5328
    @realimaginary5328 2 года назад

    Zero fluff and exceptional clarity. Updating my prior belief that I understood Bayesian thinking. Thank you Sir!

  • @pedrocolangelo5844
    @pedrocolangelo5844 2 года назад +4

    I really don't know where I'd be without ritvikmath to explain these complex concepts in statistics. Thank you for an amazing video. This is certainly one of the best videos on Bayesian statistics on RUclips.

  • @GregThatcher
    @GregThatcher 3 года назад +3

    Great stuff. I've been trying to understand the Frequentist vs. Bayes reasoning for a long time, and now I get it. Thanks so much.

  • @sasakevin3263
    @sasakevin3263 Год назад

    The explanation of this concept is often presented in a dry manner with formulas, while some use engaging and intricate animations to explain it. However, you excel in your ability to intuitively convey how we should understand it. This approach is highly effective as it links science directly to our lives. I particularly appreciate your style.

  • @martingreler6236
    @martingreler6236 Год назад +1

    You're work is opening doors for me. Thank you!

  • @rubencardenes
    @rubencardenes 3 года назад +4

    So nicely explained! I really like how you go beyond the formulas, explaining the concepts, also with clear examples.

  • @marsellosful
    @marsellosful 2 года назад +5

    A very good video. A suggestion: better to use different numbers in the example to avoid confusion. For example, at your first table, the "15" is two times, once at (B,N) and secondly at (S,~N). If you would say (S,~N)=20 then, again, it would be confusing as you add up the 15+20 and the total N is 20 (possible confusion). If (S,~N)= 16, then numbers would be different and the example would limit possible confusions. I got confused at the beginning and I thought you may find useful my observation.

    • @ritvikmath
      @ritvikmath  2 года назад

      Good suggestion! Thank you

  • @shubhampandilwar8448
    @shubhampandilwar8448 3 года назад +2

    Very well explained. Bayesian statistics is always confusing to grab. This video made it clear. People without a lot of statistics can also grasp it very comfortably.

  • @DeltaPi314
    @DeltaPi314 3 года назад

    This channel needs more subs, more likes and more views.
    How is Bayesian Stats being explained here better than my undergrad prof did live? HOW?!

  • @robinbartmann6774
    @robinbartmann6774 3 года назад +2

    Hey ritvikmath
    This is pure genius - literally the best video I saw about explaing the basics of bayesian statistics. I really understood it now & as I am writing my thesis about prediciting carbon price with bayesian stats (and the new shrinkTVP package in R) this really helps me a lot.
    One idea that tripped me up a bit is between 9:30-10:00, as you talk about dividing 15/170 and I thought: isn't the probability that I hear the noise 20/170? After rewatching a few times I know what you mean - just something that might make it even better as it already is. Thanks for providing real value!

  • @immersivestudyandliving4272
    @immersivestudyandliving4272 3 года назад +2

    I used Naive bayes classifier in my final class project last semester. You explained Baysian Stats nicely. Keep posting good contents 👍.

  • @abdulelahaljeffery6234
    @abdulelahaljeffery6234 2 года назад +1

    this is, seriously, top notch stuff ❤️❤️
    would love to have more bayesian topics ...
    how dose the markov chain monte carlo algorithm works? gibbs sampling? all those bayesian concepts

  • @gaofan2856
    @gaofan2856 2 года назад +1

    Excellent explanation. Thank you so much for your hard work. I'm watching your vids just for entertainment after work :)

  • @hyz5741
    @hyz5741 3 года назад +3

    I still remember that I took Bayesian Statistics in college, and that was one of my favorite class!

  • @MS-fw4kf
    @MS-fw4kf 2 года назад +1

    hands down one of the best explanations!

  • @BetoAlvesRocha
    @BetoAlvesRocha Год назад

    What a great explanation about the Bayesian Reasoning. I'll have a test about Bayesian Inference and this video helped me to have more clues about this topic. Thanks for the kind introduction for this subject, mate!
    Cheers from Brazil!

    • @BetoAlvesRocha
      @BetoAlvesRocha Год назад

      Just a piece of advice, mate: everytime you make a video using the white board, give us some seconds at the end to take a print screen of it. It helps a lot of the notes here. But, again, nicely done! Thanks for the amazing class!

  • @Idonotwanthandle
    @Idonotwanthandle Месяц назад

    To anyone wondering why Bayesian approach didn’t match “Approach 2” probabilities, this is because P(B) = 150/170 is not 0.88, but 0.882352… If you calculate precisely l, than 1/3 proportion would remain.

  • @mrinalde
    @mrinalde Год назад

    Good job Ritvik. There are few explanations I have seen in the past, I will recommend your video from now on :)

  • @djfl58mdlwqlf
    @djfl58mdlwqlf 3 года назад +1

    this is insane
    your videos are so valuable

  • @mgm8997
    @mgm8997 3 года назад +2

    Awesome explanation! Keep up the excellent work 👏👏

  • @benjamindilorenzo
    @benjamindilorenzo 3 года назад +1

    nice! I was asking my professor this morning exactly this kind of questions: How can I differentiate between conditional probability and bayes theorem and when to use what? This Video breaks down very good the problems that need to be understood to notice the difference. By the way your videos get better, and you start to talk more calm and a bit better to understand.
    Thank you!

    • @ritvikmath
      @ritvikmath  3 года назад

      Thanks for the kind words!

  • @spencerreid2765
    @spencerreid2765 Год назад +1

    You made it so clear and easy to understand, thank you very much.

  • @lauravargasgonzalez9317
    @lauravargasgonzalez9317 2 года назад

    Another great video. Thanks a lot, you have no idea how much you had help me

  • @adamtran5747
    @adamtran5747 2 года назад

    Absolutely love the content

  • @yaseenmohmand1224
    @yaseenmohmand1224 6 месяцев назад

    thank you for explaining this so well!
    I wish you had taken even longer to explain these concepts, the cuts in between the video are a little distracting.

  • @Crualaiocht
    @Crualaiocht 3 года назад +1

    Thank you for this explanation. I like your teaching style.

  • @user-so4hy3jk7t
    @user-so4hy3jk7t 7 месяцев назад

    What a perfect video! Thank you!

  • @albert6737
    @albert6737 3 года назад

    Never have I ever thought of bayes theorem in this way. This video has changed my thinking. Thank you

  • @kimtaewoo5947
    @kimtaewoo5947 2 года назад

    You are a really good educator. I'm excited to watch other videos in your channel.

  • @yuzhujiang5018
    @yuzhujiang5018 3 года назад +3

    I love how you explain the concepts. That's very clear and helpful. Could you please do some deep learning (CNN, RNN etc) videos? And also for ML, could you talk about the specific Validation methods that we can apply to Time Series. Thank you!!!!

    • @ritvikmath
      @ritvikmath  3 года назад +1

      Great suggestion!

    • @hemantnyadav
      @hemantnyadav 3 года назад

      Hi, I am also working on Time Series forecasting(One of very interesting for me)... If @ritvikmath makes videos it will be more interesting.

  • @pipertripp
    @pipertripp Год назад +1

    Regarding your final point, what's wrong with just having a weak prior? The data you collect will then drive the posterior and as you collect more data, the priors will become less and less relevant.

    • @user-mn8th3ie1t
      @user-mn8th3ie1t 8 месяцев назад

      100% right as the updating mechanism of Bayes theorem gives more weighting to the incoming data as you collect more data, hence rendering the prior belief less and less impactful on your decision.

  • @steveh4920
    @steveh4920 Год назад

    great video - very well explained

  • @samrudhithakar5682
    @samrudhithakar5682 9 месяцев назад

    Dude! You are good! Really good.

  • @rajatadimeti2398
    @rajatadimeti2398 3 года назад +1

    Thank you very much for clearly explaining the concept.

  • @alishasapkota4311
    @alishasapkota4311 2 года назад

    Thank you for best explanation. :)

  • @rrio7171
    @rrio7171 11 месяцев назад

    thank you, really good video easy to understand

  • @paulbearcamps
    @paulbearcamps 11 месяцев назад

    Awesome video. Finally understand. Thanks so much for your help!

  • @saisiddharthametta5252
    @saisiddharthametta5252 Год назад +2

    This just cleared most of the doubts on the fundamentals I had during my undergrad days. Very intuitive and very helpful!

  • @AYUSHKUMAR-cc7id
    @AYUSHKUMAR-cc7id 2 года назад

    This is really good. Please do a complete series in forecasting and TimeSeries including auto regression/ moving averages/ARMA models/non linear models/GARCH/ARCH/cointegration etc. etc.)

  • @ieserbes
    @ieserbes Год назад

    Amazing explanation. Thank you so much.

  • @BeeZedits
    @BeeZedits Год назад

    sick flip!

  • @babaumar4188
    @babaumar4188 Год назад

    Wow, amazing elucidation. Thank a lot.

  • @sachingoud6064
    @sachingoud6064 3 года назад

    Great work. Really like your videos!
    Thank You.

  • @sgpleasure
    @sgpleasure 3 года назад +2

    So, if the objective is to find the probability to check either the bedroom or study, approach-1 was never the correct approach?

  • @pedrazzinig
    @pedrazzinig 6 месяцев назад

    Well done

  • @lalasalalasa2428
    @lalasalalasa2428 Год назад

    Yes I got a good understanding

  • @evenblackercrow4476
    @evenblackercrow4476 2 года назад

    You're a great resource. Thanks very much

  • @DeltaPi314
    @DeltaPi314 3 года назад

    I am currently doing a seminar on Data Science for Risk Evaluation in Banking. And I am trying to apply this to calculating the Default Probability. Hope I got it right.

  • @srilamaiti
    @srilamaiti 3 года назад

    Nicely explained the concepts, formula and examples. Can you please make a video on hierarchical time series and multiple time series forcasting?

  • @rahilbalar3107
    @rahilbalar3107 2 года назад

    Great explanation!

  • @resocipher873
    @resocipher873 2 года назад +1

    Might be a silly question but why doesn't the result in approach in 2 equal the final result? For example P(B/N) is 75% in approach 2 then after you expand it equals to 8.8%?

    • @dinber19
      @dinber19 2 года назад

      Because he doesn't divide by P(N)

    • @Idonotwanthandle
      @Idonotwanthandle Месяц назад

      Also because 0.88 is rounded value, actually it is 0.8823…

  • @HuongGiangNguyen-qt3sm
    @HuongGiangNguyen-qt3sm Год назад

    Thank you.

  • @osamaali3748
    @osamaali3748 2 года назад

    Man you are the best

  • @joycwang
    @joycwang 2 года назад

    So well explained!

  • @gcumauma3319
    @gcumauma3319 2 года назад

    Excellent

  • @kafaayari
    @kafaayari 2 года назад

    This guy is genius.

  • @cyan_aura
    @cyan_aura 2 года назад +1

    @ritvikmath If you start a patreon or even add donation options in youtube, I'll gladly pay, and I'm sure many folks would do the same. These explanations are truly remarkable and they drive the point home so effortlessly. Thanks a lot for your contribution to the ML/DS community.

  • @yashasvi5293
    @yashasvi5293 6 месяцев назад

    The perfect video for understanding bayesian stats, priors, Likelyhood... thanks bhai.... I usually never comment but this thin was making me sick understanding🙂

  • @aidanabregov5929
    @aidanabregov5929 3 года назад

    Wish I had discovered this BEFORE finals week!

  • @johanrodriguez241
    @johanrodriguez241 3 года назад +1

    very clear, and very interesting but now i'm thinking about the next natural step, how to apply it in data science?. Could be nice to see different implementations like bayesian optimization to get an idea of its power.

  • @caustinolino3687
    @caustinolino3687 4 месяца назад

    4:09 In approach 1, why do you calculate frequentist probability of the phone being in the bedroom upon hearing the cell phone noise as 15/150? Why should the denominator be 150, since 150 is the sum of both kinds of noises?
    135 of those 150 times it was in the bedroom, you heard some other noise. So in approach 1 asking P(N|B), you're asking the probability of in the bedroom after only the cell phone noise, not some other noise. So how are the 135 instances of some other noise relevant? Why isnt the relevant stat for "in the bedroom given the cell phone noise" 15/20 even in approach 1?

  • @asjsingh
    @asjsingh Год назад

    Wow! That was an incredibly skillful and clear explanation of Bayesian stats. I had real trouble understanding it for the past year even after applying it in my work. This really spelled out what I was actually trying to do. Thank you!

  • @chenqu773
    @chenqu773 3 года назад +1

    I watched this 3 times. Finally, I think I got it !

  • @jakewhitworth3116
    @jakewhitworth3116 2 года назад

    So correct me if I’m wrong, Bayesian thinking is just taking the way you’d normally do conditional probability and just doing the inverse of that? My question makes me think I didn’t fully grasp the concept lol

  • @ivancarlson953
    @ivancarlson953 Год назад

    In Summary, the phone being in the bedroom is 3.00x more likely there is noise than the phone being in the study. The phone being in the bedroom is 9.00x more likely there is no noise than the phone being in the study. There is no noise is 1.20x more likely the phone being in the bedroom than there is noise. There is noise is 2.50x more likely the phone being in the study than there is no noise. There is noise given the phone being in the study is 2.50x more likely than there is noise given the phone being in the bedroom. There is no noise given the phone being in the bedroom is 1.20x more likely than there is no noise given the phone being in the study.
    Let’s say the prevalence or prior probabilities for the phone being in the bedroom is 88.24% (odds of 7.50x or chances of 100 for every 113), and for the phone being in the study is 11.76% (0.13x or 100 for every 850), whether or not there is noise. In a world of the phone being in the bedroom, 10.00% (0.11x or 100 for every 1000) is there is noise, let’s say, and 90.00% (9.00x or 100 for every 111) is there is no noise. In a world of the phone being in the study, 25.00% (0.33x or 100 for every 400) is there is noise, let’s say, and 75.00% (3.00x or 100 for every 133) is there is no noise. Thus, the phone being in the bedroom is 0.40x as likely there is noise as the phone being in the study. Also, the phone being in the bedroom is 1.20x as likely there is no noise as the phone being in the study. We know this as the Likelihood Ratio, Risk Ratio, or Bayes Factor.
    The prevalence of there is noise, or there is no noise, regardless of the phone being in the bedroom or the phone being in the study, is 11.76% (0.13x or 100 for every 850), and 88.24% (7.50x or 100 for every 113), respectively. Therefore, which is more likely? In a world of there is noise, the posterior probability of the phone being in the bedroom is 75.00% (3.00x or 100 for every 133), and the phone being in the study is 25.00% (0.33x or 100 for every 400). In a world of there is no noise, the posterior probability of the phone being in the bedroom is 90.00% (9.00x or 100 for every 111), and the phone being in the study is 10.00% (0.11x or 100 for every 1000). The probability of the phone being in the bedroom, and there is no noise is 79.41% (3.86x or 100 for every 126). The probability of the phone being in the study, and there is noise is 2.94% (0.03x or 100 for every 3400). The probability of the phone being in the study, and there is no noise is 8.82% (0.10x or 100 for every 1133).
    Sensitivity analysis:
    What would the prevalence or prior probabilities for the phone being in the bedroom, and the phone being in the study, whether or not there is noise, need to be such that in a world where the phone being in the bedroom given there is noise, and the phone being in the study given there is noise, that both these posterior probabilities are equally likely? In other words, we’d be indifferent? The prevalence of the phone being in the bedroom would need to be 71.43% (2.50x or 100 for every 140), and the phone being in the study would need to be 28.57% (0.40x or 100 for every 350), all else being equal. Similarly, what would the prevalence or prior probabilities for the phone being in the bedroom, and the phone being in the study, whether or not there is no noise, need to be such that in a world where the phone being in the bedroom given there is no noise, and the phone being in the study given there is no noise, that both these posterior probabilities are equally likely? In other words, we’d be indifferent? The prevalence of the phone being in the bedroom would need to be 45.45% (0.83x or 100 for every 220), and the phone being in the study would need to be 54.55% (1.20x or 100 for every 183), all else being equal.
    What would the consequent probabilities or likelihoods for there is noise given the phone being in the bedroom, and there is no noise given the phone being in the bedroom, need to be such that in a world where the phone being in the bedroom given there is noise, and the phone being in the study given there is noise, that both these posterior probabilities are equally likely? In other words, we’d be indifferent? The likelihood of there is noise given the phone being in the bedroom would need to be 3.33% (0.03x or 100 for every 3000), and there is no noise given the phone being in the bedroom would need to be 96.67% (29.00x or 100 for every 103), all else being equal. Similarly, what would the consequent probabilities or likelihoods for there is noise given the phone being in the study, and there is no noise given the phone being in the study, need to be such that in a world where the phone being in the bedroom given there is noise, and the phone being in the study given there is noise, that both these posterior probabilities are equally likely? In other words, we’d be indifferent? The likelihood of there is noise given the phone being in the study would need to be 75.00% (3.00x or 100 for every 133), and there is no noise given the phone being in the study would need to be 25.00% (0.33x or 100 for every 400), all else being equal.
    What would the consequent probabilities or likelihoods for there is noise given the phone being in the bedroom, and there is no noise given the phone being in the bedroom, need to be such that in a world where the phone being in the bedroom given there is no noise, and the phone being in the study given there is no noise, that both these posterior probabilities are equally likely? In other words, we’d be indifferent? The likelihood of there is noise given the phone being in the bedroom would need to be 90.00% (9.00x or 100 for every 111), and there is no noise given the phone being in the bedroom would need to be 10.00% (0.11x or 100 for every 1000), all else being equal.

  • @rajavelks6861
    @rajavelks6861 Год назад

    Thanks Ritvik.
    Rajavel KS
    Bengaluru

  • @johnhausmann2391
    @johnhausmann2391 Год назад

    This example is somewhat confusing. If I know it's in the apartment, then I would just check the place where it's most likely based on P(B) vs P(S). Why would I go through the extra step of calling my phone?

  • @roopanjalijasrotia3946
    @roopanjalijasrotia3946 Год назад

    You da best!!

  • @ChocolateMilkCultLeader
    @ChocolateMilkCultLeader 2 года назад

    Do you have any social media. Your videos on Bayesian statistics are amazing, and would love to share them with my network

  • @lamduongtung8783
    @lamduongtung8783 3 года назад +1

    awesomeeeee

  • @fgdf1072
    @fgdf1072 2 года назад

    is approach 1 could be regarded as kind of frequentist method?

  • @dharmatycoon
    @dharmatycoon 6 месяцев назад

    I'm so confused as to how he can calculate that P(B|N) = 15/20 = 0.75, whilst with Bayes theorem he calculates that P(B|N) = 0.88/P(N).. Wouldn't that give us P(B|N) = 0.88/20 = 0.04?? That's a totally different number from 0.75!

  • @rosierui8119
    @rosierui8119 3 года назад +1

    i'm your biggest fan in Shanghai!!

    • @momodoubjallow2585
      @momodoubjallow2585 3 года назад

      Are you sure I watch his videos more in Guangzhou. :)

    • @ritvikmath
      @ritvikmath  3 года назад

      Well, a big thanks to both of you haha :)

    • @momodoubjallow2585
      @momodoubjallow2585 3 года назад

      @@ritvikmath you are welcome and keep the great work going!!!

  • @shravone3036
    @shravone3036 3 года назад

    This was awsome!

  • @ramankutty1245
    @ramankutty1245 3 года назад

    Very good

  • @yarenlerler67
    @yarenlerler67 Год назад

    Vaov!

  • @blvck265
    @blvck265 2 года назад

    So Bayesian would work really well in cases where you have lots of data on already occurred past events, go to know! Now learn how to apply it lol.

  • @robertwest6244
    @robertwest6244 3 года назад +1

    I think Bayesian methods receive too much criticism. All analyses can be used with really uninformative prior distributions that don’t take analyst bias into account

  • @aishkhan7433
    @aishkhan7433 3 года назад +1

    What's your insta or fb account?