Support StatQuest by buying my books The StatQuest Illustrated Guide to Machine Learning, The StatQuest Illustrated Guide to Neural Networks and AI, or a Study Guide or Merch!!! statquest.org/statquest-store/
I just want to tell you how much I appreciate your videos. I am a 74 year old retiree living in Singapore doing time series analysis of financial markets data using NumXL software. For the first time, I understand Maximum Likelihood Estimation. I have signed on as a Member and hope to learn more by watching your unique so-clearly-explained videos. Thanks again.
@@vishalthakran1743 Nah, the one who rests, rusts. You need to keep going and stay stimulated with something fun, instead of just resting all day for the rest of your life. My maternal grandma became a volunteer castle tour guide in her late 70s/early 80s. My paternal grandpa learnt a whole new language because they moved to my paternal grandma's mum's country of origin for retirement. My paternal grandparents visit a technology class every week to keep with the times. The only one who has dementia now and is deteriorating fast is my maternal grandpa. He is the only monolingual of my grandparents and barely had hobbies (pretty much just gardening) after he retired. So he rested, and now he's rusting. My grandparents are btw between 1 and 3 years before 90. So this guy has plenty of time left to live his life and learn.
Sometimes I think professors make it extra hard for their students at University by explaining simple things as complicated as possible.Luckily there are guys like Joshua. Great video!
It is because I paid several thousand USD for my masters but still felt my education was outdated, that I still come and watch youtube for more ( to sort of recover my investment)
From all statistics courses I've taken so far, I've never heard about the difference between likelihood and probability. As we can expect from any StatQuest, it was clearly explained. Thank you Josh, cheers from Hungary!
I just want to express how much I appreciate your videos. I’m an 84-year-old retiree diving into the fascinating world of string theory. For the first time, concepts that once seemed incomprehensible are starting to make sense thanks to your clear and unique explanations. Your teaching style is truly a gift, and I’m excited to keep learning more through your incredible content. Thank you!
I am doing my Masters in Informatics right now and I feel bad I didn't find you during my Bachelors lol would have cleared so many concepts years ago but better late than never God bless you dude lovely precise explanations to brush up on things and understand them.
I'm doing a PhD in Economics, and we learnt Maximum Likelihood with a lot of math formalisations. But then your short and simple video is exactly what I need to get the intuition behind everything. Thank you so much!
the intro made my day man.I have a shit tone of assignments and i am low on time so really that little guitar gig made me smile.Also great work on the explanations.KEEP it up!!
This video has helped distressed students who are awake at night all around the world for over 3 years .... and counting. Joshua can make a religion for students & grad students and it will become a major religion in no time. I mean, he's literally "Joshua". The Holy Book will be named "StatQuest".....
you deserve an oscar. i have been struggling for years to understand this thing. and you came from nowhere and explained it in such an easy and beautiful way. i really think you.
Wow! You litterly nailed it first sentence. 'Why' seems to be the most difficult question to ever face statisticians. I've read an entire textbook and still been unable to grasp, Why at an intuitive level. " it's the optimal way to fit a distribution to your data" job done. Thankyou so much.
I loved this. You have no idea how I needed this. We just started this chapter this week and just knowing what it is that I'm trying to do is really calming. Now I can listen with understanding.
If not a teacher, you could very easily be an awesome songwriter and singer! But, as the luck would have it, you blessed us with the best statistics videos instead :D Thanks Josh for such clear explanation :)
Bro wtf this is the revolutionary. This is amazing. Thank you for sharing your knowledge. You made something so clear in six minutes. I am deeply impressed. May fortune be with you.
I sat through a 3 hour stats lecture earlier today and had no idea what he was talking about. Thanks to your 6min video actually learned something about likelihood functions today (and it turned out to be so straight forward too). Thanks.
Such amazing timing! One of my mathematically inclined friends just told me that we could use maximum likelihood to determine how many times I had to conduct an experiment to produce a statistically significant result, but I had no idea what she was talking about till I saw this!
You saved my life, best plug in principle explanation I've ever watched. I need this to solve a best estimator problem for some probability density function.
I've got a few examples of how to use MLE to estimate the best parameters. Here's an example for the exponential distribution: ruclips.net/video/p3T-_LMrvBc/видео.html and here's an example for the normal distribution: ruclips.net/video/Dn6b9fCIUpM/видео.html
Sir Josh, you have no idea how helpful your explanations are in your videos. Waaay better and clearer than available statistics textbooks and lecturers. I am wondering if you can make other videos regarding difference between maximum likelihood vs penalized likelihood and the application of penalized likelihood in Firth's Logistic Regression (as well as its interpretation). I encounter a quasi-separation problem after running binary logistic regression while the sample size is not that small (~1800). Any thoughts will be highly appreciated. Best regards
I don't know how to thank you but this explanation really helps me understand what I'm reading elsewhere. I really appreciate the work and thought you put into teaching us an intuitive approach.
Every time I listen to the intro I can imagine Phoebe singing it. Thanks for the explanation, your channel is the best I found about statistics on youtube and it's helping me analyse results for my thesis
Intuitive way of teaching yields better understanding than the so called “robustness “……Make concepts intuitive to me in simple terms and robustness will be nothing but mere usage of dense notations. God bless you StatQuest!
So in essence the type of distribution is determined by Goodness of Fit and the parameters of distribution are determined by Maximum Likelihood. Thank you professor.
Mr. Starmer, may I request for a video on MAP (maximum a posteriori) inference? Subsequently, a comparison of MLE vs MAP will also be extremely helpful
Thank you a lot! I'm passing an online course on statistics that has NONE simple graphical representation of terms and teacher always looks at his papers. This sucks. But at least it has some structure on the subject.
You make the best videos on statistics. Thank you so much! After your videos I would like to study statistics and data analysis further and further! )))))LOL! And I'm 35 years old woman, and just trying to figure out a few concepts for an IRT course. Very interesting and thank you very much for your genius work!
Great explanation. However, from watching to doing is still a big step. I can recommend everyone to also do the calculus, really getting numbers. Maybe for a uniform distribution, having no difficult formulas, like the "normal" distribution has.
I've got a few examples of the calculus in action for the binomial distribution: ruclips.net/video/4KKV9yZCoM4/видео.html for the exponential distribution: ruclips.net/video/p3T-_LMrvBc/видео.html and the normal distribution (this one is long since the math is messy): ruclips.net/video/Dn6b9fCIUpM/видео.html
I would be really careful. Weight isn't a federally protected characteristic but we're getting there. I wouldn't joke about anything that alludes to demographical features of humans and/or their sensitivity about it (which is what "big boned" means-- euphemism for fat bc people are embarrassed to say they're fat) in academia. No one's going to care in a math dept / conference but if it's mixed field with undergrads there? Ehhhh.
In 3:33 and forward, in each step we calculate the product operator for all gaussian functions taking the data as input. The resulted product with the highest value will indicate which gaussian function to choose. am I wrong?
I believe you are correct. At the first step, we have a gaussian function on the far left side of the screen - and to calculate the likelihood of that specific function (with the mean over on the left side), we calculate the product of the likelihood of that function given the first datapoint times the likelihood of that function given the second data point times the likelihood of that function given the third data point, etc. Then we shift the distribution to the right a little bit and calculate the same product using the new mean, etc. Until we find the mean that results in the largest product.
Did you intentionally obfuscate this comment with the use of the word obfuscate? I think the answer to your question is the question itself. 1. You knew the word and understood and hence assumed that everyone else would. (The professors might do the same with the formulae.) 2. You just wanted to show off your vocabulary (The professors are human too.) Haha, just a thought, I know what you mean though. Cheers, Ani,
So weird. My textbook says nothing about MLE being the mean of the distribution. Why can't the authors just be clear and direct instead of making us read between the lines and figure out what they mean.
Joshua Starmer absolutely! Going through my books and R scripts can be quite dry and you videos provide another view onto certain topics. They are great!
Subscribed! I’m so glad I found this channel. I struggled with stats throughout college. To the point that I gave up on the field and avoided it as much as I could. Watch out statisticians. I’m back with “vengeance” to devour this field. :-) Seriously! Thanks for putting these videos together. Highly informative.
I don't really understand why we we need MLE for mean which is similar to average. In-terms of standard deviation, it is also almost similar to the normal sd calculation.
I feel like professors don't do a great job at bridging the gap between theory and practice especially in the later upper division stats classes so I end up knowing how to calculate things but I have trouble understanding why. That's why I love this video. Thank you!
Support StatQuest by buying my books The StatQuest Illustrated Guide to Machine Learning, The StatQuest Illustrated Guide to Neural Networks and AI, or a Study Guide or Merch!!! statquest.org/statquest-store/
I just want to tell you how much I appreciate your videos. I am a 74 year old retiree living in Singapore doing time series analysis of financial markets data using NumXL software. For the first time, I understand Maximum Likelihood Estimation. I have signed on as a Member and hope to learn more by watching your unique so-clearly-explained videos. Thanks again.
Wow! Thank you very much for your support!!!
bro,you just need to chill at that age!!!!
@@vishalthakran1743 Nah, the one who rests, rusts. You need to keep going and stay stimulated with something fun, instead of just resting all day for the rest of your life.
My maternal grandma became a volunteer castle tour guide in her late 70s/early 80s. My paternal grandpa learnt a whole new language because they moved to my paternal grandma's mum's country of origin for retirement. My paternal grandparents visit a technology class every week to keep with the times.
The only one who has dementia now and is deteriorating fast is my maternal grandpa. He is the only monolingual of my grandparents and barely had hobbies (pretty much just gardening) after he retired. So he rested, and now he's rusting.
My grandparents are btw between 1 and 3 years before 90. So this guy has plenty of time left to live his life and learn.
Sometimes I think professors make it extra hard for their students at University by explaining simple things as complicated as possible.Luckily there are guys like Joshua. Great video!
Kevin H. I couldn't agree more. Thanks Stat-Quest!
The untold secret to civilization (a lecture): ruclips.net/video/8PQ4svtAfmI/видео.html
I have always said I think the 'community' tries to remain as small and closed as possible by making it hard for people to understand.
They themselves do not understand
@@Ewuraa_D I also think so
It is just ridiculous.
I paid several thousands USD to my college and end up at getting better education in youtube.
I'm glad to hear this video helped you out! :)
But some companies are asking for certifications...damn
It is because I paid several thousand USD for my masters but still felt my education was outdated, that I still come and watch youtube for more ( to sort of recover my investment)
no kidding... same here!
Getting to college makes me appreciate more of the internet resource.
From all statistics courses I've taken so far, I've never heard about the difference between likelihood and probability. As we can expect from any StatQuest, it was clearly explained. Thank you Josh, cheers from Hungary!
If you can explain a concept with simple tools, it means you really understand it well, else you are just memorizing !
You are doing a great job !
Noted
I just want to express how much I appreciate your videos. I’m an 84-year-old retiree diving into the fascinating world of string theory. For the first time, concepts that once seemed incomprehensible are starting to make sense thanks to your clear and unique explanations. Your teaching style is truly a gift, and I’m excited to keep learning more through your incredible content. Thank you!
Thank you very much! :)
I am doing my Masters in Informatics right now and I feel bad I didn't find you during my Bachelors lol would have cleared so many concepts years ago but better late than never God bless you dude lovely precise explanations to brush up on things and understand them.
Thanks!
I'm doing a PhD in Economics, and we learnt Maximum Likelihood with a lot of math formalisations. But then your short and simple video is exactly what I need to get the intuition behind everything. Thank you so much!
Glad it was helpful!
the intro made my day man.I have a shit tone of assignments and i am low on time so really that little guitar gig made me smile.Also great work on the explanations.KEEP it up!!
Thanks and good luck with your assignments. :)
Whenever I get confused reading Statistics books, I come here. Thanks!
Happy to help!
Best teacher in the world! Even English is my second language, I can understand you easily.
Hooray! :)
This video has helped distressed students who are awake at night all around the world for over 3 years .... and counting. Joshua can make a religion for students & grad students and it will become a major religion in no time. I mean, he's literally "Joshua". The Holy Book will be named "StatQuest".....
:)
You have made statistics so much better and easy for people like me (who have been avoiding it for so long) , Thankyou ❤
You’re welcome 😊
You're a statistical outlier when it comes to teaching! Above 100 SDs on the scale of teaching goodness :)
I love this! Thank you.
Agreed. It's almost as if college stats professors have some kind of coalition for teaching badly, and somehow Josh wasn't invited.
I literally applied to UNC because of him
you deserve an oscar. i have been struggling for years to understand this thing. and you came from nowhere and explained it in such an easy and beautiful way. i really think you.
I wish I saw your video 10 years ago during graduate school. I finally understand the maximum likelihood! THANK YOU!
Better late than never! :)
The "Large-Boned" was priceless. Well done.
Hooray! :)
The distribution is bulking
no doubt some people will think that's the actual term for it and will write "large boned" in their coursework lol
🤣🤣🤣🤣
I totally thought I was misreading it and assumed it was “large bound” before taking my glance off of it… holy shit he actually said it
The enthusiasm in the video makes the learning experience more motivating!
Thanks! :)
Wow! You litterly nailed it first sentence. 'Why' seems to be the most difficult question to ever face statisticians. I've read an entire textbook and still been unable to grasp, Why at an intuitive level. " it's the optimal way to fit a distribution to your data" job done. Thankyou so much.
Thank you! :)
I spent the whole day trying to understand this. Its just now that i found your video on youtube. GOD BLESS YOU. You are greaaattttttttttt.
Hooray! :)
I loved this. You have no idea how I needed this. We just started this chapter this week and just knowing what it is that I'm trying to do is really calming. Now I can listen with understanding.
Thanks!
If not a teacher, you could very easily be an awesome songwriter and singer! But, as the luck would have it, you blessed us with the best statistics videos instead :D Thanks Josh for such clear explanation :)
Thanks!
Bro wtf this is the revolutionary. This is amazing. Thank you for sharing your knowledge. You made something so clear in six minutes. I am deeply impressed. May fortune be with you.
Thank you!
Every time I see a video here, it makes me fall in love with statistics a little more...❤️
Wow, thank you!
I've been looking for a straightforward approach to explaining this concept - you've provided the perfect blueprint. Thanks!
Thanks!
WOW! it was literally the best explanation of MLE I've ever seen! Well done!
Wow, thank you!
I sat through a 3 hour stats lecture earlier today and had no idea what he was talking about. Thanks to your 6min video actually learned something about likelihood functions today (and it turned out to be so straight forward too). Thanks.
Excellent video....loved the way you explained it. FINALLY!!!!! I understood what MLE actually means. Great work Josh! :)
Hooray! :)
Gold content. Can't find anyone on RUclips really try to explain the phrase "maximum likelihood". Thank you so much!
This is so refreshing. I just had to take these things as 'given' in my econometric course.
I'm glad my videos are helpful! :)
Such amazing timing! One of my mathematically inclined friends just told me that we could use maximum likelihood to determine how many times I had to conduct an experiment to produce a statistically significant result, but I had no idea what she was talking about till I saw this!
There could not have been a better explanation of this topic.
Thank you!!!
First time on your channel, the intro had me questioning what I was doing. I am eternally thankful I stayed until the end! Cheers mate, great content.
Thanks! :)
I think you're the king in machine learning and statistics on RUclips. Could you please make a playlist for deep learning as well ?
I'm going to make deep learning videos in the next few months.
MLE is a crucial concept for machine learning. Thank you so much for this nice explanation!
Thanks!
Very intuitive. Phenomenal explanation, Mr. StatQuest :)
Glad you think so!
Thanks statquest, grad student here and this was clearer than what I get currently at school.
Hooray!!! :)
Wow, The simplest explanation I've seen.
You saved my life, best plug in principle explanation I've ever watched. I need this to solve a best estimator problem for some probability density function.
I've got a few examples of how to use MLE to estimate the best parameters. Here's an example for the exponential distribution: ruclips.net/video/p3T-_LMrvBc/видео.html and here's an example for the normal distribution: ruclips.net/video/Dn6b9fCIUpM/видео.html
Sir Josh, you have no idea how helpful your explanations are in your videos. Waaay better and clearer than available statistics textbooks and lecturers. I am wondering if you can make other videos regarding difference between maximum likelihood vs penalized likelihood and the application of penalized likelihood in Firth's Logistic Regression (as well as its interpretation). I encounter a quasi-separation problem after running binary logistic regression while the sample size is not that small (~1800). Any thoughts will be highly appreciated. Best regards
Thank you so much for explaining this concept so easily. You are a true blessing.
Thanks!
I'm doing a masters degree and yet youtube is a better teacher
Thank you! :)
I don't know how to thank you but this explanation really helps me understand what I'm reading elsewhere. I really appreciate the work and thought you put into teaching us an intuitive approach.
You're welcome! I'm so happy to hear that the video was helpful for your understanding.
Every time I listen to the intro I can imagine Phoebe singing it. Thanks for the explanation, your channel is the best I found about statistics on youtube and it's helping me analyse results for my thesis
Awesome! If this intro song reminds you of Phoebe, check out this one: ruclips.net/video/D0efHEJsfHo/видео.html
Intuitive way of teaching yields better understanding than the so called “robustness “……Make concepts intuitive to me in simple terms and robustness will be nothing but mere usage of dense notations. God bless you StatQuest!
Thank you very much! :)
Finally clicked for me after years of trying to figure this stuff out.
Hooray!!! :)
Same case Adam, that's great!
The best statistic tutorials from youtube. Thank you
Wow, thanks!
Excellent.
4:53 BAM!
I am to see your effort of this platform &an excellent videos , please can you show me how R software to teaCh these statistical inference theories
So in essence the type of distribution is determined by Goodness of Fit and the parameters of distribution are determined by Maximum Likelihood.
Thank you professor.
"clearly explained" is actually clearly true. Thanks a lot sir
Thanks and welcome!
No words to say 😊how easily you explained everything 🤠🤩
Thanks!
Thank you, very clearly. It was a good recommendation in a virtual class about Maths for Data Science, greetings from Peru
Muchas gracias!
How the hell did I not know you before ? Excellent video. Kudos man.
Thanks! :)
this is the greatest explanations that I found in all google search great job Josh
Thanks!
Simple and clear, as it should have always been! Thanks ALOT!
Thanks! :)
The best explanation of MLE I've ever seen!
Thank you!
When you say "probability or likelihood" you effectively make these terms mean the same thing, while the whole point is that they are different.
Thank you so much Joshua for this uniquely-explained video!!!
Thank you!
Mr. Starmer, may I request for a video on MAP (maximum a posteriori) inference? Subsequently, a comparison of MLE vs MAP will also be extremely helpful
needed a refresher on the concept, was rewarded with the jam... still crushing.
bam!
Thank you a lot!
I'm passing an online course on statistics that has NONE simple graphical representation of terms and teacher always looks at his papers. This sucks. But at least it has some structure on the subject.
Hooray! I'm glad the video is helpful. :)
Same with me. My course is on Bayesian statistics. The instructor foolishly copies from his notes by looking down all the time.
I guess they're right...if you cannot explain it simply, you don't understand it well enough. Thank you for this video!
You're welcome!
'large boned' HAHAHAHA this guy sounds 5% sarcastic at all times i love it
:)
I had finals tomorrow. You're a lifesaver!
Good luck!
@@statquest thanks. New subs here.
@@hmingthanavanchhawng9993 BAM!
Wonderful video!!
and I spent a lot of time to understand a "silly" formula when it would be enough to see your beautiful video :)
Thanks! I'm glad it was helpful. :)
You make the best videos on statistics. Thank you so much! After your videos I would like to study statistics and data analysis further and further! )))))LOL! And I'm 35 years old woman, and just trying to figure out a few concepts for an IRT course. Very interesting and thank you very much for your genius work!
Great explanation. However, from watching to doing is still a big step. I can recommend everyone to also do the calculus, really getting numbers. Maybe for a uniform distribution, having no difficult formulas, like the "normal" distribution has.
I've got a few examples of the calculus in action for the binomial distribution: ruclips.net/video/4KKV9yZCoM4/видео.html for the exponential distribution: ruclips.net/video/p3T-_LMrvBc/видео.html and the normal distribution (this one is long since the math is messy): ruclips.net/video/Dn6b9fCIUpM/видео.html
That's great. Nicely goes to the deep. That was smooth.
Thanks!
Best thing i found for this week, so clear to understand - lots of appreciation for your lecture.
Thank you! :)
ABSOLUTELY ASTOUNDED BY THE WAY YOU TAUGHT ME THIS. thank yaaaa
Thanks! :)
Video starts at 0:30 :D
There are actually a lot of explanations of likelihood, but this one gives the best presentation.
Thanks!
@@statquest My pleasure.
I can’t wait to present at a conference and use “large boned” without giggling
That will be a funny day. :)
I would be really careful. Weight isn't a federally protected characteristic but we're getting there. I wouldn't joke about anything that alludes to demographical features of humans and/or their sensitivity about it (which is what "big boned" means-- euphemism for fat bc people are embarrassed to say they're fat) in academia. No one's going to care in a math dept / conference but if it's mixed field with undergrads there? Ehhhh.
S. E. Z thank you for pointing that out I wouldn’t use big boned, I was just kidding. Loll
LOVE THE WAY YOU EXPLAINING THE CONCEPT
Thank you! :)
I'm just here for the song intros.
Awesome! :)
Best explanation for maximum likelihood ever! Thanks so much
Thank you! :)
You saved me, from the terrible explanation of my teacher.
Bam! :)
I really enjoyed your terminology alert! Good catch!
Thank you very much! :)
In 3:33 and forward, in each step we calculate the product operator for all gaussian functions taking the data as input. The resulted product with the highest value will indicate which gaussian function to choose. am I wrong?
I believe you are correct. At the first step, we have a gaussian function on the far left side of the screen - and to calculate the likelihood of that specific function (with the mean over on the left side), we calculate the product of the likelihood of that function given the first datapoint times the likelihood of that function given the second data point times the likelihood of that function given the third data point, etc. Then we shift the distribution to the right a little bit and calculate the same product using the new mean, etc. Until we find the mean that results in the largest product.
StatQuest with Josh Starmer Thank you very much.
Hooray! :)
best explanation of this topic that I have found so far
Woah! Do they intentionally obfuscate this knowledge with all those formulae?
That is a great question! It's not nearly as complicated as a lot of people make it seem.
yes
Did you intentionally obfuscate this comment with the use of the word obfuscate? I think the answer to your question is the question itself.
1. You knew the word and understood and hence assumed that everyone else would. (The professors might do the same with the formulae.)
2. You just wanted to show off your vocabulary (The professors are human too.)
Haha, just a thought, I know what you mean though.
Cheers,
Ani,
So weird. My textbook says nothing about MLE being the mean of the distribution. Why can't the authors just be clear and direct instead of making us read between the lines and figure out what they mean.
Hey I have watched this several times for the content... thank you... and then several more for the opening song
BAM! :)
I just tune in for the intro ;)
Joshua Starmer And you're doing awesome. You videos have already helped me a lot with my work!
Joshua Starmer absolutely! Going through my books and R scripts can be quite dry and you videos provide another view onto certain topics. They are great!
The way u explained was really unique and easy to catch👍👍
Thanks a lot 😊!
"or large boned"
yessssssss! :)
Subscribed!
I’m so glad I found this channel.
I struggled with stats throughout college. To the point that I gave up on the field and avoided it as much as I could.
Watch out statisticians. I’m back with “vengeance” to devour this field. :-)
Seriously!
Thanks for putting these videos together. Highly informative.
Awesome!!!!
What is the probability distribution of people who like the weird ass intro song the statQuest videos start with? It's distributed by Uniform(0,0).
Dang....
Thanks for the video, it helped me study for my statisticts exam
Thanks! I hope you did well on your exam! :)
*Large Boned*
This is goldmine. Wish i had struck it earlier , nevertheless better late than nayver.. Tons and tons of thanks. Josh🙏🙏🙏
Glad you enjoyed it!
Very clearly explained, but man, the little intro songs are cringey
:)
Maximum Likelihood is pretty hard , but you explain it very clearly and easy
Thank you so much! :)
i swear you make it so much easier than those professors u beeast
Thanks!
Thanks man, this video is absolutely legendary! :D
Glad you liked it!
amazing, this is best explaining video on maximum likelihood estimation i ever seem
Thank you! :)
I don't really understand why we we need MLE for mean which is similar to average. In-terms of standard deviation, it is also almost similar to the normal sd calculation.
Love you Josh! This is how concepts should be taught
Thank you so much!! :)
Ngl, i thought he was gonna sing throughout the whole explanation and i was all up for it
BAM! :)
I feel like professors don't do a great job at bridging the gap between theory and practice especially in the later upper division stats classes so I end up knowing how to calculate things but I have trouble understanding why. That's why I love this video. Thank you!
Hooray!! I'm glad the video was helpful. :)
thank you this helped giving me context and background as to what this is lol
bam!