Calculating Power and the Probability of a Type II Error (A One-Tailed Example)

Поделиться
HTML-код
  • Опубликовано: 31 янв 2013
  • An example of calculating power and the probability of a Type II error (beta), in the context of a Z test for one mean. Much of the underlying logic holds for other types of tests as well.
    If you are looking for an example involving a two-tailed test, I have a video with an example of calculating power and the probability of a Type II error for a two-tailed Z test at • Calculating Power and ... .

Комментарии • 313

  • @ofoproductions7257
    @ofoproductions7257 7 лет назад +241

    You taught me in 5 minutes what my stats lecturer couldn't make me understand in 2 years of doing power. Legend

    • @jbstatistics
      @jbstatistics  7 лет назад +23

      I do my best, and I'm glad to be of help!

    • @theodor320
      @theodor320 5 лет назад +2

      I got to agree! We got this obfuscated definition of the theta-power-function - it's great for plug-and-calculate, don't get me wrong, but I didn't get what was going on at all.

    • @GirishKumar-xs8on
      @GirishKumar-xs8on 3 года назад +4

      @@jbstatistics I read too much on internet and also followed Montgomery book to understand how alpha and beta are inversely related to each other, but didn't understand and visualize it. You explained the things in awesome way. The world requires people like you to teach the concept instead of book worm definition. Hats off man, you did amazing job.

  • @gfhfhgfhgf8117
    @gfhfhgfhgf8117 9 лет назад +83

    Thank you so much. Don't know why hardly anyone can explain type 1 and 2 errors so that it makes any sense. You did it very well... thank you again!!

    • @jbstatistics
      @jbstatistics  9 лет назад +10

      frfrffrfrfrrffrfrfxsvcxv You are very welcome!

  • @michaelcmccall
    @michaelcmccall 4 года назад +6

    I'm a high school AP stats teacher, and your video is simply terrific. Was looking for something to share with my kids, who find errors and power to be mind bending. This is it! Thanks!

  • @jonathanramirez5463
    @jonathanramirez5463 3 года назад

    Many years later and your videos were amazing to follow along to.
    Thank you so much!

  • @MashrufKabir
    @MashrufKabir 9 лет назад +17

    Amazing, and crystal-clear explaining. You've got decent teaching skills dude.

  • @KrspySauce
    @KrspySauce 10 лет назад +1

    You are seriously my hero for today. I was so confused on this topic until I watched just two of your videos. Everything makes much more sense now. Thank you so much JB.

  • @jbstatistics
    @jbstatistics  11 лет назад +3

    I don't do a two-tailed example for a couple of reasons. But the logic is very similar to that used in this video. The difference is that you will have two rejection regions, so you will need to find two tail areas (one will be small), and add these areas.

  • @JawadLion
    @JawadLion 5 лет назад

    Published in 2013 and yet this triumphs over other videos relating to this subject! As a visual learner, this was incredibly useful. Thank you!

  • @jbstatistics
    @jbstatistics  11 лет назад +1

    You are very welcome Yubaraj! I'm glad you found this video helpful. Cheers.

  • @jack000pumpkin
    @jack000pumpkin 7 лет назад +1

    Best explanation on Type II error and Power i've ever seen. Just brilliant. Thanks.

    • @jbstatistics
      @jbstatistics  7 лет назад

      Thanks so much for the kind words! I'm glad I could be of help.

  • @James08091980
    @James08091980 4 года назад

    These are by far the best stats videos. Well done

  • @insidewantsout135
    @insidewantsout135 6 лет назад

    The graph helped tremendously. I was staring at a homework question for over 30 minutes now but figure it out since the professor never cared to explain. Thanks so much!!

  • @jbstatistics
    @jbstatistics  10 лет назад +2

    You are very welcome Ben! I'm glad to be of help. Cheers.

  • @storiesshubham4145
    @storiesshubham4145 2 года назад

    Was pondering for a long time how to visualise the power of a test....best explanation really 💥💥

  • @Arsenalappleftw
    @Arsenalappleftw 10 лет назад +13

    This was brilliantly explained! Why can't you be my teacher? Thank you so much for a great job!

    • @jbstatistics
      @jbstatistics  10 лет назад +4

      You are very welcome Gustav. Thanks for the compliment!

    • @udriss1
      @udriss1 2 года назад

      Thanks to the internet and these great videos, @jbstatistics is teacher in the entire world.

  • @nicholastolbert4207
    @nicholastolbert4207 7 лет назад +1

    I don't think I would have finished my stats homework tonight if it weren't for you. Thank you for the excellent video.

  • @maxmacfarlane9890
    @maxmacfarlane9890 6 лет назад

    Your videos are always so informative. Thank you so much!

  • @jbstatistics
    @jbstatistics  11 лет назад +1

    To find the power you need to find two areas (corresponding to the two tails) and add them. One area (the one on the opposite side of the true value of mu) will be small. The other area (the one on the same side as the true value of mu) will be bigger. I know people struggle with this sometimes, so I'll get a video up at some point (but probably not soon enough for your purposes). Cheers.

  • @prakashchandrakandel
    @prakashchandrakandel 2 года назад

    You are more effective than my Professor when it comes to teaching Statistics. Please upload more videos on ANOVA and regression.

  • @VritanshKamal
    @VritanshKamal Год назад

    This is one of the best videos on the internet. This is the way it should be taught in every school. Thanks a ton!

    • @jbstatistics
      @jbstatistics  Год назад +1

      Thanks for the kind words! Happy to be of help!

  • @laurennnturnerr
    @laurennnturnerr 7 лет назад +1

    You have saved my life so many times this semester, thank you :D

  • @danishk44
    @danishk44 3 года назад +1

    That gap you take while speaking is very good sir. We get time to understand.

  • @IbrahimKoyratty-es1cd
    @IbrahimKoyratty-es1cd 2 месяца назад

    Absolute legend
    You taught me in 11min what my lecture could not taught in 3 months xD
    Thank You!

  • @zackorycramer2798
    @zackorycramer2798 6 лет назад +1

    It's amazing how these youtubers can give lessons better than my stats teacher.😀 Kudos to you man. 👍🏻

  • @jlfa
    @jlfa 5 дней назад

    This video is absolutely precious. Couldn't be clearer.

  • @VanillaCookie08
    @VanillaCookie08 10 лет назад

    Very clear explanation. Helped me understand this topic when my textbook was absolutely useless. Thank you!

  • @zenapsgas
    @zenapsgas 7 лет назад +2

    Thank you so much for your nice videos! What software and equipment are you using? Considering doing something similar in courses I take, and I find your way of explaining very easy to understand and follow.

  • @jbstatistics
    @jbstatistics  11 лет назад +1

    I'm up in Canada (in Guelph -- near Toronto), but consider this a virtual handshake. I'm glad to be of help.

  • @jbstatistics
    @jbstatistics  11 лет назад

    You're welcome, and thanks for the compliment!

  • @yukihanatan
    @yukihanatan 10 лет назад +1

    Thank you so much, I love the pacing of this video, and it totally cleared me up on calculations for power before my ap exam!!!

    • @jbstatistics
      @jbstatistics  10 лет назад

      You are very welcome. Best of luck on your exam!

  • @jvmonteirof2781
    @jvmonteirof2781 8 месяцев назад

    why do I pay to go to college. I always end up having to learn through youtube videos like this one. this video is EXCELLENT. thank you so much for saving me and thousands of students.

  • @jbstatistics
    @jbstatistics  11 лет назад

    You are welcome. I'm happy to help.

  • @jbstatistics
    @jbstatistics  11 лет назад

    I'm glad to be of help. Best of luck on your test.

  • @lol-wd5cw
    @lol-wd5cw 4 года назад +1

    This is such a good explanation. Thank you sir.

  • @jbstatistics
    @jbstatistics  11 лет назад +1

    You're very welcome Pasang. Cheers.

  • @eastliu3277
    @eastliu3277 8 лет назад +1

    你是我听过的讲的最好的!(you are the best ever i heared of.)

    • @jbstatistics
      @jbstatistics  8 лет назад +1

      +East Liu 谢谢

    • @zhenli6450
      @zhenli6450 8 лет назад

      +jbstatistics Omg, did you google translate this?

    • @jbstatistics
      @jbstatistics  8 лет назад

      +Zhen Li Yes. I hope I didn't say something offensive :)

    • @zhenli6450
      @zhenli6450 8 лет назад

      Not at all. I was just surprised :)

  • @southsun1149
    @southsun1149 2 года назад

    You very clearly explained the Power and the probability of a Type II error.

  • @vipulkhandelwal220
    @vipulkhandelwal220 4 года назад

    The way you taught this is really great

  • @eylemseale9997
    @eylemseale9997 7 лет назад

    Thank you so much for this great explanation of Type II error and its calculation. I have not understood it before I watched this video.

  • @Le0Fender
    @Le0Fender 11 лет назад

    You are saving lives here, mate, thank you!

  • @jbstatistics
    @jbstatistics  11 лет назад

    You are welcome! I'm glad to be of help.

  • @hopefullysoonaweldingengineer
    @hopefullysoonaweldingengineer Месяц назад

    So in order to calculate type two error first we assume what the real value is then set up the new condition around it.. It was very simple with thinking like that. Thank you for video upen upped my horizon.

  • @jasoncao9607
    @jasoncao9607 10 лет назад

    Great video. I finally figured out how to calculate type 2 error as well as power. Thank you!

    • @jbstatistics
      @jbstatistics  10 лет назад

      Thanks Cao! I'm glad you found this video helpful!

  • @jbstatistics
    @jbstatistics  11 лет назад

    It's the area to the right of 0.66 under the standard normal curve, which can be found using software or a standard normal table.

  • @Saraazinkabul
    @Saraazinkabul 7 лет назад

    Thank you! Have you published any other video on "choosing the right sample size for testing mu"?

  • @jonesz31
    @jonesz31 10 лет назад +1

    You just saved my ass on this test. I owe you one

  • @middleclassseabass7178
    @middleclassseabass7178 10 лет назад

    This explains things much better than my professor, thanks.

  • @erica_wu
    @erica_wu 5 лет назад

    thank you so much for explaining it so well!! i was so confused before, hope to do well on my test tomorrow :))

    • @jbstatistics
      @jbstatistics  5 лет назад

      You are very welcome. I hope your test went well!

  • @HasanAlMasri
    @HasanAlMasri 10 месяцев назад

    Saved my soul with this video! Thanks

  • @micahsnow346
    @micahsnow346 5 лет назад +3

    I feel like such a stats wizard now, thank you so much!

    • @tgdhsuk3589
      @tgdhsuk3589 5 лет назад

      i know right? it makes so much sense

  • @ElwinderSingh
    @ElwinderSingh 11 лет назад

    Hello thank you for your video, I was just wondering if the alternative hypothesis is greater (the opposite of the example you just used) does that mean that the the test statistic calculation we get is a type two error?

  • @georgeogdon1268
    @georgeogdon1268 9 лет назад

    this is such a clear and lucid explanation of a potentially thorny topic. Kudos jbstatistics! Im using you a lot to complement and in lieu of my textbook when the textbook , sadly, fails me in terms of the required clarity and simplicity my less than mathematically gifted mind requires (I'm doing a psychology BA; compulsory statistics module atm!)

  • @jbstatistics
    @jbstatistics  11 лет назад

    You're welcome Albert!

  • @tumul1474
    @tumul1474 5 лет назад +2

    awesome video sir !! just made my day

  • @jbstatistics
    @jbstatistics  11 лет назад +1

    If we kept the same hypotheses as given in this video, then rejecting the null hypothesis for values of the true mean greater than 50 wouldn't be considered the correct decision, and we wouldn't be calculating power in those cases.
    If the alternative hypothesis was mu > 50 instead of mu < 50, and we wish to calculate power for values of mu greater than 50, then the plots would simply be a mirror image of those in this video. I have another video of a power calculation in this setting.

  • @jbstatistics
    @jbstatistics  11 лет назад

    I believe kbwebtech1 meant a two-tailed test (an alternative hypothesis of mu not equal to 50), where the true value of mu is 75. It looks like I misfired in my earlier response; I meant a true value of mu equal to 75.

  • @SatishDubeyG
    @SatishDubeyG 8 лет назад +1

    I really bound to appreciate the work..god bless...please update few videos using advance statistical tools such as SAS or SPSS..or Excel

  • @jbstatistics
    @jbstatistics  10 лет назад

    That is an area under the standard normal curve. It is found using software or a standard normal table. Cheers.

  • @pb5626
    @pb5626 7 лет назад

    Love when he said "power is the probability of rejecting the null when it is false, that is a good thing." My prof explained it totally opposite of that and I struggled to clarify it in my mind. Love the visuals in this video too.

  • @jbstatistics
    @jbstatistics  11 лет назад +1

    Not quite. If the alternative hypothesis is greater than 50, then the rejection region would change (instead of rejecting H_0 when x bar is less than 45.31, as we do in the video, we'd reject H_0 when x bar is greater than 50 + 21/sqrt(36)*1.34 = 54.69). To find the power (if the alternative was greater than), we'd find P(X bar > 54.69), and to find the probability of a Type II error we'd find P(X bar < 54.69) (using the appropriate values of mu, n, and sigma).

  • @jbstatistics
    @jbstatistics  10 лет назад

    You are very welcome!

  • @AlexWangUS
    @AlexWangUS 10 лет назад

    This video saved my life thank you I owe you my life.

    • @jbstatistics
      @jbstatistics  10 лет назад +1

      I'm always glad to save a life. You owe me nothing :)

  • @americanbluediamonds
    @americanbluediamonds 8 лет назад

    Wonderful video! I am so confused until viewing your video. You are very talent in teaching. Can you make some video in Analysis of Variance, Randommized Block, Latin Squares... Thanks.

  • @jbstatistics
    @jbstatistics  10 лет назад

    The power of the test is the probability of rejecting the null hypothesis, given it is false (in this case, given mu = 43). So the power is not calculated by finding areas under the distribution of the sample mean when the null hypothesis is true (mu = 50), but by finding areas under the distribution of the sample mean when the null hypothesis is false (mu = 43). That's why the power was an area under the blue curve (mu=43) in the video, and not an area under the white curve (mu=50).

  • @melisiremyaman4212
    @melisiremyaman4212 5 лет назад +1

    Allah razı olsun mümin kardeşim. Mübarek ramazan gününde allah ne muradın varsa versin

  • @sakkariyaibrahim2650
    @sakkariyaibrahim2650 4 года назад

    crystal clear. excellent presentation

  • @user-jz9fu9uc4p
    @user-jz9fu9uc4p 4 месяца назад

    Amazing video! Better than my lecturer!

  • @chintanjadwani
    @chintanjadwani 8 лет назад

    Thanks for making the video! A quick question - since we don't actually know the population mean, how does one calculate the power of the test?

  • @nicoleblackwood2783
    @nicoleblackwood2783 7 лет назад +5

    this video saved my life

  • @pasangtshering2998
    @pasangtshering2998 11 лет назад

    Well explained and useful. Thanks JB Stats.

  • @hannahtriana2932
    @hannahtriana2932 7 лет назад +10

    do you have a video that does this using t-statistic?

  • @yubarajboro3958
    @yubarajboro3958 11 лет назад

    thanks for the excellent video. esp, the type 2 error calculation was a life saver!!!!

  • @monanasery1992
    @monanasery1992 4 года назад +1

    Thanks for the helpful video and clear explanation. Just a question: at 1:10, since we are interested in the left part only, why didn't you divide the alpha by 2 for finding the z? Thanks!

  • @MrWinter2
    @MrWinter2 3 года назад

    This is super helpful. Thank you!!

  • @PaulJohn204
    @PaulJohn204 10 лет назад +1

    Wow, this video is fantastic. Can't thank you enough my friend.

    • @jbstatistics
      @jbstatistics  10 лет назад +1

      You are very welcome. Thanks for the compliment!

  • @jbstatistics
    @jbstatistics  11 лет назад

    We need to find the value of a standard normal random variable that has an area to the left of 0.09. To 2 decimal places, that value is -1.34. This can be found using software or the standard normal table. I go through how to use the standard normal table for this type of problem in "Finding percentiles using the standard normal table".

  • @faizanulhaq8349
    @faizanulhaq8349 4 года назад

    Note that Type 1 and Type 2 errors are CONDITIONAL probabilities - this really helped make things make sense for me

  • @jawaharkonathala2262
    @jawaharkonathala2262 2 года назад

    Thank you very very very much...Awesome explanation.

  • @shaniquajohnson3010
    @shaniquajohnson3010 7 лет назад +1

    Why didn't you have to subtract the area to right of 45.31 ( .255) from 1 making beta .745 if we were testing P ( Z> 45.31) vsP( Z

  • @reajulchowdhury8534
    @reajulchowdhury8534 7 лет назад

    Thank you. I understand the concepts better now. But I cannot determine sample size corresponding to particular power. Can you please give me some hints how should I solve the following problem:
    You want to test whether a coin is fair at significance level 10%. What is (approximately) the minimum number of tosses that is required such that the probability of concluding that the coin is not fair is at least 90% when the true probability of Tails is 60%?
    thanks in advance

  • @pedrodelfino9493
    @pedrodelfino9493 5 лет назад

    Excellent explanation. My material did not plot the curves. This is great to visualize the concepts. Thank you!

    • @jbstatistics
      @jbstatistics  5 лет назад +1

      You are very welcome! Without the visualization it's a little tricky to think about.

    • @pedrodelfino9493
      @pedrodelfino9493 5 лет назад

      ​ jbstatistics That's first time I received an answer for a comment on RUclips rsrs. Thanks. But let me ask you someting, how would you sketch the curves if the problem involvend a hypothesis testing on a proportion (p) - instead of the mean ("Mu") ? Where would you center the curve? It would be also bell shaped, right? Thanks, again!

    • @jbstatistics
      @jbstatistics  5 лет назад +1

      @@pedrodelfino9493 If we were speaking about a large sample Z test on a population proportion, then yes, it would be a very similar type of thing. There would be one normal curve centred at the hypothesized value of p, and another centred at the true value. We'd have to be a touch careful though, as the variances would differ (since the variance of p hat depends on the true value of p).

  • @vbdad7290
    @vbdad7290 10 лет назад

    Great video! What program did you use for this video? I'm wondering if I could use it teach my Elementary Stats class.

    • @jbstatistics
      @jbstatistics  10 лет назад

      The base is a Latex/Beamer presentation. I annotate using Skim, and record and edit using Screenflow. Cheers.

  • @ada87
    @ada87 Год назад

    Bro this was the best video Ive seen in my life

    • @jbstatistics
      @jbstatistics  Год назад

      Power calcs are a little dry, so this one isn't my fave, but I'm glad to be of help!

  • @TBSFilmsx
    @TBSFilmsx 10 лет назад +1

    Great video. You explained it just the way my mind interprets it.

  • @shefaligandhi1767
    @shefaligandhi1767 8 лет назад +1

    How do you get the z value of -1.34 on a calculator (TI-84)

  • @varundixit1365
    @varundixit1365 4 года назад

    How to calculate power of a test for composite hypotheses? How does the "power.t.test" function in R calculate the power without asking for actual value of parameter?

  • @nsivaprasad1417
    @nsivaprasad1417 6 лет назад +1

    Well presented and explained

  • @sukursukur3617
    @sukursukur3617 4 года назад

    What do you say for this question? We dont know std and mean of population. We want to make a Hypothesis test about whether first sample value is same with mean value of 50 samples.
    For this test, i reckon to use mean and std of samples. Mü-zero will be mean of 50 samples and sigma will be std of 50 samples. X bar will be the first sample value according to formulation z score. Is this method true?

  • @Mark6770
    @Mark6770 6 лет назад

    You can also do this one. 1-B= P(z>(zc-ztest)).. This will work in left tailed, right tailed, or even two tailed test.

  • @DrAppleMedia
    @DrAppleMedia 2 года назад

    I only needed a small section of this video to tell me what neither my textbook or my classes could

  • @kbwebtech1
    @kbwebtech1 11 лет назад

    Ok Thank you and would we have two regions to test? Because I have no idea how the process would work.

  • @sdan3537
    @sdan3537 Год назад

    Absolutely wonderful visualisation scaffold. A quick question (6.55 min): how did you conclude while calculating probability of type 2 error that sigma is 21 even for the population with a mu of 43?

  • @nwm76
    @nwm76 7 лет назад

    Great video. One question - given the small sample size of 36, interested to know why the test statistic in your video is assumed to be distributed as standard normal, rather than as Students t?

    • @jbstatistics
      @jbstatistics  7 лет назад

      In this video I've assumed the population standard deviation to be known, and thus the appropriate test statistic is the Z statistic. (If the population standard deviation is known, then Z=(X bar - mu_0)/(sigma/sqrt(n)) is the appropriate test statistic. If the null hypothesis and assumptions are true, this Z test statistic has the standard normal distribution.)
      In the real world we don't know sigma, so we use the t test, but power calculations for t tests are more complicated (involving the noncentral t distribution). I introduce power calculations using the Z test, because it's simpler and more understandable, and I bring it in at a point in the course where we have not yet discussed t tests.

    • @nwm76
      @nwm76 7 лет назад

      jbstatistics Great, that makes sense. Thanks for taking the time to reply.

  • @arghadeepmodak9413
    @arghadeepmodak9413 3 года назад

    I have a question , you are assuming here the population parameter (miu) to be something to calculate the type 2 error ..But in empirical studies we generally do not know the population mean .does that mean type 2 error can not be computed for real empirical studies?

  • @tsp8855
    @tsp8855 7 лет назад

    Wait, so power can be calculated using either
    1 - P(Fail to reject H0 | real mu mu0)
    OR
    P(reject H0 | real mu mu0)
    ??

    • @jbstatistics
      @jbstatistics  7 лет назад

      Rejecting Ho and not rejecting Ho are complementary events, so, under the same underlying conditions P(Reject Ho) = 1-P(Do not reject Ho). I work it out both ways in this video because when some students see a power question they automatically jump to Power = 1-Beta, and I think that's not a great way to think about it.

  • @madisonbies7036
    @madisonbies7036 2 года назад

    Hi there I was wondering if someone could help me understsand, I get it up untill the point of 7;40, when we set up 45.31-43/21/SQ(36) where is Z > 0.66 coming from? and where is 0.255 coming from ? thanks!

  • @Kyzcreig
    @Kyzcreig 9 лет назад

    these videos are fantastic

  • @manaspreetkaur9836
    @manaspreetkaur9836 6 лет назад

    Awesome explanation !

  • @abhishekmathur5119
    @abhishekmathur5119 10 месяцев назад

    Thank u so much for simplifying it

  • @widerface
    @widerface 10 лет назад

    While calculating the power ( 1 - beta) for meu = 50 with the alternate hypothesis for meu = 43; some of the area was included while it was outside the normal curve of null hypothesis. Can you kindly explain?