Covariance and correlation

Поделиться
HTML-код
  • Опубликовано: 27 июл 2013
  • This video explains what is meant by the covariance and correlation between two random variables, providing some intuition for their respective mathematical formulations. Check out ben-lambert.com/econometrics-... for course materials, and information regarding updates on each of the courses. Quite excitingly (for me at least), I am about to publish a whole series of new videos on Bayesian statistics on youtube. See here for information: ben-lambert.com/bayesian/ Accompanying this series, there will be a book: www.amazon.co.uk/gp/product/1...
  • ХоббиХобби

Комментарии • 104

  • @SpartacanUsuals
    @SpartacanUsuals  10 лет назад +16

    Hi, thanks for your comment. Good question. Essentially what it means is that the maximum covariance between two random variables, X and Y, is given by when the two variables are the same. In this case the sqrt(var(x).var(x))=var(x). The proof of this depends on the Cauchy-Schwarz inequality, and was a little too involved for me to post here. However, I have added it to my list of videos to do in the future. Best, Ben

    • @ARM26878
      @ARM26878 2 года назад

      Hi Ben, have u gotten around to making that video? if yes could you please post the link? Thanks

  • @cgabt1109
    @cgabt1109 3 года назад +28

    Good content lasts forever. This has been useful for me, old engineer dog in his mid 50's , relearning statistics. I couldn't get my head around the differences between these two measures - your video did the trick!

    • @luckyprod9013
      @luckyprod9013 2 года назад +2

      Man i feel you, 45 years old here and relearning math for my trading after 20 years spent on excel in corporate finance lol

    • @jospremji
      @jospremji Год назад

      @@luckyprod9013 hey, im into trading as well. how are you using statistics for your trading?

  • @darynaivaskevych1907
    @darynaivaskevych1907 5 лет назад +7

    Thank you for the brilliant explanation!
    I finally understand why these formulas are like this.

  • @meshreporting
    @meshreporting 10 лет назад +67

    These videos have been nothing but helpful. Thank you so much!

    • @SpartacanUsuals
      @SpartacanUsuals  10 лет назад +11

      Hi, glad to hear they are useful! All the best, Ben

  • @talkohavy
    @talkohavy 7 лет назад +12

    Well done!
    I'm taking a course called Linear Regression
    and I learned a lot from your video.
    Thank you for the lesson.

  • @tymothylim6550
    @tymothylim6550 3 года назад

    Thank you very much for this video, Ben. It really helped me understand the intuition behind the formulae, as well as the relation between Cov and Corr! The visuals helped a lot with explaining, too!

  • @tjfirhfjejUTH24
    @tjfirhfjejUTH24 7 лет назад +5

    good video very clear. if anyone is having trouble make sure you really understand joint pdfs, and expected values.

  • @h-s7218
    @h-s7218 Год назад +2

    this video was just a piece of art ! thank you so much! well explained and really clear and smooth !

  • @kejeros
    @kejeros 8 лет назад +6

    Thank you so much. I am actually getting excited for this final now. haha!

  • @batuhantekmen6607
    @batuhantekmen6607 3 года назад +1

    Very intuitive and can be watched along with a formal explanation or numerical calculations! Thank you.

  • @harunsuaidi7349
    @harunsuaidi7349 3 года назад +1

    Ah, so that's where it comes from. I'm an Art graduate learning Statistics for my master degree in Instructional Technology. I never quite got how one could figure out the mathematical expression of the relationship between two sets of data. Now that you explained it, it becomes much clearer. Damn, mathematicians are smart.

  • @imzhaodong
    @imzhaodong 9 лет назад +4

    I would say these videos are just awesome. thank you so much for effort.

  • @alextessier5727
    @alextessier5727 9 лет назад

    So helpful to finally understand the difference and the why's! Thank you!

  • @myvoice8167
    @myvoice8167 8 лет назад

    Hello Sir,You are such a good instructor.Great job!!!!!! May God Bless you and your loved ones..

  • @kamalgurnani924
    @kamalgurnani924 6 лет назад +1

    Thanks a lot for explaining the idea behind that intuition!!!

  • @shashikalaraju5769
    @shashikalaraju5769 4 года назад

    Perfect. You are amazing teacher. You inspire me. Thank you

  • @gabrielasantana3809
    @gabrielasantana3809 3 года назад

    This guy just has a video for every question, thank you

  • @Stirner219
    @Stirner219 6 лет назад

    It's really nice that you also explain the underlying logic of cov and cor. B/C doing without understanding is not much worth. Thanx :)

  • @antibioticsOfWorld
    @antibioticsOfWorld 2 года назад

    thank you !! i am doing masters in data science and it helped me to understand the basics properly

  • @Kike_Reloaded
    @Kike_Reloaded 3 года назад

    Great explanation, thanks for sharing!

  • @palashmyaccount
    @palashmyaccount 4 года назад

    Great Explanation. Thank you!

  • @user-zt8dj4nq9g
    @user-zt8dj4nq9g 6 лет назад

    Really appreciate for the perfect explanation.

  • @Josh54152
    @Josh54152 9 лет назад

    This is very good, thank you for your help.

  • @july-9319
    @july-9319 3 года назад

    thank you for the intuition, ben!

  • @aref6561
    @aref6561 7 лет назад

    Thank you very much. This was very helpful.

  • @Skandawin78
    @Skandawin78 6 лет назад +2

    very good explanation. thanks.
    what is colinearity?

  • @waihinlee3899
    @waihinlee3899 4 года назад

    Thank you, very clear explanation.

  • @edentrainor776
    @edentrainor776 4 года назад

    This is such a damn clear ad well explained explanation it hurts.

  • @owenlie
    @owenlie 3 года назад

    Straight to the brain! Thank You!

  • @Banaan1985
    @Banaan1985 8 лет назад

    Cheers dude. Helpful video

  • @saraw8951
    @saraw8951 4 года назад

    Thank you so much! it's really helpful for my paper

  • @husseinfarag7937
    @husseinfarag7937 4 года назад

    Thanks man, this was really helpful

  • @emanuelhuber4312
    @emanuelhuber4312 5 лет назад

    Thank you! Awesome video

  • @hondopirat2735
    @hondopirat2735 5 лет назад

    Super Catalin, très utile !

  • @emilylawrence6051
    @emilylawrence6051 2 года назад

    What kind of people disliked this video? this video is amazing! Thank you Ben!

  • @nackyding
    @nackyding 2 года назад

    Thank you for the concise definition.

  • @isabelchen3302
    @isabelchen3302 Год назад

    This is wonderful, thank you!

  • @jfregnard
    @jfregnard 6 лет назад

    Very helpful. Thanks !

  • @JackTheOrangePumpkin
    @JackTheOrangePumpkin 3 года назад

    Thanks, this was really enlightening

  • @COSMOPOLITANWORLD
    @COSMOPOLITANWORLD Год назад

    You made it easy to understand! Thanks a lot!!

  • @sophievanbeek7768
    @sophievanbeek7768 5 лет назад

    This is helping me so much, thank you!

    • @TrangPham-cy5km
      @TrangPham-cy5km 5 лет назад

      Sophie Van Beek i dont know how to identity the (+) or (-)of Y. Can you help me

  • @moliv8927
    @moliv8927 Год назад

    Good video, explained well and on point

  • @SachinModi9
    @SachinModi9 Год назад

    Ben Ji, Awesome video..

  • @nickpenacl_
    @nickpenacl_ 7 лет назад

    question not related with topic ... which instrument (system) did you use for write in the board, will appreciate your explain

  • @Elsmeire
    @Elsmeire 8 лет назад

    Exam in two days, great videos

  • @Jdonovanford
    @Jdonovanford 6 лет назад

    I've read that the formula for betas is beta=cov(x,y)/var(x). However, the formula given in many places for betas does not divide by n (or n-2): beta=sum[(x-x_m)*(y-ym)]/sum(x-x_m)^2. IN this formula, neither the numerator or denominator are divided by N or n-1… to be called covariance and variance.

  • @najlahs7311
    @najlahs7311 3 года назад

    Thaaaaaank youuuuuu. So breif and clear.

  • @katiegraham8484
    @katiegraham8484 5 лет назад +2

    This is an awesome explanation. It would be even better if there was an example to accompany it

  • @khazovaru9892
    @khazovaru9892 6 лет назад +1

    Thank youuuuuuuuu 😘😘😘😘

  • @GK-qv3xd
    @GK-qv3xd 5 лет назад

    Brilliant!

  • @amanuelnigatu4621
    @amanuelnigatu4621 7 месяцев назад

    this what I want intuition tnx man

  • @priyankpatel4041
    @priyankpatel4041 6 лет назад

    can you give about jtc cross correlation detail

  • @horizontaalschaalbaar9470
    @horizontaalschaalbaar9470 6 лет назад

    Love the black background. For some unknown(?) reason, almost all programs use white backgrounds, which I hate because I don't want to be sitting in front of a big ball of light. Tip: there are great plugins to make webpages "dark".

    • @horizontaalschaalbaar9470
      @horizontaalschaalbaar9470 6 лет назад

      I readded this comment because it was deleted. Why??? Strange things happen here... It even had likes gd!!!

  • @nicholaschen5821
    @nicholaschen5821 8 лет назад +2

    well, u said when P=1, it means X and Y are perfect positively related. Is that mean the gradian of the line is one or this just mean the points are in the same line and no matter the degree between the line and X-axis?

    • @SpartacanUsuals
      @SpartacanUsuals  8 лет назад

      +Nicholas Chen Thanks for your comment - good question. If two variables are perfectly correlated then it means we can draw a perfectly straight line through samples from both variables. It doesn't require however, that the relationship is 1:1 between them. Essentially perfect correlation just means that we if we had one variable we could perfectly (ie with no error) predict the other variable. Does that make sense? Best, Ben

    • @nicholaschen5821
      @nicholaschen5821 8 лет назад

      Thank you, that is a very helpful answer!!!

  • @SciFiFactory
    @SciFiFactory 4 года назад

    Ah, so it is basically the normalized slope of a linear function?
    y=m*x
    with the slope [m]=[y/x]
    Then times x on both sides:
    y*x=m*x^2
    On the left side would be the covariance, if you were to substitute it with (y-mu) and (x-mu).
    And then to normalize the units on both sides they are divided by something that has the same units as y*x.
    So here we use the standard deviations sy=sqrt(var(y)) and sx=sqrt(var(x)) ....
    But I am confused why it never gets bigger than the standard deviation? I mean, aren't like 32% of the samples out side of the standard deviation?
    So that in 32% of the cases you have something like (y-mu)>=sy , or in 5% of the cases you have something like (y-mu)>=2*sy ?

  • @ARM26878
    @ARM26878 2 года назад

    at 4:50 whats the intuition that the covariance of x,y can never exceed variance of x times variance of y" ? Thanks

    • @ARM26878
      @ARM26878 2 года назад

      probably you meant - the covariance of x,y can never exceed std dev of x times std dev of y" ? I'm still not sure about its intuition.

  • @henriquebenassi
    @henriquebenassi 5 лет назад

    Excellent.

  • @randomyoutubeaccount6906
    @randomyoutubeaccount6906 4 года назад

    I needed an example. What id Mew? and the expectation, is that the mean? also do we use the total of x and y anywhere? Sorry i'm bad at math and got lost in this video at the same point every time I watched.

  • @trent_tsu
    @trent_tsu 2 года назад

    thank u very much!

  • @GEconomaster112
    @GEconomaster112 4 месяца назад

    Giga chad, thanks!!

  • @utkarsh5667
    @utkarsh5667 3 года назад

    how did you prove that cov(X,Y)=0 implies there is no correlation between the random variables?

  • @sidekick3rida
    @sidekick3rida Год назад

    What does it mean to "plot a realization?"

  • @MochitoMaker
    @MochitoMaker 7 лет назад +1

    I don't get why in one case we have X>Mx and we get +++ and then we have the same equation with X>Mx and we get +- -
    What's the logic?
    Thanks.

    • @ugurgudelek
      @ugurgudelek 5 лет назад

      X and Y dont have to be perfectly correlated. So, in some X>Mx cases, Y can be smaller than its mean.

  • @shrijithr9345
    @shrijithr9345 3 года назад

    Can someone tell me or point to me someplace where it's explained "How we 'know' that the covariance of x,y can never exceed variance of x times variance of y" ?

    • @ARM26878
      @ARM26878 2 года назад

      I have the exact same doubt. Did u find out the answer?

  • @EOCmodernRS
    @EOCmodernRS 6 лет назад

    I'm not looking for a formula, I'm looking for examples. I don't get the formula. In my head it says ''(E(x)-E(x))*(E(y)-E(y), which is 0. I don't get the formula....

  • @christinating1340
    @christinating1340 8 лет назад

    why use covariance when correlation can tell you the direction and strengh of a relationship in a standardized/comparable form? What does covariance give us that correlation does not?

    • @DmitriNesteruk
      @DmitriNesteruk 8 лет назад +1

      There are plenty of places where covariance is used _in lieu_ of correlation. For example, in Modern Portfolio Theory we calculate the covariance matrix in order to be able to calculate the efficient frontier.

  • @andrescheepers3223
    @andrescheepers3223 4 года назад

    really enjoys the word sort've...

  • @sanathgunawardena832
    @sanathgunawardena832 Год назад

    Nice!

  • @kunstkt
    @kunstkt 10 лет назад +2

    Towards the end you say that var(x)*var(y) is "the greatest possible way in which x and y can covary". What does that mean?

    • @diodin8587
      @diodin8587 4 года назад

      +1

    • @kunstkt
      @kunstkt 4 года назад +1

      @@diodin8587 corr=cov/sd(x)*sd(y). The strongest possible correlations are 1 and -1, and they correspond to covariances of sd(x)*sd(y) and -sd(x)*sd(y). He must have meant the square root of var(x)*var(y).

  • @hugovreugdenhil
    @hugovreugdenhil 8 лет назад

    Thanks

  • @deepak2012able
    @deepak2012able 10 месяцев назад

    Thankyou

  • @robertotosacanogalarza9021
    @robertotosacanogalarza9021 4 года назад

    Good!

  • @arunthashapiruthviraj2783
    @arunthashapiruthviraj2783 2 года назад

    Clear my doubt

  • @Darius1295
    @Darius1295 6 лет назад

    Important to point out that Covariance and Correlation can be zero even if the two variables are dependent.

  • @pomegranate8593
    @pomegranate8593 2 года назад

    cheers lad

  • @piersanna8866
    @piersanna8866 3 года назад

    you say, if x is higher than its mean, then y tends to be also positive. But seconds later yous say if x is higher than its mean then the second parenthesis is likely to be negative. this doesn't make sense and is a contradiction.... could someone please explain????

    • @mohammadrezakhedmati7777
      @mohammadrezakhedmati7777 3 года назад

      He's talking about two different scenarios. In the first one, he assumes X and Y are positively correlated ( just like the first graph he drew) and in the second one he assumes these variables are negatively correlated (second graph). That's why the sign of the second parenthesis varies. You've probably figured this out by now, but I tried to give my explanation just in case someone else has the same question. Cheers!

  • @magnusonx1
    @magnusonx1 6 лет назад

    British accent....NICE ! ! ! Wishing all Yankees could have British accents

  • @hamzatarq7000
    @hamzatarq7000 2 года назад

    100%

  • @zip9267
    @zip9267 4 года назад

    help

  • @joannaqian7755
    @joannaqian7755 Год назад

    save my life

  • @tastsolakis1519
    @tastsolakis1519 5 лет назад

    thanks for the explanation really good! Next time though please talk a little more clear!

  • @pkavenger9990
    @pkavenger9990 Год назад

    In future I think Universities will go obsolete. Any Government can pay experts to make a course and just upload it. Why burn your fuel and energy to get to a place and then spend so much energy coming back home to learn the same thing you can learn from just RUclips.

  • @krunkerdylan6146
    @krunkerdylan6146 2 месяца назад

    cut out the 'sort of' 🤣such a brit!

  • @bebla8381
    @bebla8381 4 года назад

    i want the fucking explanation for the formula, the intuitive reason of why it is what it is. why is that so hard to find? the ACTUAL intuitive explanation for the formula, every fucking video about covariance they show you the formula and thats it.. it makes me wonder if anyone actually understands where the formula truly comes from

  • @deedi9001
    @deedi9001 4 года назад

    The logic is fucking confusing

  • @GuglielmoRiva97
    @GuglielmoRiva97 4 года назад

    try saying "sort of" less often

  • @ilhamkseibi6157
    @ilhamkseibi6157 7 лет назад

    oh man, things with you sounds much more complicated, if you are trying to do something like khan academy, well you are not