Standardization vs Normalization Clearly Explained!

Поделиться
HTML-код
  • Опубликовано: 1 окт 2024
  • Let's understand feature scaling and the differences between standardization and normalization in great detail.
    #machinelearning #datascience #artificialintelligence
    For more videos please subscribe -
    bit.ly/normaliz...
    Support me if you can ❤️
    www.buymeacoff...
    Join our discord -
    / discord
    Facebook -
    / nerdywits
    Instagram -
    / normalizednerd
    Twitter -
    / normalized_nerd

Комментарии • 124

  • @NedSar85
    @NedSar85 Год назад +98

    This video should be nominated to the RUclips Oscars/Grammy awards....

  • @xTurqoise
    @xTurqoise 2 года назад +49

    Also in Principal Component Analysis, scaled features are very important because we search for the principal axes that have the highest variance. So if we have one feature in [0,1] and the other one in [1, 100], then the latter one has a much higher variance, even though it may not contain much information to be kept by the PCA.

    • @NormalizedNerd
      @NormalizedNerd  2 года назад +4

      Great point! Feature scaling is very important in pca also.

  • @gloryjaw4327
    @gloryjaw4327 Месяц назад +1

    You haven't really talked about standardization much.

  • @severtone263
    @severtone263 6 месяцев назад +6

    Your clarity is amazing. This helps! Sub earned

  • @Anna-uh7qx
    @Anna-uh7qx 7 месяцев назад +4

    How many more people would understand math if we had explanations like this. I feel like I have been reading math papers written in French, and you just spoke in English for me. Gosh, THANK-YOU.

  • @AbheeBrahmnalkar
    @AbheeBrahmnalkar Год назад +7

    This is the first video I watched and man you have crushed it. This intuitive explanation of math was a joy to watch. Please keep them coming.

  • @Mutual_Information
    @Mutual_Information 2 года назад +11

    I was wondering where you’ve been! Nice to see you back to posting.
    Well covered topic - it’s easy to overlook standardization and normalization thinking they are simple. They have some important subtleties

    • @PritishMishra
      @PritishMishra 2 года назад +1

      I saw you today in Yannic's channel as well, nice to see you again.

    • @NormalizedNerd
      @NormalizedNerd  2 года назад +2

      Thanks a lot mate! Really happy to be able to upload again :D❤️

    • @taotaotan5671
      @taotaotan5671 2 года назад

      Hey DJ, we are waiting for you also!

    • @Mutual_Information
      @Mutual_Information 2 года назад

      @@taotaotan5671 lol coming soon!!

    • @stayinthepursuit8427
      @stayinthepursuit8427 10 месяцев назад

      A standardization makes the original distribution look more normal . It doesn't just make a zero mean and 1 stdev.

  • @chwenjun225
    @chwenjun225 Год назад +2

    thanks man, It's help me so much to understand about normalization
    Very helpful

  • @NathanCats777
    @NathanCats777 Год назад +2

    Hi there thanks a lot! I have one question on min-max normalization as I m using Stata. When I use the formula, shall I take into consideration the actual min and max values of the variable, or I should consider the potential/feasible range of values the variable can assume? E.g. I have one variable that can take values -100,+100, yet in my dataset the min is -12 and the max is 34.

  • @DaniilKanaki
    @DaniilKanaki 3 месяца назад

    Amazing explanation! Thank you.
    The datasets get normalized just like the speaker! (a joke, couldn't help it)

  • @benradmer7668
    @benradmer7668 3 месяца назад

    Can someone here help me with my data preprocessing project or know where i can find help? I am so stuck and cant get over 70%. i really wann do well but dont really know what else do in preprocessing

  • @JKrlo999
    @JKrlo999 Месяц назад

    Saludos desde Perú, Excelente tus videos! gracias! éxitos.

  • @rouanemouaad
    @rouanemouaad Год назад +1

    Thanks man for the video. this was with no doubt very helpful.
    however i was wondering how do you make all these animations ?
    Thanks in advance for you kindness.

  • @arnobbaiga318
    @arnobbaiga318 2 месяца назад

    Hello brother. If i have given a time scale for a Analysis. Can i use this time scale to normalize my analysis time?

  • @TranquilSeaOfMath
    @TranquilSeaOfMath 10 месяцев назад +1

    Very nice explanation and demonstration. Good topic.

  • @anilkumarsharma8901
    @anilkumarsharma8901 2 месяца назад

    Noor and malai become normalization 😂😂😂since noor and malaise are top by nature 👌 😂😂

  • @mmasa1
    @mmasa1 Месяц назад

    wow bro, this was really really good. Thank you soo much.

  • @jb_makesgames2264
    @jb_makesgames2264 2 года назад +3

    Good video - your description and explanation is good. However relating the basic explanations to real world problems would be helpful for users. Also using a partial distribution to calculate things such as volatility based on only the negative change is interesting. Also using curve fitting of data to determine parameters for trading and models is also interesting

  • @brianthomas9148
    @brianthomas9148 Год назад +1

    could you please tell me what software you used for these visualizations

  • @NandiniMaharaj-u5j
    @NandiniMaharaj-u5j Месяц назад

    such an informative video! good work!!

  • @amitkarmakar1684
    @amitkarmakar1684 2 месяца назад

    can you please make a video on PQN normalization?

  • @suyashrahatekar4964
    @suyashrahatekar4964 5 месяцев назад

    blud comes after 1 year and does not come back even after another year gone past .

  • @TheNiraj_
    @TheNiraj_ 23 дня назад

    Now I realize I'm really poor in math.😥

  • @valerionetophdcandidate
    @valerionetophdcandidate 9 месяцев назад

    Very good. I have a doubt. I would love to hear your comment on it.
    In recent months, I have been reflecting on the apparent prevalence of certain predatory mega-journals, in particular MDPI's Sustainability, which stands out as the journal with the most publications on various topics, according to various tourism bibliometrics. However, this observation has led me to consider the need for further analysis.
    Specifically, it has caught my attention that when using the percentage of publications in relation to the specific research topic in percentage terms (number of articles on a topic divided by the total number of articles published), the magnitude of the contribution decreases drastically. To illustrate this point, let me present a hypothetical example:
    Journal A has published 10 articles on prospect theory in the last five years, but its total output is 600 articles.
    In comparison, Journal B has published 25 articles on prospect theory in the same period, but its total publication volume exceeds 49,000 articles.
    Some bibliometrics would say that Journal B is the one that publishes the most, however, it is just a matter of gaining by quantity. I gave the journals weights based on their percentages (Weight of journal = Percentage of Journal / Highest Percentage among journals) then I did the min-max normalisation (Normalised weight = (Weight of Journal−Min Weight) / (Max Weight−Min Weight)), Then I created a Weighted Metric with Normalisation (multiplying the normalised * their weight). The use of min-max normalisation in this one is correct? Do you think there is a better approach?

  • @vmkkannan
    @vmkkannan Год назад

    Good Explaintion... thank you very much 😊😊😊😊😊😊

  • @mahaalabduljalil6596
    @mahaalabduljalil6596 Месяц назад

    We always learn something new even when I knew the topic from before! you make it more interesting and valuable. Thanks from Kuwait

  • @nipunikalnu8645
    @nipunikalnu8645 7 месяцев назад

    what software do you use for animations?

  • @DennisKorolevych
    @DennisKorolevych Год назад

    Jesus, thats so great. Im totally new to data science and ML and Im trying to take it slow to properly understand everything. This video was super great in doing that. I picked up new knowledge that will be helpful for when Im writing my own ML algorithm (probably KNN based image classfication)

  • @rayaneaboud9043
    @rayaneaboud9043 6 месяцев назад

    gg budd you opened new horizons for me

  • @Steve-ey9ws
    @Steve-ey9ws Месяц назад

    Love it when you have on your glasses

  • @taha7shaikh
    @taha7shaikh Месяц назад

    thanks man. amazing video

  • @arhammonds4492
    @arhammonds4492 2 месяца назад

    Wow - what an incredibly helpful video; thank you.

  • @sailakshmicholanilath9794
    @sailakshmicholanilath9794 4 месяца назад

    Thanks to you I understood why feature scaling is imp, thank legend

  • @paulowiz
    @paulowiz 3 дня назад

    Really nice explanation

  • @jullienbeaufondcamacho2055
    @jullienbeaufondcamacho2055 Год назад +1

    Great, specially good to explain the misconception with non linear transformations which for some reasons is constantly used in conversations as normalization/standarization

  • @ingrid88
    @ingrid88 2 месяца назад

    thank you so much for this!

  • @analyticseveryday4019
    @analyticseveryday4019 Год назад

    extremely beautiful viz , teaching methodology is amazing too. I too run ana analytics channel, but u inspired me more

  • @narangfamily7668
    @narangfamily7668 2 месяца назад

    Amazing amazing amazing!!!!!

  • @brianthomas9148
    @brianthomas9148 Год назад +1

    Your explanation was damn neat!

  • @devonrd
    @devonrd 4 месяца назад

    Great video!

  • @muhtasirimran
    @muhtasirimran 2 года назад

    Ahhhahaaa, I was sad seeing your last video was a year ago. Your visualization is really cool and as good as intuitive ml. But he stopped making videos 3 years ago

  • @NiceHirwa
    @NiceHirwa 4 месяца назад

    WOWW! Absolutely loved this! Thanks

  • @nitika9769
    @nitika9769 4 месяца назад

    i wanna be as smart as you

  • @AmNotLegend
    @AmNotLegend Месяц назад

    good explanation

  • @craftbalika3568
    @craftbalika3568 2 года назад +1

    Great to get back nerdy notifications...

  • @farhanfaiyaz8471
    @farhanfaiyaz8471 Год назад

    Hey! I wanted to know which software/ tools you used to make videos like this?

  • @niheltouil7513
    @niheltouil7513 3 месяца назад

    thank you so much

  • @NicolasRicaurte-l1g
    @NicolasRicaurte-l1g Месяц назад

    I LOVE YOUR VIDEOS

  • @gactve2110
    @gactve2110 9 месяцев назад +1

    Great videos, dude!
    It's a shame we no longer get this great content

  • @Anagha-pm3fu
    @Anagha-pm3fu 4 месяца назад

    do you use manim?

  • @lampeve
    @lampeve 4 месяца назад

    You are the best!

  • @vmendesmagalhaes
    @vmendesmagalhaes Год назад

    I really hope you are fine now. Your videos helped me a lot in several times. Easily you could be a teacher if you want to. Thanks!

  • @jacobnyonyintono1442
    @jacobnyonyintono1442 Год назад

    This guy explained something my lectures failed in years, in 5 minutes

  • @hawardizayee3263
    @hawardizayee3263 9 месяцев назад

    May I ask about the technologies that have been used to create this content ?
    I really appreciate sharing.

  • @ramiltaghiyev9712
    @ramiltaghiyev9712 2 месяца назад

    great video

  • @alextonev4145
    @alextonev4145 3 месяца назад

    Thank you!

  • @nishikantanayak7797
    @nishikantanayak7797 Месяц назад

    Man this is the most intuitively explained video for this topic i ever found ,thanks man

  • @donghyunlee-zg8hx
    @donghyunlee-zg8hx Год назад

    2:15

  • @_dion_
    @_dion_ 3 месяца назад

    excellent.

  • @tim_faith
    @tim_faith 11 месяцев назад

    thank you

  • @buildlackey
    @buildlackey 7 месяцев назад

    superb !

  • @vemundrye8999
    @vemundrye8999 6 месяцев назад

    You're doing amazing work here, hopefully one day you will get the recognition you deserve

  • @Akwjbwbqm
    @Akwjbwbqm 4 месяца назад

    Great lesson! Thank you so much for you video

  • @ramblingsofadegenerate1174
    @ramblingsofadegenerate1174 4 месяца назад

    Great explanation boss helped a lot chaliye jaao guru

  • @xeniosm4549
    @xeniosm4549 Год назад

    Hi. For deep learning, it best to do min-max normalization (i.e. stretch values to 0-1) or max normalization (i.e. only divide by max to keep within 0-1)? I see a problem with the former approach, as a single outlying value can significantly skew all the rest of the values, making them not very comparable to the reference values.

  • @aravindr9109
    @aravindr9109 10 месяцев назад

    Normalisation became new normal to me, great job dude!!!!

  • @Skandawin78
    @Skandawin78 7 месяцев назад

    great video, to the point with great visuals, subscribed.. Btw, how did you make these nice graphics?

    • @Skandawin78
      @Skandawin78 6 месяцев назад

      can you pls respond ?

  • @DeathlessLife786
    @DeathlessLife786 Год назад

    An excellent explanation...Thanks a lot for sharing ....

  • @roshantonge1952
    @roshantonge1952 Год назад

    How can you so perfect in explaining

  • @Ruhsaran
    @Ruhsaran 10 месяцев назад

    Excellent! Thanks.

  • @fosheimdet
    @fosheimdet Год назад

    Great videos! May I ask what software you use to create your equations/animations?

    • @neha4206
      @neha4206 Год назад

      I think he uses manim

  • @lenko_me
    @lenko_me Год назад

    Very nice video! Everything became clear as soon as I watched this

  • @ashraf_isb
    @ashraf_isb 8 месяцев назад

    sir olease make more videos, your sessions are very helpful

  • @ritira20mila
    @ritira20mila Год назад

    Sorry, I can't understand at 3:10 : Good old [what?] algorithm

  • @matheusalvessoaresdecarval1834

    i'm new to machine learning and theres something i dont quite understand:
    if you scale the X(input), does it affect the Y(output)? In a real life scenario where i want to make a prediction with my model, wont the scalling affect the results? if i shrink the input wont the output also be smaller?

    • @yamanarslanca8325
      @yamanarslanca8325 Год назад

      By looking at what you are saying: No, I don't think so (don't take my word though, I am new at ML). I'd say your weights will be computed accordingly. But I read that even scaling your outputs (before the training) is a thing, there are people who do that.

  • @ryguywy
    @ryguywy Год назад

    excellent visualization, thanks!

  • @S.G.2
    @S.G.2 3 месяца назад

    yes ty

  • @deborahfranza2925
    @deborahfranza2925 Год назад

    AWESOME VIDEO TYSM YOU'RE AWESOME

  • @thomasbates9189
    @thomasbates9189 11 месяцев назад

    High quality content. Thank you!

  • @patralichakraborty1295
    @patralichakraborty1295 2 года назад +1

    ♥️♥️♥️

  • @ts.nathan7786
    @ts.nathan7786 Год назад

    Very good explanation.

  • @aditi3601
    @aditi3601 2 года назад +1

    Absolutely loved the explanation!

  • @elotimmi4942
    @elotimmi4942 3 месяца назад

    I just love your channel name so much

  • @Rockefeller.69
    @Rockefeller.69 2 года назад

    Khan Academy 2.0?

  • @sabastianmoore8467
    @sabastianmoore8467 Год назад

    Love the sound effects! lol

  • @kienchung8189
    @kienchung8189 7 месяцев назад

    coolest presentation!

  • @syifasyuhaidahazman2384
    @syifasyuhaidahazman2384 Год назад

    love it. thanks so much for the explanation

  • @arijitRC473
    @arijitRC473 2 года назад +1

    Great to see you back bro ! ✌️

  • @JackSee-wr3le
    @JackSee-wr3le Год назад

    Excellent visuals!

  • @mohammadzeeshan992
    @mohammadzeeshan992 Год назад

    Good video, content animation are amazing.

  • @tanvirhasanmonir1627
    @tanvirhasanmonir1627 Год назад

    Very helpful

  • @Vikram-wx4hg
    @Vikram-wx4hg Год назад

    Very nice!

  • @cyberpunk_edgerunners
    @cyberpunk_edgerunners 2 года назад

    thanks bro

  • @shivanigawande4953
    @shivanigawande4953 2 года назад

    Yayyyyy! Thanks for an amazing video.

  • @736939
    @736939 2 года назад

    Please add NLP course.

    • @NormalizedNerd
      @NormalizedNerd  2 года назад +1

      Hey, have you checked this playlist?
      ruclips.net/p/PLM8wYQRetTxCCURc1zaoxo9pTsoov3ipY
      Feel free to suggest more topics!

  • @suyogshinde9050
    @suyogshinde9050 2 года назад

    Good that you are back!😎

  • @memelol1859
    @memelol1859 2 года назад

    Omggggg ur back!!!

  • @Hitman1Sniper
    @Hitman1Sniper 2 года назад

    So glad to see you back !

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 года назад

    Excellent!

  • @shrinivassampathmuthupalan8283
    @shrinivassampathmuthupalan8283 2 года назад

    Well explained.