Introduction to Cluster Analysis with R - an Example

Поделиться
HTML-код
  • Опубликовано: 10 дек 2024

Комментарии • 1,2 тыс.

  • @DineshKumarT1990
    @DineshKumarT1990 8 лет назад +27

    Great tutorial!!...the way you explain is easy to understand...you should do more like this

    • @bkrai
      @bkrai  8 лет назад

      Thanks for the feedback!

    • @josebueno7602
      @josebueno7602 5 лет назад +2

      Please, how can I get the data utilities.csv? Thanks.

  • @ramasamythirunavukkarasu6777
    @ramasamythirunavukkarasu6777 3 года назад +1

    Thank you so much Dr.B.Rai, I inspired your way of teaching even you in online, hopefully, every one enjoying your teaching

    • @bkrai
      @bkrai  3 года назад

      You are welcome!

  • @factChecker01
    @factChecker01 6 лет назад +6

    This is an excellent tutorial -- well presented and thorough. I followed along with my own application example (country healthcare per capita expenditure versus infant mortality rates of various types) and got very interesting results.

    • @bkrai
      @bkrai  6 лет назад

      Thanks for comments and feedback!

  • @rarosification
    @rarosification 7 лет назад +2

    My goodness, this video is so complete, and clearly explained with details of the script... Thank you so very much... 100 points to you...!! You have a new fan...

    • @bkrai
      @bkrai  7 лет назад

      Thanks :)

  • @ArcenisRojas
    @ArcenisRojas 8 лет назад +4

    Great tutorial. I really like how you stuck to explaining the steps through a practical application. Thank you for this.

    • @bkrai
      @bkrai  4 года назад

      Thanks for comments!

  • @sebastiansocianu5441
    @sebastiansocianu5441 4 года назад +2

    5-star explanation. thank you! Very much recommended for beginners and intermediate R users. You got a new follower!

    • @bkrai
      @bkrai  4 года назад

      Awesome, thank you!

  • @karoargote
    @karoargote 4 года назад +3

    Really thank you so much!!! The best tutorial on this topic!!!

    • @bkrai
      @bkrai  4 года назад

      You're very welcome!

  • @kanikalungani
    @kanikalungani 6 лет назад +1

    If i had a thousand likes you would have received them all sir. Love the way you have explained and covered the concepts

    • @bkrai
      @bkrai  6 лет назад

      Thanks, I’ll consider it 1000😊

  • @stephenhobbs948
    @stephenhobbs948 7 лет назад

    Excellent explanation and code. I took the Johns Hopkins data science course, and clustering was part of the course. This video really helps explain the concept.

    • @bkrai
      @bkrai  7 лет назад

      +Stephen Hobbs thanks 👍

  • @rupeshbharadwaj
    @rupeshbharadwaj 6 лет назад +2

    Great tutorial! You are really helping a lot of people like me, and the best part is- drama, background music etc are completely missing unlike many other tutorials. Also saw some bhojpuri songs :)...thank you sir!

    • @bkrai
      @bkrai  6 лет назад

      Thanks for comments and feedback!

  • @markshanks9142
    @markshanks9142 5 лет назад +1

    This is truly an excellent, clear and concise tutorial. You covered a lot of topics in a short amount of time. I will be watching your other videos. Well done!

    • @bkrai
      @bkrai  5 лет назад

      Thanks for your comments and feedback!

  • @janelutken9818
    @janelutken9818 4 года назад +1

    Thank you so much. This was easy to follow and I did my own analysis as we went along with almost no trouble. This was a breakthrough video for me.

    • @bkrai
      @bkrai  4 года назад

      You are welcome! For more detailed presentation, you may refer to:
      ruclips.net/video/otjWCaMcVaA/видео.html

  • @archeops.
    @archeops. 5 лет назад +1

    Fantastic explanation! I followed along with a different dataset and it worked perfectly! Great work!!

    • @bkrai
      @bkrai  5 лет назад

      Thanks for comments!

  • @jonathanrhein7553
    @jonathanrhein7553 8 лет назад

    Hi Bharatendra, great video - really helpful!
    Everything goes well until the point of doing the scree plot, I am getting:
    > withinGroupSumOfSquares = (nrow(normNum)-1) * sum(apply(normNum, 2, var, na.rm=TRUE))
    > for(i in 2:20) withinGroupSumOfSquares[i] = sum(kmeans(normNum, centers=i)$withinss)
    Error in do_one(nmeth) : NA/NaN/Inf in foreign function call (arg 1)
    > plot(1:20, withinGroupSumOfSquares, type="b", xlab = "Number of Clusters", ylab = "Within group SS")
    Error in xy.coords(x, y, xlabel, ylabel, log) :
    'x' and 'y' lengths differ
    Can you help me? Thank you.

    • @jonathanrhein7553
      @jonathanrhein7553 8 лет назад

      someone has deleted my comment...

    • @bkrai
      @bkrai  8 лет назад

      +Jonathan Rhein Not sure what's causing the error you got. May have something to do with data. I ran my data using the code you have, and everything seems fine.

    • @bkrai
      @bkrai  8 лет назад

      +Jonathan Rhein I still see your previous comment.

  • @sarahroffe2142
    @sarahroffe2142 5 лет назад +1

    This is a brilliant tutorial which is easy to understand and follow.

    • @bkrai
      @bkrai  5 лет назад

      Thanks for comments!

  • @tradingtraveller05
    @tradingtraveller05 8 лет назад +1

    Thanks for such wonderful explanation.
    By the way, I was working on a similar dataset, and apply didnt work for me. Although I removed all character vectors, but still the numeric vectors were returning 'NA'. I applied sapply and it solved the purpose.
    Thanks again!!

    • @bkrai
      @bkrai  8 лет назад

      Good to hear!

  • @harikamacharla7005
    @harikamacharla7005 7 лет назад +1

    Wah!!! how could u explain it so well!! Great job.

    • @bkrai
      @bkrai  3 года назад

      Thanks!

  • @kapilrana1153
    @kapilrana1153 3 года назад +1

    Great Explanation!
    Thank you Sir For this Video Lecture
    I will be watching your other videos.

    • @bkrai
      @bkrai  3 года назад

      Thanks and welcome!

  • @emiltsenov7853
    @emiltsenov7853 8 лет назад +1

    Hi Bharatendra, this is an excellent tutorial - the first one that worked for me. Great effort, keep up the good work!

    • @bkrai
      @bkrai  8 лет назад

      +Emil Tsenov Good to know, thanks for feedback!

  • @arnab_jana
    @arnab_jana 8 лет назад +1

    After a long time, I have seen such a good tutorial. Thanks, for your effort

    • @bkrai
      @bkrai  8 лет назад

      +Arnab Jana Thanks for the feedback!

  • @ahmetcandemir7032
    @ahmetcandemir7032 4 года назад +1

    Very good tutorial ! impressively well explained. Thank you

    • @bkrai
      @bkrai  4 года назад

      You are welcome!

  • @rosestube1233
    @rosestube1233 8 лет назад +1

    Thank you for this tutorial! it's amazingly easy to follow and thanks a lot for the script/file

    • @bkrai
      @bkrai  8 лет назад

      +Roses Tube 👍

  • @saikrishna2589
    @saikrishna2589 7 лет назад +1

    Thank you for wonderful explanation. Appreciate your help with these amazing videos

    • @bkrai
      @bkrai  7 лет назад +1

      Thanks for your feedback!

  • @kishoreyarramshetty2930
    @kishoreyarramshetty2930 3 года назад +1

    Good Job in explaining the content along with code..

    • @kishoreyarramshetty2930
      @kishoreyarramshetty2930 3 года назад +1

      can u provide us the link to download the dataset in this video to run the code.

    • @bkrai
      @bkrai  3 года назад

      Thanks for comments!

    • @bkrai
      @bkrai  3 года назад

      For data, there should be a link below this:
      ruclips.net/video/otjWCaMcVaA/видео.html

  • @abdulkhader101
    @abdulkhader101 6 лет назад +1

    You are a great teacher sir, you are really awesome

    • @bkrai
      @bkrai  6 лет назад

      Thanks for comments!

  • @mwambakapambwe2382
    @mwambakapambwe2382 5 лет назад +1

    Fantastic presentation. Very helpful

    • @bkrai
      @bkrai  5 лет назад

      Thanks for comments!

  • @zhuziyan9454
    @zhuziyan9454 6 лет назад +2

    dear professor, I am so lucky to know you. could you also update full tutorial about using rmd and advanced model like hmm? Thank you and wish you have a great day

    • @bkrai
      @bkrai  6 лет назад

      Thanks for the suggestion, I've added this to my list.

  • @ssundaraju
    @ssundaraju 6 лет назад +1

    Very Informative, great slides and explanations. The delivery and presentation was good. I will be viewing other videos produced by Edureka. Some suggestions, show more examples. Present the limitations and god fit scenarios for K-means clustering.

    • @bkrai
      @bkrai  6 лет назад

      Thanks for comments and feedback!

  • @metalhealth14
    @metalhealth14 8 лет назад +1

    this is a really great detail thank you! I appreciate the detailed guidance into understanding and checking cluster membership

    • @bkrai
      @bkrai  8 лет назад

      It's good to hear your feedback! Thanks

  • @liamhannah6325
    @liamhannah6325 6 лет назад +1

    This was really helpful THANK YOU! Make more! I would love it if you showed us how to do Latent Class Analysis in R, its not obvious right now

    • @bkrai
      @bkrai  6 лет назад

      Thanks for comments and suggestion!

  • @bassamal-kaaki3253
    @bassamal-kaaki3253 4 года назад +1

    Lovely explanation:) easy to absorb.

    • @bkrai
      @bkrai  4 года назад

      Thanks for comments!

  • @Aminah6623
    @Aminah6623 4 года назад +1

    Wow. This was extremely helpful. Thank you.

    • @bkrai
      @bkrai  4 года назад

      You're very welcome!

  • @nafinks6081
    @nafinks6081 7 лет назад +1

    Excellent tutorial! very easy to grasp.

    • @bkrai
      @bkrai  7 лет назад

      +Nafin Ks thanks for the feedback!

  • @prashantmishra2094
    @prashantmishra2094 5 лет назад +1

    nice tutorial Sir. Keep making such videos

    • @bkrai
      @bkrai  5 лет назад

      Thanks for comments!

  • @fredpoole6373
    @fredpoole6373 6 лет назад +1

    Great Video! Look forward to more videos!

    • @bkrai
      @bkrai  6 лет назад

      Thanks for comments! For more machine learning videos you can use this link: goo.gl/WHHqWP

  • @khushboobegwani1612
    @khushboobegwani1612 6 лет назад +1

    Thank you so much sir for informative video. You really made it easy.

    • @bkrai
      @bkrai  6 лет назад

      Thanks for your comments!

  • @saikatkar547
    @saikatkar547 4 года назад +1

    thats really excellent explanation!

    • @bkrai
      @bkrai  4 года назад +1

      Glad it was helpful!

  • @gulapakarthik3864
    @gulapakarthik3864 3 года назад +1

    This is really Amazing...Thank you so much 😎

    • @bkrai
      @bkrai  3 года назад

      You are welcome!

  • @omkarsingh6060
    @omkarsingh6060 5 лет назад +1

    Amazing...Really impressed

    • @bkrai
      @bkrai  5 лет назад

      Thanks for comments!

  • @thejuhulikal6290
    @thejuhulikal6290 3 года назад +2

    sir please make the video on this K-mode also, that would be great to understand both topics and comparison

    • @bkrai
      @bkrai  3 года назад

      Thanks, I've added it to my list.

  • @kandreitapomen
    @kandreitapomen 8 лет назад +1

    Great tutorial. Thank you very much!

    • @bkrai
      @bkrai  8 лет назад

      +Kandreitapomen 👍

  • @hridayborah9750
    @hridayborah9750 4 года назад +1

    yes all your videos are helpful. Could you prepare a tutorial on machine learning in the tidy verse.

    • @bkrai
      @bkrai  4 года назад

      I've added it to list of future videos. Thanks!

  • @biswadeepdas5528
    @biswadeepdas5528 8 лет назад +1

    sir, it is quite good. I would really appreciate if you upload more videos .

    • @bkrai
      @bkrai  8 лет назад

      +biswadeep das thanks for your feedback! I'll definitely create more such videos.

  • @DeepeshSinghAndroid
    @DeepeshSinghAndroid 8 лет назад +1

    Hi Mr. Rai, great tutorial. Thanks for your effort. Just wanted to understand more about these 2 methodologies. Why and when we apply different methodologies i.e. K means and Hierarchy. It will be great help if you can make separate videos for the same. Also, as lots of people requested for data set and you have already uploaded to Dropbox, could you please share the link in your description for everyone's benefits. Thanks again :)

    • @bkrai
      @bkrai  8 лет назад

      Initially we try all methods and finally choose the one that seems more meaningful for the dataset used. It's difficult to say which method will work best beforehand. Also thanks for your feedback and suggestions.

  • @mariaamithapennington3737
    @mariaamithapennington3737 4 года назад +1

    Thank you so much for the tutorial. It is extremely helpful. But my question like the other is that it would have been very kind of you if you would have linked your data set too. Thanks!

    • @bkrai
      @bkrai  4 года назад +1

      You can get it from here: ruclips.net/video/otjWCaMcVaA/видео.html

    • @mariaamithapennington3737
      @mariaamithapennington3737 4 года назад +1

      @@bkrai Thank you very much! Appreciate it! :)

    • @bkrai
      @bkrai  4 года назад +2

      You are welcome!

  • @alicelatimier3133
    @alicelatimier3133 4 года назад +2

    Thank you so much for your amazing videos, everything is so clear and practical :) From a french research in cognitive science, I have one tricky question for you : i would like to find the best classifier/cluster analysis for repeated measures dataset (i.e., multiple repeated measures for one subject on the same features, as this is the case in experimental psychology research for example, or in longitudinal studies). Best

    • @bkrai
      @bkrai  4 года назад

      You can look into this link:
      ruclips.net/p/PL34t5iLfZddvMPAl1TzHJ_GjQcD3s6w_Z

  • @rithishvikram1759
    @rithishvikram1759 4 года назад +1

    nice explaination sir!!!!! thank you so much ....great respect ....sir if you would pls attach concern datasets with a video ...thank you once again

  • @santosacosta4645
    @santosacosta4645 6 лет назад +1

    Thank you very much sir. Question: using Within group SS plot (min 14:39), isn't the optimal number of clusters 5? the variability from 4 to 5 seems very significant. Please let me know.

    • @bkrai
      @bkrai  6 лет назад +2

      This data has only 22 companies. As we increase number of clusters, number of companies in some clusters becomes really small, to the extent that a cluster may contain just one company. So the choice of 'k' should also consider this aspect.

  • @EduardoFrancoChalco
    @EduardoFrancoChalco 8 лет назад +1

    Really great tutorial, thank you very much!

    • @bkrai
      @bkrai  8 лет назад

      +Eduardo Franco Chalco 👍

    • @EduardoFrancoChalco
      @EduardoFrancoChalco 8 лет назад

      Would you please send me the scrip and data? email: efranco1@uc.cl

  • @betzthomas9693
    @betzthomas9693 4 года назад +1

    Thank you Sir for the tutorial.Please explain if there is any package is R to identify on what basis clusters are grouped from the data we provide.

    • @bkrai
      @bkrai  4 года назад

      Refer to the averages for each cluster and all variables.

  • @Nit1601
    @Nit1601 2 года назад +1

    THE BEST !!! Could you please advise, do we need to do anything else to normalize if we are dealing with Binary columns (0,1). Thanks !

    • @bkrai
      @bkrai  2 года назад +1

      We should exclude such variables.

  • @desisto007
    @desisto007 7 лет назад

    Thank you so much! Very well explained.
    I would like to ask you if I still can use the Euclidian distance to find the closest elements of a cluster center, even if I use a dimensionality reduction approach (such as PCA, T-sne) that uses probabilities to arrange clusters in 2 dimension before using K-means.

  • @shezamalik7918
    @shezamalik7918 2 года назад +1

    hello sir, great tutorial, you're a life saver for marketing analytics course!
    I have a question regarding Scree plot code:
    wss

    • @bkrai
      @bkrai  2 года назад +1

      it tries 1 to 20 clusters.

    • @shezamalik7918
      @shezamalik7918 2 года назад +1

      @@bkrai oh right, thanks alot! Can you also tell how do we deal with gender variable for clustering? What im doing is mutating a new var thats 1 and 0 instead of male and female. I then convert that to numeric variable. And then i do the usual process. Is this correct?

    • @bkrai
      @bkrai  2 года назад

      For clustering, we should use only numeric variables.

    • @shezamalik7918
      @shezamalik7918 2 года назад +1

      @@bkrai so how should i deal with gender? Its an important variable in marketing for ad targeting etc

    • @bkrai
      @bkrai  2 года назад

      you can put that on Dendrogram after clustering to see if it shows any pattern.

  • @txigual
    @txigual 5 лет назад +1

    Thank you so much, very useful video.

    • @bkrai
      @bkrai  5 лет назад

      Thanks for comments!

  • @asifjeelani1215
    @asifjeelani1215 3 года назад +1

    thank you sir, very well explained

    • @bkrai
      @bkrai  3 года назад

      Thanks for comments!

  • @thejuhulikal6290
    @thejuhulikal6290 3 года назад +2

    Sir please do the vedio on PAM algorithms!

    • @bkrai
      @bkrai  3 года назад

      Thanks, I've added it to my list.

  • @phediasdiamandis2441
    @phediasdiamandis2441 8 лет назад +1

    Great Video. Congrats

    • @bkrai
      @bkrai  8 лет назад

      +Phedias Diamandis thanks for the feedback 👍

  • @anigov
    @anigov 6 лет назад +1

    Dear Sir..thank you for the time & effort that you have put in to make this wonderful video tutorial.
    I have a query. At 12:27 , how are the original average values displayed even though member.c is used which is obtained through a series of calculations using the normalised data?
    Why did not you use PCA to decide the no. of clusters for kmeans?
    Regards
    Aniruddh

    • @bkrai
      @bkrai  6 лет назад +1

      In the 2nd aggregation line, note that I've used utilities. That's the reason we can display original values. In the 1st aggregation, z was used. Also, here focus was on clustering, so pca is not used.

    • @anigov
      @anigov 6 лет назад +1

      Thank you

  • @tahzeebfatima3121
    @tahzeebfatima3121 6 лет назад +1

    Thanks for the informative video. May I please know how to deal with dichotomous variables along with continuous variables in the data if we want to include both in one cluster analysis, how do we do it please?

    • @bkrai
      @bkrai  3 года назад

      This link has more cluster analysis topics:
      ruclips.net/video/otjWCaMcVaA/видео.html

  • @stephravelo
    @stephravelo 8 лет назад +1

    This is a very informative video. I hope you would have a repository github of your data so that we can play around with the script you used.

    • @bkrai
      @bkrai  5 лет назад

      Here is the link: github.com/bkrai/Top-10-Machine-Learning-Methods-With-R

  • @theshubhnaam
    @theshubhnaam 6 лет назад +1

    Best tutorial ever thank you sir..got the concept bt sir can you please share the utilities dataset..🙌🙌

    • @bkrai
      @bkrai  6 лет назад

      Thanks for comments! Send email id.

    • @theshubhnaam
      @theshubhnaam 6 лет назад

      Bharatendra Rai imshubhamv.25@gmail.com

    • @theshubhnaam
      @theshubhnaam 6 лет назад +1

      Thank you sir

    • @bkrai
      @bkrai  6 лет назад

      all set.

    • @theshubhnaam
      @theshubhnaam 6 лет назад +1

      Bharatendra Rai yes sir🙌🙌

  • @TusharLapani
    @TusharLapani 8 лет назад +1

    Thanks Bharatendra. Can you please upload video of how to performe clustering when the dataset has numbers of numerical attributes and categorical attributes. In this video you are eliminating categorical attribute. What would you have done if your dataset has 10 numeric columns and 8 categorical data.
    Appreciate your knowledge contribution.

    • @bkrai
      @bkrai  8 лет назад +1

      +Tushar Lapani For cluster analysis you must have quantitative variables. You can use categorical variables after cluster analysis to see if they show any pattern with identified clusters and use it for characterizing the clusters.

  • @azfersaeed1602
    @azfersaeed1602 8 лет назад +1

    Great video man! Thank you very much for posting :). Could you show cluster analysis using more than 2 variables?

    • @bkrai
      @bkrai  8 лет назад

      +Azfer Saeed thanks for feedback! In the example we have cluster analysts with 8 variables. However for scatter plot we use two variables at a time.

    • @azfersaeed1602
      @azfersaeed1602 8 лет назад

      +Bharatendra Rai You are correct...sorry for the incorrect semantics. At 2:15, you mention that broadly, there are 3 clusters but they are based only on 2 variables. Is there a way to create clusters based on more than 2 variables?

  • @mallorywright1453
    @mallorywright1453 5 лет назад +1

    Do you have any examples of validating a cluster analysis using LPA?

    • @bkrai
      @bkrai  5 лет назад

      I'm adding to the list of future videos.

  • @thejuhulikal6290
    @thejuhulikal6290 3 года назад +1

    Hello sir, please upload a video on Qualitative comparative analysis!! thanks again sir

    • @bkrai
      @bkrai  3 года назад

      I've added it to my list, thanks!

  • @deepaksingh9318
    @deepaksingh9318 7 лет назад +1

    A good tutorial ,
    Could you please also tell us when should we go for Kmeans and When should we go for Hclust(I.E situations to select methods)
    2. What do we mean when we say above average and below average (in Hclust) , i mean if the value is 1.05 so are we saying that sales in cluster x is higher 1.05 than average ??
    a explanation will be appreacited..
    REst everything is explained in a really simple way so Subscribing the channed :)
    Keep it up..

    • @bkrai
      @bkrai  3 года назад

      For more on clustering:
      ruclips.net/video/otjWCaMcVaA/видео.html

  • @rezaamirahmadi6013
    @rezaamirahmadi6013 3 года назад

    Thanks , How can I use fuzzy k-means (FKM) to impute missing in R ?

  • @Guavarosa
    @Guavarosa 5 лет назад +1

    Please can you give me a hint? I want to give as input the initial centres for kmeans clustering. I just do not manage to select these points out of my dataset. Thank you in advance for your help!

    • @bkrai
      @bkrai  5 лет назад

      Why do you need that? The algorithm should automatically take care of finding the best clusters.

    • @Guavarosa
      @Guavarosa 5 лет назад

      @@bkrai Because I try to correlate my clusters to the physical problem. That is why I was wondering if I can give initial centres as in case of software Origin Pro. I appreciate your answer.

  • @zhuziyan9454
    @zhuziyan9454 6 лет назад +1

    could you please explain why subtracting the first variable by [,-c(1,1)] rather than[,-1]? Thank you

    • @bkrai
      @bkrai  6 лет назад

      Both work fine. You can use it if you need to remove more than one variable.

  • @shubhasmitasahani1738
    @shubhasmitasahani1738 5 лет назад +1

    Hello Sir, do you have any video on latent class clustering in R? Please share...Looking forward.

    • @bkrai
      @bkrai  5 лет назад

      Not yet, but I'm adding this to my list for future. For clustering related videos, you may refer to this link:
      ruclips.net/p/PL34t5iLfZddvMPAl1TzHJ_GjQcD3s6w_Z

  • @ramp2011
    @ramp2011 7 лет назад +1

    Great tutorial. Thank you... How do you handle categorical variables for clustering? In this example looks like you removed the 1st column that happened to be a factor variable. Can you please post the data file used in the comments as well if possible? Thank you

    • @bkrai
      @bkrai  7 лет назад

      Cluster analysis only works with quantitative variables. During the analysis you may note that we calculate distances, which we cannot do with categorical variables. But after finalizing number of clusters, you can plot dendrogram with a categorical variable to see if there is any obvious pattern or not.
      For data, send email id.

    • @Jorge-vp7of
      @Jorge-vp7of 6 лет назад

      you can use K-modes to do clustering with categorical data

    • @medardkafoutchoni6511
      @medardkafoutchoni6511 6 лет назад

      Thank you dear Sanchez. What about mixed data (i.e. including both numerical and categorical variables)?

    • @vivekwilliam3370
      @vivekwilliam3370 6 лет назад

      vivek4u.3048@gmail.com

  • @tanmay094
    @tanmay094 4 года назад +1

    Nice and informative tutorial sir.
    I am performing hierarchical clustering on my dataset with 10 variables and 200 observations. But the output is not very interpretable.
    Please suggest how can I make it more interpretable.
    Thanks.

    • @bkrai
      @bkrai  4 года назад

      You can explore other clustering methods and if they provide better insights. Here is the link:
      ruclips.net/p/PL34t5iLfZddvMPAl1TzHJ_GjQcD3s6w_Z

    • @tanmay094
      @tanmay094 4 года назад +1

      @@bkrai Thanks, sir.
      I have one more query. I want to do cluster analysis on PCA.
      Can you please suggest a good reference tutorial for doing that?

    • @bkrai
      @bkrai  3 года назад

      This approach will work fine.

  • @rinoypaultharu5071
    @rinoypaultharu5071 5 лет назад

    Great tutorial, it really help for my analysis. Im having some douts, in that while silhouette calculation, whether we need to check average silhouette value, or which value we have to check to find out the number of clusters. Please help me with that. In your analysis what is the silhoutte value for k=3, where it is showing on that plot?
    Second while calculating my Euclidean distance, i have 40 observations, so it is not showing complete rows of Euclidean matrix, so is there any other way to obtain the complete matrix

  • @niv2419
    @niv2419 7 лет назад +1

    Hi!
    Thank you so much of making this blog! Can you please make a video on feature engineering in R?
    Thank you!

    • @bkrai
      @bkrai  6 лет назад

      Here is the link:
      ruclips.net/video/VEBax2WMbEA/видео.html

  • @niv2419
    @niv2419 7 лет назад +1

    Hello sir, as always your videos have been very helpful and thank you for this video too. Also, I wanted to know if there is a way to improve between cluster distance? If so can you please let us know?
    Thank You!

    • @bkrai
      @bkrai  7 лет назад +1

      You can increase or decrease number of clusters and see which one improves between cluster distance.

  • @VenkateshDataScientist
    @VenkateshDataScientist 8 лет назад

    HAPPY NEW YEAR TO YOU AND YOUR FAMILY MEMBERS .
    Sir ,If you have time please upload support vector machine and Sentimental analysis .

    • @bkrai
      @bkrai  8 лет назад

      A very happy new year to you and family too! I'll keep your suggestion in mind for next videos.

    • @bkrai
      @bkrai  7 лет назад

      Here is the link to SVM:
      ruclips.net/video/pS5gXENd3a4/видео.html&list=PL34t5iLfZddtII4ssT8FSUFP27fPYDEhY&index=25

  • @sanjayh3897
    @sanjayh3897 8 лет назад +1

    Excellent tutorial Bharatendra ! Do you have any example to share for Overlapping clustering - would appreciate it.
    Thanks !

    • @bkrai
      @bkrai  8 лет назад

      There are 52 datasets where clustering can be applied in the link below:
      archive.ics.uci.edu/ml/datasets.html?format=&task=clu&att=&area=&numAtt=&numIns=&type=&sort=nameUp&view=table

  • @ste6826
    @ste6826 3 года назад +1

    One suggestion to improve the video - When you click buttons and such please can you do it slowly so people can see where you click. Also perhaps consider using a highlight icon for your mouse? I had to watch 4 times before I realised you had pressed the 'run' button in the middle.

    • @bkrai
      @bkrai  3 года назад

      Thanks for the suggestion!

  • @machinelearningzone.6230
    @machinelearningzone.6230 4 года назад +1

    HI Sir,
    How do we assign the clusters to new data points, like if we have a new data set but use the same model.
    Regards
    Gourab.

    • @bkrai
      @bkrai  4 года назад

      You can develop a prediction or classification model with cluster as independent variable.

    • @machinelearningzone.6230
      @machinelearningzone.6230 4 года назад +1

      @@bkrai Thank you . Do you mean that we can develop a classification model using the clusters labels as classes?if so,then how do we take into account the distance parameters like eucledian or taxi cab etc..

    • @bkrai
      @bkrai  4 года назад

      You don't need that as it is already baked into the clusters.

  • @mfkalabdullah6966
    @mfkalabdullah6966 8 лет назад +1

    Sir, Do you have more videos on clustering? Also, can I contact you in the future regarding clustering because I'm doing a research using data mining clustering?

    • @bkrai
      @bkrai  3 года назад

      There is a playlist on clustering:
      ruclips.net/video/otjWCaMcVaA/видео.html

  • @keeninterest8889
    @keeninterest8889 5 лет назад +1

    Sir, Can you please tell me whether it is necessary to do normalization to qualitative data?

    • @bkrai
      @bkrai  5 лет назад

      No you don’t need it for qualitative variables.

    • @keeninterest8889
      @keeninterest8889 4 года назад

      @@bkrai Thank you sir

  • @manigandanv8531
    @manigandanv8531 7 лет назад +1

    Thank you so much for explaining this . It would be really grate help if you could upload a video using bray curtis similarity.. b

    • @bkrai
      @bkrai  7 лет назад

      Thanks for the suggestion, I'll keep it for future.

  • @arunsoni3280
    @arunsoni3280 4 года назад +1

    Which software does it run on ?

    • @bkrai
      @bkrai  4 года назад

      If you are looking to get started with RStudio, you may find this link useful:
      ruclips.net/p/PL34t5iLfZddv8tJkZboegN6tmyh2-zr_T

  • @maggief6653
    @maggief6653 5 лет назад

    I´d like to change the dendogram position (Horizontal Plot), what package and function can I use?

  • @klaows
    @klaows 6 лет назад +1

    Thank you for your video.
    I try to practice but my data are 48 rows, after I normalization, It omitted 26 rows
    What should I do ?
    Thank you

    • @bkrai
      @bkrai  6 лет назад +1

      Normalization should not lead to omitting rows.

    • @klaows
      @klaows 6 лет назад

      Bharatendra Rai Thank you for your replying. Yes I wonder. The program is omitted rows by itself.
      I was doing until I get the dendrogram. The trend is good. But I have no idea it correct is.

    • @liamhannah6325
      @liamhannah6325 6 лет назад +1

      @@klaows sometimes R does that just to reduce the output visually, you can adjust with options(max.rows = 9999999)

  • @javzmaatsend3785
    @javzmaatsend3785 4 года назад +1

    Thank you, Very easy

    • @bkrai
      @bkrai  4 года назад

      You are welcome!

  • @aks1008
    @aks1008 5 лет назад +1

    Sir how to remove multicollinearlity in cluster analysis as it is an unsupervised algorithm..there is no dependent variable..

    • @bkrai
      @bkrai  5 лет назад

      Multicollinearlity is a problem only for regression models. For cluster analysis it not an issue.

  • @dr.naeemhaider4747
    @dr.naeemhaider4747 7 лет назад

    your video is very helpful for me to learn cluster analysis, i also want to know does k- means can be applied to time series data as well, like 50 companies electricity consumption data of 3 months and each company has 24 hours of discrete values of voltage and resistance with time stamps .... can we use k means with time series?

    • @bkrai
      @bkrai  7 лет назад

      I would say try and see what you get, no harm in trying.

    • @dr.naeemhaider4747
      @dr.naeemhaider4747 7 лет назад

      can you suggest a method for time series data.?

    • @dr.naeemhaider4747
      @dr.naeemhaider4747 7 лет назад

      i tried it works fine but i want to use time and dates aswell any suggestions ?

  • @sayedyavar3752
    @sayedyavar3752 7 лет назад +1

    i want to remove multiple columns from my data set just like you removed the company. what code should I use?

    • @bkrai
      @bkrai  7 лет назад

      let's say tou want to remove columns 2, and 4 from 'data' that has 5 columns. Then,
      data1

  • @AnchalSingh06
    @AnchalSingh06 9 лет назад +1

    Thank you for posting this video. It's helpful. I have (500,226) data . Please guide me to do Kmeans and Silhouette in R

  • @shruthihariharapura
    @shruthihariharapura 8 лет назад +2

    hi, excellent tutorial, it helped me a lot, can you help us in implementing density based clustering in R. Feeling difficult in implimenting

    • @bkrai
      @bkrai  3 года назад

      Thanks!

  • @rohanshetty1016
    @rohanshetty1016 5 лет назад +1

    Sir your video lectures are really awesome! Excellent Tutorial!
    Can you please share the csv file used for cluster analysis?

    • @bkrai
      @bkrai  5 лет назад

      send me your email id.

  • @betzthomas9693
    @betzthomas9693 4 года назад +1

    Can you please explain in K means clustering(Scree plot).What is the idea behind wss calculation

    • @bkrai
      @bkrai  4 года назад

      wss is within sum of squares that captures within cluster variability. When wss is low, then cluster formation is good.

    • @betzthomas9693
      @betzthomas9693 4 года назад

      Thank you @@bkrai

  • @springANDstorm
    @springANDstorm 5 лет назад +1

    Sir, how to interpret the between SS/total SS value? In your example, it's 36% . How should that be interpreted?

    • @bkrai
      @bkrai  5 лет назад +1

      Between SS captures variability between clusters. When it increases, it indicates better clustering because within cluster variability will come down. Elements within a cluster should be closer to each other whereas elements between clusters should be further away for a good cluster formation.

    • @springANDstorm
      @springANDstorm 5 лет назад +1

      @@bkrai thanks Sir.

  • @sudhakarbabunynavarapu8133
    @sudhakarbabunynavarapu8133 7 лет назад +1

    Could you please send the data files for the practice what datafiles used in the tutorial.

    • @bkrai
      @bkrai  7 лет назад

      email id?

  • @im_karamo1907
    @im_karamo1907 6 лет назад +1

    Thanks for the video... how can we get the video to practice on? Thanks again for the video

    • @bkrai
      @bkrai  6 лет назад

      If you need data, send me email id.

    • @im_karamo1907
      @im_karamo1907 6 лет назад +1

      @@bkrai my email ID # kamasbah@live.com

    • @bkrai
      @bkrai  6 лет назад

      all set.

  • @gambhiraogirish1710
    @gambhiraogirish1710 7 лет назад +1

    Thanks for great explanation sir. May I have data set for practice please.
    Thanks again sir.

  • @harishnagpal21
    @harishnagpal21 6 лет назад +1

    Nice video as always. I have couple of questions. In K means cluster example, if we want a list as per the three clusters, how do we tag that.
    2nd query, I have a data set of 100000 insurance customers having customer ids and their policy Face amount. I want to divide them in cluster ( say 5 cluster) and also want to know which customer comes in which cluster (same query as first) so that I can target them for a campaign. How do we do that and which clustering technique to use? Thanks in advance.

    • @bkrai
      @bkrai  6 лет назад

      You can use something similar to kc$cluster that I've used at around 16:30 time point in the video.

    • @harishnagpal21
      @harishnagpal21 6 лет назад

      Thanks

  • @tabasummirza8638
    @tabasummirza8638 4 года назад +1

    great tutorial.please tell me how to label he clusters

    • @bkrai
      @bkrai  4 года назад

      You can come up with appropriate names for the labels by looking at averages for each cluster and each variable.

  • @chitralalawat8106
    @chitralalawat8106 5 лет назад +1

    Does mclust also required normalization of data?

    • @bkrai
      @bkrai  5 лет назад

      It's always better to do normalization.

    • @chitralalawat8106
      @chitralalawat8106 5 лет назад +1

      @@bkrai I have many files which I want to concatenate..should I concatenate and then normalize the data or should I normalize and then concatenate?

    • @bkrai
      @bkrai  5 лет назад

      You can first concatenate.

    • @chitralalawat8106
      @chitralalawat8106 5 лет назад

      @@bkrai Are you sure?