SCD: Slowly changing dimensions explained with real examples
HTML-код
- Опубликовано: 1 окт 2017
- The video explains what are slowly changing dimensions, Their relevance in data warehousing and which SCD type should be used in what kind of data scenario.
The video Explains below with real project examples.
#SlowlyChangingDimension #SCD2 #TechCoach
SCD 0 - Passive method (No change in data)
SCD 1 - Overwriting the old value (Latest Record Only)
SCD 2 - Creating a new additional record (Maintains History)
SCD 3 - Creating an additional Column (Rarely Used)
SCD 4 - Using history table
SCD 6 - The hybrid approach
Guys please support me in building my new youtube channel "An Indian Abroad " by watching subscribing and sharing with your friends
ruclips.net/user/AnIndianAbroadd
what about a situation where by the current snapshot doesn't contain the last data especially in a case like the employee is fired or left the job and that information is reported in a different table .How do you update the previous date and at that point will you maintain the current flag as 'Y' or'N'
SCD explained very well and with so much patience. !! Much appreciated... Thanks for sharing the knowledge on it
Thanks for the kind words buddy :)
Please consider subscribing to my other channel as well it will really help me
ruclips.net/video/6G1xGi-D5ow/видео.html
Superlike!! What I like about your videos is that you give real examples.
Thanks a lot shruti :)
thanks for the excellent lesson and clear sound
Simple and clear explanation. Thank you Tech Coach.
Thanks Udi Tech for the kind words, I have a small request.I am working on this new channel and will really appreciate if you watch and subscribe to it
ruclips.net/video/j7RrxEnZ_8E/видео.html
Thank you very much for this simplest explanation I could find over youtube! Awesome :)
Thanks Sanjay for the kind words :)
Hello Vivek ..thanks for sharing. I noticed that for SCD Type 3 example (at 14:50) when the salary value changes, you left out to put prev_salary and current_salary in the table although you did explain in your video that if there are more than one column change for each column there must be both previous and current values to be kept in DW.
Very precisely and beautifully explained. I was able to understand each and every thing you explained. 👏
Thank you so much for you explanation, it was very clear!
Thanks a lot for the kind words, I have a small request I am working on this new youtube channel " An Indian Abroad " and will really appreciate if you watch and subscribe to it.
ruclips.net/video/11DK-oyRql0/видео.html
Great video. Thanks a lot Vivek for explaining very simply and clearly!
I am glad Anand I could help :)
Very informative and concise video. Thanks!
Thanks for the kind words.I have a small request, I am working on a new channel " An Indian Abroad" and it will really help me if you watch and subscribe to it.
ruclips.net/video/11DK-oyRql0/видео.html
Very well explained. Thank you!
Thanks Usha for the kind words.
I have a small request I am working on this new channel "An Indian abroad" and will really appreciate if you watch and subscribe to it.
ruclips.net/video/11DK-oyRql0/видео.html
Thank you for the clear explanation!
Thanks Pranav for the kind words, This video on Indexing may interest you as well.
ruclips.net/video/0X9bbtwTnuE/видео.html
This is some wonderful explanation. And they way you explain is so easy to understand and follow. Thank you so much Bro!
Thanks Mohanraj for the lovely words, I am glad I could help :)
Explanation was very precise and through the point.I really like the way you explained..!!
Could you please explain the concept of granularity in depth and its significance..
Thanks in advance.!
very nice video, good knowledge sharing
Thanks a lot for the kind words.
I would really appreciate if you help me in my new Initiative "An Indian Abroad"
by subscribing viewing and sharing.
ruclips.net/user/AnIndianAbroadd
I didn't understand before watching this video now I'm able to understand the SCD concept; thanks for the information
I am glad I could help Krishna :)
Too good and simple explanation of SCD.. 👍🏻
Hi Vivek, Thank you for this video. It helps me a lot. I have watched several training in SCD but they made me much more confuse. But this video helped me to understand. Just I want to mention that as far as I know the surrogate key should change in each update in SCD2.
Thanks Majid, with every change ( insert in ScD 2 the surrogate key should increment)
Thank you! Super concise and clear
Thanks a lot buddy :)
Very well Explanation. Thank you so much :)
+Ranvir singh Thanks a lot Ranvir Singh :)
Thanks for the clear explanation
You are welcome Keith :)
Great explanation thank you !
Thanks Saurabh for the kind words, It means a lot to me. I have a small request, I am working on this new channel and would really appreciate if you watch and subscribe to it.
ruclips.net/video/IP2Vn6jK8Hg/видео.html
Excellent Explanations Skills!!!
Thanks Hiren for the wonderful comment. I have a small request I am working on this new youtube channel and will really appreciate if you watch and subscribe to it.
ruclips.net/video/HBQHekM1U2c/видео.html
nice explanation with examples
It was knowledge rain for me, thank you brother for the social work!
Simple and easy !! Great work
Thanks a lot for the kind words Mandar :)
The way of explanation is damn clear...
Very useful for beginners.
Thanks a ton for this video
+Sivanjaneya Reddy M.V. Thanks a lot for the kind words :)
I would love your support for my new channel, Please watch subscribe and share with your friends.
ruclips.net/channel/UCoLdaMxhfDgdgIAcRGlUvkg
Very Good with example & explanation
Thank you , keep adding more ..👍
dhanaraju ramadi Thanks for the kind words. I will be uploading more such videos soon.
Thank you very much for your explanation 👍
Thanks for the kind words :)
Very well explained . Thanks
Awesome explanation.. totally worth it!
Thanks Jyoti for the kind words.
Please consider subscribing to my other channel as well. It will really help me.
ruclips.net/video/6G1xGi-D5ow/видео.html
thats awesome...very well explained..thank you very much bro.
Thanks buddy for the kind words, this video on indexing may interest you as well.
ruclips.net/video/0X9bbtwTnuE/видео.html
Very well explained. I had an issue where I had implemented SCD 1. Later SCD 2 replaced it. I would say SCD 4 is a more elegant way. Great job! thanks for this video
Very nice explanation and real life examples ..kudos
Thanks Dipti for the kind words, I have a small request. I am working on this new youtube channel and will really appreciate if you watch and subscribe to it.
ruclips.net/video/IP2Vn6jK8Hg/видео.html
Once again Good work Vivek
Thanks a lot for the kind words.
I would really appreciate if you help me in my new Initiative "An Indian Abroad"
by subscribing viewing and sharing.
ruclips.net/user/AnIndianAbroadd
well explained; this SCD types always ask during technical interview.
Thanks Vin for the kind words I have a small request
I am working on this new youtube channel, I Would love it if you watch and subscribe to it as well.
ruclips.net/video/GnVn3mPBRz4/видео.html
Lol i was asked this in an inteview. I said I've never heard of it. After watching this video, it turns out that I've been working on SCD for severals years now. 😂😂 I just didn't know they were called as such.
@@gregorclegane7563 exactly bro.. Just now I was asked this.. I said I don't know and searching in RUclips now. Found this
What we want to do,if we want an additional column which is not presented in dataware house previously...?
This is very informative, very easy to understand. Thank you so much for this!
I am glad I could help :)
Nice once Vivek......Keep it up
please upload videos regarding SCD based scenarios wth both SQL and informatica (two approaches) your explanation methodology is very good.
shubham chouhan Sure Shubham I will work on it soon
excellent stuffs and nicely explained.
Thanks Ahmad Syed for the kind words.
I have a small request, I am working on this new channel please do watch and subscribe to it.
Your support is my motivation. ruclips.net/video/JobONiVWA9Q/видео.html
Thanks. Nice and concise explanation of the different types of SCD.
Thanks a lot for the kind words :)
Thanks a lot for the kind words :)
Thanks dada (bhaiya) for your clear and concise approach to scd.
Thanks buddy for the kind words.
Please consider subscribing to my other channel as well
ruclips.net/video/6G1xGi-D5ow/видео.html
Awesome bro...keep doing 👍🏼
Thanks a lot for the kind words, I have a small request I am working on this new youtube channel " An Indian Abroad " and will really appreciate if you watch and subscribe to it.
ruclips.net/video/11DK-oyRql0/видео.html
clear and practical examples. good job
@shukri thanks for the kind words.
Please consider subscribing to my other channel as well. It will really help me.
ruclips.net/video/6G1xGi-D5ow/видео.html
Well explained vivek... Big thumps up
Thanks a lot for the kind words Nishanth :)
This video may interest you as well .
ruclips.net/video/5nfHmh8NsHw/видео.html
Beautifully explained!
I am glad I could help
Really great video ,easy to understand
@Vivek, Thanks for your kind words.
It made my day :)
Please consider subscribing to my other channel as well. It will really help me.
ruclips.net/video/6G1xGi-D5ow/видео.html
You deserve much more viewers than now since you narrated the concepts very well,I like your videos, Thanks, dear friend.
Thanks a lot sreejith for the kind words, you made my day. I have around 80 videos and your comments boosted my confidence to make many videos.
Thanks a lot again.
Hello thank you very much for this.
For SCD type II, in your example, what happens if you are pulling data from the source every day and some day the id 123 doesn't come? How will you reflect that change in your data warehouse table? and what if then the id 123 comes again?
Is this possible?
Thanks
great simple explanation!!
Thanks a lot for the kind words :)
I would love your support for my new channel, Please watch subscribe and share with your friends.
ruclips.net/channel/UCoLdaMxhfDgdgIAcRGlUvkg
Thanks, Vivek, really its very good video to understand SCD.
If you have any video with the practice session plz share a link for the same which helps more clear.
Thanks Mohammad , Unfortunately at this moment i don't have a practice video on it.
Thank you Vivek! this was very helpful.
Regards,
Sujaa
Thanks Sujaa for your constant feedback, It helps me going :)
great explanation... thanks for the video
Thanks a lot buddy, I am glad I could help :)
Simply awesome
very nicely explained. Thankyou
Thanks a lot Megha
If the ID col is primary key, then how do we add additional rows?
amazing explaination.great job bro
Thanks a lot buddy :)
Hi..Thank you so much for this valuable information that helps me a lot
Very well explained with nice example 🙂 thanks
Thanks a lot buddy :)
Nice explanation
Very crisp and to the point.
Thanks buddy for the kind words,
Please consider subscribing to my other channel as well, it will really help me :)
ruclips.net/video/6G1xGi-D5ow/видео.html
@golden,
please consider subscribing to my new channel it will really help me
ruclips.net/video/6G1xGi-D5ow/видео.html
Superb explanation understand very easily thank you so much bro......
Thanks Buddy
Thanks. Great video.
Thanks buddy for the kind words :)
Excellent 😊
Thank you!!
Thanks Tony for the appreciation. I have a small request. I am working on this new youtube channel and will really appreciate if you watch and subscribe to it.
ruclips.net/video/11DK-oyRql0/видео.html
Excellent video. Only question is on scd 6. Why did you set old value equal to current value in last row?
good explanation . Really helpful for me. Tq
I am glad I could help :)
Hi, thanks for the video on SCD's, watched and understood, but as per the video 0 to 6 SCD's explained except SCD 5, do we have SCD 5 as well, if not then why we go to SCD 6 without 5, why we given name to 6 for last SCD it should be 5 ?
Great video thanks.
Thanks a lot for the Kind words :)
Vivek brother it's awesome
Thanks a lot for the kind words :)
best explanation ever you are the best
Thanks a lot Henri :)
In the SCD 2 example the ID column in the datawarehouse table shows same value 123 for both old and updated records. I believe the ID column values should be different 123 , 124 etc.
thanks for video got my final interview with amazon in 2 hours!!
All the very best buddy :)
Nicely explained.
Thanks Vijay for the kind words :) please consider subscribing to my other channel as well.it will really help me
ruclips.net/video/6G1xGi-D5ow/видео.html
Very nice explanation 👍 , please upload some videos on ETL logic to enhance the performance
Most common methods are to view the Last_Updated flag to see if any changes occurred since the last refresh. If that's not available, I'll (reluctantly) use the CHECKSUM(col1,col2,col3) feature in SQL Server to see if there is a difference between the current data and what is in the DW (very slow though). You can speed things up by storing the checksum with the record so it doesn't have to recompute every time.
Hi Vivek,
Your video was very helpful.
Just one query. In case of SCD 2, can we have duplicate value for id??As it has 123 in all the cases.
In SCD usually you will have a surrogate key to uniqely identify every record also you will have a start_date end_date and /or a flag to identify the old and the latest records :)
Excellent performance bro really very nice and clear explanation such containt all the best bro
Thanks Buddy, please consider subscribing to my other channel it will really help me
ruclips.net/video/gTg6nCUuYO8/видео.html
thank you for such good video
Thanks Vasupradha :)
Thank you it is very helpful for me
Thanks buddy, I am glad I could help :)
Amazing Video (y). Get going!
Thanks a lot Aruna :)
in SCD0 if we are using the column anymore then doesn't it make sense to delete the column rather than keeping it and not updating?
Thank you so much 😊
thank you so much very help full
I am glad I coulf help :)
awesome vid
Hi Vivek..very nice explanation..!! I have one question - for SCD 4 why we need to maintain two different tables for latest snapshot and history, we can just create a view on our SCD2 dim with condition 'to_date='12-dec-99' for the latest snapshot data and normal 'As-is' view for historical data. Please let me know if I'm missing anything. Thanks again..every video of yours is really helpful.
A view will run the underlying query everytime it is accesed which may become a big performance hit if it is called often.
Much appreciated ....
I am glad I could help
Very nicely explained
Thanks Parth for the kind words :)
Good Job!
Thanks buddy
Thank you😊
+Ankush Gondane You are welcome :)
Very nice man❤️❤️
Thanks buddy, please consider subscribing to my other channel as well.
ruclips.net/video/6G1xGi-D5ow/видео.html
Good info
Have implemented scd 6 for hcm dwh for movement report ... Pretty common In hcm analytical reporting
9:52
ID Column I assume as a Primary key in that case in Data warehouse table new ID gets generated or Same ID get repeated?
Informative.
Thanks buddy for the kind words :)
Thank you!
I am glad I could help :)
Thank you so much bhai 💙
Thanks buddy :)
Beautiful