Hi Viresh, Thanks for sharing your videos.They are awesome! I am new to Apache Spark. I have worked in few projects using Spark but I need to explore more like more details including performance. can you please point me to some use cases, some datasets which I can practice that will give me an overall experience required to crack interviews in BigData? I am from Java background.
didn't get the concept for filtering first and then scanning. Even if it is filtering first, let's say here for src=DEN, then doesn't that mean, it is checking for that "src" from amongst the all available "src"s, in a way scanning only. Kindly explain if I am wrong.
Think it from the perspective that , do you want to bring all the partitions into the context and then do filtering versus do the filtering first and bring only the required partitions into the context for further processing.
Hi Viresh , I am watching your videos regularly. I am into Hadoop production experience. Want to move spark development . Please help me with any project which I can work
You deserve more subscribers and views !! All these videos are extremely simplified and yet very informational.
Thanks
You are doing amazing work for Data Engineering Community!! Thanks indeed for your conceptual vedios. They are really amazing.
Thanks :)
Thank you for sharing such productive stuff
Thanks :)
Thank you very much for the informative video.. it is very useful :)
Thank you.... Its a very nice video...
Could you please tell what is the difference between partition pruning and predicate pushdown
Both same
Hi Viresh, Thanks for sharing your videos.They are awesome! I am new to Apache Spark. I have worked in few projects using Spark but I need to explore more like more details including performance. can you please point me to some use cases, some datasets which I can practice that will give me an overall experience required to crack interviews in BigData? I am from Java background.
Sure, Thanks
didn't get the concept for filtering first and then scanning. Even if it is filtering first, let's say here for src=DEN, then doesn't that mean, it is checking for that "src" from amongst the all available "src"s, in a way scanning only. Kindly explain if I am wrong.
Think it from the perspective that , do you want to bring all the partitions into the context and then do filtering versus do the filtering first and bring only the required partitions into the context for further processing.
Hi Viresh ,
I am watching your videos regularly.
I am into Hadoop production experience. Want to move spark development . Please help me with any project which I can work
Please send me your profile on techwithviresh@gmail.com
bhai ye hindi m bta dega toh tera kuch chla jaa rha h kya??