00:00 Big Data and Hadoop 01:25 Hadoop processed data in batches and was slower due to disk storage, Apache Spark solves these limitations. 02:43 Apache Spark is a fast and efficient data processing framework. 04:11 Apache Spark is a powerful tool for processing and analyzing Big Data. 05:42 Apache Spark application consists of a driver process and executor processes. 07:02 Spark data frames are distributed across multiple computers and require partitioning for parallel execution. 08:24 Spark transformation block will give the final output. 09:40 Spark allows the conversion of data frames and the execution of SQL queries on top of it.
Such a nice content! What a man you are! You have covered everything in spark in just 10 mins. I wonder how you made this video and the effort u put in to make this video is wonderful. Thank you for sharing nice content in such a simple manner!!
I had understood the concept clearly within 10 min . Now I had a great understanding and knowledge about Apache Spark . This is best Spark video I had gone through . Its clear and top notch Explanation about each of the topics .
I usually be off from content titled learn/master/excel X in Y minutes. would have definitely done the same had I came accross this by myself. Watched it only because my frd shared to me. Now I feel that I am lucky after watching this as I could wrap my head around SPARK. Subscribed.
I'm just getting started with creating a group CNN project with friends and we are dealing a huge dataset of mri scans so I was thinking about platforms that could deal with lots of data without having to deplete my disk lol. Thank you so much for breaking down how Apache works compared to Hadoop, I really appreciate it! 😊
As many other already said, tantastic and informative video on Spark. Nice context by providing the history of Hadoop. Nice pace too, not to fast, not too slow!
Saw a bunch of your roadmap videos back in my freshman year, and now back here prepping for my DS internship, thanks ! The job description had spark/mapreduce which brings me here : )
I tried to replicate the code block at 10:13, Can we use tips.filter(filterA & filterB), this applied both filters at the same time and does not create intermediate results tips.filter(filterA) will create some dataframe, which will be filtered by another filterB Please correct me if I'm wrong thanks !
Bro cooked. From the history, to the technical design and demo! Hats off!
Thanks for actually explaining spark, instead of making general comments or assuming we know the basics. Great video. Thumbs up, subscribed.
agreed. I watched like 5 videos prior to this one that made wild assumptions about what I knew
Don't forget to hit that Subscribe Button for more amazing content :)
Get ready with project.
Please also upload GCP data engineering End-to-End project
You deserve much more than 1000 buddy. I learn so much from your channel
lets get that.
Are you from Gujarat?
That was an extremely good explanation. Not only explained the theory but also practical examples.
00:00 Big Data and Hadoop
01:25 Hadoop processed data in batches and was slower due to disk storage, Apache Spark solves these limitations.
02:43 Apache Spark is a fast and efficient data processing framework.
04:11 Apache Spark is a powerful tool for processing and analyzing Big Data.
05:42 Apache Spark application consists of a driver process and executor processes.
07:02 Spark data frames are distributed across multiple computers and require partitioning for parallel execution.
08:24 Spark transformation block will give the final output.
09:40 Spark allows the conversion of data frames and the execution of SQL queries on top of it.
best explanation on spark in 10 minutes. its like feynman explaining physics. excellent job!
I never knew I could recall so much in just under 10min...
Wonderful content and well explained keeping it simple...
Glad you liked it
Such a nice content!
What a man you are!
You have covered everything in spark in just 10 mins. I wonder how you made this video and the effort u put in to make this video is wonderful. Thank you for sharing nice content in such a simple manner!!
I had understood the concept clearly within 10 min . Now I had a great understanding and knowledge about Apache Spark . This is best Spark video I had gone through . Its clear and top notch Explanation about each of the topics .
I was waiting for this. Please share an end to end project using Spark.
Yes
Waiting for the same...right from spark installation on local as well as on cloud platform
Please upload ASAP.
Yes, if possible can you please also share using pyspark as well..
I usually be off from content titled learn/master/excel X in Y minutes. would have definitely done the same had I came accross this by myself. Watched it only because my frd shared to me. Now I feel that I am lucky after watching this as I could wrap my head around SPARK.
Subscribed.
You are doing a fabulous job of making Data analytics so easy for everyone. Thank you so very much. God bless you!
This was insanely good. Thanks for explaining the basics so clearly. Now I can learn deeper more comfortably.
I'm just getting started with creating a group CNN project with friends and we are dealing a huge dataset of mri scans so I was thinking about platforms that could deal with lots of data without having to deplete my disk lol. Thank you so much for breaking down how Apache works compared to Hadoop, I really appreciate it! 😊
Kudos..... Every Second was worthy..
The best Spark tutorial I have ever gone through. Thanks a lot Darshil.
Wow, thanks!
That is very short and power packed presentation.. Thank you very much Darshil Sir.
Apache Spark -- explained core concept in such a simple language..
Wonderful job 👍👍👍
The first very clear video about spark that I have seen.
Excellent explanation-clear, concise, and straight to the point.
crystal clear explanation! loved it❤
Nice video
amazing explanation!! Thank you!
Thanks For Explaining in 10 Min 🙌
Thank you!! So helpful
What a video really understood the apache spark that i could not in my university.
Explained and the presentation is good.
pretty helpful! Thank you!
You can find a full-fledged project in my other videos
I really understand the software really quickly, thanks man
You nailed it man! Amazing information that i am using for my DE interviews
As many other already said, tantastic and informative video on Spark. Nice context by providing the history of Hadoop. Nice pace too, not to fast, not too slow!
Thanks for this.Currently reading spark definitive guide.Looking forward to full tutorial
Coming soon!
Clear and concise explanation
Saw a bunch of your roadmap videos back in my freshman year, and now back here prepping for my DS internship, thanks !
The job description had spark/mapreduce which brings me here : )
I tried to replicate the code block at 10:13,
Can we use tips.filter(filterA & filterB), this applied both filters at the same time and does not create intermediate results
tips.filter(filterA) will create some dataframe, which will be filtered by another filterB
Please correct me if I'm wrong
thanks !
Thank you sir 👍
Thanks for this video , much informative and easy to understand using the examples you gave.
I didn't understand apache spark since my undergraduate until I found this gem.
Brief and informative . Thanks 👍
very nicely explained
really good explanation
Alright, but need a full tutorial on this topic, if you can.
Working on it!
@@DarshilParmarthank you please upload it ASAP
@@DarshilParmarplease upload
@@DarshilParmar this is a what the heroes did. Kudos to you Darshil
Amazing, You explained everything in detail with examples. Best video on RUclips to know about Spark.👏
Wonderful summarize!
Really very nice explanations..
One of the best video ! You really exxplained in very precise and esay way. Love it!
Great introduction. Thank you so much.
Thank u i got the basics
Great content!!
Thanks for the comment, let me know what other topics you want to see.
Nice Video, Thank You.
Well said bro
superb man.. didn't waste the time.. great explaination..
Thanks Darshil
Very good video
Excellent Explanation...
good explanation, thanks bro
Thank you. Check out my other videos.
Very nice video. Thank you!
Great video bro
Nice overview.
Great video! Thank you
Great explaination
Very good intro to Spark. I've started my data science journey and it really helps.
Thank you very much and it's a very nice primer to refresh once the concepts. Thank you for your contributions 👍
Thanks alot.
Good job Darshil. Appreciate the work.
Very well explained😊
Really good content .
THanks. very helpful.
This is a great explanation
Very well explained! Thank you!
Best tutorial ❤❤all in one
Nice Explanation, Thank you
Nice video!
You explained the content simple and clear. Thank you for this video.
Thanks for the content
This explanation is very gooooooooooooooooooooooooood
Thank u
you are welcome mate!
Waiting for full course from you apache spark
Super🎉
Waiting for full tutorial
Very soon
Awesome video mate! well done.
Explained well
can you make one of these vids on lakesail's pysail?
Really productive video.
As simple as that.. Liked
Very brief and informative video
Very well explained , thank you very much
Great
Thank😊
Wonderful video you explained everything perfectly
Wonderfully explained in just 10 mins.
Impressive explanation of spark. Making it easy for every beginner to understand.
Glad it was helpful!
Awesome
You nailed it Bro in just 10 mins 😊
To the point, quick, simple and comprehensive knowledge sharing!
I appreciate that!
Super explanation bro, I got many answers in one vedio 🥳🥳
Just Amazing😇Thank you
It was really helpful. Thanks.
Nice one 👍
A very very good video. Thanks, you are doing a really great job!
Nicely presented and explained.
Excellent video Darshil. Clear and concise! Subscribed!
excellent video