hey Hogg, Im a grad student trying learn spark by my own, thanks for the video. Clear and helpful video. The little clip really get me to subscribe, it reminds me of the day when i was back in undergrad, walking to classroom in snow.
Man, if you could just stop asking people to subscribe. The channel is great and people will subscribe if they think they will need more videos in the future.
Professor, the lambda x+y has me stumped. what if there were three 1s at index 1? for example if the tuple were (2, [1,1,1])? What is the x and y that is being sent as a parameter to the lambda function?
@@AL3Ymir The result is trivial, but no, it's actually kinda difficult to understand what's going on here. It's a loop. first time, x is the first 1 and y is the second 1. It adds them to get 2. Next time in the loop, x is 2 and y is the third 1. It sums them to get 3. More info here spark.apache.org/docs/latest/api/python/reference/api/pyspark.RDD.reduceByKey.html
Take my courses at mlnow.ai/!
This pretty much sums up my BigData course at university! Another great video! Thank you.
hey Hogg, Im a grad student trying learn spark by my own, thanks for the video. Clear and helpful video. The little clip really get me to subscribe, it reminds me of the day when i was back in undergrad, walking to classroom in snow.
Just recently found your channel and i gotta say that you're a big W. Amazing content, simplified, and very informative, thank you so much!
Great to hear, thanks so much! :)
Beautiful explanation of Spark.
Thanks so much!!!
Hi Greg, Just recently discovered your channel. Amazing content. Thank you.
So happy to officially declare myself as a data scientist! Thank you for the content!
Man, if you could just stop asking people to subscribe. The channel is great and people will subscribe if they think they will need more videos in the future.
Okay
I agree. But i subscribed anyway.. great content
No, you need to tell people to subscribe because people forget sometimes, but it should not be in the face all throughout the video...
Such a great, useful material. Thank you, Greg!
Thanks so much! Very glad you enjoyed it :)
Greg, how are you? just want to thank you for sharing your khowlege and expertise with the world!
Great thank you how are you? You're very welcome.
@@GregHogg I am good, thanks for asking! your channel is fantastic, I hope you can keep creating content, All the best from NYC!
@@hsoley I'm very glad to hear that and really appreciate the kind words!
You are an #amazing human being brother, wish you all the best :)
That's very sweet. Thank you very much Emre.
Great 👍
Professor, the lambda x+y has me stumped. what if there were three 1s at index 1? for example if the tuple were (2, [1,1,1])? What is the x and y that is being sent as a parameter to the lambda function?
x + y simply sums them.
@@GregHogg Hey professor, thanks for the reply
@@AL3Ymir The result is trivial, but no, it's actually kinda difficult to understand what's going on here. It's a loop. first time, x is the first 1 and y is the second 1. It adds them to get 2. Next time in the loop, x is 2 and y is the third 1. It sums them to get 3. More info here spark.apache.org/docs/latest/api/python/reference/api/pyspark.RDD.reduceByKey.html