Hi Folks - The much requested update to this video with the new AWS Console UI for AWS Glue is now available on the channel with a new GitHub repo containing everything you need to follow along. ruclips.net/video/ZvJSaioPYyo/видео.html.
in 41 minutes, I never knew I can gain this much knowledge and at least be ready with AWS glue as we are in a transformation project. It really helped, thank you so much!
Troubleshooting tip for especially complex environments: If the user has access to ALL S3 locations in the table, then Glue will assemble the table for Athena to query. If even one S3 location can't be accessed by the user, then the table won't show up in Athena. Hope this helps complex schema lovers.
Great intro to AWS Glue for someone who's never seen it before. Needed to know these basics as we're moving to Glue for our data transformation/warehousing and this video does just that! Thanks!
As a skilled Ops Engineer / Developer i have search for infomartion about whats Glue and how its working in the basic and thanks so much for your video, its late me understanding the basic about what Glue are and whats it can be used for, :)
I am enjoying the video, thanks for this resource! I wanted to note that it seems you blurred your S3 buckets early in the video, but at 19:22 and also 21:33 when configuring glue, you do not blur your other S3 buckets. Also 24:49.
At 28:00 (AWS Glue Jobs section) current screens are much different than video. Figure all the same information has to be entered, but order and screen flips are totally different.
This was a great tutorial! I really learned a lot about AWS Glue and I plan to leverage this knowledge to be more effective in my job tasks. Thanks so much, Johnny!!
Towards the end of the course, I lost my way after we created the parquet file because my version is different from yours and I couldn't just get the visuals on my dashboard. Thank you so much and I will give this a try again some other time.
Great & comprehensive coverage of AWS Glue. I was hoping it did much more. Makes you appreciate how much easier, faster & cheaper it is to develop in Azure DataFactory. Where a single pipeline can consume multiple different CSV files, parse the filename, figure out the metadata on load, & redirect the output based on lookup parameters. All graphical or generated via script.
Hi David, This video did not cover AWS Glue Studio which provides more of a compressive graphical interface that I think would be more comparable to Azure Data Factory.
Thank you and well done. Was able to do the course still in June of 2023, though the ETL chapter was a bit of a challenge as AWS has completely redone those screens.
Jesus bless you, my friend. Your explanations are very clear. My desire is that you continue making the difference, creating and publishing awesome contents that help people. Congratulations! Good job!
@@JohnnyChivers Could you help me with something? I have been using create_dynamic_frame.from_options, with recurse, and this function isn't reading all of the files from the s3 bucket (about 1 million JSONs). I tried groupSize and groupFiles params, but also didn't work. I don't know what else to try!
![AWS Glue Tutorial for Beginners [NEW 2024 - FULL COURSE]](http://i.ytimg.com/vi/ZvJSaioPYyo/mqdefault.jpg)
![AWS Glue Tutorial for Beginners [NEW 2024 - FULL COURSE]](/img/tr.png)
![Apache Iceberg on AWS with S3 and Athena [FULL COURSE IN 30MIN]](http://i.ytimg.com/vi/iGvj1gjbwl0/mqdefault.jpg)
Hi Folks - The much requested update to this video with the new AWS Console UI for AWS Glue is now available on the channel with a new GitHub repo containing everything you need to follow along. ruclips.net/video/ZvJSaioPYyo/видео.html.
you were preparing the video when the entire west world was yelling "Happy New Year"! Great commitment and awesome result!
in 41 minutes, I never knew I can gain this much knowledge and at least be ready with AWS glue as we are in a transformation project. It really helped, thank you so much!
If you had watched with 1.25 playback speed, it would take you 33 minutes
For me the most amazing thing is that he was working in the morning of January 1st. My respect! 😅
Amazing content by far !! Please continue with Glue. Never seen such high quality tutorial :D
Thanks for watching
This the most detailed AWS glue video i have ever seen. Keep up the great work Johnny.
I don't like subscribing to people but lit I wouldn't be able to learn aws without you. Best and unique content
I am not sure, does anyone said this before or not, but i wanted to say, You are a rock start.
Awesome. I've never met people like you that you're so young with solid data science & aws skills.
Thanks Sung!
I have spent many hours on Udemy for Glue Job and Glue data Catalog, but after watching your video. I must say Damn Good Stuff, Sir!
you speak my favorite accent that's such a plus for me. Thank you so much for the quality content! :)
As someone transitioning from a data scientist to DE role, I found this extraordinarily helpful! Subscribed! Thank you!
I am interested in understanding why did you decide to make the transition.
Awesome! Thank you!
You are Awesome. watching in 2024... ETL steps needs minor updating but I was still able to follow ! Keep up the great work !
41 minutes was sufficient for me to get hands-on AWS glue. Thanks, Johhny for this awesome tutorial.
Excelent tutorial. I made three others courses before that and only with this that I understead complete this tool
I just can't believe it's free here on RUclips! Great content, very well explained. Thanks!
Thanks for watching the video and a supporting the channel!
excellent Glue tutorial .. One of the best I have come across which teaches in a composed pace and easy to pickup for anybody
Thanks for watching!!!
your commitment shows in the quality!
This is one of the best tutorials i've seen in youtube videos. Very well-explained, very useful. Thank you for uploading this!
Thanks for the comment and supporting the channel.
Johnny Chivers you rock. Really great intro to Glue.
simple and explain everything ... what we need .... thank you man ... i'm from sri lanka
This tutorial is pure gold. Thanks
Troubleshooting tip for especially complex environments: If the user has access to ALL S3 locations in the table, then Glue will assemble the table for Athena to query. If even one S3 location can't be accessed by the user, then the table won't show up in Athena. Hope this helps complex schema lovers.
Good tip.
excellent video on glue
Great intro to AWS Glue for someone who's never seen it before. Needed to know these basics as we're moving to Glue for our data transformation/warehousing and this video does just that! Thanks!
Thanks for watching Lyndsay!
Such an amazing video. Gives end to end idea about Glue in just 45 mins. Keep it up.
Superb course, covering all features with examples
Thanks for comment.
Great tutorial in 40 mins you covered everything essential in Glue 👏
Fantastic video, going to binge-watch your videos for the next few months!
Thanks for watching.
One of THE BEST videos on AWS Glue. Thank you Johnny :)
So excited to find this channel. Looking forward to watching all your videos!
I am using this in 2023, the interface has changed, but this still working, thank you so much for the video.
One of the best tutorials I've ever seen - let alone on a topic that is not easy.
You are amazing and a natural teacher !!
It was very usefull for someone who is starting with AWS from scratch! Thank you :)
As a skilled Ops Engineer / Developer i have search for infomartion about whats Glue and how its working in the basic and thanks so much for your video, its late me understanding the basic about what Glue are and whats it can be used for, :)
Such an amazing tutorial! Thanks for getting this together. Looking forward to more content.
This is one of the best AWS Glue tutorial that I've come across on RUclips. Totally worth a like and sub❤️
Thanks for the sub!
Glad the tutorial took me through the console instead of running code.
right when i needed this, always amazing content
Thanks for watching Todd
Finally an aws tutorial that uses "wee" and talks in a NI accent, made me laugh that I finally found a fellow NI person :) followed every word :D
Very nice and easy to learn video especially for begineers. Thanks for posting this.
This was a really nice video. Lot of learning within a very short time. Thanks
Excellent work Johnny. Keep continuing the work .
Thanks, will do!
Great video for beginners I hope to build some projects for keep learning
Thank you. This is an awesome introduction to AWS Glue for beginners.
Very good course, gave me a good view of glue AWS service
Wonderful and neatly described in such a short video
Thank you very much for you great explanation and hands-on! It was very useful for me.
fantastic video, very helpful and useful. Looking forward to seeing more. keep up the great work and thank you so much.
I am enjoying the video, thanks for this resource!
I wanted to note that it seems you blurred your S3 buckets early in the video, but at 19:22 and also 21:33 when configuring glue, you do not blur your other S3 buckets.
Also 24:49.
huge fan from brasil, thank you for your great content, it helped me a loooot
At 28:00 (AWS Glue Jobs section) current screens are much different than video. Figure all the same information has to be entered, but order and screen flips are totally different.
Great intro on AWS Glue! Thanks!!
Amazing Content and style of teaching, Thanks a lot for making these videos.
This was awesome explanation of glue, thanks.
this channels a great resource for learning data engineering on aws, it's been a big help. Keep up the good work Johnny!
Thank you very much, I learnt a lot from this tutorial.
Good tutorial. I was able to follow and execute. Thanks Johnny!
Thanks for nice video, it helped me understand glue and setting up the pipeline in aws.
Nicely done and explained. I have done my first AWS Glue job, without any issue... thumbs up bro 👍
Fantastic news Ammar!!
Thankyou so much. Very informative Johnny!
Impressive free content. Thank you!
Thanks for watching
Johnny, you ROCK, man!!! 🔥👏🔥👏🔥👏🔥 Thank you so much and please don't stop spreading the wisdom of the GURU!!!! 🙏🙏🙏👍👍👏👏🚀🌟
happy new year
really amazing and fun learning with Johnny :)
This was a great tutorial! I really learned a lot about AWS Glue and I plan to leverage this knowledge to be more effective in my job tasks. Thanks so much, Johnny!!
Thoroughly enjoyed, Thanks.
Towards the end of the course, I lost my way after we created the parquet file because my version is different from yours and I couldn't just get the visuals on my dashboard. Thank you so much and I will give this a try again some other time.
Amazing teacher..Many thanks for this
Thanks for watching.
Great & comprehensive coverage of AWS Glue. I was hoping it did much more.
Makes you appreciate how much easier, faster & cheaper it is to develop in Azure DataFactory. Where a single pipeline can consume multiple different CSV files, parse the filename, figure out the metadata on load, & redirect the output based on lookup parameters. All graphical or generated via script.
Hi David, This video did not cover AWS Glue Studio which provides more of a compressive graphical interface that I think would be more comparable to Azure Data Factory.
Thank you for this video, it is very helpful gives a clear glimpse of AWS glue. This is a very important video for me for the interviews :)
Super helpful.... Thank you so much.
Thanks for watching!
Thank you and well done. Was able to do the course still in June of 2023, though the ETL chapter was a bit of a challenge as AWS has completely redone those screens.
Great to hear!
How did you get past the ETL job chapter? The interface is totally different.
Very helpful for my studies
Good training course, thank for all
Thanks for watching.
Awesome tutorial.
Jesus bless you, my friend. Your explanations are very clear. My desire is that you continue making the difference, creating and publishing awesome contents that help people. Congratulations! Good job!
You are definitely a hero
Thanks for watching
Fantastic! Thank you for putting this together. It helped me a lot.
awesome video!
Excellent content! Hope you keep it coming. I just subbed
Thanks for watching.
Thank you very much, it was very helpful video to learn end to end AWS Glue. 🙂
Amigo, muito obrigado pelo vídeo... Ficou ótimo! Abraços!
Dear friend, thanks for this video. It's really great, helped a lot... Hugs from Brazil :)
That was fantastic, mate! Thank you very much for sharing your knowledge!
thanks mate, u made my day.
Very well done! Thanks for sharing this!!
Nice session. Thanks!
Good video. Thanks for this!
Awesome content. Thank you
Thanks for watching.
Love this tutorial, thanks!
Thanks for watching!
Awesome content!! Appreciate the effort. Thank you
This is good video. Thanks!
Thanks for watching!
Great content, helped me a lot.
Thanks for watching!
@@JohnnyChivers Could you help me with something? I have been using create_dynamic_frame.from_options, with recurse, and this function isn't reading all of the files from the s3 bucket (about 1 million JSONs). I tried groupSize and groupFiles params, but also didn't work. I don't know what else to try!
Great content! very educative and informative.
Thanks for watching the video.
Amazing content. 👍
Thanks for watching
Highly recommend!
wonderful tutorial, great explanation, thank you! Unfortunatly aws glue job console has changed a lot and I could not finished the tuto :(
Great tutorial 😀
Thanks for watching!
Thanks for this! So much better explained than AWS's own tutorials!