AWS Glue Studio - Lets Get Hands On!

📁 github.com/johnny-chivers/glu...
❔www.thequestionbank.io
ℹ️ johnnychivers.co.uk
• Working with AWS Glue ...
00:00 - Intro
01:26 - Setting Up The Sample Data
04:55 - Configuring The IAM Role
06:13 - Setting Up The Crawler
08:41 - The Glue Studio Console
11:17 - Create Visual Job 1
20:41 - Create Job 2 with Join
27:35 - Create Job 3 with Custom Code
In this video we get hands on with AWS Glue Studio with a full tutorial. We start by setting up a datasource to use for the tutorial and then register the data in our data catalog. Using this data we created three AWS Glue Work flows using the visual editor provided to us by AWS Glue Studio. We store the outputted data to S3 where we use S3 Select to look at our results.
😎 About me
I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies. My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software development. Alongside many a professional certification in AWS and MS SQL Server.

[@brunonog9985]

Great tutorial! Especially helpful when talking about IAM role workarounds. Thank you

[@sukhishdhawan]

i love you man,, you are making one of the best AWS courses and helping many Data Engineers

[@charleslyonga1661]

Wow!!!!! keep enriching us Johnny Chivers difficult to find real-life content like yours. Kudos

[@JohnnyChivers]

Thanks Charles! Glad it was helpful.

[@petrodyak]

Thanks for this video. It was really useful for beginner who just started to learn AWS Glue. Special thanks for to read Captions. It's really important for not native English persons.

[@JohnnyChivers]

You're very welcome!

[@muhammadnurhafiznoormohama7605]

This is very good! Thank you for doing this.

[@kaedien]

fantastic stuff as usual Johnny, well done 🎉

[@JohnnyChivers]

Thanks for watching as always.

[@bobhaffner5902]

Congrats on hitting 1K subs!

[@JohnnyChivers]

Thanks Bob.

[@p-a5603]

Hi, this is a second tutorial from you about Glue from you I am watching, very nice work!. It seems pretty easy and straightforward if your input data are in csv but what solution would you suggest, if the input data are nested jsons and I want them in Data catalogue? In this visual job settings there is stated, that "Data Catalog update options are not supported when using schemas with nested data structures." Thanks in advance.

[@SincereLe-nr3ue]

Thank you very much, John. I really enjoyed and appreciated your videos. By any chance you can do a video with the target as SQL Server on the RDS. Or the AWS SCT?

[@binio28]

fantastic tutorial, thank you

[@VamsiKrishna-vf5gm]

Thank You Very Bro

[@najmehforoozani]

Thank you for the series

[@JohnnyChivers]

Thanks for watching Najmeh!

[@midhunrajaramanatha5311]

Superb video on AWS glue studio

[@JohnnyChivers]

Thanks Midhunraja!

[@mehmetkaya4330]

Great tutorial! Thanks

[@JohnnyChivers]

You're welcome!

[@ameenbaig7400]

Great tutorial!

[@JohnnyChivers]

Thanks for watching!

[@manojkumarchallagund]

Thank you Johnny for the informative video. Would like to see how we can take these Glue jobs to higher environment using CloudFormation.

[@JohnnyChivers]

It certainly something I can do a video around in the future.

[@ced4298]

Hey Johnny, Great videos on Glue and Glue Studio! Can you do a video on how to export CloudWatch logs to s3 using a lambda?

[@andresmesad]

Could you do an ETL from S3 to a Redshift database?
Great content, btw.

[@ajayrana7481]

its a great video for me

[@JohnnyChivers]

Thanks for watching.

[@knoweverthingsuccessfullif7937]

Hi awesome video., how to use blueprint in gluestudio .