AWS Tutorials - AWS Glue Job Optimization - Flexible Job Execution

AWS Glue Job and Lake Formation Crash Course - • AWS Tutorials Crash Co...
AWS Glue now supports flex execution option which can be used to run time-insensitive workloads and save up to 34% of the cost. With Flex option, Glue jobs run on spare capacity in AWS but it is the same like standard job in every feature. Learn how to use Flex execution option with AWS Glue.

[@sebastianalegria6304]

nicee, thanks mr AWS Tutorials. I am going to use this new knowloedge on my current development.

[@AWSTutorialsOnline]

Great!

[@RamMohan-xu3ey]

Great...

[@AWSTutorialsOnline]

Thanks

[@hsz7338]

Thank you for the content. It is extremely helpful. A quick question, I haven't checked the Glue documentation on this. Is there any recommendation for the configuration/combination of Autoscaling workers and Flex execution in Glue 3.0? e.g., is it recommended to enable Autoscaling when Flex execution is configured?

[@AWSTutorialsOnline]

I tried both combination together and it works. If you are ok with flexible execution then using auto-scaling would help optimize cost further.

[@hsz7338]

@@AWSTutorialsOnline Agreed. Tried them both today. It works fine. In addition, I didn't see too much of a delay when "FLEX EXECUTION" configured.

[@cheluveshab9525]

Hello brother, please do make videos on how to perfectly make use of AWS Lambda for complex business logics and Thanks for this video.

[@AWSTutorialsOnline]

Sure. It is a very wide topic. Any particulars you want to cover?

[@cheluveshab9525]

@@AWSTutorialsOnline thanks for the reply, an example of concurrently handling the program.