AWS Tutorials - Creating Custom Visual Transforms in AWS Glue

AWS Glue enabled sharing and reusability of business specific transformation and business logic in ETL jobs among the teams and team members. This reusability of ETL business logic is enabled using Custom Visual Transform. One can call custom visual transforms from both visual and code-based jobs.

[@Ajjeshh]

This is AWESOME.!
Thanks a ton for sharing your knowledge to the AWS Community.!

[@AWSTutorialsOnline]

Glad you enjoyed it!

[@sungkim1830]

Thank you so much for uploading this video! Is there a way to pass multiple dynamicframe as an paramter? it seems like params are only str, float, int, list, bool.

[@AWSTutorialsOnline]

True, It takes only one data frame (self). There is no way to pass other data frame in custom transform.

[@user-el7qo3wf2k]

suppose i want it to write to change timestamp col.
like when i crawl from s3 bucket csv file,timestamp cols become string.
so this can help me?

[@Ajjeshh]

By using custom visual transform how de we pass a dynamic frame to a custom function and convert it to a data frame.? I am encountering an issue while trying this..
Thanks.!

[@AWSTutorialsOnline]

In custom visual transform, you always pass dynamic frame. In the code then you can use syntax like mydataframe = self.toDF() to convert dynamics frame into data frame. I have personally not tried in visual transform it but I have a gut it should work.

[@rohitsingh8442]

pl make a vedio with more parameters