AWS Tutorials - Flat nested data with “Flatten” Transform in AWS Glue Studio

Many times, the data platforms work with nested data and it needs to flat the nested data for the business need. AWS Glue Studio Flatten transformation can flatten the nested structure at any level. Learn how to use flatten transform in an ETL job.

[@SivaChidambaram15]

Thanks, I just tried it with Glue 4.0 version. The data is available in the Glue data catalog with multiple nested levels of values. I did use the Flatten and store it as a CSV in S3. But got the following error.
Error Category: QUERY_ERROR; AnalysisException: Ambiguous reference to fields StructField(Status,StringType,true), StructField(status,StringType,true)

[@durgarasane-kolapkar1842]

What is the difference between flatten and relationalize transform in AWS Glue? Can we use flatten tranform on highly nested xml files? Please explain

[@lilcoool]

Is this a new transform that was recently added to Glue Studio ?

[@AWSTutorialsOnline]

yes. it is.

[@patrikozafriko]

I think it doesn't work with Glue 4.0

[@AWSTutorialsOnline]

I did not find it anywhere in documentation. I will test for it.

[@ghostvideouploader]

It's strange. I dont see this transformation in my console. I dont see UUID transformation that you see either.

[@AWSTutorialsOnline]

Sounds strange. Checked documentation. It is not limited to any region.

[@rushikeshgore5935]

Can we catalog the nested data from s3 bucket or not?

[@AWSTutorialsOnline]

yes it can.