Can't help it but very disappointed with this video. It just spends 8 minutes on introduction and then 7 minutes of SQL/Athena queries. Where is the juicy stuff, where is the Glue job explained?
There are two blogposts on this from AWS: - aws.amazon.com/blogs/big-data/creating-a-source-to-lakehouse-data-replication-pipe-using-apache-hudi-aws-glue-aws-dms-and-amazon-redshift/ - aws.amazon.com/blogs/big-data/writing-to-apache-hudi-tables-using-aws-glue-connector/
Thanks! But How could we create Amazon Athena tables backed by Hudi? You did not show how deletes, updates are handled here? is there any other tutorial that talks of this?
There are two blogposts on this from AWS: - aws.amazon.com/blogs/big-data/creating-a-source-to-lakehouse-data-replication-pipe-using-apache-hudi-aws-glue-aws-dms-and-amazon-redshift/ - aws.amazon.com/blogs/big-data/writing-to-apache-hudi-tables-using-aws-glue-connector/
Can't help it but very disappointed with this video. It just spends 8 minutes on introduction and then 7 minutes of SQL/Athena queries. Where is the juicy stuff, where is the Glue job explained?
Thanks for the video !!
Please can you create similar demo for streaming data ?
Same question for me really, would be great to have a Kinesis / EMR streaming demo.
By any chance, can you share the glue job code to load cdc data from S3 into Hudi ?
There are two blogposts on this from AWS:
- aws.amazon.com/blogs/big-data/creating-a-source-to-lakehouse-data-replication-pipe-using-apache-hudi-aws-glue-aws-dms-and-amazon-redshift/
- aws.amazon.com/blogs/big-data/writing-to-apache-hudi-tables-using-aws-glue-connector/
Thanks! But How could we create Amazon Athena tables backed by Hudi? You did not show how deletes, updates are handled here? is there any other tutorial that talks of this?
Excellent video
Cool intro, thank you. Liked & subscribed.
I too would like to see the Glue Job code
There are two blogposts on this from AWS:
- aws.amazon.com/blogs/big-data/creating-a-source-to-lakehouse-data-replication-pipe-using-apache-hudi-aws-glue-aws-dms-and-amazon-redshift/
- aws.amazon.com/blogs/big-data/writing-to-apache-hudi-tables-using-aws-glue-connector/
You should consider a different title for this video as you showed nothing to do with Hudi