Snowflake BUILD | How To Use Apache Iceberg With Snowflake And AWS
HTML-код
- Опубликовано: 31 июл 2024
- This demo from Snowflake BUILD provides a demonstration of how to integrate Snowflake with a data lakehouse built with Apache Iceberg on AWS. You will learn how to create Iceberg Tables, register them with AWS Glue Data Catalog, and query the same table from Amazon Athena and Snowflake. In addition, you will see how to easily use various Snowflake features like data sharing, time travel, and converting catalogs without any data rewrite or upfront ingest.
Subscribe for more! www.snowflake.com/YTsubscribe/
Explore sample code, download tools, and connect with peers: developers.snowflake.com/ Наука
Everything sounds great in demo with full admin access. Very easy in my own Snowflake and AWS accounts.
Challenge is to accomplish this at a real workplace when you have to talk to 3 admins and understand what to ask to whom.
The iceberg table created through Glue , files were in Avro format.
But Snowflake support Iceberg tables with files in Parquet only.
So how did this work ?
Is it possible to create partitioned data in S3 bucket using snowflake catalog from snowflake query ? So lets say i want to create partition based on date on my timestamp column in a table and it should store in S3 location in respective date partition.