AWS Tutorials - Creating Glue Job with Apache Iceberg Table

Поделиться
HTML-код
  • Опубликовано: 4 фев 2023
  • Apache Iceberg Tutorial - • AWS Tutorials - Amazon...
    Apache Iceberg is an open table format for incremental data processing supporting ACID operations. Other than ACID operation, it also supports time travel queries and concurrent access operations. Learn how to create AWS Glue Job to read and write with Iceberg tables.
  • НаукаНаука

Комментарии • 10

  • @ghostvideouploader
    @ghostvideouploader Год назад

    very helpful. Thanks.

  • @cellentmaya1533
    @cellentmaya1533 2 месяца назад

    Thanks for this video. It helped me a lot. Question: How do you deal with timestamp(3) in AWS Athena and timestamp(6) in Iceberg?

  • @PeterpanLive
    @PeterpanLive 10 месяцев назад

    Very useful video.
    can we also use Glue Notebook (Jupyter) to connect ICEBERG tables as well?

  • @sendemail6929
    @sendemail6929 Год назад +1

    Hi I have been following your videos and they are very helpful… one query on glue … Do we need to resolve all foreign key dependencies in data frame before loading to JDBC databases or does glue have any capability to load tables with foreign keys?

    • @AWSTutorialsOnline
      @AWSTutorialsOnline  Год назад +1

      Glue (or say Apache Spark) is designed to work with de-normalized data. It will not resolve any key constraint. If you have such requirement, you will do need to resolve it.

  • @optimisteve
    @optimisteve 4 месяца назад

    Thanks as always for your videos and resources....this sounds like a lakehouse pattern and can you kindly provide the link to repo/script pls?

  • @akashgupta-gs7lv
    @akashgupta-gs7lv 8 месяцев назад +1

    please add resources to some git repo for our convenience sir

  • @mamirza98
    @mamirza98 Год назад +1

    you are creating the iceberg table in Athena, is there anyway to create it in glue? lets say I have a dataframe that I need to save to a table in iceberg format

    • @akhilMathew27
      @akhilMathew27 11 месяцев назад

      I'm facing a similar issue, did u get any insights on this bro?