Delta Live Tables in Depth Best Practices for Intelligent Data Pipelines

Поделиться
HTML-код
  • Опубликовано: 23 ноя 2024
  • Join Databricks Distinguished Engineer Michael Armbrust and Product Lead Paul Lappas for the authoritative guide to Delta Live Tables (DLT). Learn what’s new; what’s coming (spoiler alert - some BIG news); and how to easily master the ins-and-outs of DLT. Michael and Paul will explain and demonstrate: Pipeline development best practices Unity Catalog integration with DLT Data quality, monitoring and operations Serverless compute for DLT DLT Flows: The next generation of Delta Live Tables
    Talk By: Michael Armbrust, Distinguished Engineer, Databricks ; Paul Lappas, Sr Staff Product Manager, Databricks
    Here’s more to explore:
    Big Book of Data Engineering: 2nd Edition: dbricks.co/3Xp...
    The Data Team's Guide to the Databricks Lakehouse Platform: dbricks.co/46n...
    Connect with us: Website: databricks.com
    Twitter: / databricks
    LinkedIn: / data…
    Instagram: / databricksinc
    Facebook: / databricksinc

Комментарии • 2

  • @jasonkhaihoang781
    @jasonkhaihoang781 8 дней назад

    Can we test individual DLT models in notebooks now? Or we need to run the full pipeline to see and validate the results? Thanks.

  • @forow8434
    @forow8434 Месяц назад

    Thank you for the video. Can we use the python approach using the dlt module with serverless? If not, which approach should we use in order to use a dlt pipeline with serverless using python?