Delta Live Tables in Depth Best Practices for Intelligent Data Pipelines
HTML-код
- Опубликовано: 23 ноя 2024
- Join Databricks Distinguished Engineer Michael Armbrust and Product Lead Paul Lappas for the authoritative guide to Delta Live Tables (DLT). Learn what’s new; what’s coming (spoiler alert - some BIG news); and how to easily master the ins-and-outs of DLT. Michael and Paul will explain and demonstrate: Pipeline development best practices Unity Catalog integration with DLT Data quality, monitoring and operations Serverless compute for DLT DLT Flows: The next generation of Delta Live Tables
Talk By: Michael Armbrust, Distinguished Engineer, Databricks ; Paul Lappas, Sr Staff Product Manager, Databricks
Here’s more to explore:
Big Book of Data Engineering: 2nd Edition: dbricks.co/3Xp...
The Data Team's Guide to the Databricks Lakehouse Platform: dbricks.co/46n...
Connect with us: Website: databricks.com
Twitter: / databricks
LinkedIn: / data…
Instagram: / databricksinc
Facebook: / databricksinc
Can we test individual DLT models in notebooks now? Or we need to run the full pipeline to see and validate the results? Thanks.
Thank you for the video. Can we use the python approach using the dlt module with serverless? If not, which approach should we use in order to use a dlt pipeline with serverless using python?