- Видео 147
- Просмотров 166 733
Kestra
Франция
Добавлен 11 апр 2022
The Unified Orchestration Platform for All Engineers ⚡
Run Clean Up Tasks with the Finally Block | Workflow Components
Set a block of tasks to run at the end of a Flow regardless of task status. Finally tasks are beneficial for running cleanup operations at the end of your flow regardless of whether the end state was a success or failure.
Read more about it in the docs: go.kestra.io/finally
Like, and Subscribe for more quick guides on using Kestra!
Timestamps
0:00 - Introduction
0:27 - Finally with a failure state
1:30 - Finally with a success state
1:48 - Summary
----------
📖 Read the documentation: go.kestra.io/docs
⭐ Start your journey with Kestra: go.kestra.io/github
🚀 Join the Kestra Community: go.kestra.io/slack
For more information, visit Kestra's Website: go.kestra.io
Read more about it in the docs: go.kestra.io/finally
Like, and Subscribe for more quick guides on using Kestra!
Timestamps
0:00 - Introduction
0:27 - Finally with a failure state
1:30 - Finally with a success state
1:48 - Summary
----------
📖 Read the documentation: go.kestra.io/docs
⭐ Start your journey with Kestra: go.kestra.io/github
🚀 Join the Kestra Community: go.kestra.io/slack
For more information, visit Kestra's Website: go.kestra.io
Просмотров: 46
Видео
Send Logs to Your Monitoring Platform with Log Shipper in Kestra 0.21
Просмотров 574 часа назад
Log Shipper can distribute Kestra logs from across your instance to an external logging platform. Log synchronization queries logs and automatically batches them into optimal chunks. The batch process is done intelligently through defined synchronization points. Once batched, the Log Shipper delivers reliable, consistent log batches to your monitoring platform. Check out the docs for more infor...
Track Your Key Metrics with Custom Dashboards in Kestra 0.21
Просмотров 877 часов назад
Monitoring executions to get an overview of what's going on in your automations is a keystone of orchestration. In this new release we doubled down on that promise: rather than relying only on the default dashboard on Kestra's home screen, you can create charts that answer specific questions and track your key metrics. Everyone has different needs and service level thresholds. With custom dashb...
Kestra 0.21 introduces Custom Dashboards, new No Code experience and Log Shipper
Просмотров 2909 часов назад
Kestra 0.21 is here, packed with your most-requested features for our open-source orchestration platform. This major release introduces a seamless no-code experience for easier workflow creation, customizable dashboards to monitor your operations, advanced log forwarding across your entire infrastructure - and many other improvements. Read the full release notes here: go.kestra.io/release-0-21 ...
DE Zoomcamp 2.2.9 - Deploy Workflows to the Cloud with Git in Kestra
Просмотров 83221 час назад
In this video, we'll cover how you can install Kestra on Google Cloud in Production, and automatically sync and deploy your workflows. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchestration platform that makes both scheduled and event-driven workflows easy. By bringing Infrastructure as Code best practices to data, process, and micros...
DE Zoomcamp 2.2.8 - Orchestrate dbt Models with BigQuery in Kestra
Просмотров 856День назад
Now that we have raw data ingested into BigQuery, we can use dbt to transform that data. DBT is only being used to demonstrate it being used in Kestra. You'll learn about it in Module 4. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchestration platform that makes both scheduled and event-driven workflows easy. By bringing Infrastructure...
DE Zoomcamp 2.2.7 - Manage Schedules and Backfills with BigQuery in Kestra
Просмотров 1,1 тыс.День назад
In this video, we'll cover how you can schedule your data pipelines to run at specific times. We'll also cover how you can backfill your data pipelines to run on historical data, specifically on GCP using GCS and BigQuery. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchestration platform that makes both scheduled and event-driven workfl...
DE Zoomcamp 2.2.6 - ETL Pipelines in Kestra: Google Cloud Platform
Просмотров 2 тыс.День назад
Now that you've learned how to build ETL pipelines locally using Postgres, we are ready to move to the cloud. In this section, we'll load the same Yellow and Green Taxi data to Google Cloud Platform (GCP) using: - Google Cloud Storage (GCS) as a data lake - BigQuery as a data warehouse. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchest...
DE Zoomcamp 2.2.5 - Orchestrate dbt Models with Postgres in Kestra
Просмотров 1,4 тыс.День назад
Now that we have raw data ingested into a local Postgres database, we can use dbt to transform the data into meaningful insights. DBT is only being used to demonstrate it being used in Kestra. You'll learn about it in Module 4. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchestration platform that makes both scheduled and event-driven w...
DE Zoomcamp FAQ - Docker Setup
Просмотров 531День назад
We've had a few questions around host.docker.internal on other operating systems as well as how to combine all 4 containers into 1 single Docker Compose file. Will walks through both of these. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchestration platform that makes both scheduled and event-driven workflows easy. By bringing Infrastr...
DE Zoomcamp 2.2.4 - Manage Scheduling and Backfills with Postgres in Kestra
Просмотров 1,6 тыс.День назад
In this video, we'll cover how you can schedule your data pipelines to run at specific times. We'll also cover how you can backfill your data pipelines to run on historical data. We'll demonstrate backfills first locally using Postgres and then on GCP using GCS and BigQuery in a later video. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven or...
DE Zoomcamp FAQ - Ports and Images
Просмотров 361День назад
We've had a few questions around Docker configuration such as ports to use, versions of Postgres and which image to use? Will explains this during the video. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchestration platform that makes both scheduled and event-driven workflows easy. By bringing Infrastructure as Code best practices to da...
DE Zoomcamp FAQ - PostgresDB Setup and Installing pgAdmin
Просмотров 805День назад
We've had a few questions around which PostgresDB you should use for the Kestra exercises as well as how to download pgAdmin. Will goes through these during this short video. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchestration platform that makes both scheduled and event-driven workflows easy. By bringing Infrastructure as Code bes...
DE Zoomcamp 2.2.3 - ETL Pipelines with Postgres in Kestra
Просмотров 4,8 тыс.День назад
In this video, we'll cover how you can ingest the Yellow Taxi data from the NYC Taxi and Limousine Commission (TLC) and load it into a Postgres database. We'll cover how to extract data from CSV files, and load them into a local Postgres database running in a Docker container. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Check out the FAQ here: ruclips.net/video/ywAPYNYFaB4/ви...
DE Zoomcamp 2.2.2 - Learn Kestra
Просмотров 2,7 тыс.День назад
In this video, you'll learn what is Kestra, how to use it, and how to build a Hello-World data pipeline. Check out the GitHub Repository here: go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchestration platform that makes both scheduled and event-driven workflows easy. By bringing Infrastructure as Code best practices to data, process, and microservice orchestration, you can ...
DE Zoomcamp 2.2.1 - Workflow Orchestration Introduction
Просмотров 4,4 тыс.День назад
DE Zoomcamp 2.2.1 - Workflow Orchestration Introduction
Write Code Inline vs Execute File - Commands vs Script Tasks in Kestra
Просмотров 19614 дней назад
Write Code Inline vs Execute File - Commands vs Script Tasks in Kestra
Render Expressions Recursively in Kestra | How-to Guide
Просмотров 4614 дней назад
Render Expressions Recursively in Kestra | How-to Guide
Integrate Your Python Code in Kestra | How-to Guide
Просмотров 11921 день назад
Integrate Your Python Code in Kestra | How-to Guide
Make Your Workflows Dynamic with Expressions in Kestra
Просмотров 17121 день назад
Make Your Workflows Dynamic with Expressions in Kestra
Build Python Packages in Kestra | How-to Guide
Просмотров 18328 дней назад
Build Python Packages in Kestra | How-to Guide
Parallel vs Sequential in Kestra - What's the difference? | How-to Guide
Просмотров 106Месяц назад
Parallel vs Sequential in Kestra - What's the difference? | How-to Guide
Handling Null and Undefined Values in Kestra | How-to Guide
Просмотров 89Месяц назад
Handling Null and Undefined Values in Kestra | How-to Guide
Access Different Docker Containers on Localhost with host.docker.internal | How-to Guide
Просмотров 358Месяц назад
Access Different Docker Containers on Localhost with host.docker.internal | How-to Guide
Enable CORS for Local Development in Kestra | How-to Guides
Просмотров 66Месяц назад
Enable CORS for Local Development in Kestra | How-to Guides
Clean Up Kestra by Purging Old Executions | How-to Guide
Просмотров 93Месяц назад
Clean Up Kestra by Purging Old Executions | How-to Guide
Access Local Files inside of Kestra | How-to Guide
Просмотров 356Месяц назад
Access Local Files inside of Kestra | How-to Guide
Light or Dark Mode? Sync with System Theme in Kestra 0.20
Просмотров 40Месяц назад
Light or Dark Mode? Sync with System Theme in Kestra 0.20