Airflow Helm Chart : Quick Start For Beginners in 10mins
HTML-код
- Опубликовано: 31 май 2021
- Airflow Helm Chart : Quick Start For Beginners in 10mins
👍 Smash the like button to become an Airflow Super Hero!
❤️ Subscribe to my channel to become a master of Airflow
🏆 BECOME A PRO: www.udemy.com/course/the-comp...
🚨 My Patreon: / marclamberti
The Official Airflow Helm Chart is out!
Why is it important for you?
Now you only have one chart to look for and to stay up to date with. With the official Airflow helm chart you can quickly set up and run Airflow on your Kubernetes cluster. In this quick video, you are going to learn:
- How to set up your own Kubernetes cluster locally
- How to deploy Airflow with the Celery Executor using the Helm chart
- How to configure the Airflow helm chart and so, your Airflow instance
At the end of the video, you will have a fully functional Kubernetes cluster with Airflow deployed using the Celery Executor!
Enjoy!
Materials: www.notion.so/Airflow-Helm-Ch...
Top-notch as always Marc!
Thanks Marc!
LOL! I love the energy !!!!! :)
awesome!!
Great!
Teach us autoscaling with Keda. Thanks Marc!
Great video! One question, how would I use load balancer instead of port forwarding for AKS deployment? Thank you!
You are mind blowing.
thank you so much :)
You saved my day.
🫶
How to add dags created by me into airflow? How do I load my dags folder?
you found out how to do it
Very nice. In my case im using EKS. So i just need to skip Kind cluster part and proceed to rest of steps? Thanks!
🚀🚀🔥
Great video! Btw, when using helm chart to deploy airflow on k8s, how do I install python package such as boto3? Is there configuration for this?
Can you make a video on deploying it in some private gke or eks cluster?
thanks for the video! Where can I find the minimum specs for the nodes? Thanks
how to load our own dags with helm , if you have any link available please share it.
Great video. How can I add my own dag?
How you suggest to add spark binaries to this Helm Chart?
Hi What is the image for flower, and what is pod_template ? ( I am new to k8s and airflow)
how to set the base_url as a configmap and enable it on the value.yaml file.
Init:CrashLoopBackOff when i using git-sync ?
Great works! One question: what if i want to install extra python packages using requirements.txt? Which part should I change?
The docker image of Airflow :)
How do you make this thing work with rancher?
Did anybody tried with reverse proxy like exposing airflow ui thorugh nginx server?
Unfortunately, this did not work. I use microk8s under PopOS 20.04. I created the default cluster on the local dev environment using the commands provided by both you and the apache airflow helm page. Error: INSTALLATION FAILED: failed post-install: timed out waiting for the condition
same here
Hi Marc, I'm hitting that error when trying to upgrade helm airflow. Hope you can help. Thank you!
PS C:\Projects\kind-airflow> helm upgrade --install airflow apache-airflow/airflow -n airflow -f values.yaml
Error: UPGRADE FAILED: execution error at (airflow/charts/postgresql/templates/secrets.yaml:20:15):
PASSWORDS ERROR: The secret "airflow-postgresql" does not contain the key "password"
Hi there, I have an error on this command "helm install airflow apache-airflow/airflow --namespace airflow --debug". Has anybody had any issues with that?
Hi,
Please place --timeout 15m at the end of command.
helm upgrade --install airflow apache-airflow/airflow -n airflow -f values.yaml --debug --timeout 15m
Use this command it will help you to create
@@jaganmohan4388 Thank you Jagan! I'll try and get back to you with my outcome later.
Dummy operator is not working
Is anybody know what has to do
Thanks Marc!!!