Airflow Email Notification on Failure | Airflow Tutorial Tips 4

Airflow Email Notification on Failure | Airflow Tutorial Tips 4
#Airflow #AirflowTutorial #Coder2j
========== VIDEO CONTENT 📚 ==========
Discover the power of setting up Airflow email notifications on failure or retry in this exciting tutorial!
As a data engineer, staying on top of ETL workflow failures is essential, and constantly refreshing the Airflow web server UI isn't efficient. But fear not! Learn how to set up Airflow email notifications, enabling you to receive proactive email alerts for DAGs that require attention. Enhance your workflow efficiency and never miss a beat with this step-by-step guide using Outlook, Gmail, and third-party email providers. Don't forget to leave your suggestions and feedback in the video description to shape future content!
Subscribe, enable notifications: / coder2j
2-hour beginner Airflow tutorial: • Airflow Tutorial for B...
Video Request: forms.gle/UMp4GA3krcSMMWzy9
========== T I M E S T A M P ⏰ ==========
Throughout the course, you will learn:
00:00 - Intro
00:41 - Config email with Outlook
04:47 - Config email with Gmail
06:40 - Setup email connection
08:56 - Config email with SendGrid
========== L I N K S 🔗 ==========
Airflow 2-hour FULL COURSE 👉 • Airflow Tutorial for B...
SQL Tutorial for Beginners 👉 • SQL Tutorial for Begin...
Airflow Tutorial Tips 👉 • Airflow Tutorial Tips
Apache Airflow Tutorial for Beginners 👉 • Apache Airflow Tutoria...
========== Connect with me 👏 ==========
Twitter 👉 / coder2j
Website 👉 coder2j.com
GitHub 👉 github.com/coder2j

[@jeremyrojas2697]

Thanks a lot !! love your videos

[@skviknesh]

Wonderful content - you are a life saver!!!!😍❤❤❤

[@rjrmatias]

thank you very much, excellent tutorial

[@chineseculture1034]

I always can find the thing I need here. Thanks so much ❤❤

[@coder2j]

You are very welcome 🤗

[@vivekpatil6879]

Thank you for this series...❤

[@coder2j]

Thank you. ♥️

[@ronin959]

where did you get airflow.cfg file? in previous lessons, there wasn't this file

[@0kazaki]

very nice thank you

[@coder2j]

You are welcome

[@Rising_Ballers]

Bro I used to get emails in airflow when dag fails, but after latest airflow upgrade its not working, can u help

[@chihebedinezoghlami3847]

First of all thank you for the insightful playlist ❤
I was trying to recreate the email notification task using docker, however the same exact code works when executed in local python environment and not working on docker. I’m using office 365 . Can you provide the code used in this video or any tips to solve this issue

[@coder2j]

First check your airflow version, then search the corresponding configuration environment variable from the airflow doc site. Then set values for those env var in docker compose File.

[@mrviper3344]

How do you configure email notification if you are using docker?

[@coder2j]

The same configuration but via env variables as shown in the video.

[@ashwanisaxena9516]

Can we send email notification without python/other programming language ?.. I mean just Airflow

[@coder2j]

What do mean? Airflow is implemented in Python.

[@ashwanisaxena9516]

@@coder2j I have an yaml file where i am scheduling job for validation check..so trying to setup email notification if my job gets failed.
I did it using python file but they want to implement it using DAG only in yaml by calling some pythonOperator.
so just want to confirm if this is possible in some way or other ?

[@coder2j]

You can try with the email operator to send email if the upstream fails.

[@ashwanisaxena9516]

@@coder2j is there any documentation or sample code you can provide

[@coder2j]

Check the airflow official doc.