How to send out email alert ON RETRY and ON FAILURE in Apache airflow | Airflow Tutorial

In this video, I showed how you can set up and configure your APACHE airflow to receive email alerts whenever your DAG fails or up for retry. This will indeed help your data team to stay proactive on what is happening on your data pipeline and fix issues as soon as they occur thereby helping you to meet your service level agreement (SLA).
If you have any questions or comments, ok to ask or leave comments in the comment section below.
Please don’t forget to LIKE, SHARE, COMMENT and SUBSCRIBE to our channel for more AWESOME videos.
*Books I recommend*
1. Grit: The Power of Passion and Perseverance amzn.to/3EZKSgb
2. Think and Grow Rich!: The Original Version, Restored and Revised: amzn.to/3Q2K68s
3. The Book on Rental Property Investing: How to Create Wealth With Intelligent Buy and Hold Real Estate Investing: amzn.to/3LLpXRy
4. How to Invest in Real Estate: The Ultimate Beginner's Guide to Getting Started: amzn.to/48RbuOb
5. Introducing Python: Modern Computing in Simple Packages amzn.to/3Q4driR
6. Python for Data Analysis: Data Wrangling with pandas, NumPy, and Jupyter 3rd Edition: amzn.to/3rGF73G
#dataengineering #airflow #emailalert #ec2 #datapipeline #amazons3 #data #aws
**************** Commands used in this video ****************
sudo apt update
sudo apt install python3-pip
sudo apt install python3.10-venv
python3 -m venv airflow_notify_venv
source airflow_notify_venv/bin/activate
sudo pip install apache-airflow
airflow standalone
**************** USEFUL LINKS ****************
How to remotely SSH (connect) Visual Studio Code to AWS EC2 • How to remotely SSH (c...
How to build a pipeline to create table and insert records on snowflake with airflow on AWS EC2 • How to build a pipelin...
How to build and automate a python ETL pipeline with airflow on AWS EC2 | Data Engineering Project • How to build and autom...
How to Build and Automate loading data from S3 to Snowflake with email notification using airflow • How to Build and Autom...
Extract current weather data from Open Weather Map API using python on AWS EC2 • Extract current weathe...
Use airflow to orchestrate a parallel processing ETL pipeline on AWS EC2 | Data Engineering Project
• Use airflow to orchest...
PostgreSQL Playlist: • Tutorial 1 - What is D...
Github Repo: github.com/YemiOla/email_noti...
DISCLAIMER: This video and description has affiliate links. This means when you buy through one of these links, we will receive a small commission and this is at no cost to you. This will help support us to continue making awesome and valuable contents for you.

[@peterkatongole5984]

Thank you Tuplespectra. You're doing a very good job. Your tutorials are very practical

[@tuplespectra]

Thanks so much. I'm glad you find them valuable. Your comment really means a lot to us.

[@dawnokem2282]

Well Done Bros. good and clear explanation.

[@tuplespectra]

Thanks for the comment.

[@kylychbekzhumabaiuulu397]

I did try same approach with AWS sns not smtp. but it is not giving link to the logs in notification. Is there anything that you could suggest? it is only showing message which did write as message in dag script: op = SnsPublishOperator(
message="Dag Failed",
subject="Dag Failed",
)

[@mukeshkumar-yc9fq]

how do you get smtp port as 587?

[@tuplespectra]

You can just google round to get that. An example link is this: www.hostinger.com/tutorials/how-to-use-free-google-smtp-server#:~:text=Gmail%20SMTP%20port%3A%20465%20(SSL)%2F587%20(TLS)