too be true Gabe, my old team have run Airflow for a few years, just in ec2 and it's been extreamly stable. Tenacity, is my favoriate word with respect to Airflow.
You may need to check the execution role permissions policy for your environment, and that each of the VPC networking components required by the environment are configured to allow traffic. How do i resolve this issue? Do we have some reference video to show creation of execution role? And Video to check traffic ?
It's bullshit and expensive ! Better to run on EC2 Instances
Do you have a link of the dag I would like to see your code
Looks great except the pricing.
Yeah, it's way too expensive, I think Cloud Composer and Astronomer's solution are about the same but still...
exactly... too expensive...
too be true Gabe, my old team have run Airflow for a few years, just in ec2 and it's been extreamly stable. Tenacity, is my favoriate word with respect to Airflow.
which ec2 type and size are you using?
We ran it in a container hosted on Fargate.
You may need to check the execution role permissions policy for your environment, and that each of the VPC networking components required by the environment are configured to allow traffic.
How do i resolve this issue? Do we have some reference video to show creation of execution role? And Video to check traffic ?
Great resource, thanks for this intro video.
Can we include custom sql scripts/ or other python modules (helper functions) in the deployment?
I tried to create some environments, they all got stuck on "Creating" state and I cant delete them nor get any logs for why its stuck...
any idea how to fix it?
Is there any way we can have an active-active replication in two regions ?
How to access it if I select private network.. I am new to VPC
you have to set up your own VPN, e.g OpenVPN
how to measure mwaa auto scaling workers where it logged