How to Use Redshift with Airflow!
HTML-код
- Опубликовано: 30 сен 2024
- Discover the seamless integration of Amazon Redshift and Apache Airflow in this step-by-step tutorial. Whether you're managing vast datasets or orchestrating complex workflows, learn how to harness the power of Redshift's data warehousing capabilities with Airflow's dynamic workflow scheduling. This video covers setup, best practices, and real-world use cases, ensuring you can efficiently scale and optimize your data operations. Perfect for data engineers, architects, and those eager to boost their data infrastructure skills. Dive in now, and take your Redshift and Airflow expertise to new heights! Don't miss out - subscribe for more cutting-edge data tutorials.
registry.astro...
airflow.apache...
![Tee Grizzley - Blow for Blow (feat. J. Cole) [Official Video]](http://i.ytimg.com/vi/wNLN5xsx5dc/mqdefault.jpg)
Great info. It seems like every month there's a new orchestration tool that pops up. I'm sure they all have their pros and cons but it seems like airflow has the biggest community and it's battle tested.
My opinion exactly! Everyone wanna be Airflow, but ain't no body Airflow!
Would be cool if we had an Airflow + Spark / PySpark video.
Ask and you shall receive!
when i try to use the astro dev init command it says "Try 'astro --help' for help.
Error: No such command 'dev'."
i already pip installed the astro-cli
Oh interesting, would you mind running the astro version command and letting me know what you get?
@@thedataguygeorge the problem is that pip installing and brew installing is only for Unix based systems, I read the documentation for windows and installed airflow with docker so im gonna try to set up an environment now, thank you though!
it works ! just had to use the Winget method
@@thedataguygeorge btw man are you on LinkedIn or any other social media? Feel like I'll have a ton of questions about the astro cli while working with it if you're open to that