Видео

Thank you for sharing free. This is the best airflow course I have leant. Everything is expressed fluently and easy to understand and practise quickly. This courage still working at airflow 2.9.2 - latest version at the time of this command except aws s3 connection (I must watch another video of you to update). I have a question about docker-compose file. What's different type of airflow executors at 13:30 and the purpose of the services you deleted in docker-compose file after that. That good be greet if you have some video to explain them.

Hello @coder2j , I am getting error while running "airflow db init" command. Error - airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///./airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/airflow.db`.

You are the GOAT!!! Thank you so much!!!❤

Incredibly useful

as newbie i found using docker its more easy to understand than all the other ways

finally!!

Can we create a file containing database content on a website? This video saves it on a local folder, I'd like to do it on a website's folder.

If you don't want to build an image every time you can use the following commands docker exec -it <container_name> bash pip install <package> exit I think it is the airflow-scheduler container you should execute

Thank you)

Haven't seen a worse video teaching something technical. Video explanation not beginner friendly

Hi, This tutorial is good .. I would love to have more indepth knowledge in Dagster as i am thinking this would be the feature of Orchestration as well as ingestion tool.

this videos are awesome, and probably the most helpful information about usage of airflow. very brief and well prepared. Thanks Coder2j!

Great video! Thanks for sharing! Just a question about using Jupyternote book. Are there any benefits of using a Jupyternotebook in Jupyterlab over using that in VS Code?

HELP NEEDED. Anyone using windows had issue running 'airflow db init' on windows? I got error msg saying something like 'cannot use relative path, please use absolute path'. I tried 'set AIRFLOW_HOME=~/airflow', but no luck.

Great Tutorial.

BEST

thanks a lot, if i have pandas dataframe, how can i pass it from one task to another

why my code take so much time to run on vscode example scripts spark = SparkSession.builder\ .appName("NYSE Count")\ .master("local")\ .getOrCreate()

Hello, I have a question. How can I fix this error? ---Cannot relative path--- --After airflow db init-- move In the 07:40

Very great tutorial, I hope you can launch the tutorials of Spark ML and Streaming asap. Thanks

How to configure AWS Elastic cache in airflow

This was super helpful, thanks!! It answered all of my questions & provided me with everything I needed to know!

This tutorial was pretty solid. Thanks.

exporting the airflow on my end I had to export it this way for it to work globally export AIRFLOW_HOME=~/airflow

can you explain bout trigger?

unable to install docker

this was super helpful! thank you for making this video!

why is that airflow.cfg is not in my current directory?

I dont normally comment in RUclips videos but your dagster videos is awesome! learned alot as its the direct and concise.

Please also cover the dagster sensors session

Please make a video explaining the components in the docker-compose.yaml like the x-ariflow common

can someone help im getting local file error in windows *** Reading local file: /opt/airflow/logs/example_branch_dop_operator_v3/condition/2024-05-02T00:00:00+00:00/1.log

9:51

Hi coder2j... Ive been battling with this error for the past 12 hours. Would really appreciate your help and that of anyone else. I'm running vscode on windows and have tried to set AIRFLOW_HOME=. When I try to initiate the airflow database, I get the error below. I have scoured the internet for a solution and have come stuck. Plz help1 AirflowConfigException( airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///C:\Users\Dimitri/airflow/airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/airflow.db`

i had to comment nothing worked for me so far, i mainly dont have issue with the example dags. it just could not read the dag folder no matter what i tried i am using Ubuntu wsl 2, i use 'code .' to connect with vscode doesnt matter if i use C:\Users\user\Documents\\airflow\dags or /mnt/c/Users/user/Documents//airflow/dags as the path on airflow.cfg still my project does not load on the airflow UI. load_examples = False dont stop the examples from loading too. used 3 days trying to set airflow but now my project files are currently on example_dags folder and its working fine i just deleted the .py files i dont need there

getting below error:: airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///C:\Users\ADMIN/airflow/airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/airflow.db`. --- I am unable to get the airflow.cfg file(basically it is not getting created)

Thank you brother, this is the best Spark introduction.

thanks! this tutorial is super helpful and I've learned a lot!

Amazing video❤

In case of error, you might change the export command to "export AIRFLOW_HOME=`pwd`"

Thanks for this tutorial

Really nice overall Tutorial! Thanks for creating it

Can i ask why in the step install airflow in airflow_tutorial, I can open the web UI, but to the vid airflow_docker i cannot open the web UI although i have done exactly as you instructed. Please give me some helps, i have been stucking with that for 2 days

excellent video, please do hesitate to do more like these

❤❤❤

Thanks for the informative video. The pyspark environment is not activating on my windows 10 machine. Can you please help me what might be missing '.pyspark-env' is not recognized as an internal or external command, operable program or batch file.

FATAL: password authentication failed for user "airflow" . can you kindly help with it ??

Nice tutorial . when I go to localhost:8080 after extending the docker image. The Airflow UI is not loading. It gives as "localhost refused to connect." msg in my browser. Is there a way to fix this ?

Obrigado! God bless you.

watched 40 mins and Iam really happy after the coding session. keep it up :)