I have followed the steps - all good till opening VS Code and adding compose and .env file with content. But docker-compose up -d saying file not found. Any relevant help or fix will be appreciated. @AmpCode
hands down brother. I was struggling with that issue and fortunately, you came up with that and It was really very helpful for me. Thanks a lot Brother.
HI thanks for the tutorial. I want to install and connect, integrate apache pyspark and data airflow on windows 11 Guide me. Do we really need vs studio to run apache spark and data airflow ?
Sir, I am facing an issue in airflow while doing a project like ""airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///C:\Users\YOURNAME/airflow/airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/a irflow.db`."" can you please suggest any solution for this
The 8080 server page is coming, but while running the code lines in VS code, its not running completely. Many other fellow commentors have also posted about this issue. Could you please answer regarding this issue?
So I've installed it and webserver works fine, but how can I create a DAG inside my dags folder in Windows? It requires airflow to be installed, is this possible for Windows?
i had set up but when i am going to again use airflow by localhost8080 it's showing "localhost refused to connect " Any relevant help or fix will be appreciated. @AmpCode
Thank you for this video, however, i have a question, if because of security the port 8080 is blocked, how can we have access to Airflow? or is there any where I can change the port?
Hello time="2024-07-01T17:06:01+05:30" level=warning msg="The \"AIRFLOW_UID\" variable is not set. Defaulting to a blank string." time="2024-07-01T17:06:01+05:30" level=warning msg="The \"AIRFLOW_UID\" variable is not set. Defaulting to a blank string." time="2024-07-01T17:06:01+05:30" level=warning msg="C:\\Users\\kames\\Desktop\\material\\docker-compose.yaml: `version` is obsolete" I am getting above error
Thank you very much, great video. Also if you are having issues creating the user, then look in the docker-compose file and there's a username and password you can use to get in initially.
It is very seldom that I leave any comments on YT videos, but this was beyond useful. Thanks, I don't have to jump through the hoops with Linux VM and what not, and I can simply run AF on Windows!
i used docker like in this video it worked very easily, i was trying to solve error of absolute path with airflow db init for whole day ,, why it didnt worked after trying so much and talking about image of airflow how you got it ,, can you share .. like how you know that AIRFLOW_IMAGE_NAME=apache/airflow:2.4.2 AIRFLOW_UID=50000 these to set
Hi sir, i just followed your steps i'm abale to run it. but once the system is shut down or in sleep mode the airflow-init container stops running. its exiting automatically, because of that i'm getting Page not found error. even after restarting docker and containers same issue i'm saying. can you provide any solutions if possible.
that's because of the port 8080 is being used by another service , to chekck ,open CDM as addmin and type in " netstat -ano | findstr :8080 " to see if there is any service is using this port , if so , change the port of airflow web server in docker-compose.yaml file and try again
If you have an error message after creating " .env " file and you receive sth like "no file configuration found", go back to your materials folder, right click on the yaml file> properties>rename by removing the ".txt" extension. Otherwise everything should run fine. When pulling, ensure your docker is running and has not stopped. You can restart the docker if it has stopped, close and open it again.
Thanks and it worked exactly shown in the video . Can you please share video link as where to store the .py file for creating dags in this setup , I tried to put the .py code under DAGS folder in material but it didn't got refreshed in Airflow GUI . Please suggest.
Excellent bhai. I was struggling for 2 days to set up airflow without docker. Finally landed here and you helped like a breeze.
Thank you so much!
great explanation!, please continue this airflow series
Thank you so much! Subscribe for more content 😊
I have followed the steps - all good till opening VS Code and adding compose and .env file with content. But docker-compose up -d saying file not found. Any relevant help or fix will be appreciated. @AmpCode
please replay anyone how to fix it
Exactly the issue I’m facing here.
@@vikasroy33 while renaming,paste that part of the name from the link given for that page, instead of manually typing the name
thanx alot and please continue share airflow tutorials bro
hands down brother. I was struggling with that issue and fortunately, you came up with that and It was really very helpful for me. Thanks a lot Brother.
sir thank you so much, i watch many tutos but hostloc dosnt work, u saved me 5 days :)
Thanks my friend, big support from France !
Excellent airflow explanation, helped me a lot.
Thank you so much bro, you made it too simple
my saviour! thank you, easy way to setup airflow
It worked, so helpful thank you.
PS C:\Users\dataeng> docker-compose up -d when i am using this command it is showing errors like----
no configuration file provided: not found
Hello, I am trying to donwload the file from the given link in YAML formal but I am unable to do it. It is saving my file in txt format.
rename it in VS code
HI thanks for the tutorial. I want to install and connect, integrate apache pyspark and data airflow on windows 11 Guide me. Do we really need vs studio to run apache spark and data airflow ?
Thank You! Wow, this was immensely helpful.
Sir,
I am facing an issue in airflow while doing a project like
""airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///C:\Users\YOURNAME/airflow/airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/a
irflow.db`.""
can you please suggest any solution for this
Me to
Thank You for your video!! helped in getting it installed at my local.
Clear installation guide. Didn't get into any errors while downloading
very clear steps, no issue occred. satisfyied witht he installation guide, thank you.
I got this error: no matching manifest for windows/amd64 10.0.22631 in the manifest list entries when running docker-compose up -d. Any suggestions?
Amazing job Aashay 🙂
The 8080 server page is coming, but while running the code lines in VS code, its not running completely.
Many other fellow commentors have also posted about this issue. Could you please answer regarding this issue?
I want to run a workflow engine project on airflow using docker how can i do that, Do i have to do additional steps. If yes, can you provide it.
Thank you man. It was so easy.
When i write localhost:8080 it doesn’t open airflow login page
One of the best . Thank you very much
simple & straight forward, really helpful. thank you!
Thanks for the explanation. However I couldn't reach localhost:8080
I got 6/7 services Running while Airflow-init-1 Exited. Please how do I fix this?
So I've installed it and webserver works fine, but how can I create a DAG inside my dags folder in Windows? It requires airflow to be installed, is this possible for Windows?
i had set up but when i am going to again use airflow by localhost8080 it's showing "localhost refused to connect " Any relevant help or fix will be appreciated. @AmpCode
Run this cmd in terminal: docker run -d -p 8080:8080 puckel/docker-airflow webserver
can you please upload a tutorial for setting up the configurations for connecting airflow to mysql or mongo db
Where is the dag folder located to add python script with container dag
Thank you for this video, however, i have a question, if because of security the port 8080 is blocked, how can we have access to Airflow? or is there any where I can change the port?
How/where can I create a simple airflow DAG with this setup?
last two days onward i am struggling to install it..please help me
Hello
time="2024-07-01T17:06:01+05:30" level=warning msg="The \"AIRFLOW_UID\" variable is not set. Defaulting to a blank string."
time="2024-07-01T17:06:01+05:30" level=warning msg="The \"AIRFLOW_UID\" variable is not set. Defaulting to a blank string."
time="2024-07-01T17:06:01+05:30" level=warning msg="C:\\Users\\kames\\Desktop\\material\\docker-compose.yaml: `version` is obsolete"
I am getting above error
start docker and then, run "docker-compose up -d"
Hey, everything is running but localhost:8080 doesnt resolve. any ideas please?
Thanks alot for your efforts ❤❤❤
Thank you very much, great video.
Also if you are having issues creating the user, then look in the docker-compose file and there's a username and password you can use to get in initially.
localhost:8080 is not working :(
great explanation, thanks bro !
kindly do some videos related to Apache Airflow. It will be very useful to us. And thank you for this installation process.🙌❤
Hi!. is posible use Anaconda Navigator VS Code to configure Airflow dependencies and Python Librarys?
It is very seldom that I leave any comments on YT videos, but this was beyond useful. Thanks, I don't have to jump through the hoops with Linux VM and what not, and I can simply run AF on Windows!
thank you guys for this video, can you make a video for an ETL with airflow and mysql or mongodb please ?
No configuration file provided: not found on visual studio
i used docker like in this video it worked very easily, i was trying to solve error of absolute path with airflow db init for whole day ,, why it didnt worked after trying so much
and talking about image of airflow how you got it ,, can you share .. like how you know that
AIRFLOW_IMAGE_NAME=apache/airflow:2.4.2
AIRFLOW_UID=50000
these to set
Your explanation is good and clear , can you do more airflow tutorial please ? anyway THANKS :)
sir is it possible to install airflow without docker
Easy and speed, so good tutorial.
localhost:8080 not working what to do?
Please reply
Got it. i copied the latest yaml while used the old image version
Hi sir,
i just followed your steps i'm abale to run it.
but once the system is shut down or in sleep mode the airflow-init container stops running.
its exiting automatically, because of that i'm getting Page not found error.
even after restarting docker and containers same issue i'm saying.
can you provide any solutions if possible.
did you able to solve it? I'm having the same issue
From the creation of new terminal, it shows me no configuration file provided.
same did you find a solution?
can you assist me further with setting up airflow and using it
Not able to setup Airflow UI - Localhost : 8080
Hi friend, one question?. You have a cours of Apache Airflow. Thanks you.
Thanks for making such good Content. Subscribed with a bell
why is my localhost 8080 is not working to launch airflow?
I too face the same issue. Were you able to figure it out?
turn off firewall and retry@@vidhyas4459
that's because of the port 8080 is being used by another service , to chekck ,open CDM as addmin and type in " netstat -ano | findstr :8080 " to see if there is any service is using this port , if so , change the port of airflow web server in docker-compose.yaml file and try again
turn off the firewall of your computer
Thanks for saving my time!!
also getting invalid login error now using admin as user and password. I copied your cmmand exactly
facing an error docker-compose up -d
unknown shorthand flag: 'd' in -d
My localhost:8080 is working. It state that local host didn’t send any data. How can I rectify it?
turn off the firewall of your computer
@@aswathsundarr4853 still not working . how do you solve it ?
Nice one mate. Thanks a lot.
Thank you for helping me solve my problem
Thank you so much! It helped alot.
If you have an error message after creating " .env " file and you receive sth like "no file configuration found", go back to your materials folder, right click on the yaml file> properties>rename by removing the ".txt" extension. Otherwise everything should run fine. When pulling, ensure your docker is running and has not stopped. You can restart the docker if it has stopped, close and open it again.
thank you bhai , your advice was amazing
what are the benefits to installing it with docker?
so much helpful, ty!
Thank you so much! Subscribe for more content 😊
Facing error while installing docker desktop
so helpful, thank you
Can I do offline installation?
Its not taking when i give .env file
Thanks and it worked exactly shown in the video . Can you please share video link as where to store the .py file for creating dags in this setup , I tried to put the .py code under DAGS folder in material but it didn't got refreshed in Airflow GUI . Please suggest.
:) Posting answer too , seems it takes some time to get refresh in GUI after saving .py to DAGS folder.
i dont have 4gb remaining for docker, can you suggest the other method without installing docker
INstall WSL, UBuntu and then try on that
its showing page is not working
very nice explained
Error arises while starting docker dekstop
Thank you!
thanks you so much
Thank you so much! Subscribe for more content 😊
localhost didn’t send any data.
please continue this series
Thank you so much! Subscribe for more content 😊
it shows local host didnt send any data
turn off the firewall of your computer
my file showing txt there
boss first you open file in notepad++ and save as yaml.
locahost:8080 did not work
turn off the firewall of your computer
thanks bro
Thank you so much! Subscribe for more content 😊
send slide , thnx
local host not t working
turn off firewall and retry
Huuuuuge help. Thank you
king⭐⭐⭐⭐⭐
2:34
"It's a fairly small file, only 573 MB" 😂
Job karle
thanks man
Hello, I am trying to donwload the file from the given link in YAML formal but I am unable to do it. It is saving my file in txt format.
Not able to setup Airflow UI - Localhost : 8080
No configuration file provided: not found on visual studio