Install Apache Airflow for Windows PC

Поделиться
HTML-код
  • Опубликовано: 22 янв 2025

Комментарии • 135

  • @SoumitriD
    @SoumitriD Год назад +3

    Excellent bhai. I was struggling for 2 days to set up airflow without docker. Finally landed here and you helped like a breeze.

    • @ampcode
      @ampcode  Год назад

      Thank you so much!

  • @rajyalakshmiganne302
    @rajyalakshmiganne302 Год назад +3

    great explanation!, please continue this airflow series

    • @ampcode
      @ampcode  Год назад +1

      Thank you so much! Subscribe for more content 😊

  • @vikasroy33
    @vikasroy33 9 месяцев назад +1

    I have followed the steps - all good till opening VS Code and adding compose and .env file with content. But docker-compose up -d saying file not found. Any relevant help or fix will be appreciated. @AmpCode

    • @vikasroy33
      @vikasroy33 9 месяцев назад

      please replay anyone how to fix it

    • @maxyblaqdataengr.
      @maxyblaqdataengr. 7 месяцев назад

      Exactly the issue I’m facing here.

    • @shreyasrivastava5927
      @shreyasrivastava5927 3 месяца назад

      @@vikasroy33 while renaming,paste that part of the name from the link given for that page, instead of manually typing the name

  • @asadbekkholdarov2658
    @asadbekkholdarov2658 День назад

    thanx alot and please continue share airflow tutorials bro

  • @sayemhaque6737
    @sayemhaque6737 9 месяцев назад

    hands down brother. I was struggling with that issue and fortunately, you came up with that and It was really very helpful for me. Thanks a lot Brother.

  • @hideweapon1361
    @hideweapon1361 10 месяцев назад

    sir thank you so much, i watch many tutos but hostloc dosnt work, u saved me 5 days :)

  • @MG-it6ou
    @MG-it6ou 3 месяца назад

    Thanks my friend, big support from France !

  • @deepak-kz4hn
    @deepak-kz4hn 3 месяца назад

    Excellent airflow explanation, helped me a lot.

  • @sanjaychaudhary-tz8yt
    @sanjaychaudhary-tz8yt 6 дней назад

    Thank you so much bro, you made it too simple

  • @MauFeitioO
    @MauFeitioO 7 месяцев назад +1

    my saviour! thank you, easy way to setup airflow

  • @raniabouzid8219
    @raniabouzid8219 7 месяцев назад +2

    It worked, so helpful thank you.

  • @MunniV-c1f
    @MunniV-c1f Месяц назад

    PS C:\Users\dataeng> docker-compose up -d when i am using this command it is showing errors like----
    no configuration file provided: not found

  • @aliasgharmodi9850
    @aliasgharmodi9850 8 месяцев назад +3

    Hello, I am trying to donwload the file from the given link in YAML formal but I am unable to do it. It is saving my file in txt format.

  • @jaspermurphy8865
    @jaspermurphy8865 5 месяцев назад +1

    HI thanks for the tutorial. I want to install and connect, integrate apache pyspark and data airflow on windows 11 Guide me. Do we really need vs studio to run apache spark and data airflow ?

  • @jamespaullee
    @jamespaullee 5 месяцев назад

    Thank You! Wow, this was immensely helpful.

  • @sumitrawall
    @sumitrawall Год назад +2

    Sir,
    I am facing an issue in airflow while doing a project like
    ""airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///C:\Users\YOURNAME/airflow/airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/a
    irflow.db`.""
    can you please suggest any solution for this

  • @PanehaSuri
    @PanehaSuri 3 месяца назад

    Thank You for your video!! helped in getting it installed at my local.

  • @Ace_wood
    @Ace_wood 8 месяцев назад

    Clear installation guide. Didn't get into any errors while downloading

  • @datasciencekuldip
    @datasciencekuldip 7 месяцев назад

    very clear steps, no issue occred. satisfyied witht he installation guide, thank you.

  • @diegovaldes1528
    @diegovaldes1528 5 месяцев назад

    I got this error: no matching manifest for windows/amd64 10.0.22631 in the manifest list entries when running docker-compose up -d. Any suggestions?

  • @ayushimallik1907
    @ayushimallik1907 7 месяцев назад

    Amazing job Aashay 🙂

  • @shephalijain7938
    @shephalijain7938 5 месяцев назад

    The 8080 server page is coming, but while running the code lines in VS code, its not running completely.
    Many other fellow commentors have also posted about this issue. Could you please answer regarding this issue?

  • @jaykadu6835
    @jaykadu6835 Месяц назад

    I want to run a workflow engine project on airflow using docker how can i do that, Do i have to do additional steps. If yes, can you provide it.

  • @عبدهعلاء-س1ب
    @عبدهعلاء-س1ب 5 месяцев назад

    Thank you man. It was so easy.

  • @himanshushorts7143
    @himanshushorts7143 4 месяца назад

    When i write localhost:8080 it doesn’t open airflow login page

  • @Jayamathi-y1b
    @Jayamathi-y1b Месяц назад

    One of the best . Thank you very much

  • @SilverSoul169
    @SilverSoul169 9 месяцев назад +1

    simple & straight forward, really helpful. thank you!

  • @PaulOnosode
    @PaulOnosode 8 месяцев назад

    Thanks for the explanation. However I couldn't reach localhost:8080
    I got 6/7 services Running while Airflow-init-1 Exited. Please how do I fix this?

  • @ДімаКуріптя
    @ДімаКуріптя 8 месяцев назад

    So I've installed it and webserver works fine, but how can I create a DAG inside my dags folder in Windows? It requires airflow to be installed, is this possible for Windows?

  • @vikasroy33
    @vikasroy33 9 месяцев назад +1

    i had set up but when i am going to again use airflow by localhost8080 it's showing "localhost refused to connect " Any relevant help or fix will be appreciated. @AmpCode

    • @freecontent2438
      @freecontent2438 6 месяцев назад

      Run this cmd in terminal: docker run -d -p 8080:8080 puckel/docker-airflow webserver

  • @bhaumikraj8879
    @bhaumikraj8879 5 месяцев назад

    can you please upload a tutorial for setting up the configurations for connecting airflow to mysql or mongo db

  • @vijayjoshi-mw8cr
    @vijayjoshi-mw8cr 5 месяцев назад

    Where is the dag folder located to add python script with container dag

  • @DataDrivenMind-q6y
    @DataDrivenMind-q6y 8 месяцев назад

    Thank you for this video, however, i have a question, if because of security the port 8080 is blocked, how can we have access to Airflow? or is there any where I can change the port?

  • @BhanuB-s8k
    @BhanuB-s8k 2 месяца назад

    How/where can I create a simple airflow DAG with this setup?

  • @dhananjayapattnaik7428
    @dhananjayapattnaik7428 Месяц назад

    last two days onward i am struggling to install it..please help me

  • @kameswaransrinivasan9570
    @kameswaransrinivasan9570 6 месяцев назад

    Hello
    time="2024-07-01T17:06:01+05:30" level=warning msg="The \"AIRFLOW_UID\" variable is not set. Defaulting to a blank string."
    time="2024-07-01T17:06:01+05:30" level=warning msg="The \"AIRFLOW_UID\" variable is not set. Defaulting to a blank string."
    time="2024-07-01T17:06:01+05:30" level=warning msg="C:\\Users\\kames\\Desktop\\material\\docker-compose.yaml: `version` is obsolete"
    I am getting above error

    • @MrKirshoff
      @MrKirshoff 5 месяцев назад

      start docker and then, run "docker-compose up -d"

  • @TheRealKingHarry
    @TheRealKingHarry 9 месяцев назад

    Hey, everything is running but localhost:8080 doesnt resolve. any ideas please?

  • @EhabMohamed-z8i
    @EhabMohamed-z8i 3 месяца назад

    Thanks alot for your efforts ❤❤❤

  • @P4melaMasters
    @P4melaMasters 3 месяца назад

    Thank you very much, great video.
    Also if you are having issues creating the user, then look in the docker-compose file and there's a username and password you can use to get in initially.

  • @isharkpraveen
    @isharkpraveen 7 месяцев назад +2

    localhost:8080 is not working :(

  • @SamuelDaRocha-zw1jf
    @SamuelDaRocha-zw1jf 9 месяцев назад

    great explanation, thanks bro !

  • @guhanathanprathish9704
    @guhanathanprathish9704 10 месяцев назад

    kindly do some videos related to Apache Airflow. It will be very useful to us. And thank you for this installation process.🙌❤

  • @ivanachen8209
    @ivanachen8209 9 месяцев назад

    Hi!. is posible use Anaconda Navigator VS Code to configure Airflow dependencies and Python Librarys?

  • @thiothiosun
    @thiothiosun 10 месяцев назад

    It is very seldom that I leave any comments on YT videos, but this was beyond useful. Thanks, I don't have to jump through the hoops with Linux VM and what not, and I can simply run AF on Windows!

  • @josuedegbun6270
    @josuedegbun6270 Год назад +2

    thank you guys for this video, can you make a video for an ETL with airflow and mysql or mongodb please ?

  • @prakashprakash1250
    @prakashprakash1250 9 месяцев назад

    No configuration file provided: not found on visual studio

  • @SaljuCodes
    @SaljuCodes 10 месяцев назад

    i used docker like in this video it worked very easily, i was trying to solve error of absolute path with airflow db init for whole day ,, why it didnt worked after trying so much
    and talking about image of airflow how you got it ,, can you share .. like how you know that
    AIRFLOW_IMAGE_NAME=apache/airflow:2.4.2
    AIRFLOW_UID=50000
    these to set

  • @renvils
    @renvils 9 месяцев назад

    Your explanation is good and clear , can you do more airflow tutorial please ? anyway THANKS :)

  • @Munninarendra
    @Munninarendra Месяц назад

    sir is it possible to install airflow without docker

  • @JoseGutierrez-in6bn
    @JoseGutierrez-in6bn 3 месяца назад

    Easy and speed, so good tutorial.

  • @MohdKamran-x2v
    @MohdKamran-x2v 3 месяца назад

    localhost:8080 not working what to do?
    Please reply

    • @MohdKamran-x2v
      @MohdKamran-x2v 3 месяца назад

      Got it. i copied the latest yaml while used the old image version

  • @SaiPrakashR
    @SaiPrakashR 10 месяцев назад

    Hi sir,
    i just followed your steps i'm abale to run it.
    but once the system is shut down or in sleep mode the airflow-init container stops running.
    its exiting automatically, because of that i'm getting Page not found error.
    even after restarting docker and containers same issue i'm saying.
    can you provide any solutions if possible.

    • @HaticeMlikzade
      @HaticeMlikzade 5 месяцев назад

      did you able to solve it? I'm having the same issue

  • @maxyblaqdataengr.
    @maxyblaqdataengr. 7 месяцев назад

    From the creation of new terminal, it shows me no configuration file provided.

  • @LiamEdwards-se9yp
    @LiamEdwards-se9yp 11 месяцев назад

    can you assist me further with setting up airflow and using it

  • @premkumar-zp9so
    @premkumar-zp9so 6 месяцев назад

    Not able to setup Airflow UI - Localhost : 8080

  • @manuelcoaguila584
    @manuelcoaguila584 9 месяцев назад

    Hi friend, one question?. You have a cours of Apache Airflow. Thanks you.

  • @rupesh-qq5rl
    @rupesh-qq5rl 10 месяцев назад

    Thanks for making such good Content. Subscribed with a bell

  • @kibatumezgebu5398
    @kibatumezgebu5398 Год назад +1

    why is my localhost 8080 is not working to launch airflow?

    • @vidhyas4459
      @vidhyas4459 Год назад

      I too face the same issue. Were you able to figure it out?

    • @umerimran3833
      @umerimran3833 Год назад

      turn off firewall and retry@@vidhyas4459

    • @Gold1996gold
      @Gold1996gold Год назад

      that's because of the port 8080 is being used by another service , to chekck ,open CDM as addmin and type in " netstat -ano | findstr :8080 " to see if there is any service is using this port , if so , change the port of airflow web server in docker-compose.yaml file and try again

    • @aswathsundarr4853
      @aswathsundarr4853 10 месяцев назад

      turn off the firewall of your computer

  • @rohithpatel867
    @rohithpatel867 9 месяцев назад

    Thanks for saving my time!!

  • @TheRealKingHarry
    @TheRealKingHarry 9 месяцев назад

    also getting invalid login error now using admin as user and password. I copied your cmmand exactly

  • @c.shekhargupta5545
    @c.shekhargupta5545 7 месяцев назад

    facing an error docker-compose up -d
    unknown shorthand flag: 'd' in -d

  • @taiwoarikewusola2833
    @taiwoarikewusola2833 Год назад

    My localhost:8080 is working. It state that local host didn’t send any data. How can I rectify it?

    • @aswathsundarr4853
      @aswathsundarr4853 10 месяцев назад

      turn off the firewall of your computer

    • @Bodhidharma26
      @Bodhidharma26 6 месяцев назад

      @@aswathsundarr4853 still not working . how do you solve it ?

  • @shafiulamin4128
    @shafiulamin4128 8 месяцев назад

    Nice one mate. Thanks a lot.

  • @duongchitrungka
    @duongchitrungka 10 месяцев назад

    Thank you for helping me solve my problem

  • @scoobyy3112
    @scoobyy3112 9 месяцев назад

    Thank you so much! It helped alot.

  • @qlintdwayne9044
    @qlintdwayne9044 6 месяцев назад +1

    If you have an error message after creating " .env " file and you receive sth like "no file configuration found", go back to your materials folder, right click on the yaml file> properties>rename by removing the ".txt" extension. Otherwise everything should run fine. When pulling, ensure your docker is running and has not stopped. You can restart the docker if it has stopped, close and open it again.

  • @depazz
    @depazz Год назад

    what are the benefits to installing it with docker?

  • @eyamilabraham
    @eyamilabraham Год назад +1

    so much helpful, ty!

    • @ampcode
      @ampcode  Год назад

      Thank you so much! Subscribe for more content 😊

  • @gunshort8066
    @gunshort8066 5 месяцев назад

    Facing error while installing docker desktop

  • @hadilbrahem3193
    @hadilbrahem3193 6 месяцев назад

    so helpful, thank you

  • @zefur321
    @zefur321 8 месяцев назад

    Can I do offline installation?

  • @harshithajnharshitha7838
    @harshithajnharshitha7838 Год назад

    Its not taking when i give .env file

  • @RavinderShahrawat
    @RavinderShahrawat 9 месяцев назад

    Thanks and it worked exactly shown in the video . Can you please share video link as where to store the .py file for creating dags in this setup , I tried to put the .py code under DAGS folder in material but it didn't got refreshed in Airflow GUI . Please suggest.

    • @RavinderShahrawat
      @RavinderShahrawat 9 месяцев назад

      :) Posting answer too , seems it takes some time to get refresh in GUI after saving .py to DAGS folder.

  • @amalpp-tp8ww
    @amalpp-tp8ww Год назад

    i dont have 4gb remaining for docker, can you suggest the other method without installing docker

    • @jaydeepkarale
      @jaydeepkarale Год назад

      INstall WSL, UBuntu and then try on that

  • @ultron8257
    @ultron8257 5 месяцев назад

    its showing page is not working

  • @gangatharan-x4r
    @gangatharan-x4r Месяц назад

    very nice explained

  • @BOSS-AI-20
    @BOSS-AI-20 Год назад

    Error arises while starting docker dekstop

  • @JeFFiNat0R
    @JeFFiNat0R 11 месяцев назад

    Thank you!

  • @flyens
    @flyens Год назад +1

    thanks you so much

    • @ampcode
      @ampcode  Год назад

      Thank you so much! Subscribe for more content 😊

  • @uzeyirktk6732
    @uzeyirktk6732 7 месяцев назад

    localhost didn’t send any data.

  • @jaisahota4062
    @jaisahota4062 Год назад +1

    please continue this series

    • @ampcode
      @ampcode  Год назад

      Thank you so much! Subscribe for more content 😊

  • @yashaswinin5078
    @yashaswinin5078 Год назад

    it shows local host didnt send any data

  • @prajwaltamang4180
    @prajwaltamang4180 7 месяцев назад

    my file showing txt there

    • @mobinansarivlog9126
      @mobinansarivlog9126 2 месяца назад

      boss first you open file in notepad++ and save as yaml.

  • @hassanarshad8769
    @hassanarshad8769 11 месяцев назад

    locahost:8080 did not work

  • @umerimran3833
    @umerimran3833 Год назад +1

    thanks bro

    • @ampcode
      @ampcode  Год назад

      Thank you so much! Subscribe for more content 😊

  • @1nbyte
    @1nbyte 8 месяцев назад

    send slide , thnx

  • @ayaansk99
    @ayaansk99 Год назад

    local host not t working

  • @WillEDMr
    @WillEDMr 7 месяцев назад

    Huuuuuge help. Thank you

  • @abdoa7942
    @abdoa7942 8 месяцев назад

    king⭐⭐⭐⭐⭐

  • @jmjm991
    @jmjm991 9 месяцев назад

    2:34

  • @ronaldpai
    @ronaldpai 2 месяца назад

    "It's a fairly small file, only 573 MB" 😂

  • @freecontent2438
    @freecontent2438 6 месяцев назад

    Job karle

  • @isaacramirez6424
    @isaacramirez6424 5 месяцев назад

    thanks man

  • @kothapallysandhyadataengineer
    @kothapallysandhyadataengineer 6 месяцев назад

    Hello, I am trying to donwload the file from the given link in YAML formal but I am unable to do it. It is saving my file in txt format.

  • @srinathbolla5437
    @srinathbolla5437 7 дней назад

    Not able to setup Airflow UI - Localhost : 8080

  • @BoyaRakesh-cg9pw
    @BoyaRakesh-cg9pw 8 месяцев назад

    No configuration file provided: not found on visual studio