Apache Airflow One Shot- Building End To End ETL Pipeline Using AirFlow And Astro

Поделиться
HTML-код
  • Опубликовано: 26 ноя 2024

Комментарии • 53

  • @krishnaik06
    @krishnaik06  Месяц назад +3

    Check out my new Udemy complete MLOps Course with 10+ end to end ML Projects:
    www.udemy.com/course/complete-mlops-bootcamp-with-10-end-to-end-ml-projects/?couponCode=SHARING

    • @adityaverma1012
      @adityaverma1012 Месяц назад

      sir, we need new udemy coupon for ' DSA bootcamp + Leetcode Exercise ' . please sir ! do it quickly.🙏

  • @tanmaybagul2957
    @tanmaybagul2957 Месяц назад +3

    Realizing the Power of Airflow 😎 this video help me have high level understanding of what i was doing from last 3 years

  • @oceanview3165
    @oceanview3165 День назад

    It's very straightforward and helpful! Thank you!

  • @bp2807
    @bp2807 Месяц назад +3

    Krish Sir you really bring very good course, please include kubernetes. Also which tablet and software you use to write and explain sir. Love the way you teach. Kindly answer🙏

  • @maxwellmaxwels9618
    @maxwellmaxwels9618 2 дня назад

    Top content, Classic!

  • @ravulapallivenkatagurnadha9605
    @ravulapallivenkatagurnadha9605 Месяц назад +1

    Please add more Videos on Data Engineering

  • @bralabala
    @bralabala Месяц назад +3

    what I would have preferred to see is how you configured it to work with local files rather than calling an external api.
    since I posted this comment, I have now solved the problem myself.
    the short of it is to use astro's docker-compose.overrride.yml file to mount your local drives so it can communicate with the local directories

  • @SandipJadhav-ls1kg
    @SandipJadhav-ls1kg Месяц назад +14

    when will be big data engineer cource we can expect krish sir

    • @gagansingh3481
      @gagansingh3481 Месяц назад

      It's Etl , etl can be done though power query and load it to postgre sql .

    • @gagansingh3481
      @gagansingh3481 Месяц назад

      It's Etl , etl can be done though power query and load it to postgre sql .

  • @aibutsimple
    @aibutsimple Месяц назад +2

    Need more etl tools using project

  • @mohitjoshi8984
    @mohitjoshi8984 Месяц назад +4

    Sir talk about Kubernetes please

  • @Beliver5894-l8h
    @Beliver5894-l8h Месяц назад

    Hello Krish,
    create a end to end data science project which should involve ETL steps as well with airflow and also deployment

  • @aliensamv3997
    @aliensamv3997 Месяц назад +1

    hey Krish please add production-level project in your paid course (399) ... there were only basic project

  • @tejasgandhi7045
    @tejasgandhi7045 Месяц назад

    Thank you for such a nice video. It was really informative. I want to understand from the multiple pods which are coming up, if I want to run the worker node in AKS then what all chants are required and the process ?

  • @jaggyjut
    @jaggyjut Месяц назад +2

    Awesome. How is airflow different in comparison to Microsoft fabric

  • @tajudeensanni9240
    @tajudeensanni9240 Месяц назад +1

    Krish! This is amazing!!! Please is there any way Apache Airflow can be connected with k8

  • @madhuppandey3151
    @madhuppandey3151 Месяц назад +2

    Hi krish,
    How many videos you will upload on this series ?

  • @sachinkumar8369
    @sachinkumar8369 Месяц назад +1

    hey krish! thank you so much for this helping video. Can we use this build this using aws free tier account?

  • @saifilicious1749
    @saifilicious1749 Месяц назад +1

    Thanks bhai you listen to me

  • @86tejasd44
    @86tejasd44 Месяц назад

    Amazing sir 👏👏

  • @ambivert_sigma_motivation
    @ambivert_sigma_motivation Месяц назад

    Thanks for this course! Can you create a Jarvis using Python+AI?

  • @aliensamv3997
    @aliensamv3997 Месяц назад +1

    hey krish please add production level project in your paid course (399) ...

  • @satyamsubhaprakash
    @satyamsubhaprakash Месяц назад +1

    Hi Sir, can you please add projects on Market mix modelling?

  • @istiyakahamad2114
    @istiyakahamad2114 Месяц назад

    Great work..

  • @Stocks-l4x
    @Stocks-l4x 10 дней назад

    Running Dockers and airflow in local windows? It needs Linux environment right?

  • @aliensamv3997
    @aliensamv3997 Месяц назад

    hey krish please add production level project in your paid course (399) ... how we are suppose to know working process at industry lvl ... just 1 project please

  • @Sankarm018
    @Sankarm018 Месяц назад +1

    Sir pls provide full DATA science course from beginner to advance level on udemy sir

  • @dineshbiswal2775
    @dineshbiswal2775 Месяц назад +1

    What tools are you using for the video?

  • @mohammadfurquan241
    @mohammadfurquan241 Месяц назад

    📌ONE VIDEO ON KAFKA ALSOOOOO

  • @tusharmodi8344
    @tusharmodi8344 Месяц назад +4

    Sir for your mlops course do we also need to have aws subscription to do project work or is it not needed we can do something in free tiwr

    • @krishnaik06
      @krishnaik06  Месяц назад

      U can do in aws free tier

    • @harshsinha12
      @harshsinha12 Месяц назад

      ​@@krishnaik06sir the AWS Environment set-up is giving some errors, i have tried various fixes

    • @ARkhan-xw8ud
      @ARkhan-xw8ud Месяц назад

      @@harshsinha12 i have taken of my friend

  • @ChandanNayak-lq1pd
    @ChandanNayak-lq1pd Месяц назад

    Great ContentSir,will it be the part of data engineering course,and when is it available?

    • @krishnaik06
      @krishnaik06  Месяц назад +2

      yes a;ready started big data engineering course recording

    • @sumitrukadikar3521
      @sumitrukadikar3521 Месяц назад

      ​@@krishnaik06sir when it will launch?

  • @alhasanmohammedbinquraish960
    @alhasanmohammedbinquraish960 Месяц назад +2

    Hindi video sir airflow 🙏🙏🙏

  • @hemanthvarma1939
    @hemanthvarma1939 25 дней назад

    Your Voice Was Breaking in the Video due to a Connectivity issue in your end...Does this happen in any-part of your Udemy Video's too...Planning to Buy the Data Science Course on Udemy

    • @krishnaik06
      @krishnaik06  25 дней назад

      U can get it all the videos are recorded properly

    • @hemanthvarma1939
      @hemanthvarma1939 25 дней назад

      @@krishnaik06 Thanks a Lot Krish Sir

  • @njagikevin1069
    @njagikevin1069 Месяц назад +1

    Env file ".env" found. Loading...
    [+] Running 3/4
    - Container 20241028-etl-weather_43a1dc-postgres-1 Starting 1.2s
    - Container 20241028-etl-weather_43a1dc-triggerer-1 Recreated 0.4s
    - Container 20241028-etl-weather_43a1dc-scheduler-1 Recreated 0.5s
    - Container 20241028-etl-weather_43a1dc-webserver-1 Recreated 0.4s
    Error: error building, (re)creating or starting project containers: Error response from daemon: Ports are not available: exposing port TCP 127.0.0.1:5432 -> 0.0.0.0:0: listen tcp 127.0.0.1:5432: bind: An attempt was made to access a socket in a way forbidden by its access permissions.
    i am getting this error when running astro dev start

  • @RakeshPrajapati-b4z
    @RakeshPrajapati-b4z Месяц назад

    Sir machin learning ka paid cours kaise join kare kaise sir please guide me

  • @siddharthtyagi1254
    @siddharthtyagi1254 Месяц назад +1

    sir please upload some more tools in udemy course

    • @krishnaik06
      @krishnaik06  Месяц назад +1

      yes brother kubernetes will also get added

    • @siddharthtyagi1254
      @siddharthtyagi1254 Месяц назад +1

      @@krishnaik06 sir i want to learn feature store also from you . please sir

  • @deepop1287
    @deepop1287 Месяц назад

    Hello sir , Actually i want to buy your Udemy course of DATA ANALYST , But the price is currently high , so can you please provide me a Udemy coupon for this course then it will be really helpful sir 🥺🥺

  • @AlHasan-sh3il
    @AlHasan-sh3il 14 дней назад

    sir hindi video please

  • @prathmeshatre6251
    @prathmeshatre6251 Месяц назад

    S missing in using word

  • @KNfarming882
    @KNfarming882 Месяц назад +1

    First comment

  • @MOHIT836
    @MOHIT836 Месяц назад +4

    Krish sir, is this available on MLOps course ??

    • @krishnaik06
      @krishnaik06  Месяц назад +2

      yes many projects have been uploaded there :)