Master Apache Airflow: 5 Real-World Projects to Get You Started

Поделиться
HTML-код
  • Опубликовано: 15 сен 2024
  • Get the Apache Airflow Course Here - bit.ly/4f5Ml57
    USE CODE - EARLYAIRFLOW for 50% discount
    Combo Package Python + SQL + Data warehouse (Snowflake) + Apache Spark + Apache Airflow: datavidhya.com...
    USE CODE: COMBO50 for 50% discount
    In-depth Apache Airflow Course to kick-start your career in Data Engineering, you will everything about Airflow from basics to advanced, 3 mini projects, and 2 End-To-End Projects.
    👦🏻 My Linkedin - / darshil-parmar
    📷 Instagram - / datawithdarshil
    🎯Twitter - / parmardarshil07
    🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
    3 Books You Should Read
    📈Principles: Life and Work: amzn.to/3HQJDyP
    👀Deep Work: amzn.to/3IParkk
    💼Rework: amzn.to/3HW981O
    Tech I use every day
    💻MacBook Pro M1: amzn.to/3CiFVwC
    📺LG 22 Inch Monitor: amzn.to/3zk0Dts
    🎥Sony ZV1: amzn.to/3hRpSMJ
    🎙Maono AU-A04: amzn.to/3Bnu53n
    ⽴Tripod Stand: amzn.to/3tA7hu7
    🔅Osaka Ring Light and Stand: amzn.to/3MtLAEG
    🎧Sony WH-1000XM4 Headphone: amzn.to/3sM4sXS
    🖱Zebronics Zeb-War Keyboard and Mouse: amzn.to/3zeF1yq
    💺CELLBELL C104 Office Chair: amzn.to/3IRpiL2
    👉Data Engineering Complete Roadmap: • Data Engineer Complete...
    👉Data Engineering Project Series: • Data Engineering Proje...
    👉Become Full-Time Freelancer: • Best Freelancer Series...
    👉Data With Darshil Podcast: • Podcast Series - Data ...
    ✨ Tags ✨
    ✨ Hashtags ✨
    #dataengineering #airflow #datapipeline

Комментарии • 82

  • @DarshilParmar
    @DarshilParmar  22 дня назад +12

    Suggest topic for Part 2 of FREE Fundamentlas of Data Engineering Course, also don't forget to LIKEEEE

    • @aseempasha2373
      @aseempasha2373 22 дня назад

      Challanges that we can explain in each techstack (spark kafka cloud airflow)

    • @srh1034
      @srh1034 21 день назад

      Once upon a time your channel was a good source for learning. Now it has become a platform to just advertise your premium courses!!! If that is so, there might not be a case to follow you and subscribe!

    • @nobodyinparticula100
      @nobodyinparticula100 21 день назад

      Iceberg. Hearing a lot about open table format.
      That or pipeline testing/data verification and quality checks.
      Love your content.

    • @VarunSharma-jb2fr
      @VarunSharma-jb2fr 21 день назад

      @@DarshilParmar The aspects of being a DE other than tech. The soft skills, understanding the business, building a rapport with stakeholders, etc. Would appreciate real life examples from your journey. There are tons of DE Roadmaps that talk about tech. If you can give some genuine advice on how to navigate and enhance non tech skills especially in DE domain, that would be awesome. Should one focus on getting aligned with one industry like finance or utilities or it's fine to jump domains given one has competent tech skills - from long term perspective in industry Thanks.

    • @pratikgohil4848
      @pratikgohil4848 21 день назад

      ​@@srh1034This channel also has a free roadmap to become DE, but we have to do a lot of hard work to connect all the dots. If we buy his course we get everything at one place no need to do so much research on what to study and what not to. All the courses he has are pretty affordable, with good clarity. I think we should appreciate him for providing and supporting his hardwork in creating such courses.❤

  • @AadarshBaskar-x4v
    @AadarshBaskar-x4v 22 дня назад +1

    Pls post a video on data mesh

  • @sairam2731
    @sairam2731 3 дня назад

    Hi Darshil , tell me the duration of the each course

  • @pratikgohil4848
    @pratikgohil4848 21 день назад

    Hey Darshil, Thank you for providing such a good clarity about data engineer. I am from non tech background want to transition into DE, so which course I should buy from your site. I want to learn everything from scratch.

  • @user-zv5ud7sv7m
    @user-zv5ud7sv7m 22 дня назад +1

    Hello Darshil, Thanks for making video on Airflow, I am intrested in Full course of Apache Airflow course with End to end advance project using GCP Composer. Could you please give me link with coupon code ??

    • @DarshilParmar
      @DarshilParmar  22 дня назад

      Link is in the description with coupon code

  • @sayanmanik8823
    @sayanmanik8823 20 дней назад +1

    Hi Darshil
    How can I join the discord server??

  • @FA-tz9wk
    @FA-tz9wk 10 дней назад

    Hi Darshil, I would like to know your opinion on the IBM Data Engineering certificate on Coursera. Its seems to cover the important tools used in DE like Hadoop, Kafka, Spark. Would completing this certification help me get a job?(I am coming from a marketing background of over 20 years.)

  • @gnavarrolema
    @gnavarrolema 20 дней назад

    Hi. Are you planning to release courses related to cloud computing? Are they going to be part of the combo pack?

  • @whierthy2608
    @whierthy2608 20 дней назад

    Hey Darshil, Planning to buy the spark course from your site wanted to know if there is any probability of updating the course, if yes then will it reflect in my current purchased course it will be a brand new one
    Thanks

  • @amankhandelwal8293
    @amankhandelwal8293 17 дней назад

    Hi Darshil, I want to purchase airflow and snowflake only, any coupon for these seperately?

  • @parwezattar4228
    @parwezattar4228 21 день назад

    Can you please make video on DBT

  • @cesarlara3974
    @cesarlara3974 21 день назад

    If we get the zero to hero combo pack, will we get access to the other courses that you are currently working on once they are available?

    • @DarshilParmar
      @DarshilParmar  21 день назад +1

      No, this combo pack is only for 5 courses that are mentioned

  • @hameedaj-c2w
    @hameedaj-c2w 14 дней назад

    Hi Darshil, I have joined the Apache Airflow Course, I am not finding where to join the discord community.. I checked all course resources and could not find the discord community link to join. Can you please help out?

  • @detectivepk8917
    @detectivepk8917 22 дня назад

    Hi Darshil and I'm eager to learn. Could you let me know how long it will take to release the other courses, specifically the end-to-end ones?

  • @deepakdoddera1
    @deepakdoddera1 21 день назад

    I am unable to see the link for the discord community and also link for the notes. How do I access it?

  • @pranavtambre7632
    @pranavtambre7632 22 дня назад

    I don't have aws, azure or google cloud subscription. Will the course still be helpful while doing the projects ?

  • @정태민-g7l
    @정태민-g7l 21 день назад

    hello. I live in another country and was interested in this course, so I tried to pay with my Visa card, but the payment keeps failing. What should I do?

  • @VarunSharma-jb2fr
    @VarunSharma-jb2fr 21 день назад

    Is the access to structured notes limited to 5 course combo?? Or it's included with Airflow course too?

  • @sayanmanik8823
    @sayanmanik8823 21 день назад

    Hi Darshil
    For cloud related resources in gcp, AWS, will we get free subscription if we buy this course??

  • @vinayakjaiswal9976
    @vinayakjaiswal9976 22 дня назад

    hey darshil , installing airflow or similar software on linux machine specially other than debian are painsome, are there any ways through which we can use airflow directly on the web? and if yes what % of performance issue will we see?

    • @DarshilParmar
      @DarshilParmar  22 дня назад

      We use docker in course, it's platform independent

  • @ThiagoSilvaOfficial
    @ThiagoSilvaOfficial 22 дня назад +1

    Could you put the course on udemy too, please?

    • @DarshilParmar
      @DarshilParmar  22 дня назад +1

      No, udemy take 70-80% fees, you get lifetime access to course just like udemy so what's the difference?

    • @nvasudeva
      @nvasudeva 22 дня назад +1

      @@DarshilParmar Price is the difference !
      I understand that quality doesn't come cheap but at the same the course could have been made a bit more affordable and for sure it's expensive even after applying coupon code.

    • @saadmultani7251
      @saadmultani7251 20 дней назад

      ​@@nvasudevawhat is the price?

  • @amanarya289
    @amanarya289 22 дня назад

    Just brought your course, where can I found the link to discord server? Also, I don't see anything in the resources section, can you please help me with accessing the notes and other links.

    • @DarshilParmar
      @DarshilParmar  22 дня назад

      Please email on info@datavidhya.com I will share you there

    • @amanarya289
      @amanarya289 22 дня назад

      @@DarshilParmar done, thanks !

    • @mahiticircle
      @mahiticircle 19 дней назад

      Hi Aman, can you share your experience, is it worth to buy combo course

  • @dineshkumar-kc7vt
    @dineshkumar-kc7vt 21 день назад

    Its very useful but don't you think its over priced

    • @DarshilParmar
      @DarshilParmar  21 день назад

      No, you get everything hands-on + theory + 5 projects in just one course
      more than that you pay of structured learning

  • @deaspirant
    @deaspirant 22 дня назад

    Hi Darshil, like Apache airflow is there any course available for Apache Beam it is also mandatory for these days right ? correct me if am wrong ?

    • @DarshilParmar
      @DarshilParmar  22 дня назад

      That will help covered in GCP course with dataflow

    • @adharshsunny5154
      @adharshsunny5154 22 дня назад

      @@DarshilParmardid you have any course on GCP data engineering

    • @Beginner-g4v
      @Beginner-g4v 17 дней назад

      do you have any course on GCP data engineering?

  • @pvsanathkumar8465
    @pvsanathkumar8465 22 дня назад

    Sir can u suggest any free cource to learn these hard way because i cannot afford cource right now, after starting work i can do that. But for now can u suggest anything

    • @DarshilParmar
      @DarshilParmar  22 дня назад

      I have projects available on my channel and also you can just find tutorials on RUclips too

  • @Hooow410
    @Hooow410 22 дня назад

    sir one confusion has occurred whether DE field accept freshers? I have already discussed with someone in this field and he said that For fresher it really difficult to be hire as DE, eventually i also find in you tube that all person who have entered in DE field they all have some experienced in other field, please clarify and also one things that those combo courses are for fresher or experienced guy?
    N.B- I am pursuing Btech(IT) and currently in 3rd year and also very much interested to make a career in DE field

    • @DarshilParmar
      @DarshilParmar  22 дня назад

      For fresher it is difficult but you can start with internship or entry level role, there are few but possible
      My courses will help you to get started, it will make you freshers to experienced person, you will get 14 projects, in-depth content and many more

    • @Hooow410
      @Hooow410 22 дня назад

      @@DarshilParmar so it's means that after completing aforesaid courses i will manage to get some entry level job on the bases of completing those projects

    • @DarshilParmar
      @DarshilParmar  22 дня назад

      @@Hooow410 I don't promise jobs but I guarantee you will become data engineer and have all skills you need as DE

    • @Hooow410
      @Hooow410 22 дня назад

      @@DarshilParmar okey thanks a lot for sharing your valuable thoughts.

  • @merajmohammed9180
    @merajmohammed9180 22 дня назад

    Bro I think I am ur first viewer I just want to ask that how to learn data like what are the parts of it which come under

    • @DarshilParmar
      @DarshilParmar  22 дня назад

      I don't understand your questions, can you elaborate

    • @merajmohammed9180
      @merajmohammed9180 22 дня назад

      @@DarshilParmar yeah sure I am sorry if I was not able to explain properly so I have started this journey a week ago… and I plan to study python,sql and Linux in the coming 5 months but I am confused and unable to plan how to go with Things that helps to manage, manipulate,transform,store,…. The data so for example I should study about tools like airflow or technologies like Apache Kafka can use pls explain in few lines the pathway of this tools and technology and which I should learn first and move next to which one …….hope this explains feels great to connect with a data engineer like u…..thanks

  • @nihitverma5784
    @nihitverma5784 22 дня назад +1

    how much time it will take to prepare apache kafka course ?

    • @DarshilParmar
      @DarshilParmar  21 день назад

      I am working on it right now, might take one more month

  • @tedduharish7474
    @tedduharish7474 16 дней назад

    bro do you use chat gpt for help , ??????

    • @DarshilParmar
      @DarshilParmar  16 дней назад

      of course, I use ChatGPT, Google, Stackoverflow, Claude everything for help
      Don't think you have to remember everything, as an engineer you should know where to look and solve problems

  • @TarabShaikh-ij2dt
    @TarabShaikh-ij2dt 22 дня назад

    Is Airflow written in Python?

  • @Badkurdar
    @Badkurdar 22 дня назад

    Only video are there or will be getting project files ?

    • @DarshilParmar
      @DarshilParmar  22 дня назад +1

      You'll get everything from videos to project files

    • @Badkurdar
      @Badkurdar 22 дня назад +1

      @@DarshilParmar Thanks, Taken combo. waiting for kafaka as well. Thank you.

    • @nihitverma5784
      @nihitverma5784 22 дня назад +1

      heyy, i am just a student doing ITI , you already purchaed the course can i also share it with your id if you agree ?

    • @Badkurdar
      @Badkurdar 22 дня назад +1

      @@DarshilParmar how to see notes please ?

    • @nihitverma5784
      @nihitverma5784 22 дня назад

      @@Badkurdar hi bro , can you share your email id please

  • @BenthamSheila-c8o
    @BenthamSheila-c8o 9 дней назад

    Davis Patricia Jackson Joseph Garcia Joseph

  • @Badkurdar
    @Badkurdar 22 дня назад

    Is this covered in your combo
    Combo Package Python + SQL + Data warehouse (Snowflake) + Apache Spark + Apache Airflow ?

  • @arjunmajumdar7288
    @arjunmajumdar7288 22 дня назад +5

    Too expensive

    • @DarshilParmar
      @DarshilParmar  22 дня назад

      I understand
      There are amazing free resources available on my channel and youtube too
      It takes lot of effort to create this course with multiple projects, in-depth content and notes so price is for that only

    • @nihitverma5784
      @nihitverma5784 22 дня назад

      give me your mail id