How To DESIGN YOUR First DATA PIPELINE ??🔥 15 Minutes BASIC STEPS

Поделиться
HTML-код
  • Опубликовано: 28 ноя 2024

Комментарии • 61

  • @shashank_mishra
    @shashank_mishra  2 года назад +14

    Happy Diwali 😍 Also, watch the full video and complete the task which I have given in the end of this video✌

    • @prashikpatil2830
      @prashikpatil2830 2 года назад

      Same to you sir ..

    • @vaishnavibarapatre7736
      @vaishnavibarapatre7736 2 года назад

      Hi...... I m a data analyst and want to switch in data engineering....can you suggest should I prepare for this ?

  • @gauravtales04
    @gauravtales04 2 года назад +6

    I love that swastik which you have made on RUclipsplay button ...this shows how humble you are...lots of love sir...💕

  • @akritigupta9709
    @akritigupta9709 2 года назад +3

    hello Shashank...
    It's really great learning toward data engineering pipeline. I am beginner towards data engineer domain. I can't wait to implement this basic pipeline using tools like spark and airflow. Eagerly waiting for this solution part of given task.😊

  • @sandeepnarwal8782
    @sandeepnarwal8782 9 месяцев назад

    One of the best videos on youtube :)

  • @saeed-khan-cs
    @saeed-khan-cs Год назад +1

    Simple but wonderful explanation with example. Thanks a lot, for such amazing contents!

  • @dhainik.suthar
    @dhainik.suthar 2 года назад +1

    This one is one of the best video on channel. Thank you so much shashank and I am also waiting for your programming implementation of this data pipelines.

  • @aviksaha6636
    @aviksaha6636 2 года назад +1

    Informative one , I am currently using Control-M for job scheduling

    • @mayurpatil2984
      @mayurpatil2984 2 года назад

      Hey avik I am also using control-M for jon scheduling ..can it be helpful in data engineering... Airflow is just like control-M???

  • @swapnilpande2775
    @swapnilpande2775 2 года назад +3

    Where does informatica fits in this?? Why informatica is used in etl?? I am beginner so can you plz tell what is the use of informatica in this entire process you explained.
    Must reply if you read this comment .
    Thanks

  • @manvika
    @manvika Год назад

    We need more of these kinds of series from you Shashank. Great Job!!!! I want to transition to data engineering and want to learn & build basic to complex data pipelines practically. I'm targeting around 1-2 months of time to learn practically.

    • @gojosatoru805
      @gojosatoru805 Год назад

      Have you switched to data engineering field?

  • @shananwar3199
    @shananwar3199 4 месяца назад +1

    Please make a data engineering project course with atleast 10 end to end projects.

  • @ashishshetty6489
    @ashishshetty6489 Год назад +2

    Hi, thank you for the detailed explanation. I was curious to know if you can share some more detailed points before deciding on whether to use Spark or Flink as a processing engine. Since both

  • @harivilas2660
    @harivilas2660 2 года назад +1

    Keep making such videos, very less resources regarding same

  • @krushnonjaypatil4684
    @krushnonjaypatil4684 2 года назад +2

    Happy Diwali

  • @kamiluddinahmed3892
    @kamiluddinahmed3892 Год назад

    What a fabulous lecture.

  • @khanaffan4833
    @khanaffan4833 2 года назад

    ya brother .....more video on this🔥🔥🔥.....infact start making playlist of course on DE basic to pro😅

  • @nayandeshmukh6034
    @nayandeshmukh6034 2 года назад +2

    Happy diwali Shashank

  • @swaragupta7932
    @swaragupta7932 Год назад

    Very good video. Good content. I like your way of giving practical examples.

  • @prasadmuthyala9625
    @prasadmuthyala9625 Месяц назад

    Etl process going to build by single data engineer? What is the day to day work?

  • @nayandeshmukh6034
    @nayandeshmukh6034 2 года назад +3

    Iam currently frontend developer what step should I follow

  • @seshadrinitesh2566
    @seshadrinitesh2566 2 года назад +2

    Hello Shashank Happy Diwali. It's really a great guide I can't wait to implement this basic pipeline using tools like spark and airflow. Eagerly waiting for you to teach the Topics🙂🙂🙂🙂

  • @vivekjuwar
    @vivekjuwar 2 года назад +1

    Very very helpful 👍

  • @jonathanlazarte5975
    @jonathanlazarte5975 Год назад

    I subscribe for the thumbnail hahaha
    Great content!

  • @kavipreya9117
    @kavipreya9117 8 месяцев назад

    Thanks!

  • @venkateswarareddypagadala3398
    @venkateswarareddypagadala3398 2 года назад

    Very good and informative 🙏🙏🙏🙏🙏🙏🙏

  • @robingujjar7568
    @robingujjar7568 Год назад

    Very helpful👍

  • @abhinavtiwari6925
    @abhinavtiwari6925 2 года назад +2

    Please make a solution video please

  • @jyothikamatham98
    @jyothikamatham98 Год назад

    Thanks a lot sir

  • @Adityaaaar366
    @Adityaaaar366 2 года назад

    Gr8 course

  • @varunrithvikgudluru4904
    @varunrithvikgudluru4904 2 года назад +1

    Hey Shashank great project idea ....but how to get the data set that changes automatically day by day ???

  • @soumyaranjandash3597
    @soumyaranjandash3597 2 года назад +4

    We want Part - 2

  • @monicakherajani5840
    @monicakherajani5840 2 года назад

    Please make videos on new technologies and work u r currently doing in expedia

    • @sumans420
      @sumans420 Год назад

      Haan, tab jaake Bhai ko notice milegi.

  • @akshayraj7743
    @akshayraj7743 2 года назад

    Please provide the implementation part in a later video. Thank you

  • @rohitbshelar
    @rohitbshelar 2 года назад +6

    Have enrolled in your Big Data Bootcamp 2.0.Looking forward to a wonderful learn journey with you Shashank 😊.
    Good intro the layman in this domain. Thank you: )

    • @bhagyasree981
      @bhagyasree981 Год назад +1

      Hi how is the course?

    • @rohitbshelar
      @rohitbshelar Год назад

      @@bhagyasree981 Hello! The course is conducted on the weekends, 3hrs per day, and two hours doubt resolution post that. Regarding content, i personally find it very useful coming from non-cs background as all fundamentals are covered from scratch. Shashank is resourceful and positive man; and i believe we get real industry insights owing to his experience at best companies.
      Regards

  • @kirankapuriya8160
    @kirankapuriya8160 2 года назад

    Hello shashank sir i want to do Cousching of data science kindly tell your institute name

  • @jofiajoe1680
    @jofiajoe1680 2 года назад

    Hello, do you know about Data analytics course provided by Edubridge India ? Are they genuine ?

  • @uttamshukla4768
    @uttamshukla4768 Год назад

    sir, can you tell the code for the question given in the video

  • @vascanor6085
    @vascanor6085 2 года назад

    Best guide for noob like me

  • @rahulbhardwaj9130
    @rahulbhardwaj9130 2 года назад

    Bro How to Get Enrolled in your Bootcamp.
    I am fresher non
    CS background.

  • @Gautam_Buddh_Motivation55
    @Gautam_Buddh_Motivation55 2 года назад

    Tell me which is best data analyst pay after Placement course? Which is legal or job oriented please tell me

  • @rocknur
    @rocknur 2 года назад

    Hi shashank..
    I have enrolled for the big data engineer bootcamp 2.0
    Hoping for a great experience 🙂..

  • @KeyBooksInsights
    @KeyBooksInsights 2 года назад

    Is it spark is same as pyspark

    • @hiteshwadhwani629
      @hiteshwadhwani629 2 года назад

      In python we use pyspark

    • @KeyBooksInsights
      @KeyBooksInsights 2 года назад

      @@hiteshwadhwani629 can I use pyspark instead of spark

    • @ramcan7291
      @ramcan7291 2 года назад

      It's the same Spark is the framework which is being run with the help of python language hence called pyspark only spark refers to the one run with scala language

  • @Ana-vd1rl
    @Ana-vd1rl 2 года назад

    Tell me anything where I don't have to do coding but i can earn high🙂🙂

  • @DeepikaAnipini
    @DeepikaAnipini 3 месяца назад

    Has anyone completed the task?

  • @bhojrajjadhav3488
    @bhojrajjadhav3488 2 года назад

    *****