How I Use Python as a Data Engineer

Поделиться
HTML-код
  • Опубликовано: 26 ноя 2024

Комментарии • 115

  • @DarshilParmar
    @DarshilParmar  Год назад +52

    Tried new way of editing, let me know if you like this format. Also new project is coming soon on GCP so don't forget to hit LIKE button

    • @joelluis4938
      @joelluis4938 Год назад

      Hi. It will be included on your DE course ? or it will be a new one?

    • @TomKanay
      @TomKanay Год назад

      Appreciate your good work. Keep doing. Can you please share more details about your editing software. Which software you are using for video editing?

    • @My2Cents_
      @My2Cents_ Год назад

      9 Min of Super packed and incredible Video. Thank you so much for sharing the Knowledge.

    • @markslima1557
      @markslima1557 Год назад +1

      Lots of great information here - however sometimes you put up these slides and graphics with good information, but you pull away from them really quickly, I have to pause video to ingest all the information I'm seeing, perhaps be mindful not to cut away too fast. This is not a Michael Bay movie! Otherwise excellent video!

    • @DarshilParmar
      @DarshilParmar  Год назад +3

      @@markslima1557 This is just an overview video, I have indepth video on each topics
      Search
      1. Twitter Data Pipeline Darshil
      2. RUclips data analytics
      3. Uber Data Analytics
      You will learn everything in depth

  • @mohitbhatia140
    @mohitbhatia140 Год назад +1

    I haven’t added any comment on any video on youtube till now, I’m following you and your videos since more than a year, your content for Data Engineering is tooo amazing among all the other data engineers channels.
    Keep up the good work buddy!

  • @leogodofnone2706
    @leogodofnone2706 Год назад +2

    Exactly what was looking for 👍🏻

  • @samiiiiii2413
    @samiiiiii2413 Год назад +1

    This was really great short and completely on point. Thank you.

  • @karangupta_DE
    @karangupta_DE Год назад

    Great video. Recently I have seen a lot of companies encouraging graphql to query their API.

  • @craftymehreen1847
    @craftymehreen1847 Год назад

    Brother ... learning a lot from you .. Dedication determination and focus ...Thank you so much :)

  • @livetoday5849
    @livetoday5849 9 месяцев назад

    Thank you for good explaination!

  • @technicalsuranii
    @technicalsuranii Год назад

    Thank you Darshil🎉

  • @rajulsahu9218
    @rajulsahu9218 7 месяцев назад

    Very informative video.
    Lots of information covered in simple terms.

  • @viral.jhgggg669
    @viral.jhgggg669 Год назад +1

    I am learning AWS Refshift cluster from pluralsight but I don't understand anything. I need to learn redshift clusters in depth for a data engineering job. so please give me some solution.and please reply me 🙏

  • @BillusTinnus
    @BillusTinnus Год назад

    Great video!

  • @prasadbbd3525
    @prasadbbd3525 5 месяцев назад

    Good one, covering the overview of DE

  • @FacebookInc.
    @FacebookInc. Год назад +2

    bhaiya mujhe data science seekhna hai , lekin usse pahle mujhe basic se python advance tak seekhni hai toh kya agar mein aapkaa course purchase karun toh kam se kam beginner to intermediate tak toh pahuch hee jaunga naa🤔

  • @kammaridurgacharan431
    @kammaridurgacharan431 Год назад

    Crisp and clear ❤

  • @Ravi_Teja_Padala_tAlKs
    @Ravi_Teja_Padala_tAlKs Год назад +1

    I enjoy each and every video, learnt something new from you and keep going on your efforts @darshil and Thanks

  • @moeen007
    @moeen007 Год назад

    Thank you for the clear and crisp summary.

  • @ranjansrivastava9256
    @ranjansrivastava9256 Год назад

    Please share your Python training video for Spark.

  • @nanayaw7159
    @nanayaw7159 Год назад

    You are a genius...

  • @krish0804
    @krish0804 Год назад

    Very valuable information

  • @devrohan9679
    @devrohan9679 Год назад

    where else you can find all of this!Its all here

  • @playwithvihaan7601
    @playwithvihaan7601 Год назад

    Amazing video.May I know which editing software are you using?

  • @looklook6075
    @looklook6075 11 месяцев назад

    I’m interested in signing up your data engineering class. Will pyspark and airflow be learned in the course? Will the projects involve pyspark or airflow?

  • @nagulmeerashaik5336
    @nagulmeerashaik5336 Год назад +1

    Hiii.. Can you do the azure data engineering projects end to end for one plssss

  • @Sharmasurajlive
    @Sharmasurajlive Год назад

    Mast content hai re Bhai 👍🏻

  • @shashankemani1609
    @shashankemani1609 Год назад +1

    Please make a data engineering project on Rust using polars library.

    • @Chennaiahch63
      @Chennaiahch63 Год назад

      ruclips.net/p/PLTEjme3I6BCgOc6mmIozEA6jWtLqSGCPg

  • @VarshaSorout-vj9is
    @VarshaSorout-vj9is Месяц назад

    pleseeee now i complte python sql no sql db nd pandas basicllay now i want to explore more things in real tech scenrios! thtswhyy i want to buy that course

  • @jeffrey6124
    @jeffrey6124 3 месяца назад

    Great detailed intro ... Do you have a detailed video of the things that were mentioned here? That would really be a great follow up 🤓 Thank you!

    • @DarshilParmar
      @DarshilParmar  3 месяца назад

      I have a course, please check - datavidhya.com/combo-course-info

  • @praveenbhandari2516
    @praveenbhandari2516 Год назад

    What is the best way to make a logic building in python tell me some steps

  • @Moiz_tennis
    @Moiz_tennis Год назад

    Your best video!

  • @ajayram7973
    @ajayram7973 Год назад

    Sir you really are my mentor, I followed all you instructions as a Data Engineer intern.
    I saw all you Content.
    I just want to know, how one can do freelance as a Data Engineer. Are we allow to build ETL tools or the system (ETL+Database design+ APIs) and sell ???? Please make a video this 🙏

    • @Chennaiahch63
      @Chennaiahch63 Год назад

      ruclips.net/p/PLTEjme3I6BCgOc6mmIozEA6jWtLqSGCPg

  • @zeeshanu6
    @zeeshanu6 10 месяцев назад

    Why you have not discussed about dealing with databases in your course: Python for Data Engineering?

    • @DarshilParmar
      @DarshilParmar  10 месяцев назад

      It's a part of SQL DE, in order to deal with database you need basic SQL understanding

  • @jerbear97
    @jerbear97 Год назад

    hey darshil, how does python (as you described your process in the video) fit in a cloud platform, such as aws/gcp/azure

  • @kiransalagala6249
    @kiransalagala6249 Год назад

    bro, I want to learn about data engineering for Redshift. But I see that you have course available for snowflake. My work belongs to manage redshift as of now. What should I do? Please help me.

  • @aniketbhalla1521
    @aniketbhalla1521 4 месяца назад

    Wow!!

  • @ghostareagaming6895
    @ghostareagaming6895 Год назад

    Bhaiya kya aap bata sakte ho ki data engeneer k liye konsi stream leni sahi hogi aur konsi bachelor's degree leni sahi rahegi ?? Please reply

  • @payalbhatia5244
    @payalbhatia5244 Год назад

    This is great , Darshil. This video gives some really wise nugget of knowledge , which is at times hard to get at workplace even and also in any other courses. You have explained it so simply. I am quite experienced but took a long route to understand. You are doing it for free,. Great Job

  • @ashishchauhan8328
    @ashishchauhan8328 Год назад

    @darshil parmar Azure users do this python course
    And how much use poration of this course

  • @MDMUSHTAQALI-m1j
    @MDMUSHTAQALI-m1j Год назад +1

    Make Series on Snowflake with Matillon ETL

  • @VarshaSorout-vj9is
    @VarshaSorout-vj9is Месяц назад

    that combo pack is job ready excepet aws? plese replyy !

    • @DarshilParmar
      @DarshilParmar  Месяц назад

      You will learn AWS, Azure and GCP in the course only - dadatavidhya.com/combo-pack

  • @innovativewaves1847
    @innovativewaves1847 Год назад

    can you please suggest some budget laptops for student studding data engineering.

  • @syedhashir5014
    @syedhashir5014 Год назад

    make video on docker in mac

  • @AmarNath-zh8cv
    @AmarNath-zh8cv Год назад

    Tnq sir

  • @rayyanabdulwajid7681
    @rayyanabdulwajid7681 Год назад

    Hi Darshil. Is Pandas syntax necessary to remember for interviews? I'm asking because pandas also supports SQL syntax.

    • @markslima1557
      @markslima1557 Год назад

      Pandas is such a useful and perfect library for working with dataframes in Python, I would definitely make it a priority to have at least the basics down. It isn't difficult, and I think rather fun.

  • @HeshamNasser0
    @HeshamNasser0 Год назад

    Genius

  • @RaNd0MiZeD
    @RaNd0MiZeD Год назад

    Thanks

  • @VarshaSorout-vj9is
    @VarshaSorout-vj9is Месяц назад

    bhiya ye data with darshil apka hi course hai ?

  • @dcc-c6c
    @dcc-c6c Год назад

    Hi Darshil, your python course got English subtitles? cheers

  • @syedansar4681
    @syedansar4681 Год назад

    Hello bro...Iam having 8+ yrs experience in Sap basis administrator.. Willing to move to Data science will that be good choice? If yes what is best institute you suggest me to train.

  • @govardhan9418
    @govardhan9418 Год назад +1

    I have 2+ years into the DBA, am I eligible to land to Data engineer????

    • @Chennaiahch63
      @Chennaiahch63 Год назад

      ruclips.net/p/PLTEjme3I6BCgOc6mmIozEA6jWtLqSGCPg

  • @sravankumar1767
    @sravankumar1767 Год назад

    Nice explanation bro can you please tell me how to extract data from Api using python code . Can you please send me. In our project we have to write this code in function apps. Please share

    • @DarshilParmar
      @DarshilParmar  Год назад +1

      Check out my video Twitter Data Pipeline with Airflow

  • @sachinnambiar
    @sachinnambiar Год назад

    Please make a course of sql for data engineering as well

  • @VarshaSorout-vj9is
    @VarshaSorout-vj9is Месяц назад

    vo course buy krlu ky

  • @FacebookInc.
    @FacebookInc. Год назад

    Bhaiya aap hamesha English hee bolte ho kyaa aap thoda saa simple Hindi mein sikhaa dijiye toh jyada better rahega aapka content accha hai lekin aap Hindi bhi bola kijiye sikhate time ya fir Hindi mein ek course launch kar dijiye

  • @SlicerJi
    @SlicerJi Год назад

    Can i do it with PYspark

  • @diwakarnrp2092
    @diwakarnrp2092 Год назад

    Hii darshil pls add the some projects in azure

  • @bamidelak
    @bamidelak Год назад

    I think Im loving the way you lecture. Just followed you on twitter and have subscribed to your channel. I want to verge on Data engineer path. Python doesn't stick to my brain or let me say I am being impatient. Any link to learn python fast and understand better? Atlas I can be doing some data ingestion, Minning and visualisation like you

  • @mohammadmauwaz984
    @mohammadmauwaz984 Год назад

    Why not azure 🥺

    • @DarshilParmar
      @DarshilParmar  Год назад

      It will come in future

    • @mohammadmauwaz984
      @mohammadmauwaz984 Год назад

      @@DarshilParmar Can you provide a good source to go through for Azure Data Factory not like Udemy.

    • @Moiz_tennis
      @Moiz_tennis Год назад

      @@mohammadmauwaz984 www.youtube.com/@WafaStudies

  • @ntuthukophlybeatzmakhathin898
    @ntuthukophlybeatzmakhathin898 Год назад

    As a beginner, just couldn't follow, too fast

    • @DarshilParmar
      @DarshilParmar  Год назад

      There are end-to-end projects that go in-depth
      Just search "Darshil Parmar Projects" you'll get hour-long tutorial

  • @Funnyanimalstalkk
    @Funnyanimalstalkk Год назад

    brother make it free please people will give you more links and subscribers maybe some people can't afford like me

  • @sumitrawat0001
    @sumitrawat0001 Год назад

    Bhai thodhi Hindi bolo lo yaar

  • @shantanutripathi
    @shantanutripathi Год назад

    As a viewer, I've to ask, is that thumbnail makes your content more engaging? I don't understand. For me, it's kind of irritating as everyone opens their mouth...or puts hand on face or smthng

    • @DarshilParmar
      @DarshilParmar  Год назад +2

      I understand even I don’t like it but when new viewers gets recommended this video reactions make it more clickable, the way RUclips algo works and I have to do this way

    • @shantanutripathi
      @shantanutripathi Год назад

      @@DarshilParmar It's okay because your content is good. That's why I see you daily in my feed. No offence on the your thumbnail but I personally think that an standard way of thumbnail (ex. bytebytego, ibm, Hussain Nasser) would work much better in long run and create more value to viewers

    • @DarshilParmar
      @DarshilParmar  Год назад

      Definitely, I’ll look into this

  • @sarahkhan-hg9fo
    @sarahkhan-hg9fo Год назад

    I think you have lost creativity . This Twitter api is just a repetition of one of your earlier video. Put some effort while making content or u can take a break as well to get back the creativity

    • @DarshilParmar
      @DarshilParmar  Год назад +2

      I knew this might come but think about this there are many people who never watched my content and this introduces them to my channel, not everyone can watch 1 hr long video but this summary can give me path to watch entire video

    • @deelovely7565
      @deelovely7565 Год назад

      Right Darshil. This is really helpful for me who has been looking for a video to learn about extracting data using APIs. Thank you.

    • @ajayram7973
      @ajayram7973 Год назад

      ​@@deelovely7565 Do you need Data Engineer+ developer?

    • @deelovely7565
      @deelovely7565 Год назад

      @@ajayram7973 I am learning data engineering

    • @ajayram7973
      @ajayram7973 Год назад

      @@deelovely7565 All the best 👍

  • @johannest.mensah6516
    @johannest.mensah6516 Год назад

    Hi @DarshilParmar I bought the course linked in this video but I’m unable to interact with any videos. Can’t pause, skip, etc.
    I have emailed you since then but no response yet. Kindly respond to my email or issue a refund. Thank you

    • @DarshilParmar
      @DarshilParmar  Год назад +1

      Hey,
      Let me check and will get back to you

    • @johannest.mensah6516
      @johannest.mensah6516 Год назад

      Thanks so much for the quick resolution! All good now

    • @mandarjadhav3405
      @mandarjadhav3405 Год назад

      Hey Johannes....I would like to know your review about this course, before I purchase it. Thanks you.

  • @HameedMA-v9u
    @HameedMA-v9u 9 месяцев назад

    excellent demo Darshil , Please share your contact number - i would like to get a course from you in Data Engineering