Learning Data Engineering: 7 Hard Truths

Поделиться
HTML-код
  • Опубликовано: 26 окт 2024

Комментарии • 36

  • @JashRadia
    @JashRadia  День назад +1

    Uploading after a while! These are 7 hard truths you need to face if you're learning about data engineering. GFG Premium: gfgcdn.com/tu/T9z/
    Thank you for watching! Let's talk more about it here 😃

  • @majidmenouar2444
    @majidmenouar2444 6 часов назад +1

    People are asking now for uploading your videos playing Table hehe thanks for the valuable videos Jash! Always a pleasure to watch.

  • @kaizer-919
    @kaizer-919 День назад +3

    1:16 some random senior data engineers getting bored: let's make a new tool

  • @artofheart2891
    @artofheart2891 День назад +5

    Powerful message by this video.. "Doing is Learning." 😅😍👍🏻

  • @jaladhithakur7567
    @jaladhithakur7567 День назад +2

    Very informative! Loved the point where you were talking about revision and how setting realistic goals can help us 😊

  • @aishwaryaradia
    @aishwaryaradia День назад +2

    Great Video, Once Again ☑️👌🏻
    Packed with Knowledge 👏🏼

  • @aryamansingla4337
    @aryamansingla4337 День назад +2

    Hey,Jash This is Aryaman Singla I started following you recently and It is remarkable the way you are enlightening by sharing your knowledge and experiences ,
    I have just got an offer as Data engineer at an analytics company and just starting my career as fresher.
    What top 5 things I should remember to grow in my career?

    • @JashRadia
      @JashRadia  День назад +3

      Hey Aryaman, congrats on your offer 🎊 and thank you for watching my videos! I would recommend to
      1 stay curious and keep learning
      2 take feedback positively instead of being defensive
      3 work on high visibility stuff in front of leadership., overall that's best for career progression.
      All the best!

  • @Bobb414
    @Bobb414 День назад +1

    Is it possible to switch to data engineering role in service based company after 3 years of experience in Mainframe

  • @nadarajanrajan7120
    @nadarajanrajan7120 День назад +1

    Hey Jash, Thanks for a wonderful video as always😃!!
    Any quick tips/suggestions for myself who is going to attend a Google DE interview in 3 weeks. Would love to hear your advice/thoughts

    • @JashRadia
      @JashRadia  День назад +2

      Practice solving leetcode easy, medium problems and focus on HLD about data pipelines. Also non functional components like observability,etc. More importantly, be confident and communicate well in all round. Focus on data modeling, too.

  • @MahidharAtukuri
    @MahidharAtukuri 12 часов назад

    Hi Jash, I'm about to start my journey for Data Engineer. Thanks for organising my study plan i will try my best to stick to these 7 rules. Could you please suggest any best place where i can practise unlimited problems on python language please........

    • @JashRadia
      @JashRadia  7 часов назад

      Start with leetcode.com/studyplan/top-interview-150/
      You don't need to solve unlimited problems. Just focus on solving about 100. Patterns will start repeating then.

  • @maheshp5287
    @maheshp5287 День назад

    Hello Jash, Your content is really helpful.
    For someone who is starting as a fresher in DE,will it be difficult to stay in the job market after 5 or 10 yrs, due to automation with AI. Can you please suggest few skills that will help to stand out.

  • @maitrayobrahmachari6886
    @maitrayobrahmachari6886 День назад

    Hey Jash, considering where the whole industry is going towards, do you think learning AI tools would become a necessity for Data Engineers to learn and adapt? Great video as always!

    • @JashRadia
      @JashRadia  День назад +2

      Yes 100%. Learning prompt engineering well is now like learning SQL 10 years ago. Basics of gen AI is important. In fact, I am planning to make a video on this soon. Thank you!

  • @sudhakanthaiah2922
    @sudhakanthaiah2922 День назад

    Hey in the upcoming years will there be openings for data engineer role to freshers?? I have been said by many tht freshers aren't hired for data engineer roles but the same freshers can get hired as engineer in web development domain . So would u suggest me to build skills related to web development or data engineering

  • @nikhil316_pspk
    @nikhil316_pspk День назад +1

    what kind of projects to do for fresher trying to enter this field

    • @JashRadia
      @JashRadia  День назад +2

      Create a simple project that helps answer a business question from data. Build a pipeline. End result can be in the form of dashboard, or a chat bot byilt frok AI which uses the data you just processed. It's ont of the ideas.

    • @nikhil316_pspk
      @nikhil316_pspk День назад

      @@JashRadia thank you

  • @dineshmergu9314
    @dineshmergu9314 День назад

    Can you please create a video on Data Engineering related books

  • @santoshkumargouda6033
    @santoshkumargouda6033 День назад

    sir, please help on resources for system design for data engineering..

  • @uttarshah5106
    @uttarshah5106 День назад

    What will make more money, data science or data engineering, please mention books.

    • @JashRadia
      @JashRadia  День назад +1

      Why do people think it's the job profile. Many data engineers make more than data scientist and many data scientists make more than data engineers. It depends on the company and qualifications.

  • @aryamansingla4337
    @aryamansingla4337 День назад

    Is SDE Better than DE in terms of Salary Growth and Career Opportunities and Are there more job openings for SDEs as Compared to DEs? And can DE transition into SDE such as Backend or Cloud/Devops Profile later in career ? Also Can freelance Work Be done in Data field ? If Yes Please make a video about it.
    Thanks

    • @JashRadia
      @JashRadia  День назад +1

      Okay, just to clear out any doubts. SDE is the parent job profile. An SDE or SWE can be data engineer, full stack engineer, ai engineer, ml engineer etc.
      And yes DE can change to backend engineer and vice versa.

  • @tumusaikarthik6632
    @tumusaikarthik6632 День назад

    Hey jash, I'm working as a data engineer and want to learn AI please make a video on this

    • @JashRadia
      @JashRadia  День назад

      Sure, thanks for the suggestion

    • @mobinansarivlog9126
      @mobinansarivlog9126 7 часов назад

      Sir I want a job as a data engineer. Can u refer me or guide me. Help would be Highly appreciated

  • @ajg3951
    @ajg3951 День назад

    I believe data engineering can be largely automated with AI technology. In the long run, this could reduce the demand for traditional data engineering roles, while data science may see more AI-oriented tasks. For example, traditional pipelines could be shifted towards LLM-based models. This is my perspective; is it accurate?

    • @JashRadia
      @JashRadia  День назад

      Yes. Prompt engineering will be like SQL.. yes, AI will be in all aspect on DE and it will automated a lot of things we do today. What DE does will merge with AI a lot.
      It's just the evolution of tech. Things that were manual 50 years ago are automatic now but that doesn't mean there aren't new things to work on and innovate more on. Same will happen in future.

    • @ajay9413
      @ajay9413 4 часа назад

      Not possible in the next 20-30 years!!! May be ai can code it for you but it will not be able to maintain a system!!! Companies like Google or meta can afford that kind of infrastructure but not every company can afford the huge infra costs. So DE's will be required to process data with max accuracy and with less infra costs!! These are some aspects where ai won't be mature. So if ai will tell to process data using a spark cluster having 1000 of nodes for some minimal Computation then it would be blunder right?!!