The EXACT Path to a Career in Data Engineering

Поделиться
HTML-код
  • Опубликовано: 14 окт 2024

Комментарии • 52

  • @youngkim8493
    @youngkim8493 4 месяца назад +5

    your no nonsense videos about these data roles are so good

  • @chessopenings
    @chessopenings 2 года назад +29

    I couldn't agree more with this video man I'm both certified in DP-203 and Snowpro Core and got 1 year exp as a DE
    it makes a huge difference, cheers

  • @Getatitboy
    @Getatitboy 2 года назад +12

    Nice video! I have worked as a junior data analyst for just under 1 year and I am currently in the recruitment process for a role as a junior data engineer. It seems like a very interesting job so I sure hope that when they call back they'll come with an offer since I want to dig deeper and further my knowledge in the field of data. The company that I've interviewed at uses the AWS stack and I thought about getting a certification as a "AWS Certified Cloud Practitioner" but they recommend that you have "Six months of exposure to the AWS Cloud" which I don't have, so I'll probably hold off on getting that for the time being.
    I don't really know how for sure how it works in the US but here in Sweden it seems more common with junior positions within data engineering that requires less experince than companies in USA. For example, the job process I'm in right now said they will be hiring 3 people. 2 of these will be straight of school and 1 (hopefully me) will be someone with a bit of worklife experience.
    Regarind "The Big 3" in the cloud computing platform (Azure, GCP and AWS), some googling have led me to believe that certifications for Azure are the most beginner friendly in terms of prior experience before starting. Microsoft seems to offer 3 courses: Fundamental, Associate and Expert. Do you think it's a good idea to maybe aim for the Azure Fundamental course and progress from there?

    • @thedatajanitor9537
      @thedatajanitor9537  2 года назад +10

      Yep. Any cloud cert on your cv is going to look good. I think the Azure path is a great idea.

    • @Getatitboy
      @Getatitboy 2 года назад +4

      @@thedatajanitor9537 Awesome, thank you!

    • @Getatitboy
      @Getatitboy 2 года назад +16

      Update: the recruiter called today and offered me the job, woop woop! Also I've started the Azure Fundamentals course on Microsoft's website and it's very interesting.

    • @thedatajanitor9537
      @thedatajanitor9537  2 года назад +7

      @@Getatitboy Congrats!!

    • @Getatitboy
      @Getatitboy 2 года назад +6

      @@thedatajanitor9537 Thank you :D Super excited for this new job. I feel like this new job definitely has better opportunities to develope my skills, also it was +11% in salary with a promise of +16% when/if I get permantently hired.
      Gonna keep up with your videos to get more insight into the practical aspects of the fields.
      Keep going!

  • @poptimistic100
    @poptimistic100 2 года назад +6

    Thank you for your videos. I got an intership this summer for a DE role and I found them very helpful.

    • @thedatajanitor9537
      @thedatajanitor9537  2 года назад +2

      Sure. Thanks for watching and welcome.

    • @houstonvanhoy7767
      @houstonvanhoy7767 Год назад

      Summer internship for a DE role? How did that work out, @Ioan Simion?

    • @poptimistic100
      @poptimistic100 Год назад +2

      @@houstonvanhoy7767 no returning offer, but good experience

  • @furqanhussain2625
    @furqanhussain2625 2 года назад +3

    thanks for your knowledge, it means a lot to us.

  • @ZeryusXD
    @ZeryusXD 2 года назад +4

    Great advice!

  • @ollicron7397
    @ollicron7397 Год назад +3

    I'm in the IT space and I'm totally confused on what I should learn. I'm already a hardcore programmer too, but everyone is saying to learn a bunch of different things.

    • @thedatajanitor9537
      @thedatajanitor9537  Год назад +8

      You're a hardcore programer and don't know what to learn? Hmmm.

    • @ollicron7397
      @ollicron7397 Год назад +1

      @@thedatajanitor9537 Yeah the pipeline isn't exactly intuitive there's so many things in data engineering.

    • @thedatajanitor9537
      @thedatajanitor9537  Год назад +4

      @@ollicron7397 Yes. It's a really broad space and the tools are different between companies. You'll need to specialize. For example, a SnowFlake Data Eng or Azure Data Eng.

  • @yassersaid3700
    @yassersaid3700 Месяц назад +1

    So for entry level for those who want to change career what do you recommend? Software engineer?

  • @EzraSchroeder
    @EzraSchroeder 2 года назад +2

    I need that first i.t. role, badly. I love writing code. Data engineer sounds good to me, but like you said, there are no entry level roles. Should I shoot for entry level data analyst, SQL developer, or DBA? Thank you!!!

    • @thedatajanitor9537
      @thedatajanitor9537  2 года назад +5

      If you think you can get one then yes. The data analyst path is the only entry level one I know of.

    • @prof.mangabhai
      @prof.mangabhai Год назад +1

      @@thedatajanitor9537 can you explain how people move into data engineer role if there's similar entry level role ? Do software engineers/backend developers later become DEs or please share what was the background of your peers who are DEs now

    • @thedatajanitor9537
      @thedatajanitor9537  Год назад +2

      @@prof.mangabhai No. I've never seen a software engineer become a data engineer. SQL is the top data skill for every role and most devs don't make it past the SQL phone screen. Every DE I met came from a DBA role. Every singe one.

  • @Nahidwin-v9g
    @Nahidwin-v9g Год назад

    interesting ,love your vids in your own knowledge whats the difference between data engineer and a cloud engineer

    • @thedatajanitor9537
      @thedatajanitor9537  Год назад

      Completely different jobs. A cloud engineer is often associated with a network engineer or windows or linux engineers. There are a ton of cloud data roles but you would never use the term cloud engineer for them. They would be data engineers who specialize in working with cloud data tools like Azure Data Factory.

  • @gabomandam7654
    @gabomandam7654 Год назад +1

    How will the development of AI affect data analytics/data sciences roles? Will it be mutualistic or will the job opportunities decline?

    • @thedatajanitor9537
      @thedatajanitor9537  Год назад +1

      Data science has already been democratized.
      ruclips.net/video/8_vIWWO-11k/видео.html
      AI will have little impact on the other data roles.

    • @gabrieldanomandam2728
      @gabrieldanomandam2728 Год назад +1

      @@thedatajanitor9537 Thank you so much for your response. Your insights truly are remarkable.

  • @giorgididebulidze8394
    @giorgididebulidze8394 2 года назад +2

    is it the worst idea, to start as a DevOps engineer for experience, if my end goal is an ML engineering career? btw nice video

    • @jamirajamira7303
      @jamirajamira7303 2 года назад +1

      CI/CD is a big part of software engineering now including data engineering or ML engineering. Without the infra knowledge, depending on company, you can still get by but it's a very valuable to skillset to know. If your company don't currently employ CICD now, they will sooner or later.

    • @thedatajanitor9537
      @thedatajanitor9537  2 года назад +5

      Take whatever role in IT you can get. Any role programming, working with data and SQL is a step in the direction to a job in machine learning.

  • @improvementology4011
    @improvementology4011 Год назад +1

    Can people who are currently working as back end engineers and have experience in that transition to Data Engineering roles??

    • @thedatajanitor9537
      @thedatajanitor9537  Год назад

      Nope. Not without heavy, Heavy SQL. A data engineer is nothing more than a DBA with programming and pipelining skills.

  • @princerockstar4609
    @princerockstar4609 Год назад +1

    Hey Mike , my company is trying to decide between Airflow and other open source tools like mage . We work on dbt for transformations. What do u suggest for the EL process ?

    • @thedatajanitor9537
      @thedatajanitor9537  Год назад +3

      I'm not that deep in the weeds. You probably no more about if you've done some research than I do. My only advice is to stay away from AWS data services. They suck.

    • @princerockstar4609
      @princerockstar4609 Год назад

      @@thedatajanitor9537 Couldn't agree more on the AWS thing

  • @mrchatterjee_
    @mrchatterjee_ 2 года назад +1

    Any advice on learning any prog language such as Python?

    • @thedatajanitor9537
      @thedatajanitor9537  2 года назад

      For data engineering or machine learning?
      Here's one that's free and it's well received.
      ruclips.net/video/foAMYMhwbsA/видео.html

    • @mrchatterjee_
      @mrchatterjee_ 2 года назад

      @@thedatajanitor9537 data engineering, yes

  • @SIMONGREYMAN
    @SIMONGREYMAN Год назад

    I want to learn and be proficient in PostgreSQL flavour. Can you please suggest me any sql developer certification for the same which is industry recognized?

    • @thedatajanitor9537
      @thedatajanitor9537  Год назад +1

      Sorry. Don't work with the db and don't know much about it other than I'm glad I don't have to work with it.

  • @bhanuteja4066
    @bhanuteja4066 Год назад

    I just graduated out of college and working as AWS Data Engineer. I am AWS SAA and MLS certified. In my current job I just do some ops work(monitoring, debugging job failures). When will people usually get to do the dev work?

    • @thedatajanitor9537
      @thedatajanitor9537  Год назад +1

      No you aren't. Not at any serious company. No serious company is going to let a new grad have access to their data let alone their data in the cloud.

    • @fawad_khan
      @fawad_khan 3 месяца назад

      ​@@thedatajanitor9537😅😅😅😅