You're the man Zach, I'm a beginner (even though I'm old and just pivoting into the data space now) but your insights have been really helpful so far and your personality is really relatable to me compared to most other folks I see talking about the space. Really appreciate what you're doing, keep going!
Hi Zach! I really do like your video bits with inspiring rrhythm. I just wonder I don't see you mention about the cloud platforms of AWS, Azure and the likes?
Zach, what about Dask in DE projects? I'm using this framework now to build up a BigQuery data warehouse instead PySpark, would you post your thoughts on this one day? Appreciate all your work and contribution anyway.
Is it bad to stay a Senior backend or data engineer? I just wanna be the technical problem solving person for the rest of my life. I don’t mind teaching and mentoring but I don’t wanna go into management but I also don’t wanna become a lead because they just stay in meetings and delegate stuff all day. Basically I don’t wanna move away from getting to program a lot.
I am in a similar situation. I have five years of data engineering experience. So I consider to switch to backend role with similar reasons you mentioned . One question: is it not recommend if I switch early before reaching to a senior level? IMO, I rather want to switch early before specializing too much. I will appreciate your opinion. thanks.
Hi Zach, I am a software engineer and mostly have worked on Java as programming language. Is it mandatory to learn python to crack data engineering interviews?
I am learning scala for my first job as well. Its fun cause learning functional programming is like re learning programming. I want to get really deep into scala but not sure it is a good idea for the future. Zach what do you think about getting really proficient at scala?
I'm curious if SQL is so prevalent in data engineering. I'm on my 3rd data engineering job and I've yet to use SQL. It's always Python/bash/yaml pipelines. But i live in Denmark tho
I guess it depends on what data engineering flavour you're in. On the BI side, SSIS is still the most popular ETL tool in Denmark - you'll find a lot of jobs within the Backend BI Developer/ Data Engineer space which rely on a combination of SSIS tasks with SQL snippets and Stored Procedures. For newer companies you can increasingly find some cloud dw (Snowflake/Bigquery) with dbt being used. I don't have a sense of how widespread SQL is vs. Python/Java/Scala in the non Data Warehouse flavours of Data Engineering
I've been in the data world for about 25 years. Started out with SQL Server 7 and Oracle 8i. I've been a DBA, SQL developer, BI developer and found myself in a data engineering roles in the last few years. SQL doesn't appear to be a major factor any longer, as python, scala, pyspark, databricks, whateverthenewtoolistoday has taken over. Just my opinion, but I agree with the original post.
Did you manage to retain your senior-level salary when you transitioned to backend development, despite not having senior-level expertise in that area?
Good for you ! I assume you negotiated a transition within the same company. Though most people won’t change track easily as it might require accepting a lower salary
This was an eye opener. I feel like hitting a plateau and want to learn something new so bad.
Great insights Zach . Appreciate you 👍🏻
This channel deserves to blow. Such quality content.
G8 advice Zach!!!
Great advice for keep growing, whether add additional skill set or broaden management knowledge. Or even both of them.
Zach your carrer track record is inspirational. I love tech and leading people, hopefully I can be a CTO some day.
You're the man Zach, I'm a beginner (even though I'm old and just pivoting into the data space now) but your insights have been really helpful so far and your personality is really relatable to me compared to most other folks I see talking about the space. Really appreciate what you're doing, keep going!
Thanks for the kind words!
Hi Zach, can you do a comparison video between software engineering and data engineering and your experience in both?
Hi Zach! I really do like your video bits with inspiring rrhythm. I just wonder I don't see you mention about the cloud platforms of AWS, Azure and the likes?
I am now getting deeper into software engineering while working as a data engineer 😁
Zach, what about Dask in DE projects? I'm using this framework now to build up a BigQuery data warehouse instead PySpark, would you post your thoughts on this one day? Appreciate all your work and contribution anyway.
Hey Zach, can you recommend resources to learn data modeling?
That’s what I am doing now
Is it bad to stay a Senior backend or data engineer?
I just wanna be the technical problem solving person for the rest of my life.
I don’t mind teaching and mentoring but I don’t wanna go into management but I also don’t wanna become a lead because they just stay in meetings and delegate stuff all day.
Basically I don’t wanna move away from getting to program a lot.
I have a question Zach
When you say full-stack data engineer, which tool or skill set is required to become a data engineer?
Waiting for next bootcamp date 😊
I am in a similar situation. I have five years of data engineering experience. So I consider to switch to backend role with similar reasons you mentioned . One question: is it not recommend if I switch early before reaching to a senior level? IMO, I rather want to switch early before specializing too much. I will appreciate your opinion. thanks.
Hi Zach, I am a software engineer and mostly have worked on Java as programming language. Is it mandatory to learn python to crack data engineering interviews?
Can i become a data engineer as a fresher and can land a job
I already hit a wall when I got to know that I had to work with scala spark for my current project also my first project of the internship 😩
You got this!
I am learning scala for my first job as well. Its fun cause learning functional programming is like re learning programming. I want to get really deep into scala but not sure it is a good idea for the future. Zach what do you think about getting really proficient at scala?
Do you think this also applies to Data Analysts? Or what would be the best options there to keep learning? I can definitely relate :)
Definitely! Probably applies to DA even more actually!
Grow into ML, DS or DE is a pretty great option for DA
I'm curious if SQL is so prevalent in data engineering. I'm on my 3rd data engineering job and I've yet to use SQL. It's always Python/bash/yaml pipelines. But i live in Denmark tho
I guess it depends on what data engineering flavour you're in. On the BI side, SSIS is still the most popular ETL tool in Denmark - you'll find a lot of jobs within the Backend BI Developer/ Data Engineer space which rely on a combination of SSIS tasks with SQL snippets and Stored Procedures. For newer companies you can increasingly find some cloud dw (Snowflake/Bigquery) with dbt being used. I don't have a sense of how widespread SQL is vs. Python/Java/Scala in the non Data Warehouse flavours of Data Engineering
@@rachidt2764 in my company we use databricks
I've been in the data world for about 25 years. Started out with SQL Server 7 and Oracle 8i. I've been a DBA, SQL developer, BI developer and found myself in a data engineering roles in the last few years. SQL doesn't appear to be a major factor any longer, as python, scala, pyspark, databricks, whateverthenewtoolistoday has taken over. Just my opinion, but I agree with the original post.
What js full stack engineering
Did you manage to retain your senior-level salary when you transitioned to backend development, despite not having senior-level expertise in that area?
Yep!
Good for you ! I assume you negotiated a transition within the same company. Though most people won’t change track easily as it might require accepting a lower salary
was it even valuable? how out of touch...