Been following your content for over 3 years now... I'm glad I decided to go for the DE path after being DA for 3 years (plus 2 years of master's). While all my master's colleagues are still looking for DS positions, it was really easy for me to land a well-paid DE position. Thanks Mike.
They are all SQL devs. You can write heavy SQL or you won't be working in any of these roles. Machine learning has almost completely replaced traditional BI roles.
Current DE with 2.5 YOE working mostly python/SQL pipelines. Thinking about working on a switch to MLE but there are far more job postings for DE than MLE currently. Any thoughts on if it is worth the switch and further specialization?
Yeah. The DE role is the top role on earth and that's not going away. That's not me, that's actually a Google stat. If I were going to go a direction right now, I'd be a SnowFlake admin/dev. Tons of jobs. Lots of coin. Not much experience needed. Everyone is fascinated with the MLE role and faker science role while the DE continues to grow.
@@thedatajanitor9537 Thanks so much for your content. When you say Snowflake Admin/Dev, what do these guys/gals do on a daily basis? Thanks in advance.
Thank you for the light you share, I was hoping to see Database Designer and it roles among the categories. Since it’s not among, so I will ask: Are Database Designer also DBAs or it’s a total different role?
If a new grad has some research papers in Robotics and AI to their name and is also a Microsoft certified data scientist associate. Do they have a shot at a junior data scientist role?
Is it possible to move to a data engineer or machine learning engineer position if you come from a software engineering position, or do you have to be a data analyst? Would a software engineer with the GCP data engineer or GCP mle certification be a good profile? Also, is the SQL developer or DBA and entry level job, or only the Data Analyst?
Mike do you think that all the myths around ML (math myth, modeling myth) are going to disappear in the future or do you think that people are going to still think that ML is about math and modeling?
I don't get it, data scientists I've come across are just using the best known models to use for the job at hand, more senior experienced ones are usually in the productioninsing so becoming a MLE or BA route with ds. They're not building models from scratch, usually just use best libraries and methods to solve the problem. Maybe it's different in my country
I don't think you've read my message the data science guys are not building any models from scratch,they're using the best models and methods then work with MLE guys to productionise, they usually end up being MLE guys as they progress in careers or BA with ds background to implement ml models for whatever stakeholder problem there is . I think you're confusing research ds roles with commercial ones. I'm not referring to research theoretical ds roles who are trying to build new models from scratch.
I'm not confusing anything man. I've worked at several top tech companies and I know exactly what the roles are and who is doing the real-world work and who isn't. A DS is nothing more than a statistician. In the real-world, the people doing the work at Google and Microsoft are the machine learning engineers. The researchers aren't doing shit either. They are worthless.
@matt_milack US companies don't usually hire in Europe bc of very different time zones, to have meetings, etc. If they want cheap they go to Latam, which has roughly the same time zones. The only cases I've seen they go for other continents is for USD 1.50/hour in India.
@@thedatajanitor9537 How about relating the Cloud to your ideas ., Opinions and Experience/Expertise on Data - Yeah I know you did a Little of that here., but a More Incorporation on the idea of Cloud / cloud Engineering with your General idea on Data [for Enhanced Clarity] ., will be very Nice
Is dba still relevant? I think this job role is dying , please explain me .. currently i am junior dba working in fintech, and i am trying switch da/ds role .
Greetings Mr Data Janitor, I'd like to ask, how long should I work as a Data Analyst before making the switch. Also considering that DE is far more technical than DA, what can I do during my time as a DA to make the transition to DE as seemless as possible. I know it would be better to work as a DBA before, however it is really difficult to get any junior DBA roles in my country. For context, I'm still in college and I'm currently working on getting certifications in SQL, PowerBI (because it's open source) and Microsoft Data Analyst.
@@thedatajanitor9537 Understood. I just saw your most recent video and I think all my questions should be answered. Thank you for your assistance, those burning questions were starting to scare me (because I wasn't sure if that was something I could do).
Mike, just to be inspired, however silly, may I know if you have shared your current role, remuneration and stuff? I dont know. Would be interesting to know what you are doing.
Okey that's great, but i'm wondering now like what about deep learning and building AI models is this the same as MLE?, i started to study to be an AI Engineer and you sir just saying there is NO ai engineers so....
Machine learning engineers build deep learning models. A MLE might specialize in NLP or computer vision... but at the end of the day... they are developers or data professionals doing the work. Again, it's all data cleansing regardless of the data.
Going to apply for internship for data analytics Do you think I should also learn some web-scrapping so I can also analyze live data ? Also in one of the earlier comment you said onsite is better Do why do need to be onsite for analysis ?
In the US, there are no roles for entry level IT guys. Companies want you onsite until you learn the core job then you can work remotely. Nah, web scraping is heavy coding and it's done by the MLE or other programmers. Not a ton of fun. Most models in the real-world are sourced from relational databases.
Thanks for the video I have a quick question. I’m just starting out, and realistically speaking, how interchangeable are these roles? By that, I mean if I start as a DA, how difficult would it be to transition into something like a DE or MLE later on?
@@thedatajanitor9537 thanks for the answer Being at the start is quite daunting, but knowing it's achievable, even if it takes 3-5 years, is reassuring.
Hey Mike! I'm at my second year of uni (bachelor's in data science, I know, I chose it before I watched your videos) and just got hired for a MLE intern role. Just wanted to ask, could you give me any tips? I feel that thanks to your videos I have a good grasp on what each data role does, but just wanted to ask you for a bit of advice. Thank you!
What about high-level design? Is this done by the DBA, or is it the responsibility of a data architect? Also, can you recommend any books on database design or high-level data infrastructure design? I am currently reading Itzik's books and "Database Design for Mere Mortals" while working as a SQL Server developer who also does some JSON parsing.
Any database design SHOULD be done by the DBA. Unfortunately, at most companies, unqualified developers do it... and it's why most databases are shit shows.
Hello, I'm surprised you didn't mention the analytics engineer role. We have one in my company and I'm pretty sure the role exists, though it's pretty recent. Its a hybrid DA/DE role, with a lot of data modeling (mostly with dbt).
All I see here is "data scientist", JK but thank you for creating this! Maybe a hiring manager or leadership will come across this and not just hire for data scientist because that's the most elite of all data practitioners.
It's not the most elite. In IT, they are the least elite. They have no technical skill and the technical people place no value on them. They are only valued outside of the real-world because most people are clueless.
Hi sir I'm Yoosuf from Sri Lanka Currently I'm learning machine learning as a fresher Is it good or learn data analyst Can I get a idea from you sir Thank you
Hi sir I'm Yoosuf Ahamed from Sri Lanka My dream is become a machine learning engineer and also I'm doing computer science degree Before learn machine learning will I learn Data analyst is it good? Can I get a good idea from you sir
Hi! I really like your videos and I have some questions only you can solve (the text will be a little long, I beg your patience). I'm a fullstack developer (web), I have a little of coding experience and know how to create websites. I also got some contact with SQL since being fullstack means I work with both frontend end and backend. I'm scrared the AI will replace me by the time I have more experience and all my efforts becomes a wast. I saw your videos and didn't knew about the existance of data engineering. I'm self taught, I don't have a degree. I'll enroll in a university, but it's not that great, my real experience came from being self taught, since I notice working is more important than just having a bachelor's degree these days... I'll go with software engineer. My questions for you are: 1) with my back-ground (no bachalors yet/selth taught/still didn't land my first job) can I, with deep understanding of SQL, mongoDB + tableau land my first job as a Data analyst? 2) If I get this entry-level-job, I keep studying, get my degree (the college is prett bad, I only want the degree certificate), what else would I need to study in order to upgrade to a Data engineer and how much time would it take? 3) Being a data enginer is actually a career that can give me financial and location freedom for years into the future if I stick to it and study a lot? Or will it also be replaced by ai? What are your prediction for future for this career? Please do not tell lies to me, I really appreciate your videos and your honest. Thankyou.
@@thedatajanitor9537 I am in one testing role, I do analyse insurance data every day accross multiple dbs, py scripts to compare dbs , would u consider it a entry level role to pursue the major roles.
Nope. All SQL development is done by SQL developers. Data engineers simply don't have that level of SQL knowledge. No, an ETL developer develops, a data engineer administrates. The only code I write when I'm doing DE work is for data movement.
Been following your content for over 3 years now... I'm glad I decided to go for the DE path after being DA for 3 years (plus 2 years of master's). While all my master's colleagues are still looking for DS positions, it was really easy for me to land a well-paid DE position. Thanks Mike.
Welcome aboard!
Thank you!
Sometimes you'll have to do all those roles by yourself
for the last time, here are the data roles
For the last time... this month... here they are again. :)
Hahahaha hahahaha hahahaha 😂
Mike is 💯 correct once again
What about BI Analyst or BI Developer?
They are all SQL devs. You can write heavy SQL or you won't be working in any of these roles. Machine learning has almost completely replaced traditional BI roles.
@@thedatajanitor9537 You have a Video on this very comment .. kindly share Link 🔗 asap Mike
Data scientist are a figment of the industry's imagination 😂
great video
Thanks!
Current DE with 2.5 YOE working mostly python/SQL pipelines. Thinking about working on a switch to MLE but there are far more job postings for DE than MLE currently. Any thoughts on if it is worth the switch and further specialization?
Yeah. The DE role is the top role on earth and that's not going away. That's not me, that's actually a Google stat. If I were going to go a direction right now, I'd be a SnowFlake admin/dev. Tons of jobs. Lots of coin. Not much experience needed. Everyone is fascinated with the MLE role and faker science role while the DE continues to grow.
@@thedatajanitor9537 Thanks so much for your content. When you say Snowflake Admin/Dev, what do these guys/gals do on a daily basis? Thanks in advance.
@@richarddownes7729 Administer the SF data warehouse and build data pipelines. Devs will write code for different front end tools.
Thank you for the light you share, I was hoping to see Database Designer and it roles among the categories. Since it’s not among, so I will ask: Are Database Designer also DBAs or it’s a total different role?
Same role. The DBA designs the database structures... or at least he/she should. Sometimes, ill-informed developers do it.
@@thedatajanitor9537 Thank you for this
Is there like a hierarchy of these roles?
Like BA < DA < SQL Dev < DBA < DE < MLE?
Sort of. The DA is the lower role. The DE, MLE, DBA and SQL Dev are top tier roles.
If a new grad has some research papers in Robotics and AI to their name and is also a Microsoft certified data scientist associate. Do they have a shot at a junior data scientist role?
Nah. You'll need a PhD for any research role.
Is it possible to move to a data engineer or machine learning engineer position if you come from a software engineering position, or do you have to be a data analyst? Would a software engineer with the GCP data engineer or GCP mle certification be a good profile?
Also, is the SQL developer or DBA and entry level job, or only the Data Analyst?
You can come from a programming role... but you must have SQL. You must have data skills. Without SQL on your resume, no one is going to look at you.
thanks mike!
Mike do you think that all the myths around ML (math myth, modeling myth) are going to disappear in the future or do you think that people are going to still think that ML is about math and modeling?
Too many people believe the advertising so it's not going away.
what myth exacly jorge?
I don't get it, data scientists I've come across are just using the best known models to use for the job at hand, more senior experienced ones are usually in the productioninsing so becoming a MLE or BA route with ds. They're not building models from scratch, usually just use best libraries and methods to solve the problem. Maybe it's different in my country
The *failure* rate for DS projects globally is around 95%. They aren't different in your country, they are failing at the same rate.
I don't think you've read my message the data science guys are not building any models from scratch,they're using the best models and methods then work with MLE guys to productionise, they usually end up being MLE guys as they progress in careers or BA with ds background to implement ml models for whatever stakeholder problem there is . I think you're confusing research ds roles with commercial ones. I'm not referring to research theoretical ds roles who are trying to build new models from scratch.
I'm not confusing anything man. I've worked at several top tech companies and I know exactly what the roles are and who is doing the real-world work and who isn't. A DS is nothing more than a statistician. In the real-world, the people doing the work at Google and Microsoft are the machine learning engineers. The researchers aren't doing shit either. They are worthless.
What about the effect of ai on data engineering field?? Would data engineer field dissappear after 10 or 20 years cause of Ai
Nothing. Noting in any data field is going to disappear because of AI. Not going to happen.
I didn't realize most of the machine learning role is data cleaning. I don't want that.
Thank you.
Nobody says this. The hype is wild.
Would you say that getting remote Data analyst position in US company being from Europe is realistic scenario?
Nah. Every company I know starts their junior roles onsite.
@@thedatajanitor9537 How about if I'm extremely happy to work for $10 per hour?
Then maybe.
@matt_milack US companies don't usually hire in Europe bc of very different time zones, to have meetings, etc. If they want cheap they go to Latam, which has roughly the same time zones. The only cases I've seen they go for other continents is for USD 1.50/hour in India.
I laugh when I see AI engineer at a jobpost😂
I always ask... what are you engineering? The top models already exist?
So Guys - where., and who., are the so called "Manufactured role" AI Engineers then
Kindly help Clarify chiefs
@@thedatajanitor9537
@@thedatajanitor9537hahahaha
No one. The role does NOT exist. The only people writing AI models are developers.
@@thedatajanitor9537 How about relating the Cloud to your ideas ., Opinions and Experience/Expertise on Data -
Yeah I know you did a Little of that here., but a More Incorporation on the idea of Cloud / cloud Engineering with your General idea on Data [for Enhanced Clarity] ., will be very Nice
What about analytics engineer? It’s DA + DE. Isn’t it on the rising?
No such role.
That is just data engineer
Is dba still relevant? I think this job role is dying , please explain me .. currently i am junior dba working in fintech, and i am trying switch da/ds role .
Dying? There are more relational databases than any other storage mechanism. No, not dying.
Greetings Mr Data Janitor,
I'd like to ask, how long should I work as a Data Analyst before making the switch. Also considering that DE is far more technical than DA, what can I do during my time as a DA to make the transition to DE as seemless as possible. I know it would be better to work as a DBA before, however it is really difficult to get any junior DBA roles in my country.
For context, I'm still in college and I'm currently working on getting certifications in SQL, PowerBI (because it's open source) and Microsoft Data Analyst.
You'll need 3 years of real-world experience on your resume before companies will start looking at you for a move up.
@@thedatajanitor9537 Understood. I just saw your most recent video and I think all my questions should be answered.
Thank you for your assistance, those burning questions were starting to scare me (because I wasn't sure if that was something I could do).
Mike, just to be inspired, however silly, may I know if you have shared your current role, remuneration and stuff? I dont know. Would be interesting to know what you are doing.
Okey that's great, but i'm wondering now like what about deep learning and building AI models is this the same as MLE?, i started to study to be an AI Engineer and you sir just saying there is NO ai engineers so....
Machine learning engineers build deep learning models. A MLE might specialize in NLP or computer vision... but at the end of the day... they are developers or data professionals doing the work. Again, it's all data cleansing regardless of the data.
@@thedatajanitor9537 Thanks sir 🙏🏻
Going to apply for internship for data analytics
Do you think I should also learn some web-scrapping so I can also analyze live data ?
Also in one of the earlier comment you said onsite is better
Do why do need to be onsite for analysis ?
In the US, there are no roles for entry level IT guys. Companies want you onsite until you learn the core job then you can work remotely. Nah, web scraping is heavy coding and it's done by the MLE or other programmers. Not a ton of fun. Most models in the real-world are sourced from relational databases.
Thanks for the video
I have a quick question. I’m just starting out, and realistically speaking, how interchangeable are these roles? By that, I mean if I start as a DA, how difficult would it be to transition into something like a DE or MLE later on?
Doable but not easy. MLEs need to know a lot of shit from a lot of different categories.
@@thedatajanitor9537 thanks for the answer
Being at the start is quite daunting, but knowing it's achievable, even if it takes 3-5 years, is reassuring.
Mike do you think that a backend dev is like 50% a data role and the other 50% just traditional software engineering?
Depends on what they are doing. There are backend engineers that don't touch SQL. Not many though.
Hey Mike! I'm at my second year of uni (bachelor's in data science, I know, I chose it before I watched your videos) and just got hired for a MLE intern role. Just wanted to ask, could you give me any tips? I feel that thanks to your videos I have a good grasp on what each data role does, but just wanted to ask you for a bit of advice. Thank you!
Learn and make friends at the company that hired you. I you are lucky, they'll hire you after college.
@@thedatajanitor9537 Thank you!
What about high-level design? Is this done by the DBA, or is it the responsibility of a data architect?
Also, can you recommend any books on database design or high-level data infrastructure design? I am currently reading Itzik's books and "Database Design for Mere Mortals" while working as a SQL Server developer who also does some JSON parsing.
Any database design SHOULD be done by the DBA. Unfortunately, at most companies, unqualified developers do it... and it's why most databases are shit shows.
@@thedatajanitor9537 Does this include OLAP databases? i.e. should the DBA design a data warehouse? or only transactional databases?
Hello, I'm surprised you didn't mention the analytics engineer role. We have one in my company and I'm pretty sure the role exists, though it's pretty recent. Its a hybrid DA/DE role, with a lot of data modeling (mostly with dbt).
Nope. No such thing as an "analytics engineer" in the real-world. Something your company made up.
@@thedatajanitor9537 It's an actual role Mike. It's becoming even more popular now.
Nope.
All I see here is "data scientist", JK but thank you for creating this! Maybe a hiring manager or leadership will come across this and not just hire for data scientist because that's the most elite of all data practitioners.
It's not the most elite. In IT, they are the least elite. They have no technical skill and the technical people place no value on them. They are only valued outside of the real-world because most people are clueless.
Hi sir
I'm Yoosuf from Sri Lanka
Currently I'm learning machine learning as a fresher
Is it good or learn data analyst
Can I get a idea from you sir
Thank you
Hi sir
I'm Yoosuf Ahamed from Sri Lanka
My dream is become a machine learning engineer and also I'm doing computer science degree
Before learn machine learning will I learn Data analyst is it good?
Can I get a good idea from you sir
@@thedatajanitor9537 should have been more sarcastic. I just see everyone only hiring DS as a catch all for many of these roles.
@@bms4654 Yeah. Companies have mostly stupid people also. It's the Pareto Principle at work... everywhere you go.
Hi! I really like your videos and I have some questions only you can solve (the text will be a little long, I beg your patience). I'm a fullstack developer (web), I have a little of coding experience and know how to create websites. I also got some contact with SQL since being fullstack means I work with both frontend end and backend. I'm scrared the AI will replace me by the time I have more experience and all my efforts becomes a wast. I saw your videos and didn't knew about the existance of data engineering. I'm self taught, I don't have a degree. I'll enroll in a university, but it's not that great, my real experience came from being self taught, since I notice working is more important than just having a bachelor's degree these days... I'll go with software engineer. My questions for you are:
1) with my back-ground (no bachalors yet/selth taught/still didn't land my first job) can I, with deep understanding of SQL, mongoDB + tableau land my first job as a Data analyst?
2) If I get this entry-level-job, I keep studying, get my degree (the college is prett bad, I only want the degree certificate), what else would I need to study in order to upgrade to a Data engineer and how much time would it take?
3) Being a data enginer is actually a career that can give me financial and location freedom for years into the future if I stick to it and study a lot? Or will it also be replaced by ai? What are your prediction for future for this career? Please do not tell lies to me, I really appreciate your videos and your honest. Thankyou.
Big boring companies, with boring jobs doing boring data shovelling :(
You didnt even care to mention ETL/data testing roles😢😅
ETL is done by data engineers these days. Testing roles are not serious roles.
@@thedatajanitor9537 I am in one testing role, I do analyse insurance data every day accross multiple dbs, py scripts to compare dbs , would u consider it a entry level role to pursue the major roles.
Nah. If you aren't doing the work, it doesn't count. You need to move to a role where you are writing the code.
I thought most SQL Development is done by Backend Engineers?
Usually ETL Developer is Synonymous with Data Engineer.
Nope. All SQL development is done by SQL developers. Data engineers simply don't have that level of SQL knowledge. No, an ETL developer develops, a data engineer administrates. The only code I write when I'm doing DE work is for data movement.