Can you create a playlist for all these mentioned skills? I know you already have few complete tutorials such as your big data fundamentals etc but could you provide us a proper playlist with all these tech stacks!!
Hi Bro, have 2years experience with data (just executing minimal tech), now started learning for data engineering how can I search for a job (as fresher or experienced in DE) wat should i show case to them becoz I don't have data engineering experience before.
Hi I appreciate and thank you for the quality of the content you are sharing. Super Informative and to the point. Just want some advice I am working as big data-engineer with knowledge of spark & cloud. I want to upgrade my skills by doing master along with the job. Can you provide some good suggestions please?
why there is no job for freshers in data engineering 🙁 is it a good to 1st being a frontend dev then we can shift to data engineering after some experience of 2 3 yrs??
I am data analyt with 1 yoe, planninh switching to DE my query is does it day to day work if DE involes lot of coding? Also is it very tough job comoared to DA? Will my DA exp be consider while applying to DE roles
Hi. Thanks for sharing the information. It is really helpful. Inhave one question. Being a Cloud Software engineer having 6years if experience, if I want to get some opportunity in AI/ML then should I first move into Data Engineering field?
I think you are always stressing on Linux more than its required. Linux is mostly useful for people if you maintain your own spark or Hadoop or any other clusters. But today most of the work is done on cloud and there are only few people who does maintain clusters and gives you access etc. So, I think only creating files and navigating between them is mostly enough and then go to SQL and other stuff.
Straight away we all are not going to work in fully automated project its going to be POC's also. Linux is not just about cluster maintenance its more than that Even in cloud we need to use linux , yes most of them will not have access for cluster box but what about client node ( GCP client node) its still a linux Box Many of the banking LOB will not provide access to web clients End of Day we dont have or Use UI to run our jobs (mostly) , I will add few more justification 1. File Handline - ls , cp , mkdir , mv etc ( day to day activity ) 2. Imagine you are doing a history load or manual run for a POC - then we need process handling commands to see whats running in background 3. Imagine you need to find out the issue from the spark yarn logs of your job (many people doing this ) - You need search and pattern matching commands ( If you use airflow it can provide us a log but some times we face slowness or no full information ) 4. Scripting - Mentioned the video itself I am sure, that I haven't stressed it. this is basic , if I stress it it would have been even more 😜 " more than its required " - No , these comands are basics that all should definetly know Thanks for Bringing this , Happy learning :)
I have around 10 years of experience in sw engg and trying to transition to data engg. Do you think I would be able to get interview calls if I complete certifications?
![Blox Fruits Dragon Rework Update [Full Stream]](http://i.ytimg.com/vi/EqDAp8udhm0/mqdefault.jpg)
(THIS VIDEO IS FOR BEGINNERS AND NOT FOR EXPERIENCED, MENTIONED IN THE VIDEO ALREADY)
Can you create a playlist for all these mentioned skills?
I know you already have few complete tutorials such as your big data fundamentals etc but could you provide us a proper playlist with all these tech stacks!!
Thank you Anna for this brief but in-depth analysis.
Hi Bro, have 2years experience with data (just executing minimal tech), now started learning for data engineering how can I search for a job (as fresher or experienced in DE) wat should i show case to them becoz I don't have data engineering experience before.
Can you please tell if the future scope of data engineering, if it will still be a key skill or will automation take away all data engineering jobs
Hi I appreciate and thank you for the quality of the content you are sharing. Super Informative and to the point. Just want some advice I am working as big data-engineer with knowledge of spark & cloud. I want to upgrade my skills by doing master along with the job. Can you provide some good suggestions please?
why there is no job for freshers in data engineering 🙁
is it a good to 1st being a frontend dev then we can shift to data engineering after some experience of 2 3 yrs??
I'm currently working on GCP based data engineering for retail. Is it good to stay here or should I move to AWS internally?
I am looking for best data engineering institute to learn pyspark
I am data analyt with 1 yoe, planninh switching to DE my query is does it day to day work if DE involes lot of coding? Also is it very tough job comoared to DA? Will my DA exp be consider while applying to DE roles
Hi. Thanks for sharing the information. It is really helpful. Inhave one question. Being a Cloud Software engineer having 6years if experience, if I want to get some opportunity in AI/ML then should I first move into Data Engineering field?
what re challenges and not to go for this field isssues?
I think you are always stressing on Linux more than its required. Linux is mostly useful for people if you maintain your own spark or Hadoop or any other clusters. But today most of the work is done on cloud and there are only few people who does maintain clusters and gives you access etc. So, I think only creating files and navigating between them is mostly enough and then go to SQL and other stuff.
Straight away we all are not going to work in fully automated project its going to be POC's also.
Linux is not just about cluster maintenance its more than that
Even in cloud we need to use linux , yes most of them will not have access for cluster box but what about client node ( GCP client node) its still a linux Box
Many of the banking LOB will not provide access to web clients
End of Day we dont have or Use UI to run our jobs (mostly) , I will add few more justification
1. File Handline - ls , cp , mkdir , mv etc ( day to day activity )
2. Imagine you are doing a history load or manual run for a POC - then we need process handling commands to see whats running in background
3. Imagine you need to find out the issue from the spark yarn logs of your job (many people doing this ) - You need search and pattern matching commands ( If you use airflow it can provide us a log but some times we face slowness or no full information )
4. Scripting - Mentioned the video itself
I am sure, that I haven't stressed it. this is basic , if I stress it it would have been even more 😜
" more than its required " - No , these comands are basics that all should definetly know
Thanks for Bringing this , Happy learning :)
Now that's what I call a constructive reply...thanks for letting us know this...
@thedatatech 🔥
Will i make a data engineer as a fresher i am gonna graduate jun 2024 and how is market opportunities for fresher as data engineer
I have around 10 years of experience in sw engg and trying to transition to data engg. Do you think I would be able to get interview calls if I complete certifications?
how about Docker? is it still relevant in coming years for data engineering?
Is learning azure databricks will help here ?
6:57 This needs to be carved into stone
Thanks man....looking fwd to learn from you so pls bring more indepth content as most of the free content is quite introductory.
More to come! , thanks
Hi,
Very informative video❤
Can you please share all these details in a pdf?
Superr video, what about Azure Databricks?
I think that its a future.
Sir,
Create series on Linux implementation on project
belong to mech but want to strt career here can u tell growth and begginer level salary
thank you
thankyou sir if can please do a project on Data engineering sir which will be really helpful for us as a fresher to attend interview
Excellent Bro
1st view. Very informative video 🔥💥
Thank you so much 🙂
Informative
Sir I want to talk to you. I m willing to pay for consultation.
How to contact you bro