monobrow somehow suits you 😂 you should rename this channel accordingly. «[...] _Wear it like armor, and it can never be used to hurt you_ » -- Tyrion Lannister, GOT
Summary - 1. LEARN PROGRAMMING LANGUAGE 2. LEARN ABOUT CLOUD DATA WAREHOUSES 3. DATA PROCESSING AND ANALYTICS 4. DATA ORCHESTRATION & WORKFLOW MANAGEMENT 5. LEARNING ABOUT CLOUD PLATFORMS 6. LEARNING DATAOPS 7. LEARNING MODERN DATA STACK
You are the best. Starting my career in DE, stopped watching other videos. Just watching your videos. Also can you make a sample diagramatic aprroach of a pipeline step by step for a basic idea to know where all these tools fit by order, it would be really helpful
1) what's about apache hive ? It is outdated or not it demand? 2)Can we learn n practice spark on databricks community edition ( free)? 3) Is your sql and python courses are enough to clear coding rounds of DE role? 4) What's your view on hadoop? Still lots of companies are using hadoop and companies are asking hadoop related question.
There will be companies who’ll use tools that you mentioned but goal of this video is to give clarity of what’s in demand 1. Snowflake and BigQuery >>> 2. Yes you can on community edition 3. These courses are designed to teach you how to use them from DE POV, interview prep is completely different game 4. You can learn basic fundamentals but don’t need to master it
Sonarqube is not a CICD application. It is a code analysis tool that also analyses the code for security vulnerabilities. The code analysis can be integrated as part of the CI pipeline. For implementing CICD, you can consider applications such as Jenkins, TeamCity, GitLab, etc.
Hi, My course is designed with core data warehouse fundamental with snowflake and there are final two projects that use AWS Check website for more details
tbh it most of the DE is done on cloud platforms, I have hardly deployed anything on my local machine, but if you have budget you can always go with above config. One thing I suggest is get travel friendly laptop that is easy to carry, always a good choice. Laptop with GPUs are very heavy
Sir you are ignoring some tools like hive ,hadoop...etc ,which are very good to learn and also foundation of DE. You just emphasizing on the course selling . Which you build course on. 😂
I created roadmap 2 years back and I mentioned same thing about foundation skill Also companies are migrating from Hadoop to new stack, my goal from this video was to give you clarity of tools What’s the point if I list them all? You’ll still get confused Also about course selling, it is how I make living so I have to do it and they are good because I helped more than 5000 students around the world
2000 likes and I will upload new project 🙂 100k subs when?
Hi Darshil
why only 2k, you will get more likes !!
Hey The courses link you shared is not working when doing the payment for the course please check IT out and let me know when you fix IT
Hi Please mail me at info@datawithdarshil.com@@latesttelugutech4490
Hi Darshil the way your giving road map to data engineer and other technologies information awesome
monobrow somehow suits you 😂 you should rename this channel accordingly.
«[...] _Wear it like armor, and it can never be used to hurt you_ »
-- Tyrion Lannister, GOT
Summary -
1. LEARN PROGRAMMING LANGUAGE
2. LEARN ABOUT CLOUD DATA WAREHOUSES
3. DATA PROCESSING AND ANALYTICS
4. DATA ORCHESTRATION &
WORKFLOW MANAGEMENT
5. LEARNING ABOUT CLOUD PLATFORMS
6. LEARNING DATAOPS
7. LEARNING MODERN DATA STACK
1)Python
2)SQL
3)Cloud data warehouse (Snowflake & Google big query)
4)Data processing & Analysing (Apache spark & apache kafka by databricks)
5)
You are the best. Starting my career in DE, stopped watching other videos. Just watching your videos. Also can you make a sample diagramatic aprroach of a pipeline step by step for a basic idea to know where all these tools fit by order, it would be really helpful
very informative darshil. thanks for the video. we would love to have a video assisting us in the interview prep for DE.
I will put this in my liast
1) what's about apache hive ? It is outdated or not it demand?
2)Can we learn n practice spark on databricks community edition ( free)?
3) Is your sql and python courses are enough to clear coding rounds of DE role?
4) What's your view on hadoop? Still lots of companies are using hadoop and companies are asking hadoop related question.
There will be companies who’ll use tools that you mentioned but goal of this video is to give clarity of what’s in demand
1. Snowflake and BigQuery >>>
2. Yes you can on community edition
3. These courses are designed to teach you how to use them from DE POV, interview prep is completely different game
4. You can learn basic fundamentals but don’t need to master it
@@DarshilParmar Thank you.
How to get a data engineer role as a fresher? Because everyone says you need some experience to get into this role
projects, only way out
Nope you cant most probably. I would suggest get an SQL developer job and then switch to data engineer
Hey Darshil, this is another great video! Can you share the software you use to create and edit your videos?
Thanks for your content Darshill, you are my inspiration bro !!
Happy to hear that bro
Hi
Could you pls make a video of DE interview prep for experienced roles
Thanks in advance :)
Thanks for the video. What do you think about learning CICD: Jenkins and Sonarqube?
Don't have much idea about CICD but jenkins is normally used
Sonarqube is not a CICD application. It is a code analysis tool that also analyses the code for security vulnerabilities. The code analysis can be integrated as part of the CI pipeline. For implementing CICD, you can consider applications such as Jenkins, TeamCity, GitLab, etc.
You can add Data Observability tools in this stack example Datadog
WHAT ABOUT Talend ETL , i m currently work as Talend Developer. what would you suggest me to become a whole data engineer.
Darshil need some guidance on converting full load pipelines(using many source tables on postgres) to incremental
Please mail me with details on info@datawithdarshil.com and I will see if I can share my insights
Well explained.. Got clear understanding about skill sets 👍👍
Thank you
How long would it take to learn all these stuff? I'm not trying to master everything, but have a good knowledge on all of this?
3-4 months with full monk mode
@@DarshilParmar That I can do! Thank you.
Hi Darshil, I love your channel.
How i can get experience as a beginner data engineer?
Can we learn Big Data Hadoop for Data Processing . along with Apache spark & kafka to Become Big Data engineer
Nice video , what is your opinion on data analysts vs clound engineer which easy to get wary job for non coding background
Thanis for summarizing in one video.
Thank a lot Darshil
You are welcome
As an data analyst do i need to learn every steps you mentioned?
@DarshilParmar When can we expect the course related to Databricks & Apache Kafka
Very informative, can you create a course on AWS for DE?
Please make a video on your course and explain also. I want to buy your course.
What are your thoughts of delta lake for data warehousing ?
We are moving in this direction only, companies want to keep their data on one place and query using DW tools like Snowflake
The course links you gave is working but when we do book seat there is problem with the key can you check it
I have learnt ML and deep learning, sql,
Could I get job with this or I need to learn data engineering tools?
You will have to learn Data Engineering tools if you want to get job in DE
i want to join your snowflake course could you throw some points on bigdata AWS along with snowflake is added advantage?
Hi,
My course is designed with core data warehouse fundamental with snowflake and there are final two projects that use AWS
Check website for more details
is laptop with i5 11th gen with 1650gpu, 512gb SSD and 8gb ram enough if i want data engineering field?
Go ahead!!
it's more than enough
tbh it most of the DE is done on cloud platforms, I have hardly deployed anything on my local machine, but if you have budget you can always go with above config.
One thing I suggest is get travel friendly laptop that is easy to carry, always a good choice.
Laptop with GPUs are very heavy
Thanks for making these videos.
Glad you like them!
@@DarshilParmar Indeed. Your videos have been a guiding stone as I ventured into this ever confusing space of Data engineering :D
Can you please suggest some good courses on data engineer or data analysts
I am eager to learn data engineering but have one doubt that hoe to get job as fresher?
Will AI replace Data Analysts ( Tableau Developers )?
Hi darshil please make video for translation into date engineering
nice background music could you tell me the name of the song
Bhai either you give 60% off or remove the tag showing the same on your data warehouse course
Will do, thanks for the feedback
what is your opinion on aws data engineer cert in beta now
I am going to make video on it soon
Will AI replace data engineers am having fear that am learning data engineering but am thinking if Ai will replace data engineers? Please reply 🙏
No, it won’t
Make dedicated videos on this topic
Tell one field there is no fear of ai from hotel server to janitor all have automation and ai
@@PremKumar-ky2qqcyber security space
@@PremKumar-ky2qq Cyber security. NO CAP
What do you think of Rust programming language?
I am exploring it, I've heard about it, I will share my insights
Do we need laptop with good GPUs for these softwares?
Nope
Nice video, can you collaborate the courses of python + SQl and data warehouse, so that I can go and opt for it as a combine...
Working on it but you can purchase individual won’t be much difference
What about software testing do it have future plz someone reply
love your content bro
Thank you bro
Sir you are ignoring some tools like hive ,hadoop...etc ,which are very good to learn and also foundation of DE. You just emphasizing on the course selling . Which you build course on.
😂
I created roadmap 2 years back and I mentioned same thing about foundation skill
Also companies are migrating from Hadoop to new stack, my goal from this video was to give you clarity of tools
What’s the point if I list them all? You’ll still get confused
Also about course selling, it is how I make living so I have to do it and they are good because I helped more than 5000 students around the world
Many companies are migrating from Hadoop to snowflake
is snowflake certification worth it
Yes
Do you teach some kind of Bootcamp?
I am building bootcamp, check my courses to get started in description
@@DarshilParmar sorry I prefer only live classes for Bootcamp not self paced
your course have a enlít sustitle? because my english is not good
Not yet but we are planning add it, you can still try it and if you don’t understand then I’ll issue refund
AWS link pls
Nice video
Thank you
Will AI replace full stack developers or web developers in general???
No, a person using AI will replace those who are not
Sir how can i contact you