How Data Engineering Works

Поделиться
HTML-код
  • Опубликовано: 10 янв 2025

Комментарии • 598

  • @DistortedV12
    @DistortedV12 3 года назад +1149

    This video deserves an Emmy award

  • @Krousedp
    @Krousedp 3 года назад +869

    After 8 years of trying to explain to my parents what I do, this does it in 14 minutes. Thanks!

    • @MrBoomBoom225
      @MrBoomBoom225 3 года назад +32

      I can imagine how the initial conversation went with your parents
      “No dad I’m not help desk, I do things to move data”

    • @malcorub
      @malcorub 3 года назад +13

      My parents are super old school Mexican in their 80s. All they know is "I work with computers" 🤣 It's super hard to explain when they don't even know how to use smart phones or computers.

    • @victoriwuoha3081
      @victoriwuoha3081 3 года назад +6

      Lol.... I can imagine.

    • @nitronesstalk4783
      @nitronesstalk4783 2 года назад +1

      It’s frustrating job? does it pay well? Pls answer back, adding more details will even help.

    • @diwasyt
      @diwasyt 2 года назад +3

      @@MrBoomBoom225 Dad: That's what I'm saying. You move data from one desk to another desk😂😂

  • @siddharthsingh5031
    @siddharthsingh5031 3 года назад +1026

    I am a Data Engineer and now I know what I do :D

    • @codingwombat
      @codingwombat 3 года назад +17

      You.. Whuuuuuuuuuuut?.. XD

    • @nandhithanathan432
      @nandhithanathan432 3 года назад +7

      What should someone learn or know before entering into Data Engineering job.In what platform should they prepare for that ??

    • @avnishdeo5165
      @avnishdeo5165 3 года назад +2

      me too

    • @tektauron
      @tektauron 3 года назад +1

      LOL XD

    • @abcrx32j
      @abcrx32j 3 года назад +60

      Only non programmers would be surprised by this comment

  • @krishnacism
    @krishnacism 3 года назад +430

    I have never seen such a beautiful video on Data Engineering topic. It covered everything what a 400 pages book can't do. Appreciate your efforts

  • @rqn2274
    @rqn2274 2 года назад +116

    I'm working as a data engineer for 15 years and this is the best explanation of my work I have ever seen :)

    • @rajageetha1936
      @rajageetha1936 Год назад

      Hi sir iam new to this field... Can you explain me your project

    • @itsorcus649
      @itsorcus649 Год назад +6

      @@rajageetha1936 lmao how can he explain all that in one comment

    • @quantumphylosphy
      @quantumphylosphy 4 месяца назад

      any other such kind of videos on each topic of data engineering?

  • @moverecursus1337
    @moverecursus1337 Год назад +36

    On January of this year (2023) after I took a time off university I watched this video, loved so much and started studying this field with everyday from morning to night watching, reading, coding and adventuring on cloud. And I can say, after 9 Months, I got my first job on tech as Data Engineer. Thank You AltexSoft ❣ Without this I would be nothing 🙏

    • @AltexSoft
      @AltexSoft  Год назад +1

      Thanks for sharing. We are glad that our video helped you in your journey

    • @ShapeShowdown-0
      @ShapeShowdown-0 Год назад +4

      First of all, congratulations for your steady obsession which led you to your job.🎉🎉
      Can you give us the rough roadmap of what you did during those precious 9 months ?
      Again, congratulations ❤

    • @moverecursus1337
      @moverecursus1337 Год назад

      ​@@ShapeShowdown-0It's a long story, I recommend taking a look at Data Engineering Zoomcamp, it will start January 15th and it talks about everything a Data Engineer need (free, on RUclips)

  • @sreeyeshb
    @sreeyeshb 3 года назад +145

    This video is the single malt of all youtube videos explaining data engineering. This deserves an award for sure.

  • @gmr409
    @gmr409 Год назад +34

    One of the best technical explanation videos I’ve ever seen in 25 years in the business. Bravo, well done.

  • @livyaharikachowdary644
    @livyaharikachowdary644 2 года назад +8

    I am a Data Engineer and I cant tell you how much sense this video makes. Felt like we, Data Engineers got validation for the work we do! Next time some asks what do you do, I am going to send them this video link. Thank you :) Also special call for creativity and pun

  • @shubhamgattani5357
    @shubhamgattani5357 Месяц назад +1

    Dear RUclips, this video should be the first in the recommendations whenever anyone searches for the term "DATA ENGINEERING". I am mesmerized 🤩

  • @everenjohn
    @everenjohn 3 года назад +33

    Hi AltexSoft! I comment here not because I watched this video, but just to thank you for the amazing content! You've helped me a lot in understanding many things about software engineering in a much interesting manner compared to lecturers. I'm glad I found this channel regardless of the number of views because you making amazing content!

  • @music4u98
    @music4u98 3 года назад +25

    These videos are like movies. Well scripted, picturized and to the point . Loved watching them thoroughly. I like the background music change as the topic of content changes

  • @JuanCoolDad
    @JuanCoolDad 2 года назад +17

    I'm trying to transition from Data Analyst to Data Engineer. I already understand some of the concepts, but this video took it to the next level! Awesome content! 👌

  • @julesmules0901
    @julesmules0901 3 года назад +7

    I think I just fell in love with that video. It was truly mind-blowing. Not only did you guys manage to illustrate the different relationships between data systems and data discipline on a hight level but the way you visualised it made it so easy to comprehend that even people new to the subject would get it. Amazing! With topics like Data Engineering the true difficulty lies in simplifying things. And just just nailed that

  • @himanshupandey4038
    @himanshupandey4038 Год назад +1

    This is one of the best videos on Data Engineering
    I was confused with all the other resources just using big buzz words and not explaining the core of the job
    Thank you for the simple explanation

  • @cidrisonly
    @cidrisonly 3 года назад +1

    In the middle of the night when you fetch your phone to make sure your decision on the Data Engineering boot camp is right, such videos are very reassuring. I don’t know how much I should appreciate this channel for this video in particular. You have earned a sincere Subscriber now.

  • @goldenmilktea4992
    @goldenmilktea4992 3 года назад +28

    Now I have a better understanding of data engineering! Thanks for the video!

  • @generativeresearch
    @generativeresearch Год назад +10

    This team who made this video truly deserves an award.

  • @shatandv
    @shatandv 3 года назад +37

    Amazing. A really good high-level explanation of Data Engineering!

  • @priteshraka6408
    @priteshraka6408 3 года назад +7

    Cant believe you cleared so many doubts at once in 15 min video! This was amazing work.

  • @shivnandanigarg9315
    @shivnandanigarg9315 2 года назад +1

    This is exactly how, lectures should be. This is ideal. Nothing can be enough when I want to appreciate it. Thanks

  • @sakinasaifee3118
    @sakinasaifee3118 3 года назад +17

    One of the best videos I came across, with great explanation and animation. Enjoyed watching it! Thanks!

  • @caonhantran3531
    @caonhantran3531 3 года назад +6

    The most meaningful explanation about Data Engineering I've ever seen.

  • @mahmoudfadaly8074
    @mahmoudfadaly8074 8 месяцев назад +2

    This might be the best video on the internet explaining data engineer role

  • @mosesojonuba416
    @mosesojonuba416 11 месяцев назад

    Have been reading a lot about data Engineering but couldn't understand and place together all the concepts and terminologies.. But after watching this video animation and explanation, I can boldly say that i now understand the concept of data engineering. Thanks you

  • @Seeker_Winterfell
    @Seeker_Winterfell 2 года назад +1

    After watching this video , I feel like I have more experience in Data engineering now. Thank you

  • @ginnycheah5493
    @ginnycheah5493 2 года назад +1

    Concise and perfect! Soothing voice too! This video really deserves an award.

  • @sonicbroom8522
    @sonicbroom8522 3 года назад +1

    This is honestly lightyears ahead of other videos on what DE is. Giant Kudos to you

  • @whymeiy
    @whymeiy Год назад

    The most concise, accessible, and beautiful video I've ever seen describe my job. Captured why data engineering matters, took us through a history of how pipelines have evolved over time, and illustrated the complexity we deal with without actually bogging down the viewer with said complexity. Absolutely wonderful! Thank you for this masterpiece! 💜

  • @denidota6393
    @denidota6393 2 года назад +4

    I am an ETL Developer,
    the more I learn about data, the more I feel that my knowledges very less .
    Thank you for amazing videos !

  • @tinarajan9886
    @tinarajan9886 Год назад +1

    This is the most brilliant explanation I have watched of data engineering. The most worthwhile 15 mins of my life today 😅

    • @AltexSoft
      @AltexSoft  Год назад +1

      Thanks, we'll continue to do our best ❤️

  • @devarapallivamsi7064
    @devarapallivamsi7064 9 месяцев назад

    First thing that I have done as soon as I completed watching this video is subscribing so as to not miss out on such wonderful content. I think that's enough to explain it all.

  • @jacobjulag-ay5639
    @jacobjulag-ay5639 3 года назад +7

    This is an amazing video, summarized everything I have been researching in just one video. Thank you!

  • @shubhamdandekar20
    @shubhamdandekar20 2 года назад

    I have never seen any video explain Data Engineering this good. Very easy to understand.

  • @ariesykes1432
    @ariesykes1432 3 года назад +5

    Really interesting video! It definitely relates to what I am working on currently. I work in IT recruiting. I'm always looking for a data engineers for my jobs and this video helps me understand a little more about what data engineers have to face in their field. Thank you!

  • @deneb6139
    @deneb6139 3 года назад

    Who ever design/produce/ideate this video deserves a Nobel Prize.

  • @future_teknokrat7585
    @future_teknokrat7585 2 года назад

    Video so clean and clear, I had to view it several times. I normally have to do that for stuff I don't quite catch. I understood everything here on the first go and just have to see it again and again. This was the perfect combination of audio and visual intake with just enough jargon.

  • @vaibhavgadewar5391
    @vaibhavgadewar5391 2 года назад +7

    Never seen such impactful short video on the Data Engineering concepts which clearly show the role of each component and how they get added in progression with evolving concept..
    Masterpiece.. Hats off to you guys for this simplicity 👏

  • @devScion7340
    @devScion7340 2 года назад

    I learned more about Data Engineering from this video than the company bought Udemy course Im taking to become a Data Engineer. Thank you for this!

  • @robinalvarezp
    @robinalvarezp 3 года назад

    This is the most clear video about Data and Analytics than I ever seen. Congratulations AltexSoft.

  • @prishthakkar605
    @prishthakkar605 5 месяцев назад

    Thanks a ton. This will be really helpful in my meeting tomorrow, I may close a deal. Have never seen easier explanation of data engineering than this. Deserve to go viral.

    • @AltexSoft
      @AltexSoft  5 месяцев назад +1

      Best of luck!

  • @dextergrimes502
    @dextergrimes502 Год назад

    i cant believe that every question in my head on bigdata application is answered in 14min, from the bottom of my heart Thank You 🖤

  • @davidmax7214
    @davidmax7214 2 года назад

    I'm Brazilian and I intend to become a data engineer, this was the video that best explained what a data engineer really does, amazing!! My mind exploded hahaha

  • @syed_hussaini
    @syed_hussaini 2 года назад

    I didn't know how data scientists & data engineers work together & also the usage of data lake and data warehouse before watching this video.

    A big thanks from your new subscriber.

  • @aishwaryadhaigude3460
    @aishwaryadhaigude3460 6 месяцев назад +1

    You got my subscription just after this one video! Such rich content!

    • @AltexSoft
      @AltexSoft  6 месяцев назад

      Welcome aboard =)

  • @jithinjawahar3744
    @jithinjawahar3744 2 года назад +2

    So simple yet so profoundly explained.
    Thanks for your efforts

  • @edsonsabino
    @edsonsabino 2 года назад +1

    The video is so instructive and fun at the same time

  • @terran008
    @terran008 Год назад

    This video is amazing, so informative, I don’t remember the last time I watch such a short video with such valuable and clear content on data

  • @RZing
    @RZing 10 месяцев назад

    By far the best video to describe what data engineer is in a simple way,thank you!

  • @farazqadir324
    @farazqadir324 2 года назад

    probably the best video on the internet about data specific roles and their respective operations

  • @hormengyoong2054
    @hormengyoong2054 2 года назад +1

    This is the best video that I have watched covering all aspects of data engineering in a simple, funny and engaging manner. It is a great work 👏 👍 👌

  • @Eric-fv8ft
    @Eric-fv8ft 3 года назад +5

    Amazing explanation!! Now I know what's the difference and the relationship between all these terms and professions! Thank you so much for the content producer!

  • @danielfulep6847
    @danielfulep6847 7 месяцев назад

    If I've watched this yesterday morning, I would have nailed my trainee job interview in the afternoon. :D
    Amazing video! Thanks!

    • @AltexSoft
      @AltexSoft  7 месяцев назад

      Good luck in your job search

  • @et.sachin
    @et.sachin Год назад

    This is by far the best video explaining the word of data science.

  • @amadousidibe2931
    @amadousidibe2931 Год назад +1

    Best ever , simple and clear

  • @bnee4313
    @bnee4313 2 года назад +1

    In such a short time, video touches on every aspect of Data engineering. Great job

  • @mohamedkhalaf6791
    @mohamedkhalaf6791 11 месяцев назад

    i don't think there is a better explanation than that. i am thinking about learning it and it made me love it.

  • @onlypersona
    @onlypersona 3 года назад

    This video is the best explanation for Data Platform I've ever seen in the whole Internet!!!

  • @CuriousDragonite
    @CuriousDragonite Год назад

    Thank You, Thank You, Thank You! Never seen such a perfectly crafted video talking about Data Engineering.

    • @AltexSoft
      @AltexSoft  Год назад

      Thanks for your kind words, glad u liked our video

  • @SeeWorldThroughMyLenss
    @SeeWorldThroughMyLenss 2 года назад

    Ive never seen a video that explains Data Engineering in such simpler manner. Thank you!

    • @AltexSoft
      @AltexSoft  2 года назад

      Thank you so much for watching and for your words ❤️

  • @swathik3117
    @swathik3117 3 года назад +1

    I was searching for this kinda info almost since 3weeks, was so confused about the Big data DE tools how they fit into the system. Million thanks to you! :)

  • @omkarjawaji9880
    @omkarjawaji9880 3 года назад

    I have an interview for a Data Engineer role tomorrow and I think I can explain about the work they do better than anyone, after watching this video , thanks !

    • @JoyFay
      @JoyFay 3 года назад

      How did it go?

    • @omkarjawaji4423
      @omkarjawaji4423 3 года назад +2

      @@JoyFay thanks for asking ! I didn't get the role of Data Engineer , instead they offered me a Python Developer role. Well, even though I could explain well about Data Engineering I didn't have any experience with it. Thank you so much for making such videos though!

    • @JoyFay
      @JoyFay 3 года назад

      @@omkarjawaji4423 I'm sorry you didn't get the job. Glad you got another offer. Keep working towards your goals. Good Luck!

  • @bernardogalvao85
    @bernardogalvao85 2 года назад

    This video is amazing. I finally understand the place Spark and Kafka have. The more I learn about Data Engineering the more fascinated I get. Your video definitely contributed to that!

  • @calmrelaxationmusic8856
    @calmrelaxationmusic8856 3 года назад

    I have seen multiple videos on DE on youtube but this one sums up everything so well! All of you new folks need to check out this video. This deserves more traction.

  • @Loedairy
    @Loedairy 10 месяцев назад

    I have exam next week and everything I’ve been studying , you explained in 14mins 😮. Thank You 🙏🏽

    • @AltexSoft
      @AltexSoft  9 месяцев назад

      Gl with exam =)

  • @ashishnikam3650
    @ashishnikam3650 3 года назад

    Best video about data engineering on RUclips.

  • @arigato1901
    @arigato1901 10 месяцев назад

    This is probably the best video I have seen to simply describe Data engineering! 👍

  • @zma314125
    @zma314125 3 года назад +1

    Thank you guys for explaining Data Engineering in a way that I actually understood it.

  • @Icelander00
    @Icelander00 2 года назад +1

    It was so clear and best ever explanation of DA,DE & DS

  • @ShaileshKumar-lx6ov
    @ShaileshKumar-lx6ov 3 года назад

    The best video about Data Engineering ever. Kudos to the team who developed this.

  • @SYBIOTE
    @SYBIOTE 2 года назад

    needed to revise up and look at the larger scale for a new internship , this video truly deserves an Emmy

  • @MaharFahadHussainKlasra
    @MaharFahadHussainKlasra 5 месяцев назад

    Necessary and sequenced topics to understand Data Engineering very well.👍🏻👍🏻
    I am watching this video second time and would probably refer to this video in future too.

  • @StalkedByLosers
    @StalkedByLosers Год назад +1

    This literally is an example of how automation does the exact opposite of killing jobs. It started with two people, it ended with 5 people and all of them 10x more productive than the original 2.

  • @ossamahasni7739
    @ossamahasni7739 2 года назад

    This is absolutely one of the best videos I have seen in my life. PERFECTION

  • @lifedatatech6917
    @lifedatatech6917 2 года назад

    I am super glad I found this video; I burst into tears with joy after having several aha moments while watching the video. Kudos to the video creators!

  • @saikatnextd
    @saikatnextd Год назад

    Awesomeness is an understatement // you have covered such a vast topic in such a crisp and concise manner......

    • @AltexSoft
      @AltexSoft  Год назад

      Thanks =) Glad you enjoyed it

  • @muhammadawon8164
    @muhammadawon8164 2 года назад

    Thank you solving the mystery box, now I can just refer this video to the people who'd ask me what I'm doing.
    Great video 🙌

  • @meowy2k
    @meowy2k 2 года назад

    this is THE BEST DE summary i've seen so far

  • @AxiRyu
    @AxiRyu 2 года назад

    This is the best video on data engineering I have ever seen

  • @SamrudhVNayak
    @SamrudhVNayak 2 года назад

    This video is just wow!! Simplified but captures the entire essence of Data Engineering.

  • @fahimkhan4478
    @fahimkhan4478 2 года назад

    2 years of my knowledge just explained with clearest way👌👌👌👌

  • @user-fc8vv3vu2b
    @user-fc8vv3vu2b 2 года назад

    By far the best video I have ever seen related to data engineering

  • @Oops_64
    @Oops_64 Год назад

    I would really like to appreciate the story telling technique used in this video. A huge thumbs up

    • @AltexSoft
      @AltexSoft  Год назад

      Thanks for your words 😊

  • @bilalsyed4059
    @bilalsyed4059 2 года назад

    Just 1 Video gave complete picture of Data engineering, thanks for posting !! Subscribing right away ....Good Job ..

  • @climentea
    @climentea 3 месяца назад

    Damn... Congrats on all the people who worked on this video! Top quality!

  • @anirbansarkar6306
    @anirbansarkar6306 3 года назад +1

    Best video to explain Data engineering

  • @pstefanics
    @pstefanics Месяц назад

    @AltexSoft -- this is by far the best video I've seen on the topic so far. Please make more of these on similar data-related topics.

  • @davidorellanapl
    @davidorellanapl Год назад

    This is a useful video about Data Engineering, currently. Thanks for the effort.

  • @vinitmahale
    @vinitmahale 2 года назад +2

    Omg! This is absolute gold! Thank you so much! I'm not an engineer but I understood how Data Engineering works now in under 15mins! I can't thank you enough for this video.

  • @BooklerNatsu
    @BooklerNatsu 2 года назад

    Great video! Very easy to understand explanations yet goes into enough depth for the general audience to understand the scope and complexity of data engineering. The graphics are great too, further helps with understanding the concept. Great work, thank you!

  • @anikulapoidris8860
    @anikulapoidris8860 11 месяцев назад

    One of the best video I’ve ever watched on Data topics

  • @yonelankosi5574
    @yonelankosi5574 Год назад

    Wow. Finally got to understand a summary of what I'm currently studying.

  • @glametown5178
    @glametown5178 11 месяцев назад

    This has to best videos for Data engineering. Thanks a lot.

  • @pritishsingha6760
    @pritishsingha6760 2 года назад

    This is the best video on the complete data engineering

  • @rahulbagal6741
    @rahulbagal6741 3 года назад

    The best explanation i have ever got on You tube love from India

  • @sole008
    @sole008 3 года назад

    wow best video so far about this topic and i spend the day looking at articles and videos of this subject

  • @supriyodatta3116
    @supriyodatta3116 3 года назад

    A wonderful way to explain data engineering! Provides a complete overview! Wow!

  • @pranovsarath7632
    @pranovsarath7632 3 года назад +4

    You guys deserve an award for how well this video has been made!!!!

  • @hemantmattoo
    @hemantmattoo 3 месяца назад

    Thank you for making it so easy to understand these concepts.

  • @miraclembionwu503
    @miraclembionwu503 Год назад

    this video deserves an award !!!!!!!!!!!!!!!!!!!!