Ansh Lamba
Ansh Lamba
  • Видео 3
  • Просмотров 19 472
Fundamentals of Data Engineering Masterclass (From SCRATCH!)
Fundamentals of Data Engineering Masterclass | Data Engineering Full Course | Data Engineering Bootcamp
What You’ll Learn in in the next 3 Hours?
You'll learn everything you need to know about data engineering from scratch. Whether you're a complete beginner or looking to enhance your skills, this Data Engineering Masterclass covers all the essential concepts such as:
- Introduction to Data Engineering
- Key Concepts: ETL, Data Warehousing, and Data Pipelines
- Tools and Technologies: Apache Spark, Databricks, Azure Data Engineering, SQL etc.
- Best Practices for Data Management
- Real-world Projects and Case Studies
Azure End-To-End Data Engineering Project - ruclips.net/video/0GTZ-12hYtU/видео....
Просмотров: 2 815

Видео

PySpark Tutorial | Full Course (From Zero to Pro!)
Просмотров 10 тыс.21 час назад
PySpark Tutorial | Apache Spark Full course | PySpark Real-Time Scenarios 🔍 What You’ll Learn in in the next 6 Hours? - Spark Architecture: Understand the fundamentals of Spark, including Lazy Evaluation, Spark Jobs, Stages, and Tasks, all explained from scratch. - PySpark Functions: Learn all the PySpark functions from SCRATCH (Beginner's Guide) - Real-Time Scenarios: Gain insights into practi...
Azure End-To-End Data Engineering Project (From Scratch!)
Просмотров 8 тыс.14 дней назад
Azure Data Engineering End-To-End Project | Azure Data Factory | Databricks | Pyspark | Azure Synapse Anlaytics In this video, I take you through End-to-End Data Engineering project from scratch where I leverage powerful technologies like Azure Data Factory, Azure Data Lake, Databricks, Azure Synapse Analytics, and Apache Spark. 🔍 What You’ll Learn: - How to design and implement a robust data p...

Комментарии

  • @akhileshshinde4181
    @akhileshshinde4181 Час назад

    Please Create data engineering roadmaps for various cloud services

  • @SatishBawaskar-d4n
    @SatishBawaskar-d4n 5 часов назад

    buddy, you're amazing! thank you so much for sharing your knowledge with us. i truly appreciate it. honestly, you're doing an incredible job!

  • @GoatGoal793
    @GoatGoal793 6 часов назад

    Hello sir please make video on Apache spark with python and docker

  • @dineshvishe3
    @dineshvishe3 9 часов назад

    nice explain..doing great work..

  • @ChaitanyaP-m2e
    @ChaitanyaP-m2e 11 часов назад

    df.withColumn('Item_Fat_Content',regexp_replace(col('Item_Fat_Content'),"Regular","Reg")).display() AttributeError: 'NoneType' object has no attribute 'withColumn' Getting this error What might be the reason?

  • @SriRamTrading
    @SriRamTrading 11 часов назад

    one topic you missed handing bad record , i know you left this bymistake, but altogh you cover all the things in fabulous way.... just need one dedicated video on ADF and am ready to give interview,,

  • @basabsaha6370
    @basabsaha6370 12 часов назад

    Thank you from the bottom of my heart♥️ it's really an amazingly crafted tutorial, no one teaches so smoothly and u taught everything very slowly I understood each and every concept. We are always with you. Carry on 😁👍 And do such long format videos on other topics like sql, airflow

  • @SatishGupta-eo4qh
    @SatishGupta-eo4qh 12 часов назад

    What are pre requisites for this video I have just just completed your video on data engineer fundamentals and loved it buddy and now I am keen to learn more about DE so thanks bro

  • @scoopgaming3773
    @scoopgaming3773 13 часов назад

    superb bro , keep going on brother

  • @siddeshbb-o5q
    @siddeshbb-o5q 14 часов назад

    Thanks Ansh for this Master class. I am a tester ( manual and Automation ) having 10 years to IT filed. Now willing to Move to Azure Data engineer filed. Can you please provide the roadmap or how we contact for any guidance

  • @shaikjanipasha9365
    @shaikjanipasha9365 16 часов назад

    Can you please create a new video on realtime pyspark i questions asked in the company interviews that would be great of you

  • @KrishnaMatta-f3s
    @KrishnaMatta-f3s День назад

    Hi Ansh the video with detail explaining is very good. And you covered lot of things in detail 🎉🎉🎉.My side one request if possible can you create one video with scd-1 implementation with Adf , sql ,and dataflow combination end to end.

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      I am happy that you found my video useful. Sure, stay tuned for more! Happy Learning :)

  • @s7creation796
    @s7creation796 День назад

    Anyone please tell me i am learning ml algorithms and deep learning libraries like pytorch . Is the data engineering needed

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      You can always upskill yourself by learning Data Engineering as Data is growing rapidly :)

  • @chaitanyanagare757
    @chaitanyanagare757 День назад

    Thanks Ansh.. Can you create one video on SCD types with Pyspark and with SQL?

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      Thank you for the positive feedback. Stay tuned and Happy Learning :)

  • @gkthecoder9589
    @gkthecoder9589 День назад

    I have complted the full video, Thank you very much, I appriciate for your dedication ❣🥰🥰🥰🥰🥰❣

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      I am really happy that you watched the full video and found it useful. Pls subscribe and share it with others. It will help me to grow :)

  • @manojmachagiri999
    @manojmachagiri999 День назад

    please create end to end FABRIC PROJECT

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      Thank you for the feedback. Will create soon :)

  • @ayushrajbhatt110
    @ayushrajbhatt110 День назад

    Awesome bro can you make some roadmap where you'll cover the important topics and tools to know to crack Fresher interviews and some beginners to Advance projects :)

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      Thank you so much for your kind words. Stay tuned for lots of insightful content from SCRATCH. I have also uploaded a video which has covered Fundamentals of Data Engineering :)

  • @SriRamTrading
    @SriRamTrading День назад

    hey buddy trust me, you are doing just great i watched many videos on youtube almost all creators, but you are gem bro.... just loved the way you are teaching, thanks you brother...

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      Thank you so much for your lovely words. I am glad you loved my content. Stay tuned and share it with others :)

  • @manojmachagiri999
    @manojmachagiri999 День назад

    Good bro keep going

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      Thank you so much for the positive feedback :)

  • @dhanrajdesai3668
    @dhanrajdesai3668 День назад

    Really helpful Thank you bro

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      Thank you so much for your positive feedback. Stay tuned :)

  • @09tt072
    @09tt072 День назад

    this guy is far better than so called linkedin influencers

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      That's so sweet of you. Thank you for your kind words :) Pls subscribe and share it with others :)

  • @jaganmohanthota8318
    @jaganmohanthota8318 День назад

    The explanation is clear, concise, and well-structured, making it easy to understand even complex concepts. The examples provided are relevant and help reinforce the learning. Great job breaking down the material step by step

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      I am happy that you loved my video. Stay tuned and happy learning :)

  • @pratyushpahari2606
    @pratyushpahari2606 День назад

    Sir, can you please give us a detailed guide like what are the things we need to learn step by step to become Data Engineer ?? Also please make video on Python and SQL for Data Engineers if possible 🙏

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      I am glad that you like my content. Stay tuned, will cover everything :)

  • @Butterfly-oy5tr
    @Butterfly-oy5tr День назад

    This is really good and going to help who want to grow in DE, how you're covering data engineering with free.

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      Thank you so much for your kind words. I'm getting lots of love in return :)

  • @VikashKumar0409
    @VikashKumar0409 День назад

    Man you are doing such a good job please continue the momentum. The way you created 6 hr video for Pyspark please create for other topics too if possible. Thank you for putttin the efforts❤

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      Thank you so much for your positive feedback. I am glad that you find my videos helpful. Stay tuned, lots of videos are scheduled. Pls subscribe and share it with others :)

    • @VikashKumar0409
      @VikashKumar0409 День назад

      @@AnshLambaJSR Definitely subscribed and shared with my friends. How did you transition from being a data analyst with 1 yr experience to a data engineer, if possible please make a video on this. I am in a similar position right now and it would be helpful for other people too.

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      @@VikashKumar0409 Sure, will do. Stay tuned :)

  • @connectwithanandsuresh
    @connectwithanandsuresh День назад

    Hi Brother - I have a query if you could kindly suggest? @ 2:43:11 -- The nulls value of Strings in other columns are getting replaced but the value in that is showed in this timeframe for column Item_Weight is still showing null. The only difference between both of our dateframe is, the column (Item_weight) is in double instead of string. Why the fillna doesn't work for non-string columns and how do we handle it? Could you please suggest?

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      I am happy that you are learning a lot from my videos. You need to provide values in fillna of same data type (double). Watch the video for more details. Happy Learning :)

  • @karanshah6619
    @karanshah6619 День назад

    bro make project videos please

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      I am glad that you like my content. Many projects are already scheduled. Stay tuned :)

  • @ABQ...
    @ABQ... 2 дня назад

    Thank you for the precise video, it’s exactly what I was looking for! Are you planning to create a dedicated Databricks tutorial, or is this 6-hour+ content enough?

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      I am happy that you found my video useful. Dedicated video on Databricks on the way. I am working on it. And yes, this video will be pre-requisite for that. Stay Tuned and Happy Learning :)

    • @ABQ...
      @ABQ... День назад

      @@AnshLambaJSR if possible include Unity Catalog thanks

    • @AnshLambaJSR
      @AnshLambaJSR 17 часов назад

      @@ABQ... Thank you for your suggestion. Will add Unity Catalog in my upcoming videos :)

  • @phanipaladugu3852
    @phanipaladugu3852 2 дня назад

    Thank you very much bro it will help lot of data enginner

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      Thank you for your kind words. Stay tuned for more :)

  • @astasingh
    @astasingh 2 дня назад

    one project using Aws

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      I am happy that you love my video and want more. Stay tuned, will add soon :)

  • @srinivasulunaidu8607
    @srinivasulunaidu8607 2 дня назад

    Thanks Ansh, Could you please create same kind of vedio on Python

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      It's my pleasure that you liked my video. Stay tuned !

  • @vasutke1187
    @vasutke1187 2 дня назад

    One solution A to Z channel for Data Engineering with high clarity, Present industry requiment employable skills, and Presentation as Professiinal Educator.... Which require much efforts to make this video. Thanks Sir BEST WISHES. Good Luck

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      Thank you so much for your lovely words and positive feedback. I am really happy that you loved my content. Pls subscribe and share it with others :)

  • @SatishGupta-eo4qh
    @SatishGupta-eo4qh 2 дня назад

    Hi Ansh thanks for the great video Can you make a zero to hero playlist please !?

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      Thank you for your positive feedback. Sure, stay tuned :)

  • @mohammedmahboob6908
    @mohammedmahboob6908 2 дня назад

    Just completed your 6hrs video on Spark and now you are back with another video 😅😅. Thankyou so much. Really appreciate the efforts you are putting out.

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      Thank you so much for your positive feedback. It's my pleasure. Stay tuned for more insightful content :)

  • @Nikhilkumar-mz8vz
    @Nikhilkumar-mz8vz 2 дня назад

    Thank you so much for this , Please publish a similar video on Python ! !

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      I am happy that you liked my video. Stay tuned for that :)

  • @nik54610
    @nik54610 2 дня назад

    Please please make on sql and python for data engineers I lack in basics, please help bro

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      I am glad that you found my video useful. Stay tuned and pls subscribe :)

  • @parthiban.s4291
    @parthiban.s4291 2 дня назад

    Need a dp 203 azure certification course please i am waiting for it. In the RUclips there is less content about it.

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      I am happy that you like my content so much. Pls subscribe and stay tuned for more insightful content :)

  • @vu8354
    @vu8354 2 дня назад

    I am the second one

    • @AnshLambaJSR
      @AnshLambaJSR День назад

      I am happy that you like the video. Stay tuned :)

  • @shivadev9558
    @shivadev9558 2 дня назад

    Bro , please upload indepth videos on adf, databricks and synapse separately with multiple projects.

    • @AnshLambaJSR
      @AnshLambaJSR 2 дня назад

      I am happy that you love my content! Stay tuned, will upload lots of content including the above mentioned topics as well. Happy Learning :)

  • @shivadev9558
    @shivadev9558 2 дня назад

    Omg u have uploaded again . I am the first viewer now. I will complete this now.

    • @AnshLambaJSR
      @AnshLambaJSR 2 дня назад

      I am so blessed that you love my content. This video will give you deep understanding of the crucial concepts. Happy Learning :)

  • @gkthecoder9589
    @gkthecoder9589 2 дня назад

    Bro i couldn't find the .csfv file to upload bro, please share the link, thank you.

    • @AnshLambaJSR
      @AnshLambaJSR 2 дня назад

      link in given in the description. Please check :) Happy Learning :)

  • @gkthecoder9589
    @gkthecoder9589 2 дня назад

    Teaching style 🥰

    • @AnshLambaJSR
      @AnshLambaJSR 2 дня назад

      I am happy that you love the way I teach in the videos. Check out my latest video for more insights :)

  • @keyvansalehi-ls6bu
    @keyvansalehi-ls6bu 2 дня назад

    hi Ansh. thanks for this incredible end to end project. love it. its a great hands-on data engineering on azure, have ever seen... keep going bro...

    • @AnshLambaJSR
      @AnshLambaJSR 2 дня назад

      I am glad that you found my content helpful. Check my latest video for more insights :)

  • @pradeepreddy6192
    @pradeepreddy6192 2 дня назад

    Hi Ansh, really appreciated for your efforts. I have seen many videos but yours is a simple and great video to learn for beginners. I am preparing for interview. if you can give info about challenges, blockages faced during project and root causes, Optimisation techniques used in ADF level and ADB level, strategy used for cost savings, and strategies used for secure data migration from onpremises/API to cloud and finally unit test strategies. Will be great if you help with above and any related links pls.

    • @AnshLambaJSR
      @AnshLambaJSR 2 дня назад

      Thank you for your positive feedback. I am really happy that you liked my content. Stay tuned for the above mentioned topics :)

  • @limaranirana
    @limaranirana 2 дня назад

    For 4y experience can i add this project?

    • @AnshLambaJSR
      @AnshLambaJSR 2 дня назад

      Definitely. Stay tuned to get more insightful content :)

  • @vishalkamble7533
    @vishalkamble7533 3 дня назад

    Bro this just basic project we expect some dynamic approach like input data source you I have seen your project but in adls gen 2 location you just 1 folder and some files but this is static you have to mention when any customer will shared some extra files or folder that time how you handle this situation it's just static method Don't take me wrong I am just asking you..

    • @AnshLambaJSR
      @AnshLambaJSR 2 дня назад

      I am glad that you completed this project. In the future projects, you will see more dynamic approach. Stay tuned :)

  • @TarabShaikh-q9n
    @TarabShaikh-q9n 3 дня назад

    This is exactly what I was looking for on Udemy and to my luck, this appeared as a suggestion on YT. QQ - Is learning Pandas required for learning PySpark or this course enough? Thanks in advance brother! ❤

    • @AnshLambaJSR
      @AnshLambaJSR 2 дня назад

      I am really happy that you found my video useful. Happy learning :)

  • @jaykaryuvi6799
    @jaykaryuvi6799 3 дня назад

    Hi , thank you for the great video.can you please upload azure data factory also

    • @AnshLambaJSR
      @AnshLambaJSR 3 дня назад

      Thank you for your kind words. I am happy that you loved my video. Very soon, stay tuned :)

  • @parthiban.s4291
    @parthiban.s4291 3 дня назад

    when it will be on your next vedio

  • @parthiban.s4291
    @parthiban.s4291 3 дня назад

    waiting for next vedio

    • @AnshLambaJSR
      @AnshLambaJSR 3 дня назад

      I am happy that you are loving my content. Stay tuned, it's on your way (will be live soon)