The Data Master
The Data Master
  • Видео 348
  • Просмотров 621 652
Mastering Workspaces in Microsoft Fabric and Power BI: Collaboration Made Easy
Follow me on LinkedIn:
www.linkedin.com/in/naval-yemul-a5803523/
🎉 Introduction to Microsoft Fabric:
Imagine a single platform that unites all your data, analytics, and business intelligence needs. That’s Microsoft Fabric! It’s a comprehensive, end-to-end data platform that integrates data engineering, data science, real-time analytics, and business intelligence into a single ecosystem. With Fabric, you can transform raw data into actionable insights faster than ever.
📊 Workspaces in Microsoft Fabric and Power BI:
At the heart of Microsoft Fabric lies Workspaces-your collaborative hub for organizing and managing data projects. Think of it as a digital control room where your team works togeth...
Просмотров: 21

Видео

Mosaic AI Model Serving EXPERT Shares Top LLM Integration Secrets
Просмотров 572 часа назад
Explore how to leverage external models in Databricks Mosaic AI Model Serving! 🎯 Learn how Databricks supports third-party large language models (LLMs) like OpenAI and Anthropic to streamline model usage and management within your organization. Discover how Mosaic AI Model Serving simplifies interactions with LLM providers using a unified endpoint, supports custom models with rate limits, and e...
Generative AI, RAG, and Agentic AI Explained | Start Your AI Journey in 2025!
Просмотров 3249 часов назад
Welcome to 2025! 🎉 In this video, we dive into the exciting world of AI by exploring: Generative AI: How AI systems like ChatGPT create new content, including text, audio, and video. RAG (Retrieval-Augmented Generation): Learn how this cutting-edge architecture enables large language models (LLMs) to answer questions using your proprietary data. Agentic AI: Discover how intelligent agents can p...
Master Model Serving with Databricks
Просмотров 200День назад
🎅 Merry Christmas from Data Master Consulting! 🎅 We’re thrilled to announce the launch of Model Serving with Databricks, a unified service for deploying, governing, querying, and monitoring AI models. In this video, we’ll explore how Databricks enables seamless integration with foundational models like Meta Llama 3, DBRX, and BGE, as well as external providers like: ✅ Azure OpenAI ✅ AWS Bedrock...
Databricks Marketplace Secrets Nobody Tells You!
Просмотров 238День назад
Unlock the Power of Databricks Marketplace In this video, we explore Databricks Marketplace, an open marketplace designed for data, analytics, and AI, powered by the open-source Delta Sharing standard. Discover how this platform can help you: ✅ Access high-quality datasets for analytics and AI. ✅ Share data securely in real time. ✅ Drive innovation and accelerate your data initiatives. Whether ...
What is LangChain? Query Different LLMs in Databricks | Basics of LangChain in Databricks
Просмотров 34114 дней назад
In this video, we explore what LangChain is and how to query different LLMs such as OpenAI, foundational models (Databricks, LLAMA, Mistral, etc.), directly within Databricks using LangChain. We start with the basics of LangChain in Databricks, including classes like ChatOpenAI, ChatDatabricks, and more. 📚 Useful Resources: LangChain Databricks Documentation: python.langchain.com/docs/integrati...
AI Playground in Databricks
Просмотров 34114 дней назад
Welcome to our deep dive into the AI Playground in Databricks! 🚀 In this video, we explore how Databricks empowers data scientists, machine learning engineers, and developers with its cutting-edge Serving Endpoint and Playground capabilities. What You'll Learn: 📌 Serving Endpoint: How to deploy machine learning models seamlessly on Databricks. The benefits of scalable, production-grade endpoint...
Exploring Generative AI and LLMs with Databricks
Просмотров 44521 день назад
Welcome to the ultimate guide to Generative AI and Large Language Models (LLMs)! In this video, we’ll take a deep dive into the revolutionary technologies powering the AI boom. 🌟 Learn how AI tools like ChatGPT skyrocketed to 1 million users, setting a benchmark for innovation. 🔍 Understand the difference between open-source and proprietary (closed-source) AI models-what works best for your nee...
🌟 Transform Yourself into a Generative AI Engineer! 🌟
Просмотров 1,7 тыс.28 дней назад
Welcome to the ultimate RUclips playlist for mastering Databricks Generative AI with Data Master!🚀 ☕ Buy me a coffee: buymeacoffee.com/navalyemul Follow me on LinkedIn: www.linkedin.com/in/naval-yemul-a5803523/ In this series, I'll guide you through everything you need to know-from the basics of Generative AI and LLMs, LangChain to advanced topics like RAG (Retrieval-Augmented Generation), Agen...
Production-ready end-to-end DLT Pipeline | Databricks DLT
Просмотров 4,4 тыс.Месяц назад
In this continuation of our Delta Live Tables (DLT) series, we take a deep dive into advanced concepts and real-world applications. In this video we will cover Implementing Change Data Capture (CDC): Strategies to handle incremental data changes efficiently. Slowly Changing Dimensions (SCD): A detailed guide to managing SCD Type 1 and Type 2 in DLT pipelines. Optimizing DLT Pipelines: Best prac...
Advanced Delta Live Tables (DLT) Techniques in Databricks Part -2 | DLT SQL code
Просмотров 841Месяц назад
In this continuation of our Delta Live Tables (DLT) series, we take a deep dive into advanced concepts and real-world applications. Building on the fundamentals covered in Part 1, this episode Implementing Change Data Capture (CDC): Strategies to handle incremental data changes efficiently. Slowly Changing Dimensions (SCD): A detailed guide to managing SCD Type 1 and Type 2 in DLT pipelines. Op...
Deploy Databricks in AWS like a PRO in 2024!
Просмотров 241Месяц назад
Learn how to deploy Databricks in AWS like a pro in 2024 with this step-by-step tutorial. Master the process of setting up Databricks on AWS for your data processing needs! Databricks Link: ruclips.net/p/PL7S7dD8r4QdVzOYRzIG2UJdCaCasqBv1F Follow me on LinkedIn: www.linkedin.com/in/naval-yemul-a5803523/ #deploydatabricks #awsdatabricks #dataengineering #dataanalytics #databricks #awsdataengineer...
DLT on Databricks - A Beginner's Guide
Просмотров 768Месяц назад
In this podcast, we dive deep into Delta Live Tables (DLT) in Databricks, starting from the basics and advancing to complex topics like CDC (Change Data Capture) and SCD (Slowly Changing Dimensions) Type 1 and Type 2. In this Part 0 episode, you'll learn: Introduction to Databricks Delta Live Tables. 📌 Stay tuned for upcoming parts where we explore advanced use cases and features. 🔔 Subscribe n...
Mastering Databricks Delta Live Tables: End-to-End Implementation (Part 1)
Просмотров 1,5 тыс.Месяц назад
In this podcast, we dive deep into Delta Live Tables (DLT) in Databricks, starting from the basics and advancing to complex topics like CDC (Change Data Capture) and SCD (Slowly Changing Dimensions) Type 1 and Type 2. In this Part 1 episode, you'll learn: What Delta Live Tables are How to create a DLT pipeline Step-by-step implementation using a sample dataset from Databricks Why DLT is a game-...
How to Register for Databricks Certification Exam | Data Master
Просмотров 1,6 тыс.2 месяца назад
How to Register for Databricks Certification Exam | Data Master
Unlocking the Secrets of Data Access Control with Databricks
Просмотров 1,2 тыс.3 месяца назад
Unlocking the Secrets of Data Access Control with Databricks
Unifying Parameters across Databricks | Databricks SQL | Data Master
Просмотров 1,1 тыс.3 месяца назад
Unifying Parameters across Databricks | Databricks SQL | Data Master
Unlocking the Secrets of Data Access Control with Databricks
Просмотров 1,2 тыс.3 месяца назад
Unlocking the Secrets of Data Access Control with Databricks
Databricks Unity Catalog: The Ultimate Data Governance Solution (Now Open Source!) - Part 1
Просмотров 2,8 тыс.4 месяца назад
Databricks Unity Catalog: The Ultimate Data Governance Solution (Now Open Source!) - Part 1
Automating Databricks Workflows - A Game Changer for Data Engineering
Просмотров 2,6 тыс.5 месяцев назад
Automating Databricks Workflows - A Game Changer for Data Engineering
Databricks Real Time Project- Preparing for Production: Automating Databricks Notebook-Part 1
Просмотров 3,5 тыс.5 месяцев назад
Databricks Real Time Project- Preparing for Production: Automating Databricks Notebook-Part 1
Databricks SQL: Gen AI powered Data Warehousing
Просмотров 2,1 тыс.5 месяцев назад
Databricks SQL: Gen AI powered Data Warehousing
The Next Level of AI/BI is Here - Databricks Genie
Просмотров 2,3 тыс.6 месяцев назад
The Next Level of AI/BI is Here - Databricks Genie
Serverless compute for Databricks Notebooks/Workflow Jobs
Просмотров 1,8 тыс.6 месяцев назад
Serverless compute for Databricks Notebooks/Workflow Jobs
Creating Storage Credentials and External Locations in Databricks Unity Catalog
Просмотров 2 тыс.6 месяцев назад
Creating Storage Credentials and External Locations in Databricks Unity Catalog
Unlock $100 in Free Azure Credits
Просмотров 5907 месяцев назад
Unlock $100 in Free Azure Credits
5. Lakehouse Tutorial: Ingest data into Lakehouse
Просмотров 4137 месяцев назад
5. Lakehouse Tutorial: Ingest data into Lakehouse
4. Lakehouse Tutorial: Create a lakehouse, ingest sample data, and build a report.
Просмотров 5038 месяцев назад
4. Lakehouse Tutorial: Create a lakehouse, ingest sample data, and build a report.
1. How to Create an Azure OpenAI Service | Step-by-Step Guide
Просмотров 6248 месяцев назад
1. How to Create an Azure OpenAI Service | Step-by-Step Guide
Databricks Documentation| Azure Databricks docs | AWS Databricks docs
Просмотров 5389 месяцев назад
Databricks Documentation| Azure Databricks docs | AWS Databricks docs

Комментарии

  • @sravankumar1767
    @sravankumar1767 19 часов назад

    Superb explanation 👌 👏 👍

  • @ankitpurshottam3442
    @ankitpurshottam3442 День назад

    awesome boss clear explanation

  • @RafaelCamposrafiuskes
    @RafaelCamposrafiuskes 2 дня назад

    Thanks!

  • @velpulagopiredds9943
    @velpulagopiredds9943 2 дня назад

    Thank you Nava, I passed the exam with 98% , your playlist helped me a lot 😊

  • @kurapatikumar2296
    @kurapatikumar2296 3 дня назад

    Very nice explanation about RAG

  • @SpiritOfIndiaaa
    @SpiritOfIndiaaa 4 дня назад

    Good

  • @shanmukhpriya
    @shanmukhpriya 4 дня назад

    U r rockstar sir

  • @yash-drive
    @yash-drive 4 дня назад

    Great work ,Thank you so much

  • @RameshKumar-ng3nf
    @RameshKumar-ng3nf 6 дней назад

    Bro, what is the type of cluster you using for Delta Live tables ? Is this a special cluster or the general purpose cluster we using for Delta live tables ?

  • @patrickcastro5706
    @patrickcastro5706 6 дней назад

    Thanks for the video. Which objects were created in your AWS tenant-side? I'm trying to understand how much it'll cost before starting a classic compute test.

  • @sandeepjella1743
    @sandeepjella1743 6 дней назад

    Congratulations Naval

  • @Shahnawaz_Ansari_
    @Shahnawaz_Ansari_ 9 дней назад

    Congratulations 💐

  • @samba823
    @samba823 9 дней назад

    Hello Naval, thank you so much for creating your videos crisp and clear. Your videos helped me a lot in clearing my Associate Data engineer exam today with 92%. Every detail you covered in your videos are a must watch and worth watching. Most importantly, your explanation is very clear with no confusion. Thank you much once again.

  • @ridhwanjamal8427
    @ridhwanjamal8427 9 дней назад

    Please share video about iceberg with Snowflake and compare iceberg snowflake vs delta databricks

  • @abhisheknigam3768
    @abhisheknigam3768 10 дней назад

    please upload more videos. Thank you.

  • @AshishYadav__38
    @AshishYadav__38 10 дней назад

    27:12 i think the correct answer for Q12 is option E (view)

  • @madireteja7859
    @madireteja7859 11 дней назад

    Thank you so much for this video. It helped me a lot...

  • @LelePennie
    @LelePennie 11 дней назад

    Thanks for sharing such valuable information! Could you help me with something unrelated: I have a SafePal wallet with USDT, and I have the seed phrase. (alarm fetch churn bridge exercise tape speak race clerk couch crater letter). Could you explain how to move them to Binance?

  • @shyamsundar-lf8xc
    @shyamsundar-lf8xc 13 дней назад

    Hi sir, can you make a video on how to implement the same in streamlit within databricks using apps

  • @pratikgugliya3771
    @pratikgugliya3771 15 дней назад

    Very informative video. Thank you @Naval Sir.

  • @sureshraina321
    @sureshraina321 16 дней назад

    Hi Sir, not aware of creating the secret key with open AI. Would be very helpful to create a new session for that. Thank you

    • @thedatamaster
      @thedatamaster 14 дней назад

      I'm glad you brought that up! I'll consider making a separate video on OpenAI API key creation.

    • @sureshraina321
      @sureshraina321 14 дней назад

      @thedatamaster Thank you sir

  • @abhisheknigam3768
    @abhisheknigam3768 17 дней назад

    Good work, thanks for sharing.

  • @joshuaknight2637
    @joshuaknight2637 17 дней назад

    Calendar by Tallan is a very nice visual! Lots of customization options for it too.

  • @rafisyed3836
    @rafisyed3836 17 дней назад

    I am 40 years old. I am working in non IT job with low salary and fall into debts. Is it possible for me to get into IT Sector? Which domain has possible to geta job. Is it coding is must to get high paying job.pls guide

  • @kavadianil
    @kavadianil 18 дней назад

    Naval.. Can you please record one more video on managed and external Delta table? bcz your previous video has problem where i couldn't understand

  • @sumairkhan9536
    @sumairkhan9536 19 дней назад

    Hi, You work is really remarkable. Appreciate it. I am doing this project in databricks 14 days prenium trial. And I am using Azure free trail. I am getting an error while validating "the quota error" Can we do this azure free trial subscription. Hope your reply soon. Thanks Sumair

    • @nikhilsahu4159
      @nikhilsahu4159 13 дней назад

      Try to create a cluster with 1DBU/hour or zero worker nodes.

  • @ridhwanjamal8427
    @ridhwanjamal8427 19 дней назад

    Thank you sir for your explanation. Can you please add video about about iceberg and how it works and how it differs with delta lake

  • @nevil.09
    @nevil.09 19 дней назад

    Very nicely explained. Keep uploading such informative videos!

    • @thedatamaster
      @thedatamaster 19 дней назад

      Thank you for the kind words! More videos are coming soon.

  • @alakmarshafin9065
    @alakmarshafin9065 20 дней назад

    Awesome, please upload more in series.

    • @thedatamaster
      @thedatamaster 20 дней назад

      Thanks for the suggestion! More videos are coming soon.

  • @abhisheknigam3768
    @abhisheknigam3768 20 дней назад

    Thank you. Please upload more video in this series.

    • @thedatamaster
      @thedatamaster 20 дней назад

      You're very welcome! More videos are coming soon.

  • @abhisheknigam3768
    @abhisheknigam3768 21 день назад

    Very informative video. Please make more videos in this series.

    • @thedatamaster
      @thedatamaster 21 день назад

      Thank you so much for your kind words.

  • @manjunathb.n7465
    @manjunathb.n7465 22 дня назад

    Please make end to end projects

  • @gchandra007
    @gchandra007 22 дня назад

    Direct Publishing Mode coming soon, that will enable to create ST, MV across multiple Schemas.

  • @naren06938
    @naren06938 22 дня назад

    Bit advance than GCP BigQuery, Almost simlar to that

  • @naren06938
    @naren06938 22 дня назад

    Only 5 videos in this Fabric from 1 year...plss complete full series bro

  • @gchandra007
    @gchandra007 23 дня назад

    Nice job Naval.

  • @aselb3899
    @aselb3899 23 дня назад

    Hello, Databrick DBC Files Link is not accessible. Can I have that Naval ?

  • @akila1642
    @akila1642 23 дня назад

    with azure free trial my pipeline kept processing on "waiting for resources" stage only.any parameter need to checked?

  • @MichailSikorski
    @MichailSikorski 25 дней назад

    Are you preparing videos for Databricks Data Engineer Profesional certification? I would swear that I saw first part of it before, but I can not find it now?

  • @shivakrishna-b2h
    @shivakrishna-b2h 25 дней назад

    Than you so much. can you show how to deploy jar file.

  • @sureshraina321
    @sureshraina321 25 дней назад

    Thank you for making this video

  • @EvaHaiden
    @EvaHaiden 25 дней назад

    Naval, your videos are sooo helpful for preparing for the exam. I am so glad I found this.

    • @thedatamaster
      @thedatamaster 19 дней назад

      You're welcome! Good luck with the exam!

  • @Atroxx393
    @Atroxx393 26 дней назад

    Hello, can you provide the Excel files that you use in this project? Thank you in advance

    • @thedatamaster
      @thedatamaster 26 дней назад

      You can find the DBC and SQL code files, along with the raw datasets, at this link: drive.google.com/drive/folders/1CR7csIkF6UF1ir4c74Fea7g2d2xSKut1?usp=sharing

  • @karthikeyan9592
    @karthikeyan9592 27 дней назад

    Thanks for the content. Great

  • @prabhathkota107
    @prabhathkota107 27 дней назад

    Very nice info, helped me in understanding streaming

    • @thedatamaster
      @thedatamaster 26 дней назад

      Glad it helped! Thanks for watching.

  • @suman3316
    @suman3316 28 дней назад

    Thank you..was waiting for it...

    • @thedatamaster
      @thedatamaster 26 дней назад

      Thanks for waiting! Hope it was worth it!

  • @sureshraina321
    @sureshraina321 28 дней назад

    Super Excited ❤ Thanks 👍

    • @thedatamaster
      @thedatamaster 26 дней назад

      Glad you're excited! Thanks for the support! ❤

  • @prathapganesh7021
    @prathapganesh7021 28 дней назад

    Excellent thank you so much

  • @amitjaju9060
    @amitjaju9060 28 дней назад

    Hello Sir, I liked your video on DLT. Thank you so much. I have 1 query. Currently we have 2 DLT pipeline , 1st read the data from blob storage and write data into RAW layer while 2nd read the data from Raw layer and load into Silver layer . 1st DLT using pyspark code with overwrite operation while 2nd DLT is using pyspark code and using FULL REFESH ALL method so overall both DLT is truncate & load . The table type is Metalized view in which backend table is DELTA table with External type where data is stored in different ADLS storage location. Now I want to replace from Hive_Metastore to Unity Catalog so which change do I need to do and How I can ensure that backend table should be Delta external table where data will stored in ADLS location. Do I need to explicitly create the table under Unity Catalog with required location or by modifying the DLT setting to Unity Catalog do I also need to select schema? Could you please help me with this.

  • @pradeepbhuyan
    @pradeepbhuyan 29 дней назад

    Love the content.

    • @thedatamaster
      @thedatamaster 26 дней назад

      Thank you so much! I'm glad you’re enjoying the content!