- Видео 348
- Просмотров 621 652
The Data Master
Индия
Добавлен 8 сен 2012
Never stop Learning as Life never stops Teaching.
Mastering Workspaces in Microsoft Fabric and Power BI: Collaboration Made Easy
Follow me on LinkedIn:
www.linkedin.com/in/naval-yemul-a5803523/
🎉 Introduction to Microsoft Fabric:
Imagine a single platform that unites all your data, analytics, and business intelligence needs. That’s Microsoft Fabric! It’s a comprehensive, end-to-end data platform that integrates data engineering, data science, real-time analytics, and business intelligence into a single ecosystem. With Fabric, you can transform raw data into actionable insights faster than ever.
📊 Workspaces in Microsoft Fabric and Power BI:
At the heart of Microsoft Fabric lies Workspaces-your collaborative hub for organizing and managing data projects. Think of it as a digital control room where your team works togeth...
www.linkedin.com/in/naval-yemul-a5803523/
🎉 Introduction to Microsoft Fabric:
Imagine a single platform that unites all your data, analytics, and business intelligence needs. That’s Microsoft Fabric! It’s a comprehensive, end-to-end data platform that integrates data engineering, data science, real-time analytics, and business intelligence into a single ecosystem. With Fabric, you can transform raw data into actionable insights faster than ever.
📊 Workspaces in Microsoft Fabric and Power BI:
At the heart of Microsoft Fabric lies Workspaces-your collaborative hub for organizing and managing data projects. Think of it as a digital control room where your team works togeth...
Просмотров: 21
Видео
Mosaic AI Model Serving EXPERT Shares Top LLM Integration Secrets
Просмотров 572 часа назад
Explore how to leverage external models in Databricks Mosaic AI Model Serving! 🎯 Learn how Databricks supports third-party large language models (LLMs) like OpenAI and Anthropic to streamline model usage and management within your organization. Discover how Mosaic AI Model Serving simplifies interactions with LLM providers using a unified endpoint, supports custom models with rate limits, and e...
Generative AI, RAG, and Agentic AI Explained | Start Your AI Journey in 2025!
Просмотров 3249 часов назад
Welcome to 2025! 🎉 In this video, we dive into the exciting world of AI by exploring: Generative AI: How AI systems like ChatGPT create new content, including text, audio, and video. RAG (Retrieval-Augmented Generation): Learn how this cutting-edge architecture enables large language models (LLMs) to answer questions using your proprietary data. Agentic AI: Discover how intelligent agents can p...
Master Model Serving with Databricks
Просмотров 200День назад
🎅 Merry Christmas from Data Master Consulting! 🎅 We’re thrilled to announce the launch of Model Serving with Databricks, a unified service for deploying, governing, querying, and monitoring AI models. In this video, we’ll explore how Databricks enables seamless integration with foundational models like Meta Llama 3, DBRX, and BGE, as well as external providers like: ✅ Azure OpenAI ✅ AWS Bedrock...
Databricks Marketplace Secrets Nobody Tells You!
Просмотров 238День назад
Unlock the Power of Databricks Marketplace In this video, we explore Databricks Marketplace, an open marketplace designed for data, analytics, and AI, powered by the open-source Delta Sharing standard. Discover how this platform can help you: ✅ Access high-quality datasets for analytics and AI. ✅ Share data securely in real time. ✅ Drive innovation and accelerate your data initiatives. Whether ...
What is LangChain? Query Different LLMs in Databricks | Basics of LangChain in Databricks
Просмотров 34114 дней назад
In this video, we explore what LangChain is and how to query different LLMs such as OpenAI, foundational models (Databricks, LLAMA, Mistral, etc.), directly within Databricks using LangChain. We start with the basics of LangChain in Databricks, including classes like ChatOpenAI, ChatDatabricks, and more. 📚 Useful Resources: LangChain Databricks Documentation: python.langchain.com/docs/integrati...
AI Playground in Databricks
Просмотров 34114 дней назад
Welcome to our deep dive into the AI Playground in Databricks! 🚀 In this video, we explore how Databricks empowers data scientists, machine learning engineers, and developers with its cutting-edge Serving Endpoint and Playground capabilities. What You'll Learn: 📌 Serving Endpoint: How to deploy machine learning models seamlessly on Databricks. The benefits of scalable, production-grade endpoint...
Exploring Generative AI and LLMs with Databricks
Просмотров 44521 день назад
Welcome to the ultimate guide to Generative AI and Large Language Models (LLMs)! In this video, we’ll take a deep dive into the revolutionary technologies powering the AI boom. 🌟 Learn how AI tools like ChatGPT skyrocketed to 1 million users, setting a benchmark for innovation. 🔍 Understand the difference between open-source and proprietary (closed-source) AI models-what works best for your nee...
🌟 Transform Yourself into a Generative AI Engineer! 🌟
Просмотров 1,7 тыс.28 дней назад
Welcome to the ultimate RUclips playlist for mastering Databricks Generative AI with Data Master!🚀 ☕ Buy me a coffee: buymeacoffee.com/navalyemul Follow me on LinkedIn: www.linkedin.com/in/naval-yemul-a5803523/ In this series, I'll guide you through everything you need to know-from the basics of Generative AI and LLMs, LangChain to advanced topics like RAG (Retrieval-Augmented Generation), Agen...
Production-ready end-to-end DLT Pipeline | Databricks DLT
Просмотров 4,4 тыс.Месяц назад
In this continuation of our Delta Live Tables (DLT) series, we take a deep dive into advanced concepts and real-world applications. In this video we will cover Implementing Change Data Capture (CDC): Strategies to handle incremental data changes efficiently. Slowly Changing Dimensions (SCD): A detailed guide to managing SCD Type 1 and Type 2 in DLT pipelines. Optimizing DLT Pipelines: Best prac...
Advanced Delta Live Tables (DLT) Techniques in Databricks Part -2 | DLT SQL code
Просмотров 841Месяц назад
In this continuation of our Delta Live Tables (DLT) series, we take a deep dive into advanced concepts and real-world applications. Building on the fundamentals covered in Part 1, this episode Implementing Change Data Capture (CDC): Strategies to handle incremental data changes efficiently. Slowly Changing Dimensions (SCD): A detailed guide to managing SCD Type 1 and Type 2 in DLT pipelines. Op...
Deploy Databricks in AWS like a PRO in 2024!
Просмотров 241Месяц назад
Learn how to deploy Databricks in AWS like a pro in 2024 with this step-by-step tutorial. Master the process of setting up Databricks on AWS for your data processing needs! Databricks Link: ruclips.net/p/PL7S7dD8r4QdVzOYRzIG2UJdCaCasqBv1F Follow me on LinkedIn: www.linkedin.com/in/naval-yemul-a5803523/ #deploydatabricks #awsdatabricks #dataengineering #dataanalytics #databricks #awsdataengineer...
DLT on Databricks - A Beginner's Guide
Просмотров 768Месяц назад
In this podcast, we dive deep into Delta Live Tables (DLT) in Databricks, starting from the basics and advancing to complex topics like CDC (Change Data Capture) and SCD (Slowly Changing Dimensions) Type 1 and Type 2. In this Part 0 episode, you'll learn: Introduction to Databricks Delta Live Tables. 📌 Stay tuned for upcoming parts where we explore advanced use cases and features. 🔔 Subscribe n...
Mastering Databricks Delta Live Tables: End-to-End Implementation (Part 1)
Просмотров 1,5 тыс.Месяц назад
In this podcast, we dive deep into Delta Live Tables (DLT) in Databricks, starting from the basics and advancing to complex topics like CDC (Change Data Capture) and SCD (Slowly Changing Dimensions) Type 1 and Type 2. In this Part 1 episode, you'll learn: What Delta Live Tables are How to create a DLT pipeline Step-by-step implementation using a sample dataset from Databricks Why DLT is a game-...
How to Register for Databricks Certification Exam | Data Master
Просмотров 1,6 тыс.2 месяца назад
How to Register for Databricks Certification Exam | Data Master
Unlocking the Secrets of Data Access Control with Databricks
Просмотров 1,2 тыс.3 месяца назад
Unlocking the Secrets of Data Access Control with Databricks
Unifying Parameters across Databricks | Databricks SQL | Data Master
Просмотров 1,1 тыс.3 месяца назад
Unifying Parameters across Databricks | Databricks SQL | Data Master
Unlocking the Secrets of Data Access Control with Databricks
Просмотров 1,2 тыс.3 месяца назад
Unlocking the Secrets of Data Access Control with Databricks
Databricks Unity Catalog: The Ultimate Data Governance Solution (Now Open Source!) - Part 1
Просмотров 2,8 тыс.4 месяца назад
Databricks Unity Catalog: The Ultimate Data Governance Solution (Now Open Source!) - Part 1
Automating Databricks Workflows - A Game Changer for Data Engineering
Просмотров 2,6 тыс.5 месяцев назад
Automating Databricks Workflows - A Game Changer for Data Engineering
Databricks Real Time Project- Preparing for Production: Automating Databricks Notebook-Part 1
Просмотров 3,5 тыс.5 месяцев назад
Databricks Real Time Project- Preparing for Production: Automating Databricks Notebook-Part 1
Databricks SQL: Gen AI powered Data Warehousing
Просмотров 2,1 тыс.5 месяцев назад
Databricks SQL: Gen AI powered Data Warehousing
The Next Level of AI/BI is Here - Databricks Genie
Просмотров 2,3 тыс.6 месяцев назад
The Next Level of AI/BI is Here - Databricks Genie
Serverless compute for Databricks Notebooks/Workflow Jobs
Просмотров 1,8 тыс.6 месяцев назад
Serverless compute for Databricks Notebooks/Workflow Jobs
Creating Storage Credentials and External Locations in Databricks Unity Catalog
Просмотров 2 тыс.6 месяцев назад
Creating Storage Credentials and External Locations in Databricks Unity Catalog
5. Lakehouse Tutorial: Ingest data into Lakehouse
Просмотров 4137 месяцев назад
5. Lakehouse Tutorial: Ingest data into Lakehouse
4. Lakehouse Tutorial: Create a lakehouse, ingest sample data, and build a report.
Просмотров 5038 месяцев назад
4. Lakehouse Tutorial: Create a lakehouse, ingest sample data, and build a report.
1. How to Create an Azure OpenAI Service | Step-by-Step Guide
Просмотров 6248 месяцев назад
1. How to Create an Azure OpenAI Service | Step-by-Step Guide
Databricks Documentation| Azure Databricks docs | AWS Databricks docs
Просмотров 5389 месяцев назад
Databricks Documentation| Azure Databricks docs | AWS Databricks docs
Superb explanation 👌 👏 👍
awesome boss clear explanation
Thanks!
Thank you Nava, I passed the exam with 98% , your playlist helped me a lot 😊
Very nice explanation about RAG
Good
U r rockstar sir
Great work ,Thank you so much
Bro, what is the type of cluster you using for Delta Live tables ? Is this a special cluster or the general purpose cluster we using for Delta live tables ?
Thanks for the video. Which objects were created in your AWS tenant-side? I'm trying to understand how much it'll cost before starting a classic compute test.
Congratulations Naval
Congratulations 💐
Hello Naval, thank you so much for creating your videos crisp and clear. Your videos helped me a lot in clearing my Associate Data engineer exam today with 92%. Every detail you covered in your videos are a must watch and worth watching. Most importantly, your explanation is very clear with no confusion. Thank you much once again.
Please share video about iceberg with Snowflake and compare iceberg snowflake vs delta databricks
please upload more videos. Thank you.
27:12 i think the correct answer for Q12 is option E (view)
Thank you so much for this video. It helped me a lot...
Thanks for sharing such valuable information! Could you help me with something unrelated: I have a SafePal wallet with USDT, and I have the seed phrase. (alarm fetch churn bridge exercise tape speak race clerk couch crater letter). Could you explain how to move them to Binance?
Hi sir, can you make a video on how to implement the same in streamlit within databricks using apps
Very informative video. Thank you @Naval Sir.
Thank you for the kind words!
Hi Sir, not aware of creating the secret key with open AI. Would be very helpful to create a new session for that. Thank you
I'm glad you brought that up! I'll consider making a separate video on OpenAI API key creation.
@thedatamaster Thank you sir
Good work, thanks for sharing.
Thanks for watching!
Calendar by Tallan is a very nice visual! Lots of customization options for it too.
I am 40 years old. I am working in non IT job with low salary and fall into debts. Is it possible for me to get into IT Sector? Which domain has possible to geta job. Is it coding is must to get high paying job.pls guide
Naval.. Can you please record one more video on managed and external Delta table? bcz your previous video has problem where i couldn't understand
Hi, You work is really remarkable. Appreciate it. I am doing this project in databricks 14 days prenium trial. And I am using Azure free trail. I am getting an error while validating "the quota error" Can we do this azure free trial subscription. Hope your reply soon. Thanks Sumair
Try to create a cluster with 1DBU/hour or zero worker nodes.
Thank you sir for your explanation. Can you please add video about about iceberg and how it works and how it differs with delta lake
Very nicely explained. Keep uploading such informative videos!
Thank you for the kind words! More videos are coming soon.
Awesome, please upload more in series.
Thanks for the suggestion! More videos are coming soon.
Thank you. Please upload more video in this series.
You're very welcome! More videos are coming soon.
Very informative video. Please make more videos in this series.
Thank you so much for your kind words.
Please make end to end projects
Direct Publishing Mode coming soon, that will enable to create ST, MV across multiple Schemas.
Bit advance than GCP BigQuery, Almost simlar to that
Only 5 videos in this Fabric from 1 year...plss complete full series bro
Nice job Naval.
Appreciate the feedback!
Hello, Databrick DBC Files Link is not accessible. Can I have that Naval ?
with azure free trial my pipeline kept processing on "waiting for resources" stage only.any parameter need to checked?
Are you preparing videos for Databricks Data Engineer Profesional certification? I would swear that I saw first part of it before, but I can not find it now?
Than you so much. can you show how to deploy jar file.
Thank you for making this video
You're very welcome!
Naval, your videos are sooo helpful for preparing for the exam. I am so glad I found this.
You're welcome! Good luck with the exam!
Hello, can you provide the Excel files that you use in this project? Thank you in advance
You can find the DBC and SQL code files, along with the raw datasets, at this link: drive.google.com/drive/folders/1CR7csIkF6UF1ir4c74Fea7g2d2xSKut1?usp=sharing
Thanks for the content. Great
Thank you for your kind words!
Very nice info, helped me in understanding streaming
Glad it helped! Thanks for watching.
Thank you..was waiting for it...
Thanks for waiting! Hope it was worth it!
Super Excited ❤ Thanks 👍
Glad you're excited! Thanks for the support! ❤
Excellent thank you so much
Glad you found it helpful!
Hello Sir, I liked your video on DLT. Thank you so much. I have 1 query. Currently we have 2 DLT pipeline , 1st read the data from blob storage and write data into RAW layer while 2nd read the data from Raw layer and load into Silver layer . 1st DLT using pyspark code with overwrite operation while 2nd DLT is using pyspark code and using FULL REFESH ALL method so overall both DLT is truncate & load . The table type is Metalized view in which backend table is DELTA table with External type where data is stored in different ADLS storage location. Now I want to replace from Hive_Metastore to Unity Catalog so which change do I need to do and How I can ensure that backend table should be Delta external table where data will stored in ADLS location. Do I need to explicitly create the table under Unity Catalog with required location or by modifying the DLT setting to Unity Catalog do I also need to select schema? Could you please help me with this.
Love the content.
Thank you so much! I'm glad you’re enjoying the content!