- Видео 73
- Просмотров 973 019
Mr. K Talks Tech
Индия
Добавлен 27 дек 2022
Hello Everyone,
Mr. K is a passionate teacher created this channel for only one goal "TO HELP PEOPLE LEARN THE MODERN DATA PLATFORM SOLUTIONS USING CLOUD TECHNOLOGIES"
I will be creating playlist which covers the below topics (with DEMO)
1. Azure Beginner Tutorials
2. Azure Data Factory
3. Azure Synapse Analytics
4. Azure Databricks
5. Microsoft Power BI
6. Azure Data Lake Gen2
7. Azure DevOps
8. GitHub (and several other topics)
After creating some basic foundational videos, I will be creating some of the videos with the real time scenarios / use case specific to the three common Data Fields,
1. Data Engineer
2. Data Analyst and
3. Data Scientist
Can't wait to help people with my videos. Stay tuned!
For contact:
Email: mrktalkstech@gmail.com
Mr. K is a passionate teacher created this channel for only one goal "TO HELP PEOPLE LEARN THE MODERN DATA PLATFORM SOLUTIONS USING CLOUD TECHNOLOGIES"
I will be creating playlist which covers the below topics (with DEMO)
1. Azure Beginner Tutorials
2. Azure Data Factory
3. Azure Synapse Analytics
4. Azure Databricks
5. Microsoft Power BI
6. Azure Data Lake Gen2
7. Azure DevOps
8. GitHub (and several other topics)
After creating some basic foundational videos, I will be creating some of the videos with the real time scenarios / use case specific to the three common Data Fields,
1. Data Engineer
2. Data Analyst and
3. Data Scientist
Can't wait to help people with my videos. Stay tuned!
For contact:
Email: mrktalkstech@gmail.com
Part- 8 (Data Reporting using Power BI)- End to End Streaming Azure Data Engineering Project
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through how to load the weather data from Event HUB to KQL DB using Fabric's Event Stream Pipeline.
Download the code from here: buymeacoffee.com/mrktalkstech/e/333857
Support me for my work :) Please Like, Share and Subscribe to my YT channel :)
#DataEngineering #AzureDatabricks #AzureFunctions #EventHub #MicrosoftFabric #RealTimeData #StreamingData #PowerBI #KustoDB #DataActivator #CloudData #WeatherData #EndToEndProject #DataIngestion #DataPipeline #AzureEventHub #RealTimeAlerts
Join this channel to get access to perks:
ruclips.net/channel/UCzdOan4AmF65PmLLks8Lmww...
Download the code from here: buymeacoffee.com/mrktalkstech/e/333857
Support me for my work :) Please Like, Share and Subscribe to my YT channel :)
#DataEngineering #AzureDatabricks #AzureFunctions #EventHub #MicrosoftFabric #RealTimeData #StreamingData #PowerBI #KustoDB #DataActivator #CloudData #WeatherData #EndToEndProject #DataIngestion #DataPipeline #AzureEventHub #RealTimeAlerts
Join this channel to get access to perks:
ruclips.net/channel/UCzdOan4AmF65PmLLks8Lmww...
Просмотров: 717
Видео
Part- 7 (Event Processing and Loading)- End to End Streaming Azure Data Engineering Project
Просмотров 74714 дней назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through how to load the weather data from Event HUB to KQL DB using Fabric's Event Stream Pipeline. Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #Azu...
Part- 6 (Cost Analysis and Architectural decisions)- End to End Streaming Data Engineering Project
Просмотров 96228 дней назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #AzureDat...
Part- 5 (Data Ingestion using Azure Functions)- End to End Streaming Azure Data Engineering Project
Просмотров 1,3 тыс.Месяц назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #AzureDat...
Part- 4 (Data Ingestion using Azure Databricks)- End to End Streaming Azure Data Engineering Project
Просмотров 2,4 тыс.2 месяца назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #AzureDat...
Part- 3 (Data Ingestion using Azure Databricks)- End to End Streaming Azure Data Engineering Project
Просмотров 2,8 тыс.2 месяца назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB #DataEngineering #AzureDatabricks #AzureFunctions #EventHub #MicrosoftFabric #RealTimeData #StreamingData #PowerBI #KustoDB #DataActivator #CloudData #WeatherData #EndToEndP...
Part 2- End to End Realtime Streaming Azure Data Engineering Project (Environment Setup)
Просмотров 4,4 тыс.2 месяца назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the entire environment setup process, covering all the essential resources we’ll use to build a real-time weather reporting system using Azure services and Microsoft Fabric. TimeStamp: 0:00:00 - Setting up the Weather API 0:03:58 - Creating Resource Group 0:07...
End to End Realtime Streaming Azure Data Engineering Project (Part -1) | Complete Guide with Demo
Просмотров 9 тыс.3 месяца назад
Welcome to an exciting session where we'll build a real-time streaming Data Engineering project using Azure services! This is one of the best ways to get hands-on experience with real-time streaming while understanding architectural decision-making for cost and performance optimization. In this project, we’ll: - Set up a real-time weather report system using Weather API - Implement data ingesti...
6 Proven Steps to Land a Data Engineer Job with ZERO Experience (Even as a Fresher!)
Просмотров 6 тыс.4 месяца назад
#dataengineering #azuredataengineering #aws #gcp #jobs In this video, I have explained 6 important steps that will help you to get hired as a Data Engineer. This is probably the most asked question to me, and that's the reason I decided to make a video on this topic. I hope this is helpful. Please let me know if you have any questions in the comment section. - - - Book a Private One on One Meet...
Must-Know PySpark Interview Question for Data Engineers - Live Demo & Tips!
Просмотров 4,2 тыс.4 месяца назад
#ApacheSpark #DataEngineering #AzureDataEngineer #SparkSQL #DataTransformation #DataFrame #InterviewQuestion #BigData #AzureDatabricks #PySpark #DataAnalysis #DataScience #SQLQuery #Optimization #Efficiency #Tutorial In this video, we'll dive into a popular PySpark interview question often asked by financial and banking companies-calculating the running total for grouped data. We'll explore the...
What is Apache Spark? Learn Apache Spark in 15 Minutes
Просмотров 12 тыс.5 месяцев назад
#apachespark #databricks #sparkteam #dataengineering #pyspark #architecture In this video, I have covered the most important topic of Data Engineer which is "Apache Spark". Especially, I have talked about the complete end to end Architecture of Spark Spark covering all the individual components as below, 1. Driver Programme 2. Worker Node 3. Cluster Manager 4. Spark Context or Spark Session 5. ...
Data Engineer's Biggest Nightmare: Solving Merge Conflicts Step-by-Step Guide with Demo
Просмотров 2,4 тыс.5 месяцев назад
#AzureDevOps #Git #DataEngineering #InterviewQuestions #DevOpsTutorial #AzureDatabricks #GitRevert #BranchRecovery #CodingBestPractices #TechInterviewTips #MergeConflicts 🔍 What We'll Cover: In this video, we dive into a crucial topic for every Data Engineer: Merge Conflicts. Merge conflicts are one of the most common issues encountered when working collaboratively with Git repositories. Unders...
Untold secrets of Data Engineering Project !!! Reality and Facts in 15 minutes
Просмотров 10 тыс.6 месяцев назад
Untold secrets of Data Engineering Project !!! Reality and Facts in 15 minutes
Don't fail to answer these questions in your next Interview- Data Engineering Interview Question
Просмотров 3,7 тыс.6 месяцев назад
Don't fail to answer these questions in your next Interview- Data Engineering Interview Question
Tips and Tricks- Delta Lake Table in Apache Spark - Azure Data Engineering Interview Question
Просмотров 6 тыс.7 месяцев назад
Tips and Tricks- Delta Lake Table in Apache Spark - Azure Data Engineering Interview Question
Can you solve this simple Spark SQL Interview Question? | Azure Data Engineering Tutorials
Просмотров 2,3 тыс.7 месяцев назад
Can you solve this simple Spark SQL Interview Question? | Azure Data Engineering Tutorials
15 Minutes- Libraries in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Просмотров 3,5 тыс.7 месяцев назад
15 Minutes- Libraries in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Azure Synapse Analytics- Interview Questions | Serverless SQL Pool VS Dedicated SQL Pool with Demo
Просмотров 6 тыс.8 месяцев назад
Azure Synapse Analytics- Interview Questions | Serverless SQL Pool VS Dedicated SQL Pool with Demo
Most popular Data Warehousing Interview Question- Azure Data Engineering Interview Question Tutorial
Просмотров 3,6 тыс.9 месяцев назад
Most popular Data Warehousing Interview Question- Azure Data Engineering Interview Question Tutorial
90% of Data Engineers doesn't know this - PySpark Azure Data Engineering Interview Question Tutorial
Просмотров 6 тыс.9 месяцев назад
90% of Data Engineers doesn't know this - PySpark Azure Data Engineering Interview Question Tutorial
Tips and Tricks- Azure Data Engineering Interview Questions | Managed Identity vs Service Principal
Просмотров 14 тыс.9 месяцев назад
Tips and Tricks- Azure Data Engineering Interview Questions | Managed Identity vs Service Principal
Microsoft Fabric - End to End Azure Data Engineering Project - Bing news Data Analytics
Просмотров 32 тыс.11 месяцев назад
Microsoft Fabric - End to End Azure Data Engineering Project - Bing news Data Analytics
Data Engineer Roadmap 2025 (A complete 6 Months Plan Guide) | Azure Data Engineer Roadmap 2025
Просмотров 27 тыс.Год назад
Data Engineer Roadmap 2025 (A complete 6 Months Plan Guide) | Azure Data Engineer Roadmap 2025
Unlocking Secrets in Azure Databricks with Azure Key Vault! 🗝️✨ | Azure Databricks Tutorials
Просмотров 9 тыс.Год назад
Unlocking Secrets in Azure Databricks with Azure Key Vault! 🗝️✨ | Azure Databricks Tutorials
Top 5 Notebook Features You Can't Miss in Azure Databricks 🚀| Databricks and Azure DevOps Tutorials
Просмотров 4,1 тыс.Год назад
Top 5 Notebook Features You Can't Miss in Azure Databricks 🚀| Databricks and Azure DevOps Tutorials
15 Minutes- Spark Clusters in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Просмотров 23 тыс.Год назад
15 Minutes- Spark Clusters in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Part 1- What is CI/CD? - Continuous Integration and Continuous Deployment in Azure Databricks Demo
Просмотров 32 тыс.Год назад
Part 1- What is CI/CD? - Continuous Integration and Continuous Deployment in Azure Databricks Demo
Create your first Data Ingestion Pipeline in Microsoft Fabric | Microsoft Fabric Tutorials
Просмотров 9 тыс.Год назад
Create your first Data Ingestion Pipeline in Microsoft Fabric | Microsoft Fabric Tutorials
Sending ADF Pipeline alerts to Microsoft Teams Demo | Azure Data Factory Tutorials for Beginners
Просмотров 7 тыс.Год назад
Sending ADF Pipeline alerts to Microsoft Teams Demo | Azure Data Factory Tutorials for Beginners
How to create Azure Databricks? Explained Easy | Azure Databricks Tutorials for Beginners
Просмотров 4,5 тыс.Год назад
How to create Azure Databricks? Explained Easy | Azure Databricks Tutorials for Beginners
Great content thanks for sharing
Fabric free trail is not working, did anyone face this issue? I have created a fabric account and activated the trail version, it’s stating the days left at the top but the trail mode is disabled. I have tried enabling it in tenant settings but still the same issue..any work around for this please?
Great To Go!
where is the rest of the video in english on ci cd, i can see playlist in Tamil which i can't understand
How many videos are left in this series? Sir😊
Excellent !! thank you for the explanation!! Thats Y I subscribed n became member to your channel!!
Brilliant! Thank you. Question, is the Notebook with the code available on GitHub?
Thanks for the video sir guys please download this playlist idk when sir also make it member exclusive only live other playlist
Great videos
Can you please consider making a series on creating an azure data factory dev and prod environments along with configuring git for these from the scratch. I believe it brings more practicality in your videos . Hope you consider the request.
Very informative video. When is the next video coming?
8:42 i have created an app as service principal and gave permission to access keyvault and also attached with databricks Still is says permission denied. Should i have to give permission(kv-officer) to inbuilt service principal? Like u did. Is this normal?
Wonderful explanation
Would this work if I have a different account for fabric than one that I have used for azure?
Yes, it should work :)
Hi sir please bring a azure batch processing etl project
Sure, will do :)
Thank you! It was super helpful :)
Excellent and one of the best explanation of spark architecture...
Thanks for this explanation, but as u know this solution is no longer available, bcause of the retirement of microsoft connectors office 365, do you have any ideas about the new solution on the power automate workflows?
I am not able to see the playlist of the video after the second video.
Why removed videos from this playlist?
The azure services which is used in environment setup is allowing in free trial account or i have to pay some amount of money to set the environment ,please confirm ?
really it is the an amazing explanation video of CI/CD . Thank you very much for your excellent explanation. I will follow you and see all your interesting video. Appreciated Sir
Just one '\' also will decide Interview cracked or not?😮😢
How many videos can we expect for this project? Sir please reply 😊
if i buy udemy i can do and get the knowledge of this project sir?
Good for that hidden videos. Now someone can sell your videos as course more than udemy price. your dam good to took wrong decision.
@mr.ktalkstech Hey Sir, I thought i have azure ci/cd azure devops videos in members only on youtube but is not there. I am going to pay for your udemy course anyways. Can you refund my money?
Great, neat explanation 👍🏼
Always a best session. Thanks a lot Mr. K
Fantastic. Thank you for such an easy and efficient explanation. The restaurant example is apt for spark. Great work👌👍🙏❤❤
It's very use full video sir . Why your hide those videos 😢 . could you please if possible provide those videos.
Can you please let me know could be able to find rest if videos in Udemy?
Hi sir, why have you kept this playlist hidden? It's very useful from an interview perspective... please make it visible
Are there coming parts or this is the last one 😢
why u hide others video man-----unsubscribe
That was good explanation
Back to say my proper thank you 😅🎉, you're the best bro Learning a lot from this.
Can you please create a video on how to read api(with credentials bearer token) data incrementally using ADF and Databricks both?
Very helpful! Great content! 🙏🏻
Thank you :)
nice content TQ
Thank you :)
tks u so much it's so helpful for me
Glad you found it helpful :)
Download the code from here -> buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :)
Azure Active Directory (Azure AD) was renamed to Microsoft Entra ID on July 11, 2023
RESPECT++++++++