Mr. K Talks Tech
Mr. K Talks Tech
  • Видео 73
  • Просмотров 973 019
Part- 8 (Data Reporting using Power BI)- End to End Streaming Azure Data Engineering Project
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through how to load the weather data from Event HUB to KQL DB using Fabric's Event Stream Pipeline.
Download the code from here: buymeacoffee.com/mrktalkstech/e/333857
Support me for my work :) Please Like, Share and Subscribe to my YT channel :)
#DataEngineering #AzureDatabricks #AzureFunctions #EventHub #MicrosoftFabric #RealTimeData #StreamingData #PowerBI #KustoDB #DataActivator #CloudData #WeatherData #EndToEndProject #DataIngestion #DataPipeline #AzureEventHub #RealTimeAlerts
Join this channel to get access to perks:
ruclips.net/channel/UCzdOan4AmF65PmLLks8Lmww...
Просмотров: 717

Видео

Part- 7 (Event Processing and Loading)- End to End Streaming Azure Data Engineering Project
Просмотров 74714 дней назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through how to load the weather data from Event HUB to KQL DB using Fabric's Event Stream Pipeline. Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #Azu...
Part- 6 (Cost Analysis and Architectural decisions)- End to End Streaming Data Engineering Project
Просмотров 96228 дней назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #AzureDat...
Part- 5 (Data Ingestion using Azure Functions)- End to End Streaming Azure Data Engineering Project
Просмотров 1,3 тыс.Месяц назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #AzureDat...
Part- 4 (Data Ingestion using Azure Databricks)- End to End Streaming Azure Data Engineering Project
Просмотров 2,4 тыс.2 месяца назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #AzureDat...
Part- 3 (Data Ingestion using Azure Databricks)- End to End Streaming Azure Data Engineering Project
Просмотров 2,8 тыс.2 месяца назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB #DataEngineering #AzureDatabricks #AzureFunctions #EventHub #MicrosoftFabric #RealTimeData #StreamingData #PowerBI #KustoDB #DataActivator #CloudData #WeatherData #EndToEndP...
Part 2- End to End Realtime Streaming Azure Data Engineering Project (Environment Setup)
Просмотров 4,4 тыс.2 месяца назад
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the entire environment setup process, covering all the essential resources we’ll use to build a real-time weather reporting system using Azure services and Microsoft Fabric. TimeStamp: 0:00:00 - Setting up the Weather API 0:03:58 - Creating Resource Group 0:07...
End to End Realtime Streaming Azure Data Engineering Project (Part -1) | Complete Guide with Demo
Просмотров 9 тыс.3 месяца назад
Welcome to an exciting session where we'll build a real-time streaming Data Engineering project using Azure services! This is one of the best ways to get hands-on experience with real-time streaming while understanding architectural decision-making for cost and performance optimization. In this project, we’ll: - Set up a real-time weather report system using Weather API - Implement data ingesti...
6 Proven Steps to Land a Data Engineer Job with ZERO Experience (Even as a Fresher!)
Просмотров 6 тыс.4 месяца назад
#dataengineering #azuredataengineering #aws #gcp #jobs In this video, I have explained 6 important steps that will help you to get hired as a Data Engineer. This is probably the most asked question to me, and that's the reason I decided to make a video on this topic. I hope this is helpful. Please let me know if you have any questions in the comment section. - - - Book a Private One on One Meet...
Must-Know PySpark Interview Question for Data Engineers - Live Demo & Tips!
Просмотров 4,2 тыс.4 месяца назад
#ApacheSpark #DataEngineering #AzureDataEngineer #SparkSQL #DataTransformation #DataFrame #InterviewQuestion #BigData #AzureDatabricks #PySpark #DataAnalysis #DataScience #SQLQuery #Optimization #Efficiency #Tutorial In this video, we'll dive into a popular PySpark interview question often asked by financial and banking companies-calculating the running total for grouped data. We'll explore the...
What is Apache Spark? Learn Apache Spark in 15 Minutes
Просмотров 12 тыс.5 месяцев назад
#apachespark #databricks #sparkteam #dataengineering #pyspark #architecture In this video, I have covered the most important topic of Data Engineer which is "Apache Spark". Especially, I have talked about the complete end to end Architecture of Spark Spark covering all the individual components as below, 1. Driver Programme 2. Worker Node 3. Cluster Manager 4. Spark Context or Spark Session 5. ...
Data Engineer's Biggest Nightmare: Solving Merge Conflicts Step-by-Step Guide with Demo
Просмотров 2,4 тыс.5 месяцев назад
#AzureDevOps #Git #DataEngineering #InterviewQuestions #DevOpsTutorial #AzureDatabricks #GitRevert #BranchRecovery #CodingBestPractices #TechInterviewTips #MergeConflicts 🔍 What We'll Cover: In this video, we dive into a crucial topic for every Data Engineer: Merge Conflicts. Merge conflicts are one of the most common issues encountered when working collaboratively with Git repositories. Unders...
Untold secrets of Data Engineering Project !!! Reality and Facts in 15 minutes
Просмотров 10 тыс.6 месяцев назад
Untold secrets of Data Engineering Project !!! Reality and Facts in 15 minutes
Don't fail to answer these questions in your next Interview- Data Engineering Interview Question
Просмотров 3,7 тыс.6 месяцев назад
Don't fail to answer these questions in your next Interview- Data Engineering Interview Question
Tips and Tricks- Delta Lake Table in Apache Spark - Azure Data Engineering Interview Question
Просмотров 6 тыс.7 месяцев назад
Tips and Tricks- Delta Lake Table in Apache Spark - Azure Data Engineering Interview Question
Can you solve this simple Spark SQL Interview Question? | Azure Data Engineering Tutorials
Просмотров 2,3 тыс.7 месяцев назад
Can you solve this simple Spark SQL Interview Question? | Azure Data Engineering Tutorials
15 Minutes- Libraries in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Просмотров 3,5 тыс.7 месяцев назад
15 Minutes- Libraries in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Azure Synapse Analytics- Interview Questions | Serverless SQL Pool VS Dedicated SQL Pool with Demo
Просмотров 6 тыс.8 месяцев назад
Azure Synapse Analytics- Interview Questions | Serverless SQL Pool VS Dedicated SQL Pool with Demo
Most popular Data Warehousing Interview Question- Azure Data Engineering Interview Question Tutorial
Просмотров 3,6 тыс.9 месяцев назад
Most popular Data Warehousing Interview Question- Azure Data Engineering Interview Question Tutorial
90% of Data Engineers doesn't know this - PySpark Azure Data Engineering Interview Question Tutorial
Просмотров 6 тыс.9 месяцев назад
90% of Data Engineers doesn't know this - PySpark Azure Data Engineering Interview Question Tutorial
Tips and Tricks- Azure Data Engineering Interview Questions | Managed Identity vs Service Principal
Просмотров 14 тыс.9 месяцев назад
Tips and Tricks- Azure Data Engineering Interview Questions | Managed Identity vs Service Principal
Microsoft Fabric - End to End Azure Data Engineering Project - Bing news Data Analytics
Просмотров 32 тыс.11 месяцев назад
Microsoft Fabric - End to End Azure Data Engineering Project - Bing news Data Analytics
Data Engineer Roadmap 2025 (A complete 6 Months Plan Guide) | Azure Data Engineer Roadmap 2025
Просмотров 27 тыс.Год назад
Data Engineer Roadmap 2025 (A complete 6 Months Plan Guide) | Azure Data Engineer Roadmap 2025
Unlocking Secrets in Azure Databricks with Azure Key Vault! 🗝️✨ | Azure Databricks Tutorials
Просмотров 9 тыс.Год назад
Unlocking Secrets in Azure Databricks with Azure Key Vault! 🗝️✨ | Azure Databricks Tutorials
Top 5 Notebook Features You Can't Miss in Azure Databricks 🚀| Databricks and Azure DevOps Tutorials
Просмотров 4,1 тыс.Год назад
Top 5 Notebook Features You Can't Miss in Azure Databricks 🚀| Databricks and Azure DevOps Tutorials
15 Minutes- Spark Clusters in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Просмотров 23 тыс.Год назад
15 Minutes- Spark Clusters in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Part 1- What is CI/CD? - Continuous Integration and Continuous Deployment in Azure Databricks Demo
Просмотров 32 тыс.Год назад
Part 1- What is CI/CD? - Continuous Integration and Continuous Deployment in Azure Databricks Demo
Create your first Data Ingestion Pipeline in Microsoft Fabric | Microsoft Fabric Tutorials
Просмотров 9 тыс.Год назад
Create your first Data Ingestion Pipeline in Microsoft Fabric | Microsoft Fabric Tutorials
Sending ADF Pipeline alerts to Microsoft Teams Demo | Azure Data Factory Tutorials for Beginners
Просмотров 7 тыс.Год назад
Sending ADF Pipeline alerts to Microsoft Teams Demo | Azure Data Factory Tutorials for Beginners
How to create Azure Databricks? Explained Easy | Azure Databricks Tutorials for Beginners
Просмотров 4,5 тыс.Год назад
How to create Azure Databricks? Explained Easy | Azure Databricks Tutorials for Beginners

Комментарии

  • @AshokKumar-ji3cs
    @AshokKumar-ji3cs 3 часа назад

    Great content thanks for sharing

  • @thondapusindhu3793
    @thondapusindhu3793 2 дня назад

    Fabric free trail is not working, did anyone face this issue? I have created a fabric account and activated the trail version, it’s stating the days left at the top but the trail mode is disabled. I have tried enabling it in tenant settings but still the same issue..any work around for this please?

  • @DamaMithun
    @DamaMithun 3 дня назад

    Great To Go!

  • @Rajeshkumar-o8s8x
    @Rajeshkumar-o8s8x 4 дня назад

    where is the rest of the video in english on ci cd, i can see playlist in Tamil which i can't understand

  • @mgdesire9255
    @mgdesire9255 4 дня назад

    How many videos are left in this series? Sir😊

  • @kiranzsai
    @kiranzsai 5 дней назад

    Excellent !! thank you for the explanation!! Thats Y I subscribed n became member to your channel!!

  • @ChanceTEK
    @ChanceTEK 6 дней назад

    Brilliant! Thank you. Question, is the Notebook with the code available on GitHub?

  • @jatinhingorani3704
    @jatinhingorani3704 7 дней назад

    Thanks for the video sir guys please download this playlist idk when sir also make it member exclusive only live other playlist

  • @ravulapallivenkatagurnadha9605
    @ravulapallivenkatagurnadha9605 9 дней назад

    Great videos

  • @impromptu9986
    @impromptu9986 11 дней назад

    Can you please consider making a series on creating an azure data factory dev and prod environments along with configuring git for these from the scratch. I believe it brings more practicality in your videos . Hope you consider the request.

  • @samiahmed_007
    @samiahmed_007 12 дней назад

    Very informative video. When is the next video coming?

  • @WB_Tom
    @WB_Tom 14 дней назад

    8:42 i have created an app as service principal and gave permission to access keyvault and also attached with databricks Still is says permission denied. Should i have to give permission(kv-officer) to inbuilt service principal? Like u did. Is this normal?

  • @sivaram9654
    @sivaram9654 15 дней назад

    Wonderful explanation

  • @parthmehta7648
    @parthmehta7648 16 дней назад

    Would this work if I have a different account for fabric than one that I have used for azure?

  • @ritwik121
    @ritwik121 16 дней назад

    Hi sir please bring a azure batch processing etl project

  • @KateřinaNekvindová
    @KateřinaNekvindová 17 дней назад

    Thank you! It was super helpful :)

  • @emily-bose
    @emily-bose 18 дней назад

    Excellent and one of the best explanation of spark architecture...

  • @imane-os6ih
    @imane-os6ih 19 дней назад

    Thanks for this explanation, but as u know this solution is no longer available, bcause of the retirement of microsoft connectors office 365, do you have any ideas about the new solution on the power automate workflows?

  • @ashwingupta4765
    @ashwingupta4765 19 дней назад

    I am not able to see the playlist of the video after the second video.

  • @jothsonaas4245
    @jothsonaas4245 22 дня назад

    Why removed videos from this playlist?

  • @RaviRaj-be9ju
    @RaviRaj-be9ju 22 дня назад

    The azure services which is used in environment setup is allowing in free trial account or i have to pay some amount of money to set the environment ,please confirm ?

  • @moonalariqi1737
    @moonalariqi1737 24 дня назад

    really it is the an amazing explanation video of CI/CD . Thank you very much for your excellent explanation. I will follow you and see all your interesting video. Appreciated Sir

  • @naren06938
    @naren06938 24 дня назад

    Just one '\' also will decide Interview cracked or not?😮😢

  • @mgdesire9255
    @mgdesire9255 26 дней назад

    How many videos can we expect for this project? Sir please reply 😊

  • @arunrs425
    @arunrs425 26 дней назад

    if i buy udemy i can do and get the knowledge of this project sir?

  • @DipakChavan-g7l
    @DipakChavan-g7l 27 дней назад

    Good for that hidden videos. Now someone can sell your videos as course more than udemy price. your dam good to took wrong decision.

  • @sameerkhan-si9ql
    @sameerkhan-si9ql 27 дней назад

    @mr.ktalkstech Hey Sir, I thought i have azure ci/cd azure devops videos in members only on youtube but is not there. I am going to pay for your udemy course anyways. Can you refund my money?

  • @sharaniyaswaminathan8760
    @sharaniyaswaminathan8760 29 дней назад

    Great, neat explanation 👍🏼

  • @Abhinavkumar-kt8gj
    @Abhinavkumar-kt8gj Месяц назад

    Always a best session. Thanks a lot Mr. K

  • @slicein
    @slicein Месяц назад

    Fantastic. Thank you for such an easy and efficient explanation. The restaurant example is apt for spark. Great work👌👍🙏❤❤

  • @dommarajuchaitanya7284
    @dommarajuchaitanya7284 Месяц назад

    It's very use full video sir . Why your hide those videos 😢 . could you please if possible provide those videos.

  • @dommarajuchaitanya7284
    @dommarajuchaitanya7284 Месяц назад

    Can you please let me know could be able to find rest if videos in Udemy?

  • @RAHULSHINDE-ky5si
    @RAHULSHINDE-ky5si Месяц назад

    Hi sir, why have you kept this playlist hidden? It's very useful from an interview perspective... please make it visible

  • @abdofathi9611
    @abdofathi9611 Месяц назад

    Are there coming parts or this is the last one 😢

  • @MDMODASSIRALAM-v6n
    @MDMODASSIRALAM-v6n Месяц назад

    why u hide others video man-----unsubscribe

  • @mohankrishna2145
    @mohankrishna2145 Месяц назад

    That was good explanation

  • @billionairemindset7192
    @billionairemindset7192 Месяц назад

    Back to say my proper thank you 😅🎉, you're the best bro Learning a lot from this.

  • @manjunathb.n7465
    @manjunathb.n7465 Месяц назад

    Can you please create a video on how to read api(with credentials bearer token) data incrementally using ADF and Databricks both?

  • @sharaniyaswaminathan8760
    @sharaniyaswaminathan8760 Месяц назад

    Very helpful! Great content! 🙏🏻

  • @kvs7720
    @kvs7720 Месяц назад

    nice content TQ

  • @mannhi2261
    @mannhi2261 Месяц назад

    tks u so much it's so helpful for me

  • @mr.ktalkstech
    @mr.ktalkstech Месяц назад

    Download the code from here -> buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :)

  • @MDTARIF-pj7bc
    @MDTARIF-pj7bc Месяц назад

    Azure Active Directory (Azure AD) was renamed to Microsoft Entra ID on July 11, 2023

  • @RijyosInfo-wn6wt
    @RijyosInfo-wn6wt Месяц назад

    RESPECT++++++++