- Видео 79
- Просмотров 64 973
Data Leaps
Великобритания
Добавлен 13 авг 2020
Welcome to Data Leaps, this is a data channel for Power BI, Databricks, DevOps, Platform Security, Career in Data, and Learning Resources.
I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on RUclips, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to creating content on RUclips, I am also a blogger (www.dataleaps.co.uk) and international public speaker (www.sessionize.com/lipinght), you can follow me on Linkedin (www.linkedin.com/in/lipinght) for content release notification.
The statements and views expressed here are mine alone.
How to incorporate #Databricks #AI Functions in Genie space
This video walks through how to incorporate Databricks AI Functions to be used by Databricks #genie space.
This demo was created by my coworkder Puneet Jain www.linkedin.com/in/puneetjain159/ follow him on linkedin for more LLM content.
-----------------------------------------------
This video is part of the series "Databricks Essentials".ruclips.net/video/sOCQgoemQIo/видео.html
In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog
-----------------------------------------------
Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligenc...
This demo was created by my coworkder Puneet Jain www.linkedin.com/in/puneetjain159/ follow him on linkedin for more LLM content.
-----------------------------------------------
This video is part of the series "Databricks Essentials".ruclips.net/video/sOCQgoemQIo/видео.html
In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog
-----------------------------------------------
Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligenc...
Просмотров: 167
Видео
How to use #Databricks AI Functions to analyze your text data with out-of-box Gen AI features
Просмотров 139Месяц назад
In this video, I cover how to build AI functions in Databricks to analyze your text data with out-of-box Gen AI functioanlities. This video is part of the series "Databricks Essentials".ruclips.net/video/sOCQgoemQIo/видео.html In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog Hi, I am Liping, Data & AI Solution Architect, ex-Micro...
How to build a personal brand as a data professional #data #dataengineering #machinelearning #ai
Просмотров 78Месяц назад
In this video, I go through how to build a personal brand as a data professional. 00:00 Intro 00:33 Why personal brand building is important for you 04:29 What's your brand 07:13 How to get started 09:20 Reach the right audience 11:21 Personal brand vs company brand 12:50 Solo or partner in crime 14:26 The support system This is part of the Diary of a Solution Architect series ruclips.net/p/PLE...
Managing #linkedin connections and follows and avoid homogeneous feed
Просмотров 46Месяц назад
This is part of the Diary of a Solution Architect series ruclips.net/p/PLE_IpfSmEJ80dnKUJ3VswZIv7vgo4Cudr in this series, I will cover #jobhunting tips #Interview tips #Skillbuilding Different roles #Careerprogression Productivity tips Life before and after solution architect Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data ...
How to connect #Excel to #Databricks with fine-grained #accesscontrol via #PowerBI dataset
Просмотров 3002 месяца назад
In this video, I go through how to connect Excel to data in Databricks with fine-grained access control. This approach is achieved using Power BI semantic models, in the next video, I will go through how to do the Excel to Databricks connection using ODBC connector. This video is part of the series "Databricks Essentials".ruclips.net/video/sOCQgoemQIo/видео.html In this series, I will cover the...
How to use #Anomalo to automatically monitor #data #quality on #Databricks #dataengineering #AI
Просмотров 3012 месяца назад
In this demo, Toon Weyens Ph.D. (www.linkedin.com/in/toonweyens/) from Anomalo showcases how to integrate Animal with Databricks to automatically monitor data quality on Databricks lakehouse. This is part of a RUclips Series Databricks and Friends: In this series, I will cover Databricks integration with ISV partners. Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in ...
How to visualise #realtime #data using #PowerBI #streaming API and #Databricks #structuredstreaming
Просмотров 1412 месяца назад
In this video, I walked through how to use Structured Streaming in Databricks and Streaming dataset API in Power BI to visualize streaming /realtime data This is a video part of Power BI on Databricks series ruclips.net/p/PLE_IpfSmEJ80jrlBxnfJ9DPRMl8oj8fj4 Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Busi...
How to visualise #streaming / #realtime #data using #PowerBI and #Databricks #dataanalysis
Просмотров 1932 месяца назад
In this video, I walked through how to use Delta Live Tables in Databricks and Direct Query and Auto Page Refresh in Power BI to visualize streaming /realtime data This is a video part of Power BI on Databricks series ruclips.net/p/PLE_IpfSmEJ80jrlBxnfJ9DPRMl8oj8fj4 Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousin...
Life of a #Databricks Senior Solution Engineer --New Joiner PoV --Interview with Daniel Brooks
Просмотров 4303 месяца назад
In this video, Daniel Brooks (www.linkedin.com/in/db-dan/) shares his perspective as a new Senior Solution Engineer at Databricks, covering: 00:00 Intro 00:58 Life before Databricks 02:04 #Motivation to join Databricks 02:41 Preparing for the interview 03:40 The interview process 04:31 The onboarding 05:41 Difference between working for vs with Databricks 07:50 What about Databricks surprises y...
How to build #AIBI #Dashboard in #Databricks #datanalytics #visualization
Просмотров 6643 месяца назад
In this video, I cover how to build AIBI dashboard in Databricks. This video is part of the series "Databricks Essentials".ruclips.net/video/sOCQgoemQIo/видео.html In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Dat...
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
Просмотров 2863 месяца назад
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
How to use #Databricks AIBI genie #nocode #data #exploration
Просмотров 3003 месяца назад
How to use #Databricks AIBI genie #nocode #data #exploration
Life of a Resident Solution Architect in #Databricks -- feat. Holly Smith, How to become a #data RSA
Просмотров 6533 месяца назад
Life of a Resident Solution Architect in #Databricks feat. Holly Smith, How to become a #data RSA
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
Просмотров 3144 месяца назад
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
Просмотров 1554 месяца назад
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
Просмотров 4134 месяца назад
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
Просмотров 8144 месяца назад
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
#Databricks Essentials: How to import CSV files in Databricks
Просмотров 5104 месяца назад
#Databricks Essentials: How to import CSV files in Databricks
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
Просмотров 2775 месяцев назад
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
Просмотров 4285 месяцев назад
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
How to stand out in job applications as solution architects, data engineers, data scientists etc.
Просмотров 1625 месяцев назад
How to stand out in job applications as solution architects, data engineers, data scientists etc.
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
Просмотров 2296 месяцев назад
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Просмотров 5156 месяцев назад
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata
Просмотров 2856 месяцев назад
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata
How to publish semantic models to #PowerBI directly from #Databricks workspace, no desktop needed
Просмотров 3,1 тыс.6 месяцев назад
How to publish semantic models to #PowerBI directly from #Databricks workspace, no desktop needed
How to do Access Control for #powerbi on #databricks
Просмотров 9587 месяцев назад
How to do Access Control for #powerbi on #databricks
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Set Up
Просмотров 7669 месяцев назад
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Set Up
How to configure #powerbi Authentication to #databricks
Просмотров 1,6 тыс.9 месяцев назад
How to configure #powerbi Authentication to #databricks
How to choose #databricks connector for #powerbi: Azure Databricks Connector vs Databricks Connector
Просмотров 8039 месяцев назад
How to choose #databricks connector for #powerbi: Azure Databricks Connector vs Databricks Connector
How to acquire data skills(Part 4): How to form #learning habits #data #skills
Просмотров 849 месяцев назад
How to acquire data skills(Part 4): How to form #learning habits #data #skills
Nice Video, It would be really nice that If we get a path to get selected in databricks
Yeah, I will do a interview process video soon
@dataleaps appreciate, thanks
Awesome! Have 1 question. Running time increases a lot using AI query in Genie ?
Processing time will increase, yes, whether it increases a lot will be dependent on which ai function you use and how much data you have
Awesome demo is there a github link to code
github.com/lipinght/PBI-on-DB-Cookbook/blob/main/RT_with_DB_and_PBI_DAIS23/README.md
Puneet Jain and Nikhil Chandna's medium blog on this subject nikhil-chandna71.medium.com/turbocharge-your-genie-experience-with-databricks-ai-functions-unlock-ai-for-business-users-9b04965ef128
Where did you find published dataset link that pasted in tabular editor ?
Thanks for the video! I'm pretty new on Power BI admin and I try to find the best way to handle Dataflow migration with the deployment pipeline. But it seems that it does not migrate passwords, so I have to use a workaround... By any chance, do you know a course or any other resources that could help to understand the entire picture, please? I used Chatgpt to generate PowerShell scripts and thought about using task scheduler
Thank you for the content! Informative and engaging.
Thank you 😊
I am using Power BI report in import mode, data coming in from azure databricks. Is there anyway Unity Catalog security can be applied on Power BI report? Please note I am using Import mode in Power BI.
Thanks so much for sharing ❤ I have subscribed
Thank you 😊
Hey is it possible to create dshboards the way you have done if i am using community edition of databricks ?? I dont see options of SQL , Dataengineering in the side bar . So i was thinking for community edition users to create visualizations can be done only through notebooks . Sorry if the question seems dumb i am a newbie . Thanks!!
Unfortunately community edition has limited features Vs the full databricks experience , you can try the free trial for databricks for features not offered in community edition
This is really helpful. One quick question, if we use import while publishing to Power BI. Is it possible to manage access control from the unity catalog?
Import mode is using a service account, so UC can only control what that account has access to, not the end users in power bi, I explained it in a separate video ruclips.net/video/1n2M4NfH5XA/видео.htmlsi=9KrPxUU4Gixo_k_9
what if the UC is not set up?
Then you use the access control set up in your databricks workspace, non UC world has no fine grain access control though
Thanks for sharing!
Great interview ! Holly I like how candid you were, it really helps bring us into the life of a RSA :)
Great
no no
Thanks for sharing, you are sharing useful info on your channel Keep up the good work 👍👍
Great video! Nice call out on the Mac use case. Is there a way to refresh the semantic model (schema and/or metadata changes) once it’s been published?
Yes, you refresh it the same way you would when you publish from desktop
Learn something new! Thanks for sharing. Excellent content!
Did not know this existed! thanks! A lot of Mac Users will love this
Feature is brand new :)
Magic!
This is great!
basically, I can connect to databrick, but I am not able to see system table. however, i can use yout template to see system table and the dashboard
You need access to 3 things: 1. access to system tables. ie. being able to do SELECT * FROM system.billing.usage ( you might need admin to grant you access to the billing schema) 2. access to use the databricks workspace, which you already have, when you say you can connect to Databricks 3. access to a sql warehouse, again, ask admin to give you access, and use the connection string for power bi template
Hello Liping, Thanks so much for your videos, that works for me. but I am not able to setup data connection for system table from PowerBI-》 get the data source, can you give me some idea?
Is there actually a difference between using Azure Databricks Connector within Power Bi as opposed to partner connect? I really can’t see any difference which suggests to use one as opposed to the other?
If your databricks is on azure, there is no difference apart from partner connection pre-populate the connection string for you. If your databricks is on AWS and if you using some other oauth and not AAD, partner connect defaults to Azure Databricks connector and AAD as Oauth, so you are better off connecting manually in Power BI
@@dataleaps yeah mine is Azure. So it’s basically down to preference? Also, do you know if query folding will ever be supported as standard? When connecting to Azure Databricks?
Hi, is there a away to bring source table name???
Hello, iam not getting that custom actions option in tabular editor for single partiton refresh. Please help!
Nicely explained. Thanks for sharing!
Great video! Thank you! I have a large table that is not being refreshed because of premium memory capacity limit. Can I create multiple partitions based on date, and refresh all partitions separately to avoid power BI memory limit issue?
you could do incremental refreshes learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview
Thanks. But I can’t, because after implementing incremental refresh, the first refresh in power BI service is a full refresh which I get memory capacity error.
@@Amir_mo what's your model size and what power bi capacity are you on?
If you are using AAD with databricks on AWS, you can use the Azure Databricks connector in Power BI as long as you have SSO enabled
*Promosm*
Thank you so much for this. I'm new to Data Analytics and this video has helped me a lot with a project I'm working on
Al momento de intentar realizar el análisis de sentimiento me arroja el siguiente error. Agradecería tu ayuda: Expression.Error: No se puede convertir el valor "[Function]" al tipo Function. Detalles: Value=[Function] Type=[Type]
El error me aparace al conectar una Hoja de Cálculo de Google. No así cuando uso un Excel, ahí no tengo problemas
Just what I was looking for! Really helpful! Thanks a mil :)
The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better
Voice is very low, no use of video information, its very difficult to hear and understand
The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better
You forgot to add your voice.
Great!
Not able to hear anything
The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better
Does the powershell script also work if you have MFA on your account? or is a ServiceAccount some specific account type that you need to create in Azure AD?
Service Principal is not an normal AAD account, you set it up by setting up app reg in AAD, take a look at this github.com/lipinght/PBICookbook/blob/main/ServicePrincipal/ServicePrincipal.md
Very good video. TY
Glad it was helpful!
Really helpful! How's the performance through the gateway approach?
gateway typically ends up being the performance bottleneck
Thank you, it was very clear and useful!
Great to hear! Thanks
Hi, Can we do the similar Power BI Partition refresh using Power Automate? Basically we have to execute the xmla code.
data-marc.com/2020/01/13/manage-all-your-power-bi-refreshes-in-one-place-with-power-automate-flow/
I executed the same script but i am getting the below error used below module Install-Module -Name MicrosoftPowerBIMgmt.Profile -Verbose -Scope CurrentUser -Force Install-Module -Name MicrosoftPowerBIMgmt.Workspaces -Verbose -Scope CurrentUser -Force Install-Module MicrosoftPowerBIMgmt -force -AllowClobber Connect-PowerBIServiceAccount : One or more errors occurred. At D:\a\_temp\2f66e56e-fd4c-4dc0-b011-d2aa4bdd1079.ps1:8 char:1 + Connect-PowerBIServiceAccount -ServicePrincipal -Credential $credenti ... + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + CategoryInfo : WriteError: (Microsoft.Power...IServiceAccount:ConnectPowerBIServiceAccount) [Connect-Po werBIServiceAccount], AggregateException + FullyQualifiedErrorId : One or more errors occurred.,Microsoft.PowerBI.Commands.Profile.ConnectPowerBIServiceAccount
cool
What does forecast bias mean here?
Great Insight. I would like to watch more videos from you often, please do!😊
Thanks for the video and the explanation. At 7:34 for Gateway Connection, is Power BI Premium required? With Power BI Pro its grey out for me.
yes, vnet gateway currently is a premium or premium per user feature, you could alternatively use a on prem gateway instead if you have pro
@@dataleaps Hi, is one PPU enough to set up the gateway? Or do you also need a premium workspace? Cause I can not add pro users to a premium worksapce.
@@TiesKuipers you have use a ppu to set up the vnet gateway, in a ppu workspace, then everyone who access that will need a ppu too