Data Leaps
Data Leaps
  • Видео 79
  • Просмотров 64 973
How to incorporate #Databricks #AI Functions in Genie space
This video walks through how to incorporate Databricks AI Functions to be used by Databricks #genie space.
This demo was created by my coworkder Puneet Jain www.linkedin.com/in/puneetjain159/ follow him on linkedin for more LLM content.
-----------------------------------------------
This video is part of the series "Databricks Essentials".ruclips.net/video/sOCQgoemQIo/видео.html
In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog
-----------------------------------------------
Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligenc...
Просмотров: 167

Видео

How to use #Databricks AI Functions to analyze your text data with out-of-box Gen AI features
Просмотров 139Месяц назад
In this video, I cover how to build AI functions in Databricks to analyze your text data with out-of-box Gen AI functioanlities. This video is part of the series "Databricks Essentials".ruclips.net/video/sOCQgoemQIo/видео.html In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog Hi, I am Liping, Data & AI Solution Architect, ex-Micro...
How to build a personal brand as a data professional #data #dataengineering #machinelearning #ai
Просмотров 78Месяц назад
In this video, I go through how to build a personal brand as a data professional. 00:00 Intro 00:33 Why personal brand building is important for you 04:29 What's your brand 07:13 How to get started 09:20 Reach the right audience 11:21 Personal brand vs company brand 12:50 Solo or partner in crime 14:26 The support system This is part of the Diary of a Solution Architect series ruclips.net/p/PLE...
Managing #linkedin connections and follows and avoid homogeneous feed
Просмотров 46Месяц назад
This is part of the Diary of a Solution Architect series ruclips.net/p/PLE_IpfSmEJ80dnKUJ3VswZIv7vgo4Cudr in this series, I will cover #jobhunting tips #Interview tips #Skillbuilding Different roles #Careerprogression Productivity tips Life before and after solution architect Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data ...
How to connect #Excel to #Databricks with fine-grained #accesscontrol via #PowerBI dataset
Просмотров 3002 месяца назад
In this video, I go through how to connect Excel to data in Databricks with fine-grained access control. This approach is achieved using Power BI semantic models, in the next video, I will go through how to do the Excel to Databricks connection using ODBC connector. This video is part of the series "Databricks Essentials".ruclips.net/video/sOCQgoemQIo/видео.html In this series, I will cover the...
How to use #Anomalo to automatically monitor #data #quality on #Databricks #dataengineering #AI
Просмотров 3012 месяца назад
In this demo, Toon Weyens Ph.D. (www.linkedin.com/in/toonweyens/) from Anomalo showcases how to integrate Animal with Databricks to automatically monitor data quality on Databricks lakehouse. This is part of a RUclips Series Databricks and Friends: In this series, I will cover Databricks integration with ISV partners. Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in ...
How to visualise #realtime #data using #PowerBI #streaming API and #Databricks #structuredstreaming
Просмотров 1412 месяца назад
In this video, I walked through how to use Structured Streaming in Databricks and Streaming dataset API in Power BI to visualize streaming /realtime data This is a video part of Power BI on Databricks series ruclips.net/p/PLE_IpfSmEJ80jrlBxnfJ9DPRMl8oj8fj4 Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Busi...
How to visualise #streaming / #realtime #data using #PowerBI and #Databricks #dataanalysis
Просмотров 1932 месяца назад
In this video, I walked through how to use Delta Live Tables in Databricks and Direct Query and Auto Page Refresh in Power BI to visualize streaming /realtime data This is a video part of Power BI on Databricks series ruclips.net/p/PLE_IpfSmEJ80jrlBxnfJ9DPRMl8oj8fj4 Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousin...
Life of a #Databricks Senior Solution Engineer --New Joiner PoV --Interview with Daniel Brooks
Просмотров 4303 месяца назад
In this video, Daniel Brooks (www.linkedin.com/in/db-dan/) shares his perspective as a new Senior Solution Engineer at Databricks, covering: 00:00 Intro 00:58 Life before Databricks 02:04 #Motivation to join Databricks 02:41 Preparing for the interview 03:40 The interview process 04:31 The onboarding 05:41 Difference between working for vs with Databricks 07:50 What about Databricks surprises y...
How to build #AIBI #Dashboard in #Databricks #datanalytics #visualization
Просмотров 6643 месяца назад
In this video, I cover how to build AIBI dashboard in Databricks. This video is part of the series "Databricks Essentials".ruclips.net/video/sOCQgoemQIo/видео.html In this series, I will cover the fundamentals of #Databricks, #deltalake, #apachespark, #mlflow, and #unitycatalog Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Dat...
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
Просмотров 2863 месяца назад
How to start & grow a #data & #ai consultancy-Interview with Advancing Analytics CEO Terry McCann
How to use #Databricks AIBI genie #nocode #data #exploration
Просмотров 3003 месяца назад
How to use #Databricks AIBI genie #nocode #data #exploration
Life of a Resident Solution Architect in #Databricks -- feat. Holly Smith, How to become a #data RSA
Просмотров 6533 месяца назад
Life of a Resident Solution Architect in #Databricks feat. Holly Smith, How to become a #data RSA
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
Просмотров 3144 месяца назад
#Data and #AI decoded webinar #data101#learning #dataanalytics #dataengineering #dadtascience
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
Просмотров 1554 месяца назад
#Data & #AI decoded: Live Webinar Announcement What is data & AI, How to #pivot into #career in Data
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
Просмотров 4134 месяца назад
How to connect #PowerBI to #Databricks on AWS using SSO passthrough and use Unity Catalog ACL in PBI
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
Просмотров 8144 месяца назад
How to #interview at #microsoft as Cloud Solution Architect or Technical Specialist #jobhunting
#Databricks Essentials: How to import CSV files in Databricks
Просмотров 5104 месяца назад
#Databricks Essentials: How to import CSV files in Databricks
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
Просмотров 2775 месяцев назад
What different types of architects do and their names in #databricks, #microsoft, #aws, #google
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
Просмотров 4285 месяцев назад
How to become a digital nomad as a data professional feat. Mara from datapears #data #digitalnomad
How to stand out in job applications as solution architects, data engineers, data scientists etc.
Просмотров 1625 месяцев назад
How to stand out in job applications as solution architects, data engineers, data scientists etc.
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
Просмотров 2296 месяцев назад
How to do Databricks Cost Analysis and Cross Charge using Power BI template: customization
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Просмотров 5156 месяцев назад
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Report Navigation
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata
Просмотров 2856 месяцев назад
Welcome to Data Leaps - A channel for #PowerBI #Databricks #platformsecurity #DevOps #Careerindata
How to publish semantic models to #PowerBI directly from #Databricks workspace, no desktop needed
Просмотров 3,1 тыс.6 месяцев назад
How to publish semantic models to #PowerBI directly from #Databricks workspace, no desktop needed
How to do Access Control for #powerbi on #databricks
Просмотров 9587 месяцев назад
How to do Access Control for #powerbi on #databricks
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Set Up
Просмотров 7669 месяцев назад
How to do Databricks Cost Analysis and Cross Charge using Power BI template: Set Up
How to configure #powerbi Authentication to #databricks
Просмотров 1,6 тыс.9 месяцев назад
How to configure #powerbi Authentication to #databricks
How to choose #databricks connector for #powerbi: Azure Databricks Connector vs Databricks Connector
Просмотров 8039 месяцев назад
How to choose #databricks connector for #powerbi: Azure Databricks Connector vs Databricks Connector
How to acquire data skills(Part 4): How to form #learning habits #data #skills
Просмотров 849 месяцев назад
How to acquire data skills(Part 4): How to form #learning habits #data #skills

Комментарии

  • @suryapratapsingh9713
    @suryapratapsingh9713 6 дней назад

    Nice Video, It would be really nice that If we get a path to get selected in databricks

  • @joysin9574
    @joysin9574 11 дней назад

    Awesome! Have 1 question. Running time increases a lot using AI query in Genie ?

    • @dataleaps
      @dataleaps 9 дней назад

      Processing time will increase, yes, whether it increases a lot will be dependent on which ai function you use and how much data you have

  • @sheikhfpk7129
    @sheikhfpk7129 17 дней назад

    Awesome demo is there a github link to code

    • @dataleaps
      @dataleaps 17 дней назад

      github.com/lipinght/PBI-on-DB-Cookbook/blob/main/RT_with_DB_and_PBI_DAIS23/README.md

  • @dataleaps
    @dataleaps Месяц назад

    Puneet Jain and Nikhil Chandna's medium blog on this subject nikhil-chandna71.medium.com/turbocharge-your-genie-experience-with-databricks-ai-functions-unlock-ai-for-business-users-9b04965ef128

  • @praveensahni5547
    @praveensahni5547 Месяц назад

    Where did you find published dataset link that pasted in tabular editor ?

  • @maximecoron-dallo1780
    @maximecoron-dallo1780 Месяц назад

    Thanks for the video! I'm pretty new on Power BI admin and I try to find the best way to handle Dataflow migration with the deployment pipeline. But it seems that it does not migrate passwords, so I have to use a workaround... By any chance, do you know a course or any other resources that could help to understand the entire picture, please? I used Chatgpt to generate PowerShell scripts and thought about using task scheduler

  • @abinjacob1
    @abinjacob1 Месяц назад

    Thank you for the content! Informative and engaging.

  • @Sanj803
    @Sanj803 Месяц назад

    I am using Power BI report in import mode, data coming in from azure databricks. Is there anyway Unity Catalog security can be applied on Power BI report? Please note I am using Import mode in Power BI.

  • @PrincessAda-u1c
    @PrincessAda-u1c 2 месяца назад

    Thanks so much for sharing ❤ I have subscribed

  • @mohdazhar4534
    @mohdazhar4534 3 месяца назад

    Hey is it possible to create dshboards the way you have done if i am using community edition of databricks ?? I dont see options of SQL , Dataengineering in the side bar . So i was thinking for community edition users to create visualizations can be done only through notebooks . Sorry if the question seems dumb i am a newbie . Thanks!!

    • @dataleaps
      @dataleaps 3 месяца назад

      Unfortunately community edition has limited features Vs the full databricks experience , you can try the free trial for databricks for features not offered in community edition

  • @Sanj803
    @Sanj803 3 месяца назад

    This is really helpful. One quick question, if we use import while publishing to Power BI. Is it possible to manage access control from the unity catalog?

    • @dataleaps
      @dataleaps 3 месяца назад

      Import mode is using a service account, so UC can only control what that account has access to, not the end users in power bi, I explained it in a separate video ruclips.net/video/1n2M4NfH5XA/видео.htmlsi=9KrPxUU4Gixo_k_9

  • @Siyakutti_
    @Siyakutti_ 3 месяца назад

    what if the UC is not set up?

    • @dataleaps
      @dataleaps 3 месяца назад

      Then you use the access control set up in your databricks workspace, non UC world has no fine grain access control though

  • @NoahPitts713
    @NoahPitts713 3 месяца назад

    Thanks for sharing!

  • @DGermishuizen
    @DGermishuizen 3 месяца назад

    Great interview ! Holly I like how candid you were, it really helps bring us into the life of a RSA :)

  • @ArijitBiswasMakeup
    @ArijitBiswasMakeup 4 месяца назад

    Great

  • @Mhs.51
    @Mhs.51 4 месяца назад

    no no

  • @getsetgoo3334
    @getsetgoo3334 4 месяца назад

    Thanks for sharing, you are sharing useful info on your channel Keep up the good work 👍👍

  • @yarbrother
    @yarbrother 6 месяцев назад

    Great video! Nice call out on the Mac use case. Is there a way to refresh the semantic model (schema and/or metadata changes) once it’s been published?

    • @dataleaps
      @dataleaps 6 месяцев назад

      Yes, you refresh it the same way you would when you publish from desktop

  • @clnguye
    @clnguye 6 месяцев назад

    Learn something new! Thanks for sharing. Excellent content!

  • @haroldfranciscobartelssanc4299
    @haroldfranciscobartelssanc4299 7 месяцев назад

    Did not know this existed! thanks! A lot of Mac Users will love this

    • @dataleaps
      @dataleaps 6 месяцев назад

      Feature is brand new :)

  • @joe_plumb
    @joe_plumb 7 месяцев назад

    Magic!

  • @stephaniedatabricksrivera
    @stephaniedatabricksrivera 7 месяцев назад

    This is great!

  • @wangkaitj1
    @wangkaitj1 7 месяцев назад

    basically, I can connect to databrick, but I am not able to see system table. however, i can use yout template to see system table and the dashboard

    • @dataleaps
      @dataleaps 7 месяцев назад

      You need access to 3 things: 1. access to system tables. ie. being able to do SELECT * FROM system.billing.usage ( you might need admin to grant you access to the billing schema) 2. access to use the databricks workspace, which you already have, when you say you can connect to Databricks 3. access to a sql warehouse, again, ask admin to give you access, and use the connection string for power bi template

  • @wangkaitj1
    @wangkaitj1 7 месяцев назад

    Hello Liping, Thanks so much for your videos, that works for me. but I am not able to setup data connection for system table from PowerBI-》 get the data source, can you give me some idea?

  • @jakai1775
    @jakai1775 7 месяцев назад

    Is there actually a difference between using Azure Databricks Connector within Power Bi as opposed to partner connect? I really can’t see any difference which suggests to use one as opposed to the other?

    • @dataleaps
      @dataleaps 7 месяцев назад

      If your databricks is on azure, there is no difference apart from partner connection pre-populate the connection string for you. If your databricks is on AWS and if you using some other oauth and not AAD, partner connect defaults to Azure Databricks connector and AAD as Oauth, so you are better off connecting manually in Power BI

    • @jakai1775
      @jakai1775 7 месяцев назад

      @@dataleaps yeah mine is Azure. So it’s basically down to preference? Also, do you know if query folding will ever be supported as standard? When connecting to Azure Databricks?

  • @venkataraju4644
    @venkataraju4644 8 месяцев назад

    Hi, is there a away to bring source table name???

  • @vivekupadhyay3978
    @vivekupadhyay3978 8 месяцев назад

    Hello, iam not getting that custom actions option in tabular editor for single partiton refresh. Please help!

  • @hamooda.7994
    @hamooda.7994 8 месяцев назад

    Nicely explained. Thanks for sharing!

  • @Amir_mo
    @Amir_mo 9 месяцев назад

    Great video! Thank you! I have a large table that is not being refreshed because of premium memory capacity limit. Can I create multiple partitions based on date, and refresh all partitions separately to avoid power BI memory limit issue?

    • @dataleaps
      @dataleaps 9 месяцев назад

      you could do incremental refreshes learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview

    • @Amir_mo
      @Amir_mo 9 месяцев назад

      Thanks. But I can’t, because after implementing incremental refresh, the first refresh in power BI service is a full refresh which I get memory capacity error.

    • @dataleaps
      @dataleaps 9 месяцев назад

      @@Amir_mo what's your model size and what power bi capacity are you on?

  • @dataleaps
    @dataleaps 9 месяцев назад

    If you are using AAD with databricks on AWS, you can use the Azure Databricks connector in Power BI as long as you have SSO enabled

  • @grayson5933
    @grayson5933 Год назад

    *Promosm*

  • @followrajah7743
    @followrajah7743 Год назад

    Thank you so much for this. I'm new to Data Analytics and this video has helped me a lot with a project I'm working on

  • @claudio5870
    @claudio5870 Год назад

    Al momento de intentar realizar el análisis de sentimiento me arroja el siguiente error. Agradecería tu ayuda: Expression.Error: No se puede convertir el valor "[Function]" al tipo Function. Detalles: Value=[Function] Type=[Type]

    • @claudio5870
      @claudio5870 Год назад

      El error me aparace al conectar una Hoja de Cálculo de Google. No así cuando uso un Excel, ahí no tengo problemas

  • @Stateoftheheart
    @Stateoftheheart Год назад

    Just what I was looking for! Really helpful! Thanks a mil :)

  • @dataleaps
    @dataleaps Год назад

    The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better

  • @ShubhamYadav-xr9jq
    @ShubhamYadav-xr9jq Год назад

    Voice is very low, no use of video information, its very difficult to hear and understand

    • @dataleaps
      @dataleaps Год назад

      The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better

  • @rajsatia
    @rajsatia Год назад

    You forgot to add your voice.

  • @aaquibislam1524
    @aaquibislam1524 Год назад

    Great!

  • @GudhawalaLadka
    @GudhawalaLadka Год назад

    Not able to hear anything

    • @dataleaps
      @dataleaps Год назад

      The sound of this video was recorded on the right channel. If you cannot hear anything, change your computer sound audio balance and increase the right balance, you will be able to hear better

  • @lasseLundqvist
    @lasseLundqvist Год назад

    Does the powershell script also work if you have MFA on your account? or is a ServiceAccount some specific account type that you need to create in Azure AD?

    • @dataleaps
      @dataleaps Год назад

      Service Principal is not an normal AAD account, you set it up by setting up app reg in AAD, take a look at this github.com/lipinght/PBICookbook/blob/main/ServicePrincipal/ServicePrincipal.md

  • @HiYurd
    @HiYurd Год назад

    Very good video. TY

  • @aaquibislam1524
    @aaquibislam1524 Год назад

    Really helpful! How's the performance through the gateway approach?

    • @dataleaps
      @dataleaps Год назад

      gateway typically ends up being the performance bottleneck

  • @svitlana6420
    @svitlana6420 Год назад

    Thank you, it was very clear and useful!

    • @dataleaps
      @dataleaps Год назад

      Great to hear! Thanks

  • @AkhilDuvvuru
    @AkhilDuvvuru Год назад

    Hi, Can we do the similar Power BI Partition refresh using Power Automate? Basically we have to execute the xmla code.

    • @dataleaps
      @dataleaps Год назад

      data-marc.com/2020/01/13/manage-all-your-power-bi-refreshes-in-one-place-with-power-automate-flow/

  • @spreddyv3873
    @spreddyv3873 Год назад

    I executed the same script but i am getting the below error used below module Install-Module -Name MicrosoftPowerBIMgmt.Profile -Verbose -Scope CurrentUser -Force Install-Module -Name MicrosoftPowerBIMgmt.Workspaces -Verbose -Scope CurrentUser -Force Install-Module MicrosoftPowerBIMgmt -force -AllowClobber Connect-PowerBIServiceAccount : One or more errors occurred. At D:\a\_temp\2f66e56e-fd4c-4dc0-b011-d2aa4bdd1079.ps1:8 char:1 + Connect-PowerBIServiceAccount -ServicePrincipal -Credential $credenti ... + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + CategoryInfo : WriteError: (Microsoft.Power...IServiceAccount:ConnectPowerBIServiceAccount) [Connect-Po werBIServiceAccount], AggregateException + FullyQualifiedErrorId : One or more errors occurred.,Microsoft.PowerBI.Commands.Profile.ConnectPowerBIServiceAccount

  • @danjarupath
    @danjarupath Год назад

    cool

  • @Jamesearlpace
    @Jamesearlpace 2 года назад

    What does forecast bias mean here?

  • @praveenstar120
    @praveenstar120 2 года назад

    Great Insight. I would like to watch more videos from you often, please do!😊

  • @DennyEapen
    @DennyEapen 2 года назад

    Thanks for the video and the explanation. At 7:34 for Gateway Connection, is Power BI Premium required? With Power BI Pro its grey out for me.

    • @dataleaps
      @dataleaps 2 года назад

      yes, vnet gateway currently is a premium or premium per user feature, you could alternatively use a on prem gateway instead if you have pro

    • @TiesKuipers
      @TiesKuipers Год назад

      @@dataleaps Hi, is one PPU enough to set up the gateway? Or do you also need a premium workspace? Cause I can not add pro users to a premium worksapce.

    • @dataleaps
      @dataleaps Год назад

      @@TiesKuipers you have use a ppu to set up the vnet gateway, in a ppu workspace, then everyone who access that will need a ppu too