The BI Hub
The BI Hub
  • Видео 22
  • Просмотров 182 905
Load API Data into Snowflake using Python and Scheduled Tasks
Streamline Data Integration: API to Snowflake Automation
How to Schedule API Data Imports into Snowflake Using Python
Effortless API Data Integration into Snowflake Using Python and Scheduled Tasks
Hands-Free API to Snowflake Data Loading: Python and Task Automation
#snowflake #data #dataanalytics #datavisualization #api #automation #task #pipeline
Просмотров: 450

Видео

use measure as slicer in power bi | Measure in slicer | Filter by Measure in power bi
Просмотров 1,3 тыс.2 месяца назад
How to use measure in slicer in power bi Measure as slicer in power bi Filter by Measure in power bi #powerbi #data #dataanalytics #datavisualization #measure #dax #measureinslicer #slicer #filter
Automate Visual Formatting in Power BI
Просмотров 3433 месяца назад
How to Create Custom Themes in Power BI: Step-by-Step Guide Create and Apply Power BI Themes for Consistent Visuals Save Time with Power BI: How to Use Themes for Visual Consistency #powerbi #data #dataanalytics #datavisualization #custom #customtheme #theme #themes #themesinpowerbi
Page Level Security in Power BI || Hide and show pages based on user's permission
Просмотров 4,5 тыс.4 месяца назад
Implementing Page-Level Security in Power BI: Step-by-Step Guide Dynamic Page-Level Security in Power BI Page-Level Security in Power BI: Real-World Use Cases #powerbi #data #dataanalytics #datavisualization #pagelevelsecurity #rls #roles #security
Incremental Refresh In Power BI
Просмотров 4,1 тыс.4 месяца назад
How to configure Incremental Refresh In Power BI Power BI incremental refresh tutorial Setting up incremental refresh in Power BI Desktop #powerbi #data #dataanalytics #datavisualization #incremental #refresh #IncrementalRefresh
Create a Pop Out Slicer Window in Power BI
Просмотров 4,8 тыс.Год назад
create a pop up filter pane in power bi create a slicer window using bookmarks #powerbi #data #dataanalytics #datavisualization #slicer #filter #filterpane #ai #artificialintelligence #ml #machinelearning #dataengineering #businessintelligence
Generate automatic insights in Power BI | Data storytelling in power bi | Smart Narrative AI Visual
Просмотров 1,9 тыс.Год назад
Automatic report summary in power bi Generate automatic insights in power bi Data storytelling in power bi 0:00 Smart Narrative Visual 0:28 Smart narrative summary for a Page 2:02 Visual interaction 2:29 Smart narrative summary for a Visual 2:48 Smart narrative summary icon for a Visual Automatic summary of power bi reports using smart narrative Automatic summary of power bi reports using AI po...
AI in SQL Database
Просмотров 1 тыс.Год назад
Language-Driven SQL Database Interaction Natural Language Database Queries with OpenAI Seamless Language Model Integration for SQL Databases Interacting with SQL Databases using Language Models 0:00 intro 0:06 final output 0:40 intro 1:15 demo #data #openai #ai #datascience #dataengineering #langchain #llm #python #LanguageDrivenSQL #NaturalLanguageQuery #SQLDatabaseInteraction #LanguageModelIn...
Automate Data Cleaning in Power BI using Python
Просмотров 6 тыс.Год назад
0:00 intro 1:10 Removing duplicates 1:39 Handling missing values 2:20 Removing unnecessary columns 3:00 Renaming columns 4:12 Splitting columns 5:41 Removing leading/trailing spaces 6:30 Filtering data top 6 data cleaning methods in power bi top 6 data cleaning methods in python How to do data cleaning in power bi How to do data transformation in power bi #powerbi #data #dataanalytics #datavisu...
AI in Power BI | Automated machine learning model in Power BI
Просмотров 37 тыс.Год назад
Auto ML model in power bi Artificial Intelligence in power bi #powerbi #data #dataanalytics #datavisualization #ml #ai #artificialintelligence #machinelearning
RLS Automation in Power BI | Azure Active Directory Security Group Automation
Просмотров 5 тыс.Год назад
How to dynamically add/remove users in security group in Azure Active Directory How to automatically add users into power bi access list #powerbi #data #dataanalytics #datavisualization #rls #m365 #microsoft365 #azure #azureactivedirectory
Dynamic RLS in Power BI | Row Level Security
Просмотров 1,2 тыс.Год назад
0:00 intro 0:06 What is RLS 0:33 Implementing Dynamic RLS 4:40 Testing the RLS How to create rls in power bi row level security | userprincipalname | username #powerbi #data #dataanalytics #datavisualization #rls #username
Pull data from API using Python
Просмотров 47 тыс.Год назад
How to pull data from rest api and push it to sql server JSON data to database using python #python #data #dataanalytics #datavisualization #restapi #api #dataengineering #pipeline
Python as an ETL tool
Просмотров 27 тыс.Год назад
How to push data from excel to database What is an ETL process Extract Transform Load explained in simple words #python #etl #dataanalytics #dataengineering #datapipeline
Custom tooltip in Power BI
Просмотров 2,4 тыс.Год назад
How to create custom tooltip in power bi #powerbi #data #dataanalytics #datavisualization #tooltip #custom
Conditional formatting in Power BI
Просмотров 1,6 тыс.Год назад
Conditional formatting in Power BI
What is Microsoft Fabric
Просмотров 416Год назад
What is Microsoft Fabric
How to restrict a slicer to filter out certain visuals in Power BI
Просмотров 6 тыс.Год назад
How to restrict a slicer to filter out certain visuals in Power BI
Custom sort order | Sort by column in Power BI
Просмотров 7 тыс.Год назад
Custom sort order | Sort by column in Power BI
How to set default slicer value in Power BI
Просмотров 19 тыс.Год назад
How to set default slicer value in Power BI
Date table in Power BI
Просмотров 1,1 тыс.Год назад
Date table in Power BI
bookmarks in power bi
Просмотров 4,4 тыс.Год назад
bookmarks in power bi

Комментарии

  • @Ahmed_Farghly
    @Ahmed_Farghly Час назад

    nice pro keep going

    • @thebihub
      @thebihub Час назад

      @@Ahmed_Farghly thanks Ahmed!

  • @dndaughtery
    @dndaughtery 13 дней назад

    Which IDE are you using? I really like it.

    • @thebihub
      @thebihub 12 дней назад

      @@dndaughtery Pycharm it is!

  • @huzaifshaikh6237
    @huzaifshaikh6237 15 дней назад

    Im Not getting option as Machine Learning Model after creating dataset

  • @Liquidzoro73
    @Liquidzoro73 15 дней назад

    Can you make a video how to push the data from snowflake table to api endpoint

  • @rishi150511
    @rishi150511 22 дня назад

    Hello Brother, Videos is excellent and thanks for sharing. But you never show the output of the script ? if you share us the code. That great for the practice also.

    • @thebihub
      @thebihub 22 дня назад

      @@rishi150511 Hi Rishi, python codes are pasted below in the comment of two approaches, couldn't show the output for this demo as the snowflake account is trail where we can't create external access integration

  • @FaisalMasood-q6g
    @FaisalMasood-q6g 23 дня назад

    Thank you, i did as it is;Now it worked for me

    • @thebihub
      @thebihub 23 дня назад

      @@FaisalMasood-q6g glad it helped you!

  • @thebihub
    @thebihub Месяц назад

    Approach 2 - Outside Snowflake : import pandas as pd import requests as re import sqlalchemy as sa from snowflake.sqlalchemy import URL engine=sa.create_engine( URL( account='xx1234.ap-southeast-1', user='username', password='Password@123!', database='DEMO', schema='DEMOSCHEMA', warehouse='COMPUTE_WH', role='ACCOUNTADMIN' ) ) url = 'example.com/api/data' # Replace with your actual API URL and Headers header = {'Content-Type':'application/json', 'Accept-Encoding':'deflate'} response=re.get(url,headers=header) dt=response.json() df=pd.json_normalize(dt,'data') #pushing data from python dataframe to snowflake df.to_sql('CryptoData',con=engine,index=False,if_exists='append') engine.dispose()

  • @thebihub
    @thebihub Месяц назад

    Approach 1 as demonstrated in video: CREATE or replace PROCEDURE fetchApiData() RETURNS STRING LANGUAGE PYTHON RUNTIME_VERSION ='3.8' PACKAGES = ('requests','pandas','snowflake-snowpark-python') HANDLER = 'getData' EXTERNAL_ACCESS_INTEGRATIONS =(my_api_integration) EXECUTE AS OWNER AS $$ import requests as rq import pandas as pd from snowflake.snowpark import Session def getData(SESSION): apiurl='example.com/api/data' # Replace with your actual API URL and Headers header = {'Content-Type':'application/json', 'Accept-Encoding':'deflate'} response = rq.get(apiurl,headers=header) data = response.json() df = pd.DataFrame(data) SESSION.write_pandas(df=df, table_name='DimTable', database= 'DEMO_DATABASE', schema= 'DEMO_SCHEMA',auto_create_table=True, overwrite=True) return 'Data loaded succesfully' $$; --adhoc basis data fetching/loading CALL fetchApiData(); CREATE TASK DAILY_API_PULL_DATA WAREHOUSE = COMPUTE_WH SCHEDULE = 'USING CRON 0 9 * * * UTC' -- Schedule to run at 9:00 AM UTC daily AS CALL fetchApidata(); ALTER TASK DAILY_API_PULL_DATA RESUME;

  • @thebihub
    @thebihub Месяц назад

    External Access Integrations : docs.snowflake.com/en/sql-reference/sql/create-external-access-integration

  • @kartikeyatiwari6678
    @kartikeyatiwari6678 Месяц назад

    Hi can you make video for current logged user and orther user list ,, does this solution works for that too ?? kindly suggest. thnx

  • @nitishranjan1716
    @nitishranjan1716 Месяц назад

    Hi @The BI Hub, Nee to Implement RLS to prevent some users from accessing Drillthrough in powerbi, kindly advise on same

  • @diegoyglesias288
    @diegoyglesias288 Месяц назад

    What if an unauthorized user clicks on a shared link to a page that was not available? It will probably be able check the page, as it is not really hidden. I mean, this works but for very sensitive data I'm not sure is safe enough

    • @thebihub
      @thebihub Месяц назад

      Hi Diego, what you said is correct , to overcome this combine page level security with row level security so that if any unauthorised has a power bi url he can't see the data in visuals

  • @Arshdeep06
    @Arshdeep06 Месяц назад

    how can we write the header if we want to fetch pools table from uniswap api

  • @rahulfatnani4700
    @rahulfatnani4700 Месяц назад

    How can we automate data backup and download data from salesforce automatically in the local storage

  • @MICHAIL_NIKOLIOUDAKIS
    @MICHAIL_NIKOLIOUDAKIS Месяц назад

    thanks for that! we need more of these please. ETL and ELT processes.

    • @thebihub
      @thebihub Месяц назад

      @@MICHAIL_NIKOLIOUDAKIS sure Michail!

  • @M87user
    @M87user Месяц назад

    Copilot and ChatGPT got nothing on you guys. every time I try to fix something in power apps or power BI i am wasting time on AI. It's always an Indian guy on YT who comes to the rescue!

  • @vishnupp5944
    @vishnupp5944 Месяц назад

    Super helpful

    • @thebihub
      @thebihub Месяц назад

      Glad it helped!

  • @parthasarathimandal9437
    @parthasarathimandal9437 2 месяца назад

    But how do we get to know from which date data ic coming and we need to refresh from which date? I've my source as Oracle and I need to refresh 10 records which are updated and 5 new records which came today. How PBI will rectify that?

  • @Gautam.Khanna.excel.guruji
    @Gautam.Khanna.excel.guruji 2 месяца назад

    Thanks, its very helpful.

    • @thebihub
      @thebihub 2 месяца назад

      @@Gautam.Khanna.excel.guruji glad it helped you!

  • @alaxakbir
    @alaxakbir 2 месяца назад

    to avoid escaping backslashes, use raw strings, like r"C:\path"

    • @thebihub
      @thebihub 2 месяца назад

      Thanks for sharing, another alternative is to use double backslashes!

  • @kalaivicky364
    @kalaivicky364 2 месяца назад

    Imformative

  • @Liquidzoro73
    @Liquidzoro73 2 месяца назад

    On point, thanks

  • @pthapa55
    @pthapa55 2 месяца назад

    Nice information however you forgot to show the viewers how did you join all those tables that you created in the model.

    • @thebihub
      @thebihub 2 месяца назад

      Thanks, modelling is shown at the end of the video, please check!

    • @pthapa55
      @pthapa55 2 месяца назад

      @@thebihub Thanks I see it now. I must have ended the video few seconds early.

    • @thebihub
      @thebihub 2 месяца назад

      @@pthapa55 no issues :)

  • @Gaurav-p3x
    @Gaurav-p3x 3 месяца назад

    Not getting accurate results. i imported a csv and was trying to refresh the data incrementally. Data policy not understood properly.

    • @asdfjkl5330
      @asdfjkl5330 2 месяца назад

      I think CSV is not supported data source as query folding, so may not work?

  • @aashishmeshram9892
    @aashishmeshram9892 3 месяца назад

    very helpful and informative video, keep making such good clips for those who want to know more from basic to pro level..

    • @thebihub
      @thebihub 3 месяца назад

      @@aashishmeshram9892 thanks aashish!

  • @siddharthprajapati6907
    @siddharthprajapati6907 3 месяца назад

    How to apply incremental refresh in Power BI service?

    • @thebihub
      @thebihub 3 месяца назад

      Siddharth, incremental refresh have been configured in desktop, no need of separately doing it,

  • @thebihub
    @thebihub 3 месяца назад

    Theme Generator Link : themegenerator.point-gmbh.com/en/Home

  • @himanshusoni7618
    @himanshusoni7618 3 месяца назад

    Nice work , can you share the Pbix file , you are not show the relationship or the tables

    • @thebihub
      @thebihub 3 месяца назад

      Thanks Himanshu, relationship is been shown in last 30 seconds!

    • @himanshusoni7618
      @himanshusoni7618 3 месяца назад

      ​​@@thebihub , Thanks , there should be (one to many) relationships between PageList tables and PageAccessByRole table .. but in video it seems (Many to Many)

  • @tofonofo4606
    @tofonofo4606 3 месяца назад

    Very nice. Great info!

  • @munawarhussain1400
    @munawarhussain1400 3 месяца назад

    What if user input another user email address to see hidden pages?

    • @thebihub
      @thebihub 3 месяца назад

      User can't put another person's email, power bi will automatically take the email of user logged in, impersonation has been done only to show the demo and can only be done by owner of the dashboard.

    • @munawarhussain1400
      @munawarhussain1400 3 месяца назад

      I have completed the setup. But still pages are not reflecting in BI online service. Not sure what I have done wrong. Can we have zoom call to discuss this?

    • @thebihub
      @thebihub 3 месяца назад

      @@munawarhussain1400 this Saturday please ping me here I'll share Google meet link

  • @juangut4531
    @juangut4531 3 месяца назад

    Why isn't the "forecast" option displayed in the "chose a model" step?

  • @omkarkandekar8043
    @omkarkandekar8043 4 месяца назад

    good 👍

    • @thebihub
      @thebihub 4 месяца назад

      Thanks Omkar!

  • @MyLatinLife
    @MyLatinLife 4 месяца назад

    Nice

  • @vinodhinin568
    @vinodhinin568 4 месяца назад

    In my home page have navigation to 7 different pages. When set row level security for only access to 2 pages. It showing only in slicer, but i can go to all pages

    • @rajatdixit11
      @rajatdixit11 3 месяца назад

      You can hide all the pages and then publish. I think this might suffice.

  • @PoojaYadav-jx9sl
    @PoojaYadav-jx9sl 4 месяца назад

    Suppose my data changes earlier I was having data till 2024 Jun and now I have data till 2023 dec then how it works , currently I am facing problem on this can someone help me

    • @thebihub
      @thebihub 4 месяца назад

      Hi Pooja, the same solution given above will work, for the Max date month always it'll hold 'latest month'. In your case first time latest month would be jun 2024 now it'll be 2023 dec

    • @PoojaYadav-jx9sl
      @PoojaYadav-jx9sl 4 месяца назад

      I have a date table and a fact and they are connected to each in your case you are having only one table

    • @PoojaYadav-jx9sl
      @PoojaYadav-jx9sl 4 месяца назад

      Can you tell me what logic do I need to use

    • @PoojaYadav-jx9sl
      @PoojaYadav-jx9sl 4 месяца назад

      Date 2 = VAR _max_date = MAX ( 'Balance date'[Balance date] ) VAR _last_three_month = EOMONTH ( _max_date, -1 ) + 1 RETURN IF ( 'Balance date'[Balance date] >= _last_three_month, "current month", FORMAT ( 'Balance date'[Balance date], "yyyy mmm" ) ) this is the dax that I have written

    • @PoojaYadav-jx9sl
      @PoojaYadav-jx9sl 4 месяца назад

      It is giving me correct results in the calculated column but not in the slicer

  • @vinodhinin568
    @vinodhinin568 4 месяца назад

    I want rls in report server.. Without publish the report. It is possible to set page level security in report server without the mail id with their gen id.

  • @JuanHernandez-pf6yg
    @JuanHernandez-pf6yg 4 месяца назад

    Useful. Thank you.

    • @thebihub
      @thebihub 4 месяца назад

      Welcome Juan!

  • @tahmidrx
    @tahmidrx 4 месяца назад

    Thank you so much! I needed this for work😊

    • @thebihub
      @thebihub 4 месяца назад

      Thanks, glad it helped you! ☺️

  • @Charanpro007
    @Charanpro007 4 месяца назад

    Very much needed in current scenarios.

    • @thebihub
      @thebihub 4 месяца назад

      Yes, Thanks for sharing the knowledge boss!

  • @unnikrishnansanthosh
    @unnikrishnansanthosh 4 месяца назад

    good one, thank you for sharing

    • @thebihub
      @thebihub 4 месяца назад

      Thanks Santhosh!

  • @Tech2s3
    @Tech2s3 4 месяца назад

    First!! Awesome 💯💯🚀🚀

    • @thebihub
      @thebihub 4 месяца назад

      Thanks Meiry!

  • @Bac2277
    @Bac2277 4 месяца назад

    what if we have thousands of categories?

    • @thebihub
      @thebihub 4 месяца назад

      Hi Bhargav, we have to give ranking accordingly for all if we want custom sort

    • @Bac2277
      @Bac2277 4 месяца назад

      @@thebihub okay, but in my case, i have date table and main table and cannot have active relationship between those tables. So I think I cannot implement ranking for custom sort.

  • @shlok7580
    @shlok7580 4 месяца назад

    Thanks

    • @thebihub
      @thebihub 4 месяца назад

      Welcome Shlok!

  • @gustavotardin8154
    @gustavotardin8154 4 месяца назад

    Thank you very much!!!

    • @thebihub
      @thebihub 4 месяца назад

      Glad it helped you!

  • @tanyabhalla5083
    @tanyabhalla5083 4 месяца назад

    Hi.. Is it possible to connect via email with you...? ☺

    • @thebihub
      @thebihub 4 месяца назад

      Hi Tanya, sure bharath05026@gmail.com

  • @maheshreddy2762
    @maheshreddy2762 5 месяцев назад

    Clean explanation

    • @thebihub
      @thebihub 5 месяцев назад

      Thanks Mahesh!

  • @user-be5mz3yb8t
    @user-be5mz3yb8t 5 месяцев назад

    tq

    • @thebihub
      @thebihub 5 месяцев назад

      Welcome

  • @Skd833
    @Skd833 5 месяцев назад

    For all 3 imports, can you please help with the error :: Import 'requests' could not be resolved by Pylance???

  • @VetrivelPechammal
    @VetrivelPechammal 5 месяцев назад

    how can we use in mysql

  • @AkhilaThakur-rb1rj
    @AkhilaThakur-rb1rj 6 месяцев назад

    Good explanation with easy method 👏

    • @thebihub
      @thebihub 6 месяцев назад

      Thanks Akhila!