Maintaining Query Folding when Merging with Different Data Types

Поделиться
HTML-код
  • Опубликовано: 11 июл 2024
  • Learn how to maintain your query folding when needing to merge (join) queries in Power Query, but when the merge keys are different data types, and when converting data types might initially break your query folding. Tune in to learn more!
    RELATED CONTENT 🔗
    Query Folding Overview -- learn.microsoft.com/en-us/pow...
    BECOME A CHANNEL MEMBER 🎉
    -- / @havensconsulting
    CHECK OUT OUR MERCH STORE 👕
    -- havens-consulting.creator-spr...
    LET'S CONNECT! 🧑🏽‍🤝‍🧑🏽 🌟
    -- / havensbi
    -- / reidhavens
    -- / havensconsulting
    -- / havensconsulting
    VIDEO CHAPTERS 🎥
    0:00 - Start of Video
    0:30 - Content Intro
    HAVENS CONSULTING PAGES 📄
    Home Page - www.havensconsulting.net
    Blog -- www.havensconsulting.net/blog-...
    Blog Files -- www.havensconsulting.net/blog-...
    Files & Templates -- www.havensconsulting.net/files...
    Consulting Services -- www.havensconsulting.net/consu...
    Online Courses -- www.havensconsulting.net/onli...
    Contact & Support - www.havensconsulting.net/conta...
    EMAIL US AT 📧
    info@havensconsulting.net
    #PowerBI #powerplatform #microsoft #businessintelligence #datascience #data #dataanalytics #excel #powerapps #datavisualization #dashboard #bi #analytics #powerquery #dax #microsoftfabric #semanticmodel #queryfolding
  • НаукаНаука

Комментарии • 14

  • @gauravguliani358
    @gauravguliani358 Месяц назад

    Excellent Reid!

  • @abhijeetghosh27
    @abhijeetghosh27 Месяц назад

    Cool trick.. 👌👌Thanks @Reid 😊👍

  • @ngoduyvu
    @ngoduyvu Месяц назад

    thanks for great video

  • @jadwiga8759
    @jadwiga8759 Месяц назад

    good to know!

  • @imbhartesh
    @imbhartesh Месяц назад

    Useful 👍

  • @Milhouse77BS
    @Milhouse77BS 2 месяца назад

    This could useful. I like my queries to fold.

  • @OneNI83
    @OneNI83 Месяц назад

    Nice video. Better you could zoom in the focused frames.

  • @sohailansari9337
    @sohailansari9337 Месяц назад

    Nice👏

  • @Baldur1005
    @Baldur1005 Месяц назад

    Reid, isn't best practice is to write SQL Query instead of checking whether Query will fold or not?

    • @HavensConsulting
      @HavensConsulting  Месяц назад

      Native queries have their own complexities, and by default break any ability for Power Query to fold on top of it (more below)
      ruclips.net/video/DWbh7xp08l0/видео.html
      It also relies on having a developer know SQL and SQL optimization techniques, which are all built into the query folding engine.
      Like with most things though, it depends. :)

  • @1yyymmmddd
    @1yyymmmddd Месяц назад

    What is so special about query folding? Why we should care about it? Incremental refresh works without query folding. Some folks say, it is quicker. But how can "Select * from Table1" writen by me (which does not fold) be slower than same thing written by the engine?

    • @HavensConsulting
      @HavensConsulting  Месяц назад +2

      It's the magic sauce of Power Query :). Transformations are translated from M (Power Query) to the source, and passed back for the source to transform (faster). Rather than Power BI downloading the unprocessed data, and doing it itself (slower). You can easily get a 5, 10, 20+ times performance increase when the source database does most the work. A quick google search would give you some helpful results like below on why it makes queries faster.
      www.reddit.com/r/PowerBI/comments/14strbb/what_does_folding_in_query_folding_means/
      Also, to note,. Incremental refresh is explicitly advised NOT to use without folding. Because without folding you download the entire data before filtering to the relative period. Which is why when folding can't be confirmed with the engine, it gives a big warning that advises not to use incremental refresh. More below on that as well.
      learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview

    • @1yyymmmddd
      @1yyymmmddd Месяц назад

      @@HavensConsulting Thank you for your explanation. Are you saying if I write "Select ProductID from Sales" myself in the Source dialog Advanced options, Power Query still loads all the data first, then executes my Select statement?

    • @HavensConsulting
      @HavensConsulting  Месяц назад +1

      @@1yyymmmddd native queries (e.g. writing custom SQL Code in the statement box) will actually break any ability to query fold. So generally advised to not use that. It's advised to use the Power query actions to choose your columns, filter your rows, do your transformations. etc.
      More info about native query limitations below
      learn.microsoft.com/en-us/power-query/native-database-query