Datasets with more than 2000 Items and How to avoid Delegation limits

Поделиться
HTML-код
  • Опубликовано: 14 дек 2022
  • Using Flow and ParseJSON to import datasets larger than the 2000 item limit AND avoiding delegation limits.
  • НаукаНаука

Комментарии • 11

  • @victordauden9173
    @victordauden9173 Год назад +1

    Thank you Tim. You nailed it. Greetings from Spain

  • @geralddahl9159
    @geralddahl9159 Год назад +1

    Looking forward to trying this. Thank you.

  • @pangamot74
    @pangamot74 Год назад +1

    Great video and very well explained. This will help in many scenarios.
    But (there's always a but... 🙂), can you actually get above 5k items?
    When I try it with 5001 items, I get the "The attempted operation is prohibited because it exceeds the list view threshold." message.
    Guess the default "Get items" limitations are still a deal-breaker, but 5k is still alot better compared to 2k if needed.

    • @TimDobrinskiPowerAppsandCoffee
      @TimDobrinskiPowerAppsandCoffee  Год назад +2

      Interesting question. I used 5000 as a random number - never thinking about pulling items beyond the list view threshold.
      What i’d think of trying is to two-step it with two pulls from SharePoint get items using a skip-5000 in the second.
      Id have to try that.

    • @pangamot74
      @pangamot74 Год назад

      @@TimDobrinskiPowerAppsandCoffee
      Thanks for the quick reply!
      I thought about the "get first 5k, cache last Id, start again at last Id" method, like back in the days when we all first tried to get above the 2k limit. But it's not a fun method...

    • @TimDobrinskiPowerAppsandCoffee
      @TimDobrinskiPowerAppsandCoffee  Год назад +1

      I’m seeing it more. For example, moving D365 records to Dataverse, I have to do it in loops of 5000-7500 to avoid timeout.

  • @user-rk5vo4rc7j
    @user-rk5vo4rc7j Месяц назад

    Does this work for a document library?

    • @TimDobrinskiPowerAppsandCoffee
      @TimDobrinskiPowerAppsandCoffee  Месяц назад +1

      It should. Since you’d be returning the metadata from the library, it’s just a variation on the API used.

    • @user-rk5vo4rc7j
      @user-rk5vo4rc7j Месяц назад

      @@TimDobrinskiPowerAppsandCoffee I've tried, but can´t construct the columns needed, for example the 'Full Path', the 'Folder PAth' for subfolders, file name with extension or File Name, Im using your same ParseJson example. but is only working for the title, any suggestions would be appreciated.

  • @DavidAdediran
    @DavidAdediran Год назад +1

    You never need more than 2000 items at a time and your "explanation" for delegation is not helpful. What's frustrating is that you are on the right path to solving the problem of not being able to delegate some queries from Power Apps to SharePoint by delegating through Power Automate.
    The opportunity missed is not demonstrating how the "Send HTTP to SharePoint" action can help with pagination so users don't have to download 2000+ items at a time.