How to do Pagination on a REST API in Power Query (Part 1)

Поделиться
HTML-код
  • Опубликовано: 23 авг 2024

Комментарии • 100

  • @CurbalEN
    @CurbalEN  Год назад +4

    If you dont know the number of pages, use this method:
    ruclips.net/video/05yhwnuCjRw/видео.html&ab_channel=Curbal

  • @HachiAdachi
    @HachiAdachi 3 года назад +7

    Voting for sooner Part 2! Thanks, Ruth!

    • @CurbalEN
      @CurbalEN  2 года назад

      Sooner will be :)

    • @TUBBBBB1
      @TUBBBBB1 2 года назад

      Applying as well, trying to figure this problem out as we speak

    • @CurbalEN
      @CurbalEN  2 года назад +1

      It is out already:
      m.ruclips.net/video/05yhwnuCjRw/видео.html

  • @user-fm3xv9jx6l
    @user-fm3xv9jx6l 5 месяцев назад +1

    Thank you Corbal. This worked wonderfully for an api call that has variable number of pages (10-100).

  • @leonelcontreras-t598
    @leonelcontreras-t598 Год назад

    excellent video, knowing how to get information from api is really a great help. This video deserves so much more likes.

  • @nelsoneng208
    @nelsoneng208 Год назад

    Wanted to drop a line and say thank you! Can't tell you how much help this was. Thank you again!

  • @EverythingPants
    @EverythingPants 2 года назад +1

    I've been wondering how to do this for ages, this is amazing. I've implemented it today for a client and it's worked perfectly - Thanks!

  • @markgoode9897
    @markgoode9897 3 года назад +2

    Yes please Ruth. Would love to see that second video. Thanks for sharing :) Great practical topic

    • @CurbalEN
      @CurbalEN  3 года назад

      Fun to make too ;)

    • @markgoode9897
      @markgoode9897 3 года назад

      @@CurbalEN first time with musical interlude?

    • @CurbalEN
      @CurbalEN  3 года назад

      Nope, done a few times before, was it nice ?

    • @markgoode9897
      @markgoode9897 3 года назад

      @@CurbalEN I missed some videos?! Yup - I’ll need to slow frame my way through. Will give it a go later this week

    • @CurbalEN
      @CurbalEN  3 года назад

      I post too many 😂

  • @melissaclaassen9707
    @melissaclaassen9707 2 года назад

    Thank you so much! I just got dropped into the deep end of the reporting pool at work, and this was an exceptionally helpful video!

  • @CeliaAlvesSolveExcel
    @CeliaAlvesSolveExcel 3 года назад +3

    Love this! Making everything dynamic is exciting!

  • @skalsolutions
    @skalsolutions 3 года назад +1

    As always, a great video with good content! Waiting for the second video! :)

    • @CurbalEN
      @CurbalEN  3 года назад

      I hear you guys, will do it maybe next week already

  • @antique-bs8bb
    @antique-bs8bb 3 года назад +1

    yes please - part 2 sounds v interesting

    • @CurbalEN
      @CurbalEN  3 года назад

      It is similar, but even more powerful:)

  • @impossibru28
    @impossibru28 2 года назад

    I realize I'm a couple weeks late but I would love to see part 2!

  • @lordmarioh
    @lordmarioh 2 года назад

    This video is a lifesaver! Thank you so much!!!

  • @fajnefajne4339
    @fajnefajne4339 2 года назад

    This video is very luxurious. Thank you very much. :-)

  • @nurulbasar8277
    @nurulbasar8277 2 года назад

    great video,
    currently trying to call all available invoice pages from Xero(accounting tool). can't wait for next part.

    • @CurbalEN
      @CurbalEN  2 года назад +1

      Yes, I will try to do it next week!

  • @rkartau
    @rkartau 2 года назад +2

    Hey Loved the video. Making it really easy to learn the stuff. I'd really love to get the second part of the video.
    The thing is that my company is usking JIRA and their API does not use this page nr system as you are showing and the table i need to process has 1150 rows, but jira is limiting it to 50 outputs per request. So as a result I think there is tone of people (many jira users) who'd love to get this second part as much as I do.

    • @byrongdrums8066
      @byrongdrums8066 2 года назад

      I have the same issue in Pipedrive API, Did you solved it? Would be very helpful!!

    • @CurbalEN
      @CurbalEN  2 года назад

      Here it is:
      m.ruclips.net/video/05yhwnuCjRw/видео.html

    • @CurbalEN
      @CurbalEN  2 года назад

      Here it is:
      m.ruclips.net/video/05yhwnuCjRw/видео.html

  • @rashmirana7861
    @rashmirana7861 3 года назад +1

    Yes please do part 2

  • @prabhakaran7406
    @prabhakaran7406 2 года назад

    Thank you so much, wonderful explanation !!

  • @seandavies99
    @seandavies99 2 года назад

    Thank you so much ! Exactly what I needed !

  • @olenadumna4206
    @olenadumna4206 Год назад

    thank you for this video! very good explanation !

  • @fayaflai
    @fayaflai Год назад

    You are the absolute GOAT

  • @windsurfreview
    @windsurfreview 3 месяца назад

    I'm running into a problem with the limits on the number of API calls I can maken (400 max per 5 minutes). Do you have any advice how I could solve this? Is there a way to pause the API calls?
    Thanks for all your videos Ruth. They helped numerous times already.

  • @jasonyi6792
    @jasonyi6792 2 года назад

    Great video! 2nd video please!

  • @waldof86
    @waldof86 2 года назад +1

    I've had opportunity to do both this and another one where I don't know the amount of pages beforehand, but in both cases, my main issue is that it won't refresh in the service. I'd love a video on that if you have a solution. As always thank you for your amazing content!

    • @aCURLYproduction
      @aCURLYproduction 2 года назад

      I have the exact same problem! I get to create the report but when I publish and try to schedule a refresh I get an errormessage

    • @CurbalEN
      @CurbalEN  2 года назад +1

      Try this:
      m.ruclips.net/video/fstsQMZiHME/видео.html

  • @mikes6248
    @mikes6248 2 года назад

    Thanks!

  • @surender665
    @surender665 2 года назад

    Hi, I humble request you for getting suggestion how to import data in power bi from Apache druid . there is not direct connectivity option in power bi.

  • @prokocim
    @prokocim 3 года назад +1

    great stuff! one question: since we have the dynamic number of pages in query 'country' do we need 'Query1' any more?

    • @CurbalEN
      @CurbalEN  3 года назад +1

      No you don’t need it anymore :)

  • @abhijeetghosh27
    @abhijeetghosh27 3 года назад

    Cool .. very good idea 👍👍

  • @TiesKuipers
    @TiesKuipers 2 года назад

    Hi there,
    I was wondering how you could paginate an API with x pages and where the page ends with Next, mine keeps looping with this method, so I think my example needs another fix right?
    Could you help me with that?

  • @johnyoung5164
    @johnyoung5164 2 года назад

    Hello
    Long time viewer, first time caller, keep up the good work
    I have had a problem with this that I have encountered before using API but havent been able to solve, it is the dreaded "Formula.Firewall: Query 'Query2' (step 'Added Custom') references other queries or steps, so it may not directly access a data source. Please rebuild this data combination" error message
    There are examples online but none of them use Web.Contents, can you show me how to solve this?

  • @tuyoexcelypowerbi
    @tuyoexcelypowerbi 3 года назад

    Buen vídeo!!

  • @luukhilde4016
    @luukhilde4016 2 года назад

    Hello, I get the message "Some data sources may not be listed because of hand-authored queries" when I open the data source settings. Any idea how I could fix this? I think this appears when I dynammically loop the query based on de column1 list

  • @mahathmasadineni2884
    @mahathmasadineni2884 2 года назад

    Hi Madam. I just want to know is it possible in power query to get the data of all duplicates in a single row.

  •  Год назад

    How can I use Dataflows for this task? I always get a dynamic consult error when I try this trick.

  • @emiliag4070
    @emiliag4070 3 года назад

    Hey Ruth, great timing :) because I have problem with that :) And I have a question for You or subscribers: will this solution work on PowerBI Server?

    • @CurbalEN
      @CurbalEN  3 года назад

      Power BI server or service? It works on the service

    • @emiliag4070
      @emiliag4070 3 года назад

      @@CurbalEN I mean PowerBI Report Server?

    • @emiliag4070
      @emiliag4070 3 года назад

      I want to schedule refreshing on PowerBI Report Server and I get this message: "Scheduled Data Refresh is not available for reports. The report does not have any external data connections defined or is using an unsupported data source."

    • @CurbalEN
      @CurbalEN  3 года назад

      Oh, the on-prem one. It should work, try it.

    • @CurbalEN
      @CurbalEN  3 года назад +1

      I take it back:
      Report server does not allow dynamic data sources:
      Your report contains dynamic data sources. For example, data from the report is used to dynamicaly build the name of a server, the name of a database, or a URL address to fetch contents. Only data sources that are detected when the report was uploaded can be refreshed.

  • @debsicus
    @debsicus 2 года назад +1

    I have an API that provides a next page key and count of records but says nothing about number of pages. How do I treat this?

    • @CurbalEN
      @CurbalEN  2 года назад

      Coming up on how to fix unknown number of pages, stay tuned

    • @mirnakhoury8888
      @mirnakhoury8888 2 года назад

      is this solution available?

    • @CurbalEN
      @CurbalEN  2 года назад

      Yes:
      m.ruclips.net/video/05yhwnuCjRw/видео.html

  • @AnweshGangula
    @AnweshGangula 2 года назад

    waiting for part-2

  • @murtazaulhasan
    @murtazaulhasan 3 года назад

    Great Video!
    Can you also do a tutorial to create admin views? (Workspaces, user access, reports, datasets, etc) using REST APIs that refreshes dynamically? (Without having to hardcore your password in the query editor). TIA.

    • @CurbalEN
      @CurbalEN  3 года назад

      You mean Power BI rest api?

    • @murtazaulhasan
      @murtazaulhasan 2 года назад

      @@CurbalEN Yes please. Powerbi APIs. I am trying to create report from the thousands of workspaces that we have, which can help us manage the content, access/users, datasets etc

    • @CurbalEN
      @CurbalEN  2 года назад

      With the time I have available at the moment, it is not on my priority list I am afraid. Working with APIs takes long time :(

    • @murtazaulhasan
      @murtazaulhasan 2 года назад

      @@CurbalEN i understand. Thank you for replying.

  • @sanoobarkhan1445
    @sanoobarkhan1445 2 года назад

    How can I import data from JIRA server using rest Api.. please help

  • @quentinwinisdoerffer421
    @quentinwinisdoerffer421 3 года назад

    Hey Ruth, Thank you for the tips. I couldn't try as the API isn't working (maybe because of firewall...) however i was wondering if you could schedule refresh in the Web Service. Often it gets the error that Dynamic queries are not supported (as least in Pro version without premium)

    • @CurbalEN
      @CurbalEN  3 года назад

      You can if use RelativePath and Queries:
      m.ruclips.net/video/fstsQMZiHME/видео.html

    • @quentinwinisdoerffer421
      @quentinwinisdoerffer421 3 года назад

      @@CurbalEN I need to get deeper into that... Thanks a lot Ruth, as always :)

    • @CurbalEN
      @CurbalEN  3 года назад

      My pleasure!

  • @mrkraymnd
    @mrkraymnd Год назад

    NOTE as of 10/5/22: This approach only works in PBI desktop and wont work once published to PBI Online. Refer to "dynamic data source" error.

    • @CurbalEN
      @CurbalEN  Год назад +1

      Dynamic data source error refers to how the url is built not the list.numbers approach

    • @mrkraymnd
      @mrkraymnd Год назад

      @@CurbalEN fair - would love to see how to fix the "data source error" :D

    • @CurbalEN
      @CurbalEN  Год назад

      This might help:
      m.ruclips.net/video/fstsQMZiHME/видео.html

  • @SaniGarba
    @SaniGarba 3 года назад

    Sooner🙂

  • @user-ji7mr2vc4p
    @user-ji7mr2vc4p 10 месяцев назад

    you are not showing the whole page you have in powerbi and that makes it very hard to follow you.

    • @CurbalEN
      @CurbalEN  10 месяцев назад

      Sorry, my editing skills are not the best at times :(

  • @eugeneo1589
    @eugeneo1589 2 года назад +1

    Or you could use ?per_page=9999999 to obtain all the records in one result :)

    • @CurbalEN
      @CurbalEN  2 года назад

      Oddly enough, you actually can do it with this API. Never seen it before 🤷‍♀️

    • @iliovininino
      @iliovininino Год назад

      Love you so much, because I was lost and do not know what to do once the high speed of the video began cause there are some steps missing. I guess I need a brake from the computer.