How to Scrape Infinite Scroll Sites with Power Automate Desktop

Поделиться
HTML-код
  • Опубликовано: 6 янв 2025

Комментарии • 40

  • @andersjensenorg
    @andersjensenorg  7 месяцев назад +1

    Like if the video helped you, thanks ❤
    Every Power Automate Desktop best practice explained: ruclips.net/video/QjrxLPg_TdI/видео.html

  • @tatuhey
    @tatuhey 7 месяцев назад +2

    Hi Anders, your tutorials in Power Automate has help me since the start of my Internship in March up to today. I managed to properly connect two different webapps via REST API and it all thanks to your help. Good onya mate!

    • @andersjensenorg
      @andersjensenorg  7 месяцев назад +1

      Hey, tahuhey, wow, what a lovely message to receive. Thanks a lot 😊🙌 I will do my best to create more Power Automate tutorials that suit your needs. Kind regards, Anders

  • @andrewlockwood6102
    @andrewlockwood6102 3 месяца назад +2

    At 9:40 Anders assigns the variable AmountOfReviewsBeforeEndClick as the first operand of the 'Send Keys Loop' and then AmountOfReviewsAfterEndClick as the second. My understanding was that the variables contained a datatable (rather than the numeric value = RowsCount). In fact, they do both contain a datatable, which can be displayed using a msgbox. The actual row count can be displayed in a msgbox too but requires explicit reference to the RowsCount property of the datatable (ie. %AmountOfReviewsAfterEndClick.RowsCount%). I imagine that the requirement for the loop operands to be numeric, has PA automatically reference the RowsCount property implicitly, rather than throw an error. This was not obvious and had me scratching my head. Mystery solved!

    • @andersjensenorg
      @andersjensenorg  2 месяца назад

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 13,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders

  • @meta-marc
    @meta-marc 7 месяцев назад +1

    wish i could like this twice. haha. PA is great but the learning curve can be steep in some edge cases like this. even when they’re simple, seeing practical applications is super helpful. awesome work! Thank you!

    • @andersjensenorg
      @andersjensenorg  7 месяцев назад

      Thank you so much, meta-mac 😊 I agree, nothing is complicated in Power Automate Desktop - you need to get the right idea, which is easier when you have seen it before. Have a great day. Kind regards, Anders

  • @tamdinh6991
    @tamdinh6991 6 месяцев назад +1

    Good afternoon, Jensen,
    It seems to me that we need to set the focus to the page we like to scroll before we send key in order for the robot to scroll to the end of the review. Please advise.

    • @andersjensenorg
      @andersjensenorg  6 месяцев назад

      Good morning, yes and that's what I do at 2:20 in the video 😊 Kind regards, Anders

  • @mayankgupta247
    @mayankgupta247 7 месяцев назад +1

    Awesome video once again.. learnt so much from you since last 1 year on Desktop flows..keep doing the great stuff..

    • @andersjensenorg
      @andersjensenorg  7 месяцев назад

      Hey Mayank, thanks a lot, highly appreciated 🙌😊 Kind regards, Anders

  • @Furqan-RPAdeveloper
    @Furqan-RPAdeveloper 6 месяцев назад +1

    Hi anders,
    Your videos really halped a lot in learning specially css selectors. Very detailed and well explained.And As you always say , i pratice while watching your video. Thanks a lot and keep up the good work 👍 more power to you 💪

    • @andersjensenorg
      @andersjensenorg  6 месяцев назад

      Hey Furqan, 1000x thanks, highly appreciated - and that's the right way to do it: Open PAD and replicate. Have a great weekend, Anders 😊

  • @nightowlmusic3905
    @nightowlmusic3905 2 месяца назад

    Hi Anders, it doesn't work when I use this on RUclips to scrape streams numbers and artists name ?

    • @andersjensenorg
      @andersjensenorg  2 месяца назад

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 13,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders

  • @lawrence5304
    @lawrence5304 7 месяцев назад +1

    great job ! Anders, looking forward to watching more quality videos like this. how about s next time😀

    • @andersjensenorg
      @andersjensenorg  7 месяцев назад

      Many thanks, Lawrence. Sure, do you have a public example page I can use to demo in the video? Kind regards, Anders

    • @SwapnaBhowmick-mk7sw
      @SwapnaBhowmick-mk7sw 7 месяцев назад +1

      Thank you Anders... Please make a video on the topic captcha solving using OCR

    • @andersjensenorg
      @andersjensenorg  7 месяцев назад +1

      Noted, thank you, Swapna 🙌😊

  • @sumichandran-q9n
    @sumichandran-q9n Месяц назад

    Hi Anders, I need a help. How can we handle if it extracts the data that is only visible on the screen instead of the loaded one once scrolled. (I.e. If the loaded data has 14 rows and the visible data is 6, it capturing only those 6 rows insted of 14). Could you please help me on this?

  • @devchopra2403
    @devchopra2403 7 месяцев назад +1

    Hi Andres,
    Thanks for explaining the infinite scroll. It is working really fine. Can you help me extract whole the reviews text that can be initiated by clicking on more?

    • @andersjensenorg
      @andersjensenorg  7 месяцев назад

      My pleasure, yes I do it here: ruclips.net/video/7jqD9YucPSA/видео.html 😊

  • @willianrom
    @willianrom 7 месяцев назад +1

    Do you have any videos about Botcity? I did not find.

  • @willianrom
    @willianrom 7 месяцев назад

    Great, I have a question, in your example you used a browser that was open, I tried opening a new browser with the Google Maps URL that you left in the description, but the PAD gives a URL error, in this case is there any solution?

    • @andersjensenorg
      @andersjensenorg  7 месяцев назад

      Hey William, no problem here, you might need to add a click on the "Review" button. Kind regards, Anders

  • @stanTrX
    @stanTrX 6 месяцев назад +1

    Thanks, but Anders this assumption is based on each scroll has different numbers of reviews right?

    • @andersjensenorg
      @andersjensenorg  6 месяцев назад

      My pleasure, no - this will work regardless (at least on Google reviews). Kind regards, Anders

  • @JosephHadaCleveland
    @JosephHadaCleveland 7 месяцев назад +1

    Is there any chance you could do a video, if it is possible, on how to feed in a list of URLs from excel and save each page as a pdf to a folder?

    • @andersjensenorg
      @andersjensenorg  7 месяцев назад

      Hey Joseph, thanks a lot for the suggestion. Do you have a sample page of what you want to save? Kind regards, Anders

    • @JosephHadaCleveland
      @JosephHadaCleveland 7 месяцев назад

      @@andersjensenorg I want to pull pages from an aspx website and save as pdf so I can later selectively print the ones I need. I can enter search criteria but its faster to just enter the URLs because they are all numbered.

    • @JosephHadaCleveland
      @JosephHadaCleveland 7 месяцев назад

      Additional note, I'd like to save it as a pdf rather than as an image so I can search through the document to see if it contains key words later on.

  • @Pratzy6365
    @Pratzy6365 6 месяцев назад

    how to click on hyperlink with same name mutiple times is there any way we can store cardinal values

    • @andersjensenorg
      @andersjensenorg  6 месяцев назад

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders

  • @iammortazavi
    @iammortazavi 5 месяцев назад

    Hi Anders,
    When fetching tweets from Twitter using a specific keyword, it only extracts the latest ten tweets. When I scroll down and select more, it captures the tweets at the bottom and the ones at the top get removed. Is there a solution for this?
    Thank you for your guidance.

    • @andersjensenorg
      @andersjensenorg  5 месяцев назад

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 13,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders

  • @faridrosli7814
    @faridrosli7814 Месяц назад

    Hello my power automate keep running even the the page reached the end of list, so how to stop it from keep running after reach the end?

    • @andersjensenorg
      @andersjensenorg  Месяц назад

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 14,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders

  • @jedgeorge3485
    @jedgeorge3485 4 месяца назад

    So when we compare the values of two data tables, it actually compares the number of their datarows...hmmm

    • @andersjensenorg
      @andersjensenorg  4 месяца назад

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 13,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders