Multi Pages Web Scrap (extract) with Power Automate Desktop #45

Example used:
www.scrapethis...
In today's episode, we'll see how to set paging (pagination) for our data extraction. Web Scrap will work on CSS selector of an element which will be set as a pager. We'll cover the basics, see where all the functions are used, then we'll do real-life exercises, and then talk about advanced concepts and what can we do when there is no proper pager - iteration through all the buttons will help in this situation. Enjoy, like and subsribe!
In my recent tutorials, I'm concentrating heavily on powerapps, model-driven apps, Dataverse, Power Automate Desktop, and Power Platform as a whole, When I'm encountering an interesting defect I try to immediately post it on RUclips to make other people's life easier. Sometimes I'll also touch Power Automate but mostly when it supports Canvas.

[@宗全赵]

Hi Zbigniew, may I know how you make the mouse click on page 2 at first and automatically move to page 3 and so on, cause I only able to move 1 step (from page 1 to page 2) and it is stop moving and keep extract the data from page 2 after that......

[@zbigniewlukowskitutorials]

You have an error in Selector, look at 8:23, you need to have a recognizable selector, in my case I had numbers 1,2,3,4, etc, Idk what is your case, if you have numbers you need to iterate through them in a loop by selecting next button and adding +1 to variable in each loop, but to do this you need a selector with recognizable buttons if you don't, then write to your developer.

[@bootattkhoo6531]

Dear Sir Zbigniew, can show how to use "Get Empty Cell"? Because currently im facing a problem when Power Automate Desktop fill the excel into SAP, those "Blank" cell Power Automate desktop also copyover to SAP too. But what i want is those "Blank" cell i want to skip instead of copy. Do you have idea?

[@cezprieto3436]

What to do if next page is "Load More" and not page?

[@zbigniewlukowskitutorials]

YOu need an "IF" function and if "Load More" is visible then click it, scroll to the bottom of the page, check for load more, etc. And then at the end Scrap

[@liakatali-b9l]

@@zbigniewlukowskitutorials if there is no next button ,what would be action please. my web page 50 data at a time , when I scroll down, it automatically load another 50 data and so on. With extract data from web action, it only take first 50 data, how may I take next data ? Thanks for nice video

[@zbigniewlukowskitutorials]

@@liakatali-b9l There are many options, but usually you would need to scroll, and check for element which should be at the bottom.You'll need to do the scrolling before and then scrap all the data. If scroll is infinite, then its a problem... you'll need to set the rules when to stop.

[@chun-haosu4938]

🎯 Key Takeaways for quick navigation:
Made with HARPA AI

[@zbigniewlukowskitutorials]

?

[@namananand2725]

I did everything you mentioned. My webpage has 19 pages, my whole pages run through the flow but when the flow ends i get data only for the 1st page, why so? Please please help

[@evamitsakou]

Hi! What to do when the last page has less data than the rest of the pages and gives me an error?

[@zbigniewlukowskitutorials]

What are the details of the error -message, code etc? - its not because you have less data, but probably cant find the element, please provide more info.

[@liakat26]

Hi, Thanks for nice explain. If I need to scrape a website of 100% spanish language which i need to translate into english, and I need english data. Which technique i should know? please

[@zbigniewlukowskitutorials]

Hey, use AI Builder for translation

[@liakat26]

@@zbigniewlukowskitutorials Perfect. Thanks