div > div > div > div > span > div > div:eq(1) > span:eq(0) > a > div > h2 > span > span > span div > div > span > div > div:eq(1) > span:eq(0) > a > div > h2 > span > span > span div > div > span > div > div > span:eq(0) > a > div > h2 > span > span > span div > div > div > div > span > div > div > span:eq(0) > a > div > h2 > span > span > span div > div > div > div > span > div > div > div:eq(1) > div:eq(1) > h2 > a > span I get five duplicate headers in amazon and can't do anything about it, each of them where there is a signature (Sponsore) is added to a separate header. In other categories the output is different and the situation is quite different, you showed in the tutorials the simplest output when it is displayed by list You can do your homework where it's hard, not where it's easy - Amazon varies from category to category. In other categories, the situation is different
This was an excellent lesson took me 6 hours to complete with rewinding back to ensure that i had got it right but has enhanced my knowledge of RPA and PAD as it combined webscraping, Excel, variables/datatables, CSS Selectors and RegEx all into one project - thanks again 👍👏
Thank you. I've just come across this. I seem to remember that PAD used to have an 'Extract Href:' option when selecting a web element but seems to have disappeared. Thank you for showing how to use the selectors to do this.
This is helping me get up to speed with PA, I think I'm ready to tackle pulling in products to my store from the wholesalers site now. I just need to figure out how to drill down into each product page and retrieve more data. Veyr helpful, I hope you do more on web scraping this is so useful. Thanks!
Hey @ryanlebear. Thanks a lot 😊 Have a great day. You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
It's good to know how to get the next button by using css selector. Get data from one datatable to another is a good one as well. Thank you for the video.
Thanks a lot for putting in time to do it. I learnt a lot of new things on PAD. I was surprised that put did not use pager on "Extract Data From Webpage", then when I tried it, I could not get it to work... so I understand why you did it. In 38:52 , if you right click "The Smartest Way to Learn Python Regex: Learn the Best-Kept Productivity Secret of Code Masters" and click inspect , it will take you to the exact SPAN/. Otherwise clicking the little box-arrow icon on the top left of the "Developer tools section, and clicking "The Smartest Way to Learn Python Regex: Learn the Best-Kept Productivity Secret of Code Masters" will take one to the HTML code. I find this the fastest way to get to it.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
WOW! Thank you so much, Anders! I had the exact same problem extracting the URL behind a text from a webpage my company uses in the aquisitions department! I learned how to navigate the selectors route like you did with so many DIV and other elements.
Great job as usual! Thank you for sharing your invaluable knowledge with us. Based on your instructions, I did some web scraping from another website, and it wasn't as easy as scraping from Amazon. This website provides different results for the same search term 2 out of 10 times, showing sponsored ads (for the searched product) and other content at the top of the search results that cannot be automatically detected. I implemented a solution where I tried to read various elements that appear during the search. I'm not sure if it's the right approach, but I managed to get the results into an Excel file. Additionally, I added a short VBA code that converts "http ..." to clickable links.
Hey PawelW, wow great job 💪 Based on what you did, I'm sure you didn't needed the video 😀 Thanks a lot for reporting back, appreciated. Kind regards, Anders
Thank you. Please, do you have a tutorial on how to search a list of websites for a particular word/phrase and return those who do have that term included?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 13,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
You're very welcome, @wmferreira - your support helps me a lot 😍 You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: ruclips.net/video/xWFz-S96XGo/видео.html
Looks like an excellent video. I need to go a page deeper, for example, clicking on each product and extracting some details from the product page, and then clicking back to go back to all products, and then clicking on the next product, then clicking next page at the end and repeat. Couldn’t find a video like that on RUclips! Any suggestions?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
100% Subscribing! Anders, I love the way you teach! I have viewed hundreds of hours of RUclips videos and reviewed documentation on Power Automate and Power Automate Desktop and everyone wants you to follow along, yet no one really explains WHY they are doing what they are doing. The result is, I find myself copying but not able to create flows on my own, until now. I am now able to build flows without copying from videos even though I still refer to videos from time to time. I have run into a problem extracting data from a webpage where the data on the site does not have the header or span but shows Table Data Cell (outlined in red). I can click the cell and click Select Element as Text but it does not populate the Live Web Helper Window Extraction Preview Window. Any Suggestions?
Thanks a lot, @theprofessor4487 🤗 Your feedback helps me immensely. You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Hi Anders. Great tutorial, I learned a lot. The only thing I don't understand is why you didn't use 'Set element as pager' for the Next button in the 'Extract data from web page' action. It would have been very simple, as simple as a right click, instead of a complicated loop.
Hey Andreea, thanks a ton. The reason is that the "Set element as pager", doesn't work (or at least haven't worked for the past 2 years - I haven't tested it the last months though). Another one is that we can set the number of pages to extract, since it will take all pages. Kind regards, Anders
Hey Jeremy, thanks a lot. First of all, can I be sure it's always there? If not I need to create a check for it and then, if it exists, click to close it. Kind regards, Anders
Hi! Great vid! What would you recommend for a web with multiples pages. The web automatically refreshes every 5 or 6 minutes. How do I continue from the last one?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Hello Anders, your videos are great, congratulations! Is it possible to generate the affiliate link automatically, save it in Excel, and update the Geniuslink database? This complete tutorial would be greatly appreciated.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
This is a great video and i followed everything step by step to the end getting correct results right up until the last part where we are supposed to be scraping the first 3 pages of results for each product. But when i run my final one, I am getting the 4 tabs added to the excel spreadsheet correctly but it seems to only be displaying the 3rd page of results for each product, i.e. it displays only 17 lines of entries for each product, and they seem to all be from page 3 of the results. Any clues on what i have done wrong please?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thanks Anders for the great tutorial. but i have one question. if there is no webpage number & Page is load only when scroll down. in that case how to extract multiple pages.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thanks a bunch, @m.salmanrahmat7712 🤩 I've created a Discord. We're more than 11,000+ RPA developers networking and solving problems here: ruclips.net/video/xWFz-S96XGo/видео.html You're more than welcome. Kind regards, Anders
This was awesome except on the page I tried it on, next button thing didnt work. The next button becomes greyed out on the last page but the flow doesnt error and just continues through the loop over and over. Any ideas for a alternative way of doing this?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
I found a way around this. I got the number of pages from the "Page x or 20" message and messed with the string to get the number of pages. Then just looped this many times.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Excellent Tutorial! But im having trouble with the loop! Cause when it reaches the end it doesnt go to the label even though i put in the error to go to the label! It gets stuck in the loop!
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 7000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thank you for a very comphrensive video. I'm working on my own version of this where I'm looping through a list of search terms - not using known dropdown items, I'm checking if the term exits in a news source page. I get an error message when the search term can not be found. What's the best way to program a "For Loop" that skips if an error is found or a term cannot be found?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Hi Anders Thanks for everything and your videos are a great source thank you I have one problem that you may be able to answer I have looked at most of your tutorials and cannot find how I could get what I am after? As an example you collect the URL for the individual products but what if I wanted to follow these links and collect further detail in addition to what we have already collected from the product that is not on the brief description especially if the link brings up a pop up window? Thanks again for all your help
@@andersjensenorg Hi Anders this is great and just what I was looking for, I will use this as a guide for my own project much appreciated keep up the good work 👍
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thank you for this tutorial. I have one question... It seems that the amazon algorithm changed (or I have a wrong setting) which shows all the results in grid view and the scrape is not working. Depending on the book searched it may come up with the list view and the scrape does work. Is there a way to make it work for grid view?
@@andersjensenorg Yes... about three weeks ago it was running perfect, and I remember seeing the results as list view. But now all results are in grid mode. It seems as they changed the way the results are displayed, and hence our method of scraping.
@@mrmalone2222 I've just tested again, and nothing changed (still 16 rows and x columns). You're more than welcome to post the problem at my Discord. It's 100% free and the link is in the video description. Kind regards, Anders
Absolutely amazing training video, thanks Anders, I got from 0 to 100% in no time, one question i have though since i already implemented on a project of my own my scenario let's say is only one product so i applied exactly the same steps except from calling products name from the excel sheet, the challenge i have is after running the robot i get all the data correctly in the Base result but only last page appears in the excel sheet extracted any idea what could be done wrong?
Thanks for writing and the nice feedback 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 7000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thanks so much Ader, I followed your video step by step by I got stucked when i need to do the extraction, when i selected the Ist title as span and right click and hover the extract option, the mouse doesnt bring up the option to select text... Pls, what is can be done
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
First off - great video and as usual better explanation on what/why you're doing stuff. When I test the RegEx code [ ]+ in RegEx 101 online to replace CR & LF with just CR it works, but when I add it using your RegEx technique in my Extract Data from Web for the appropriate CSS selector - the results return nothing. Any thoughts?
thank you for this video. You didn't click on the title of each book to scrap details regarding each book. Can you complete this video on showing me how to do this? It should be taken into acount that when we make the book search today, the list of books we will find today may be diffferent of the ones we can find tomorrow or other days.
Hi Anders, While I was going through this tutorial video in step extract data from web page the data which we are reading fields like cost and reviews from the web page the data is not getting extracted and is giving blank for most of the time. But the issue is very intermittent. Sometime it works and sometime it doesn't.. is there any solution to check why we are facing this issue??. Please suggest.. thanks 😊
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Excellent tutorial, quick question, can you show us how to extract data from hover mouse action. This means if I move the mouse over an specific word, the webpage will show me the meaning, and I want to capture that information. Thank you
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Great tutorial but i am still stragling to take what i want, lets say that i have several pages of links and i want to scrape the same things from each link (structured)and the several pages(structured too) offcourse and in 1 case those pages are opening in a new tab. And in an other one case the element i want is after 1 click in the same page
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
NIce video, however I'm wondering why you're bothering using excel, instead of saving into csv ? I've ran into several errors trying to mess up with excel. Sometimes it just wouldnt launch on my computer, or on the computers of the people using my flows. Ended up never using excel again with power automate, and only read/write csv files.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
I have found a web page which seems to be protected from web extraction. When you hold ctrl to select what you want to extract, the red boxes disappear and the click just visits the link. Any ideas for to get around this?
Quick question, when I select extract data from the web. It detects the pattern of half entries but only extracts 12 entries there are 24 entries on the page. Any quick solution please?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
I hope you're doing well. I've been working through the "Web Extraction in Microsoft Power Automate Desktop" tutorial. However, I've encountered an issue. During the training phase, the Amazon website appears vertically, but when I test the bot, it opens the website horizontally, resulting in an error. Could you please create a video to help resolve this?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
You can use the "Send keys" action (find the enter in Misc). You might have to go into the Populate text field on web page just before - Advanced - untick the Unfocus.... That will work. Kind regards, Anders
hi anders.thank you for awesome tutorial.i have a question about scraping data on website.when i gathering data from website i saw this warning[[extraction preview displays only the first 20 items of the list]] but in each page i have more than 20 items.Why the others items didnt save on excell??
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
I have a question - How can I automate The file Upload like music file or videos on any platform like youtube or on any website ? How to select and upload it? can please guide me ?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
in previous version of pad when i put "-1" in css selector it directly clicks last link but after updating pad to latest version it shows "-1" as error. What to do for directly clicking the last link whithout clicking the before links
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
I realise this is quite an old tutorial, but I hope questions are still answered. I have a webpage with television seasons, episodes and precise of the episode. The Seasons are split via UL/LI lists for each season if I select the Season H4, then the next season h4, I get a list of all the seasons in the extract from webpage popup - great. However, if I then select the episode title, the list breaks and all I see is season 1 season 2 and the first episode title. So I tried just selecting the episode titles, but then I only get the first season as they are split. Can I get Season 1 episode 1 title episode 1 description episode 2 title episode 2 description etc etc Season 2 episode 1 title episode 1 description episode 2 title episode 2 description etc etc or Season 1 episode 1 title episode 1 description Season 1 episode 2 title episode 2 description etc Season 2 episode 1 title episode 1 description Season 2 episode 2 title episode 2 description etc I cant find out how to get the data from the page where the lists are separate
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Today, all of my Amazon search results are displayed as Tiles instead of as a list. As a result the Extract data from web page does not return all the items, it only returns one row with the first book. I can't find any option or method on Amazon to force it to display a List, consistently 😖😖!! This is my life as a coder ... Maybe I'll get a different result tomorrow !
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
![Eminem - Somebody Save Me (feat. Jelly Roll) [Official Music Video]](http://i.ytimg.com/vi/Vwa0HenQMi4/mqdefault.jpg)
Thanks for all your likes and support 🙌🔥
Watch this video next: ruclips.net/video/x5l7Ow7s5Lo/видео.html
Thank You so much sir, can you do a tutorial to extract all reviews of a product in amazon
Is it possible, plz replt😐😑
div > div > div > div > span > div > div:eq(1) > span:eq(0) > a > div > h2 > span > span > span
div > div > span > div > div:eq(1) > span:eq(0) > a > div > h2 > span > span > span
div > div > span > div > div > span:eq(0) > a > div > h2 > span > span > span
div > div > div > div > span > div > div > span:eq(0) > a > div > h2 > span > span > span
div > div > div > div > span > div > div > div:eq(1) > div:eq(1) > h2 > a > span
I get five duplicate headers in amazon and can't do anything about it, each of them where there is a signature (Sponsore) is added to a separate header. In other categories the output is different and the situation is quite different, you showed in the tutorials the simplest output when it is displayed by list
You can do your homework where it's hard, not where it's easy - Amazon varies from category to category. In other categories, the situation is different
Very helpful for someone who is new to PAD. I can do what I needed after watching your tutorials, many many thanks!
Hey Emma, thank you so much 🤩 Kind regards, Anders
This was an excellent lesson took me 6 hours to complete with rewinding back to ensure that i had got it right but has enhanced my knowledge of RPA and PAD as it combined webscraping, Excel, variables/datatables, CSS Selectors and RegEx all into one project - thanks again 👍👏
Hey Shaun. Thanks a ton! 🙌😎 I like your attention to details. Have a great day . Kind regards, Anders
Thank you. I've just come across this. I seem to remember that PAD used to have an 'Extract Href:' option when selecting a web element but seems to have disappeared. Thank you for showing how to use the selectors to do this.
Hey Robert, unfortunately they dont do it consistently 😞 Thank you, kind regards, Anders 😊
This is a very detailed training video. Thanks a lot for your efforts
I'm so glad to hear, thanks a lot 🙌
This is helping me get up to speed with PA, I think I'm ready to tackle pulling in products to my store from the wholesalers site now. I just need to figure out how to drill down into each product page and retrieve more data. Veyr helpful, I hope you do more on web scraping this is so useful. Thanks!
Hey @ryanlebear. Thanks a lot 😊 Have a great day. You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
@@andersjensenorg Did the video you were asked about above show up?
It's good to know how to get the next button by using css selector. Get data from one datatable to another is a good one as well. Thank you for the video.
My pleasure, happy you could use it 😍
Another excellent video for learning. Great quality. Thanks
I'm so happy to hear, Alvin, thanks a lot 💯🙂
Really enjoying you channel Anders. Thank you
I'm so glad to hear, thank you 👍😊 Kind regards, Anders
Fantastic video! Great demonstration
My pleasure, MM - kind regards, Anders
Thanks a lot for putting in time to do it. I learnt a lot of new things on PAD.
I was surprised that put did not use pager on "Extract Data From Webpage", then when I tried it, I could not get it to work... so I understand why you did it.
In 38:52 , if you right click "The Smartest Way to Learn Python Regex: Learn the Best-Kept Productivity Secret of Code Masters" and click inspect , it will take you to the exact SPAN/. Otherwise clicking the little box-arrow icon on the top left of the "Developer tools section, and clicking "The Smartest Way to Learn Python Regex: Learn the Best-Kept Productivity Secret of Code Masters" will take one to the HTML code. I find this the fastest way to get to it.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Tried this, thanks alot for such a detailed video ❤
My pleasure, thanks for the nice comment 🥰 Kind regards, Anders
Thanks!
Wow, you really don't have to - THANK YOU! Kind regards, Anders
Love your tutorials. Thank you for the great content
I love your comments, thank you so much 😍 Kind regards, Anders
Thank you so much, Anders! This is great training video. 😆
Hey Pitak, I'm so glad you could use it 🙌😊 Kind regards, Anders
Thank you Anders. This is an EXTRAODINARY video. It seems daunting but I am going to try to duplicate your training.
Hey Craig, THANKS A LOT 😍😍😍 Go for it, we can all do it 😊 Kind regards, Anders
WOW! Thank you so much, Anders! I had the exact same problem extracting the URL behind a text from a webpage my company uses in the aquisitions department! I learned how to navigate the selectors route like you did with so many DIV and other elements.
Hey Carlos - thanks a lot for letting me know, highly appreciated 😀 Have a great day. Kind regards, Anders
Mr Anders Jensen, excellent teachings. like this guaranteed. Thank you so much for the lesson.
Hey Pedro. Thank you so much 🥳😊💪
Great, thanks so much for the lesson. Like guaranteed !
Thanks a lot for all the support 😊🙌
Great job as usual!
Thank you for sharing your invaluable knowledge with us.
Based on your instructions, I did some web scraping from another website, and it wasn't as easy as scraping from Amazon. This website provides different results for the same search term 2 out of 10 times, showing sponsored ads (for the searched product) and other content at the top of the search results that cannot be automatically detected.
I implemented a solution where I tried to read various elements that appear during the search. I'm not sure if it's the right approach, but I managed to get the results into an Excel file. Additionally, I added a short VBA code that converts "http ..." to clickable links.
Hey PawelW, wow great job 💪 Based on what you did, I'm sure you didn't needed the video 😀 Thanks a lot for reporting back, appreciated. Kind regards, Anders
Thank you. Please, do you have a tutorial on how to search a list of websites for a particular word/phrase and return those who do have that term included?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 13,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Amazing solutions on paginations 👏👏👏tks
You're very welcome, @wmferreira - your support helps me a lot 😍 You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: ruclips.net/video/xWFz-S96XGo/видео.html
you are awesome
Thank you very much 😊🙌 Kind regards, Anders
Thank You so much sir, can you do a tutorial to extract all reviews of a product in amazon
My pleasure, sure, I do it with Google reviews here: ruclips.net/video/n1OOVoYrzCA/видео.html Kind regards, Anders
Looks like an excellent video. I need to go a page deeper, for example, clicking on each product and extracting some details from the product page, and then clicking back to go back to all products, and then clicking on the next product, then clicking next page at the end and repeat. Couldn’t find a video like that on RUclips! Any suggestions?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
another great, and super useful tutorial
Thanks a lot 🙌🙏😎
100% Subscribing! Anders, I love the way you teach! I have viewed hundreds of hours of RUclips videos and reviewed documentation on Power Automate and Power Automate Desktop and everyone wants you to follow along, yet no one really explains WHY they are doing what they are doing. The result is, I find myself copying but not able to create flows on my own, until now. I am now able to build flows without copying from videos even though I still refer to videos from time to time. I have run into a problem extracting data from a webpage where the data on the site does not have the header or span but shows Table Data Cell (outlined in red). I can click the cell and click Select Element as Text but it does not populate the Live Web Helper Window Extraction Preview Window. Any Suggestions?
Thanks a lot, @theprofessor4487 🤗 Your feedback helps me immensely. You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Hi Anders. Great tutorial, I learned a lot. The only thing I don't understand is why you didn't use 'Set element as pager' for the Next button in the 'Extract data from web page' action. It would have been very simple, as simple as a right click, instead of a complicated loop.
Hey Andreea, thanks a ton. The reason is that the "Set element as pager", doesn't work (or at least haven't worked for the past 2 years - I haven't tested it the last months though). Another one is that we can set the number of pages to extract, since it will take all pages. Kind regards, Anders
Very good - learnt a lot. I have a question - how would you deal with an advertisement pop-up?
Hey Jeremy, thanks a lot. First of all, can I be sure it's always there? If not I need to create a check for it and then, if it exists, click to close it. Kind regards, Anders
Hi! Great vid! What would you recommend for a web with multiples pages. The web automatically refreshes every 5 or 6 minutes. How do I continue from the last one?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Hello Anders, your videos are great, congratulations! Is it possible to generate the affiliate link automatically, save it in Excel, and update the Geniuslink database? This complete tutorial would be greatly appreciated.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
This is a great video and i followed everything step by step to the end getting correct results right up until the last part where we are supposed to be scraping the first 3 pages of results for each product. But when i run my final one, I am getting the 4 tabs added to the excel spreadsheet correctly but it seems to only be displaying the 3rd page of results for each product, i.e. it displays only 17 lines of entries for each product, and they seem to all be from page 3 of the results. Any clues on what i have done wrong please?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thanks Anders for the great tutorial. but i have one question. if there is no webpage number & Page is load only when scroll down. in that case how to extract multiple pages.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Hi sir, how do I extract preformatted text on the webpage
ah yess lets watch this
Thank you, please let me know, what you think afterward 👍😀
@@andersjensenorg yes, thank you. I completed my project. it took in 2 weeks to understand how PAD words.
LOVE FROM PAKISTAN
Thanks a bunch, @m.salmanrahmat7712 🤩 I've created a Discord. We're more than 11,000+ RPA developers networking and solving problems here: ruclips.net/video/xWFz-S96XGo/видео.html You're more than welcome. Kind regards, Anders
This was awesome except on the page I tried it on, next button thing didnt work. The next button becomes greyed out on the last page but the flow doesnt error and just continues through the loop over and over. Any ideas for a alternative way of doing this?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
I found a way around this. I got the number of pages from the "Page x or 20" message and messed with the string to get the number of pages. Then just looped this many times.
Great work... Quick question what if I need all images downloaded nothing else. How to achieve that?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Excellent Tutorial! But im having trouble with the loop! Cause when it reaches the end it doesnt go to the label even though i put in the error to go to the label! It gets stuck in the loop!
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 7000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thank you for a very comphrensive video. I'm working on my own version of this where I'm looping through a list of search terms - not using known dropdown items, I'm checking if the term exits in a news source page. I get an error message when the search term can not be found. What's the best way to program a "For Loop" that skips if an error is found or a term cannot be found?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Hi Anders
Thanks for everything and your videos are a great source thank you
I have one problem that you may be able to answer I have looked at most of your tutorials and cannot find how I could get what I am after?
As an example you collect the URL for the individual products but what if I wanted to follow these links and collect further detail in addition to what we have already collected from the product that is not on the brief description especially if the link brings up a pop up window?
Thanks again for all your help
Thanks a lot 😊 Sure, check this: ruclips.net/user/live4zmviNtOFwA?feature=share Kind regards, Anders
@@andersjensenorg Hi Anders this is great and just what I was looking for, I will use this as a guide for my own project much appreciated keep up the good work 👍
@@andersjensenorg DONE!! fantastic you are a legend thank you so much it worked !!
10:45 the drop down menu for extract element data doesn't work... please help
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thank you for this tutorial. I have one question... It seems that the amazon algorithm changed (or I have a wrong setting) which shows all the results in grid view and the scrape is not working. Depending on the book searched it may come up with the list view and the scrape does work. Is there a way to make it work for grid view?
Did you pick Books in the drop-down? 😊
@@andersjensenorg Yes... about three weeks ago it was running perfect, and I remember seeing the results as list view. But now all results are in grid mode. It seems as they changed the way the results are displayed, and hence our method of scraping.
@@mrmalone2222 I've just tested again, and nothing changed (still 16 rows and x columns). You're more than welcome to post the problem at my Discord. It's 100% free and the link is in the video description. Kind regards, Anders
@@andersjensenorg I'll check it again on my side. Thanks for the reply and all the help on these tutorials.
Absolutely amazing training video, thanks Anders, I got from 0 to 100% in no time, one question i have though since i already implemented on a project of my own
my scenario let's say is only one product so i applied exactly the same steps except from calling products name from the excel sheet, the challenge i have is after running the robot i get all the data correctly in the Base result but only last page appears in the excel sheet extracted
any idea what could be done wrong?
Thanks for writing and the nice feedback 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 7000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
@@andersjensenorg Thanks a lot, definitely will join
All the best!
Thanks so much Ader, I followed your video step by step by I got stucked when i need to do the extraction, when i selected the Ist title as span and right click and hover the extract option, the mouse doesnt bring up the option to select text... Pls, what is can be done
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
First off - great video and as usual better explanation on what/why you're doing stuff. When I test the RegEx code [
]+ in RegEx 101 online to replace CR & LF with just CR it works, but when I add it using your RegEx technique in my Extract Data from Web for the appropriate CSS selector - the results return nothing. Any thoughts?
Hey Monte, Thanks a lot 🙂 Can you try regexstorm (google it) instead? Kind regards, Anders
thank you for this video. You didn't click on the title of each book to scrap details regarding each book. Can you complete this video on showing me how to do this? It should be taken into acount that when we make the book search today, the list of books we will find today may be diffferent of the ones we can find tomorrow or other days.
Thanks a lot, I do it here: ruclips.net/user/live4zmviNtOFwA 🙂
Hi Anders, While I was going through this tutorial video in step extract data from web page the data which we are reading fields like cost and reviews from the web page the data is not getting extracted and is giving blank for most of the time. But the issue is very intermittent. Sometime it works and sometime it doesn't.. is there any solution to check why we are facing this issue??.
Please suggest.. thanks 😊
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Excellent tutorial, quick question, can you show us how to extract data from hover mouse action. This means if I move the mouse over an specific word, the webpage will show me the meaning, and I want to capture that information. Thank you
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Great tutorial but i am still stragling to take what i want, lets say that i have several pages of links and i want to scrape the same things from each link (structured)and the several pages(structured too) offcourse and in 1 case those pages are opening in a new tab. And in an other one case the element i want is after 1 click in the same page
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
NIce video, however I'm wondering why you're bothering using excel, instead of saving into csv ? I've ran into several errors trying to mess up with excel. Sometimes it just wouldnt launch on my computer, or on the computers of the people using my flows. Ended up never using excel again with power automate, and only read/write csv files.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
very nice
Thanks a lot, happy99. It's my most extensive web extraction/scraping video to date. Have a great day. Kind regards, Anders
I have found a web page which seems to be protected from web extraction. When you hold ctrl to select what you want to extract, the red boxes disappear and the click just visits the link. Any ideas for to get around this?
Are you using the Extract data from web page? Then right click and extract text 😊 Kind regards, Anders
Quick question, when I select extract data from the web. It detects the pattern of half entries but only extracts 12 entries there are 24 entries on the page. Any quick solution please?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
could i use a loop to extract all books of the same page instead of pick up each element of each book manually ?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Does anyone know how to click on the details of each scrape what's inside and add that information as well?
Hey Donald, please check this: ruclips.net/user/live4zmviNtOFwA Kind regards, Anders
thx i follow your course , but they are not files in the files link
Hey Yanna, I've just checked and I can find the files through the link, can you please try again? 😊 Kind regards, Anders
I hope you're doing well. I've been working through the "Web Extraction in Microsoft Power Automate Desktop" tutorial. However, I've encountered an issue. During the training phase, the Amazon website appears vertically, but when I test the bot, it opens the website horizontally, resulting in an error. Could you please create a video to help resolve this?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
i don`t have search icon in web page i need it to take "enter" as command to automatically search for item how to automate it
You can use the "Send keys" action (find the enter in Misc). You might have to go into the Populate text field on web page just before - Advanced - untick the Unfocus.... That will work. Kind regards, Anders
hi anders.thank you for awesome tutorial.i have a question about scraping data on website.when i gathering data from website i saw this warning[[extraction preview displays only the first 20 items of the list]] but in each page i have more than 20 items.Why the others items didnt save on excell??
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
How to get table of anchor tags urls in power automate desktop
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
I have a question - How can I automate The file Upload like music file or videos on any platform like youtube or on any website ? How to select and upload it? can please guide me ?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
in previous version of pad when i put "-1" in css selector it directly clicks last link but after updating pad to latest version it shows "-1" as error. What to do for directly clicking the last link whithout clicking the before links
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
I realise this is quite an old tutorial, but I hope questions are still answered.
I have a webpage with television seasons, episodes and precise of the episode. The Seasons are split via UL/LI lists for each season
if I select the Season H4, then the next season h4, I get a list of all the seasons in the extract from webpage popup - great. However, if I then select the episode title, the list breaks and all I see is season 1 season 2 and the first episode title.
So I tried just selecting the episode titles, but then I only get the first season as they are split.
Can I get
Season 1
episode 1 title episode 1 description
episode 2 title episode 2 description
etc etc
Season 2
episode 1 title episode 1 description
episode 2 title episode 2 description
etc etc
or
Season 1 episode 1 title episode 1 description
Season 1 episode 2 title episode 2 description etc
Season 2 episode 1 title episode 1 description
Season 2 episode 2 title episode 2 description etc
I cant find out how to get the data from the page where the lists are separate
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Today, all of my Amazon search results are displayed as Tiles instead of as a list. As a result the Extract data from web page does not return all the items, it only returns one row with the first book. I can't find any option or method on Amazon to force it to display a List, consistently 😖😖!! This is my life as a coder ... Maybe I'll get a different result tomorrow !
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
What if my website doesn't have a drop down to select a value
Then you skip that step 😊
Pagination is way more complicated compared to Uipath
I agree. There is a Next page in the Advance Settings of Extract data from web page, but unfortunately it's not stable 😔
@@andersjensenorg Very helpful tutorial though! Thank you
My pleasure 🙂