Thank you. I very much appreciate the extra time and effort you expend in order to highlight code in the upper right corner of the video as that code is being inputted into the program’s interface.
Absolutely great video. Absolutely everything I was looking for in a single video with a very straightforward and clear speech and explanation. You just got a subscriber and a preacher for your channel on all my work colleagues. This video was THIS amazing to me.
@@DamoBird365 I made a script in Python to update the delivery lead time for a container on a SharePoint Spreadsheet by crawling to a website and getting that data. I was requested to change the script from the local machine and make it run on the cloud. I managed to do so by adapting what you showed with the data treatment logic I had done and using power automate web flow
@@DamoBird365 no problem. To be honest a lot of what I am expecting to do can benefit from the content you posted, and I hope to use a lot of your videos as reference. I do find content for power automate web something that people don't invest a lot because much easier solutions can be built using the desktop software, but the lack of a machine running your scripts is too much of a benefit to jump into the desktop solution so easily.
Hi I work in a UK bank and have to track new items and regulations that have been added to the FCA website. Using . Ideally I want to be notified about new items on the FCA website eg by teams or email then I want a summary of the new item to update a SharePoint or excel. Using ms office or power automate how do I do this. I don't have coding skills
Thanks for this, it is excellent! The table I'm scraping has just one column and it includes list items. So, in my Select step I've been able to generate nice clean code but only when a table row contains a single list item. Where multiple items are present I get "null." Here is what I am using in the Select map: item()?['td/ol/li/a']?[0]?['#text'] I'm trying to wrap my head around some sort of "for each" within the "li" output. Any ideas would be great!
Looks like this website doesn't work anymore. It could be that the data is coming from some dynamic source. I asked chatGPT why I can see the HTML code with all the table data fine on Chrome's Inspect Element but Power Automate can only retrieve the headers of the table and it said the following: The issue you're encountering is likely due to the way modern web applications dynamically load data. Many websites use JavaScript to fetch and render data on the client side after the initial HTML is loaded. This means that when you inspect the element in the browser, you're seeing the fully rendered HTML, but when Power Automate fetches the HTML, it only gets the static content without the dynamically loaded data.
This won’t work in all scenarios - agreed. That’s why RPA /Desktop Flows are used. But it’s down to your scenario and source. You can see desktop flow scraping here ruclips.net/video/pajD-iFMS1M/видео.htmlsi=2RxQWL8e8dlk3HjX
Thanks Damien, I had someone message me on the forums asking for help taking HTML data and inserting it to Excel. I’m not sure it is directly off a webpage, but the HTML parsing to JSON here should be very helpful nonetheless.
Hello Damien, Thank you for the video. The HTTP Get action returns a 404 error for the web application page URL that I put in the action. The browser app is built with blazor, I think, though the page is mostly a table of data. Do you have any suggestions for scraping a web application like this using Power Automate cloud? I know it can be done with power automate desktop. However, I can easily copy cloud automations to users without having to have desktop installed.
2 года назад+1
Great demo as always Damien 👍 Appreciate all your efforts publishing it. Expressions FTW 🙌 Great example of nthIndexOf
I'm wondering how would you approach scraping the data from div elements? E.g. if the data table is in the nested 's structure - how you would do it in Power Automate flow?
I've been trying to use this but keep running into issues with HTML tags that don't have a close tag when converting to XML. is a good example of one. Any tips on how to handle this on a webpage with over 300 different images?
Each case will be different and I would need to look at an example. It might be best posting your example on the forum with some sample data. powerusers.microsoft.com/t5/Building-Flows
Another great video and demonstration. I found it extremely useful as I picked up a lot of tips using the various expressions. Thank you for sharing Damien.
Than you! Using your tutorial I wrote myself an alert system that checks if I could get a damned parking space from my municipality. There is no line, only "snag them up once they appear!"
Hi . Do you know how to enable the ''Response task" using power Bi as a trigger? I want to insert an url as a response to open a file in the browser. It seems that I can't use "response" with power bi ''Buttons'' as a trigger and I want to open an URL from Power app. This url may change depending on the user who execute the flow but I'm just having issues trying to figure out how to open URL with Power Automate and Powe bi .
Thanks for the video, how about dynamic content? i followed your steps but the view source is empty and not showing really any data but in the web works
Pretty neat but I can show you how to do the real deal webscraping with Power Automate Cloud not desktop. Http requests only, logging in and out of pages that are password protected and you have to get the cookies right. It's tough with most websites but it can be done. Best part of using just the http requests in any tool is you usually are tapped right into the sweet sweet json before it gets put in a table or you have to download a file or anything. I'll link my video when I get there but pretty cool man. I used Power Automate for a long time and I am going posting about it a bit too. I'll mix in some sql server because I have a very powerful technique that totally changes the game with the Power Automate. #PowerAutomatePirate
HI , I have one URL , when we open that URL it is downloading the excel sheet on the computer , I want to use power automate to click on the URL and send the downloaded excel content on an email is it possible ?
@@DamoBird365 Can you please guide me with the steps ? right now i am sending that URL on an email and after clicking on that URL it is downloading the ZIP and in that ZIP file one CSV is there which contains the data , so the customer requirement is to show that CSV data in an email.
That's several hours of reading I just saved myself just by watching this video!! Thanks for this! Outstanding, indeed!
Thank you. I very much appreciate the extra time and effort you expend in order to highlight code in the upper right corner of the video as that code is being inputted into the program’s interface.
Great video, very helpful to someone like me who just started using Power Automate.
Absolutely great video. Absolutely everything I was looking for in a single video with a very straightforward and clear speech and explanation.
You just got a subscriber and a preacher for your channel on all my work colleagues. This video was THIS amazing to me.
Oh wow, thanks Jorge. Would love to hear how you get on.
@@DamoBird365 I made a script in Python to update the delivery lead time for a container on a SharePoint Spreadsheet by crawling to a website and getting that data. I was requested to change the script from the local machine and make it run on the cloud. I managed to do so by adapting what you showed with the data treatment logic I had done and using power automate web flow
@@Jorgelhus thank you so much for coming back to me and pleased to hear of your success 👍
@@DamoBird365 no problem. To be honest a lot of what I am expecting to do can benefit from the content you posted, and I hope to use a lot of your videos as reference. I do find content for power automate web something that people don't invest a lot because much easier solutions can be built using the desktop software, but the lack of a machine running your scripts is too much of a benefit to jump into the desktop solution so easily.
Excellent as ever Damian, thank you so much.👏
Hi I work in a UK bank and have to track new items and regulations that have been added to the FCA website. Using .
Ideally I want to be notified about new items on the FCA website eg by teams or email then I want a summary of the new item to update a SharePoint or excel. Using ms office or power automate how do I do this. I don't have coding skills
Interesting use case. Do you want to drop me a note through contact me on my blog with more details. I can’t promise.
Thanks for this, it is excellent! The table I'm scraping has just one column and it includes list items. So, in my Select step I've been able to generate nice clean code but only when a table row contains a single list item. Where multiple items are present I get "null." Here is what I am using in the Select map: item()?['td/ol/li/a']?[0]?['#text']
I'm trying to wrap my head around some sort of "for each" within the "li" output. Any ideas would be great!
Looks like this website doesn't work anymore. It could be that the data is coming from some dynamic source. I asked chatGPT why I can see the HTML code with all the table data fine on Chrome's Inspect Element but Power Automate can only retrieve the headers of the table and it said the following: The issue you're encountering is likely due to the way modern web applications dynamically load data. Many websites use JavaScript to fetch and render data on the client side after the initial HTML is loaded. This means that when you inspect the element in the browser, you're seeing the fully rendered HTML, but when Power Automate fetches the HTML, it only gets the static content without the dynamically loaded data.
This won’t work in all scenarios - agreed. That’s why RPA /Desktop Flows are used. But it’s down to your scenario and source. You can see desktop flow scraping here ruclips.net/video/pajD-iFMS1M/видео.htmlsi=2RxQWL8e8dlk3HjX
You are the best
Thank you. I hope you learned something new.
Thanks Damien,
I had someone message me on the forums asking for help taking HTML data and inserting it to Excel. I’m not sure it is directly off a webpage, but the HTML parsing to JSON here should be very helpful nonetheless.
what can we use if we dont have a premium subscription?
You would be better to ask on the forum for a crafty solution. OneDrive can save a url to file. You could then maybe parse the html file?
Thank you so much! Worked it out finally with another web site, couldn't find yours. 🤓
Hello Damien, Thank you for the video. The HTTP Get action returns a 404 error for the web application page URL that I put in the action. The browser app is built with blazor, I think, though the page is mostly a table of data. Do you have any suggestions for scraping a web application like this using Power Automate cloud? I know it can be done with power automate desktop. However, I can easily copy cloud automations to users without having to have desktop installed.
Great demo as always Damien 👍 Appreciate all your efforts publishing it. Expressions FTW 🙌 Great example of nthIndexOf
Lovely Video thanks for making this. Also, I have one query if we want to get the table by id then which approach should we use.Thx
Any way this would work when a table has links?
XML not happy with '='
Example
Client
I'm wondering how would you approach scraping the data from div elements? E.g. if the data table is in the nested 's structure - how you would do it in Power Automate flow?
I've not explored this before, maybe ask on the forum powerusers.microsoft.com/t5/Forums/ct-p/FL_Comm_Forums
Awesome video ! You are a great teacher !
I've been trying to use this but keep running into issues with HTML tags that don't have a close tag when converting to XML. is a good example of one. Any tips on how to handle this on a webpage with over 300 different images?
Each case will be different and I would need to look at an example. It might be best posting your example on the forum with some sample data. powerusers.microsoft.com/t5/Building-Flows
Another great video and demonstration. I found it extremely useful as I picked up a lot of tips using the various expressions. Thank you for sharing Damien.
Cheers Douglas, I appreciate your feedback as always. Nthindexof is relatively new but definitely has its use cases.
Outstanding video! You have a knack for explaining these topics at the perfect cadence and with just the right level of detail. Well done!
Thank you very much 😉
Great Teacher & Great Course
Cheers Mojtaba, appreciate your kind words.
Than you! Using your tutorial I wrote myself an alert system that checks if I could get a damned parking space from my municipality. There is no line, only "snag them up once they appear!"
That’s really cool 😎 do you book the space automatically too?
@@DamoBird365 Was thinking of it.. I can't predict the type of post they would make, so I have to manually check it first. Would've been epic!
Do you have to login or is the site public?
@@DamoBird365 A public site thankfully.
Drop me it, I might take a look to see if I can book a space. Ideas@damobird365.com
Thanks!
Thank you, appreciated 👍
Hi . Do you know how to enable the ''Response task" using power Bi as a trigger? I want to insert an url as a response to open a file in the browser.
It seems that I can't use "response" with power bi ''Buttons'' as a trigger and I want to open an URL from Power app. This url may change depending on the user who execute the flow but I'm just having issues trying to figure out how to open URL with Power Automate and Powe bi .
I’m not as familiar with BI. You could ask on the forum powerusers.microsoft.com. Have you seen this behaviour elsewhere as I’m curious.
Thank you for this video.
Can you tell, is it possible to do similar scrapping with power automate for desktop?
Which adjustments necessary?
Yeah, absolutely. I’ve not done a video but I have used it for this. 👍
Thanks for the video, how about dynamic content? i followed your steps but the view source is empty and not showing really any data but in the web works
Dynamic content is possible but I would suggest you reach out to the community via powerusers.microsoft.com/t5/Forums/ct-p/FL_Comm_Forums 👍
Pretty neat but I can show you how to do the real deal webscraping with Power Automate Cloud not desktop. Http requests only, logging in and out of pages that are password protected and you have to get the cookies right. It's tough with most websites but it can be done. Best part of using just the http requests in any tool is you usually are tapped right into the sweet sweet json before it gets put in a table or you have to download a file or anything. I'll link my video when I get there but pretty cool man. I used Power Automate for a long time and I am going posting about it a bit too. I'll mix in some sql server because I have a very powerful technique that totally changes the game with the Power Automate. #PowerAutomatePirate
Please do share. The community would love it 👍
HI , I have one URL , when we open that URL it is downloading the excel sheet on the computer , I want to use power automate to click on the URL and send the downloaded excel content on an email is it possible ?
It’s possible, yes. An http action to get the response from that url.
@@DamoBird365 Can you please guide me with the steps ? right now i am sending that URL on an email and after clicking on that URL it is downloading the ZIP and in that ZIP file one CSV is there which contains the data , so the customer requirement is to show that CSV data in an email.
@@ketankamble9128 is this url public? If it is I could try a demo. Otherwise you could try the forum powerusers.microsoft.com/