How to do Data Scraping in UiPath - Full Tutorial
HTML-код
- Опубликовано: 9 июл 2024
- This video tutorial shows how to do data scraping (table scraping) in UiPath RPA. You'll learn how to extract data from a website to Excel, including selector work, and then do advanced LINQ filtering.
This is Lesson 10 from our Udemy Course. Get all the lessons (discount): www.udemy.com/course/uipath-1...
👨👩👧👦 Discord: / discord
- Join my network with 2500+ RPA Developers, where we solve RPA problems, network, and help each other upgrade our careers. It's free!
FOLLOW ME:
💼 LinkedIn: / andersjensenorg
📸 Instagram: / andersjensenorg
👨 Facebook: / andersjensenorg
🐦 Twitter: / andersjensenorg
💌 Email Newsletter: andersjensen.org/email-newsle...
0:00 Intro
Data Scraping in UiPath is very easy. This full tutorial with a use case shows how to do table scraping and apply the best practices to ensure the correct result. When the result is ready advanced LINQ filtering is applied. The case is that we want to scrape all results from several Stack Overflow pages to Excel, but the same technique goes for all web pages
1:50 Navigate and validate
We navigate to our web page, here Stack Overflow, and then we apply some settings to ensure we navigate the data we want to extract. Using anchors for UI elements helps us make robust selectors. For example, to ensure we are on the right page, we find an element that changes when we reach the correct page and then use the While loop to make a check.
13:10 Table Extraction in UiPath
Use the Table Extraction wizard to do the scraping. The intuition is that we need to help UiPath understand the pattern. So, for each data type of the table, click Add data and then Finish selection. The Next button is used to scrape multiple pages. The result is stored in a Data Table, which we can write on an Excel sheet.
18:13 Apply LINQ to the results
We use LINQ, a potent query language, to filter the scraped results.
#rpa #uipath #scraping 
Наука
![mgk - I Think I’m OKAY (with YUNGBLUD) (Sad Version) [Official Music Video]](http://i.ytimg.com/vi/7AC1uqQLIg4/mqdefault.jpg)
Get the Full UiPath Udemy Course (Discount): www.udemy.com/course/uipath-1-beginner/?referralCode=3ED73AA1F53036934C12 🙂
Thank you Anders, great job!
You're very welcome, Ms 😊
Thank you Anders great video and wonderful explanation
Hey Araz - Thanks a lot 😊 It's often a fine line between too simple and too advanced, but I'm glad that this video hit the target. Have a great day. Kind regards, Anders
The best of the best! Thanks!
Thanks a lot, Hexis 🤗 Your feedback helps me immensely. You're more than welcome at my Discord, where we're 5000+ RPA developers networking and solving problems: ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Thank you Anders. Great job
You're very welcome, Reinaldo Vicini - your support helps me a lot 😍
@@andersjensenorg I will buy your course.
Great job 👍
Thanks a lot, Sleeki 😊
fantastic!
Thanks!
Really thank you man, your tutorial was coming in the perfect moment, am a student and i have a little project to be done before this weekend and your tutorial is exactly what i need,
Without forgetting of course your wonderful explanation which is could finally prevent me from following the annoying contents of the Indian youtubers.
Hey Wissem - thanks a ton. It's really nice of you to take your time to write such a great message 😊 Have a great day, Anders!
🤩🤩🤩 good content.
Thanks a lot ❤❤❤
Hey Anders, I am using UI Path as a part of my masters thesis and you helped me so much so far! Keep up the amazing work.
I am trying to scrape only data that has not been scraped before and write it in the first empty row to the same table. Trying to do this based on on your example of comparing questions before and after by reading the latest timestamp from the excel and compare it with the ones on the website. Every row of data has a timestamp with date and time (dd.mm.yyyy hh:mm). But i cannot get it running. Any ideas? Maybe this is already included in one of your videos, much appreciated if you could provide me the link.
Anyways thanks for your effort!
Hey Strixx Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my UiPath Groups, where we all can post and solve problems or hang out around our favorite tool, UiPath. So you're very welcome. Get the addresses here: ruclips.net/video/C6xmGfEL07I/видео.html Have a great day. Kind regards, Anders
Great vid Anders, can you help me? I tying to read multiple csv files, but when i run, ui path sends a error message "Acess to the path (path name) denied"
Hey U3mura Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my UiPath Groups, where we all can post and solve problems or hang out around our favorite tool, UiPath. So you're very welcome. Get the addresses here: ruclips.net/video/C6xmGfEL07I/видео.html Have a great day. Kind regards, Anders
Great Video . Thank you for sharing. I need help. When i am trying to get the "Questions" by enabling the selectors and disabling the fuzzy selector . I am trying to click on Ui explorer option and its giving me "its blocked by group policy". Can you please let me know if this step is necessary or any workaround? thanks
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 5800+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Great video! But I have a question: " I want to scrap results of footballgames and I need to split the goals. I don´t want "1-0" , I just need the first number ( in this case the "1"). thx
Hey Ren Crypto. Thanks a lot. You can use the .NET method: Substring. Try this:
"1-0".ToString.Substring(0,1), where 0 is the start position (zero-indexed) and 1 is the length (you only want the first number).
Have you seen this video btw: ruclips.net/video/gBxDcrFBOi0/видео.html
Kind regards, Anders
amazing ❤❤❤❤. can you just help me, when i select multiple pages it automatically moves to next page until the last one but then it does not stop and start it over again and again.
Can u help me in this project I am sticking in section of question after search
Thanks a bunch, @entertainmentgalaxy971 🤩 I've created a Discord. We're more than 11,000+ RPA developers networking and solving problems here: ruclips.net/video/xWFz-S96XGo/видео.html You're more than welcome. Kind regards, Anders
Hi Anders, why did we compare strQuestionsBeforeSerach and strQuestionsAfterFiltering ?, values of these two are string type, What is the purpose of of Do while loop ?, We need only UiPath tagged questions from corresponding pages, Right ?
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Hi Anders, I have a question, Please tell us in simple way how you made your uipath resolution(View) like this. I checked no one tells us as you are using the view, it's look good ?
Hey Atul. Thanks a lot. What do you mean by a good view (resolution). Can you please elaborate? Kind regards, Anders
@@andersjensenorg Thank you for your response!!
I'm using the latest version of Uipath where due to activity and properties panel very little space available for designing workflows But I see in your videos there are much space for designing or creating workflows.
So I just wanted to ask - How I can select same view as yours ? so that my Uipath have also showing much spaces for work, Please share us according to latest Uipath version.
I hope now am able to make my question understandable for you..
@@andersjensenorg Please respond on it and if you made any video on it then please share link as well.
Is it possible to scrap the data from programs and features to excel sheet? That way admin can confirm all the software version is current.
Absolutely, very easily and with the same procedure 🙂
How to achieve if there are click to download action one after one? ex: rpa challenge page.
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4900+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
The table extractor is not able to detect some UI elements what should I do in this case?
Hey Sourabh Charwande Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my UiPath Groups, where we all can post and solve problems or hang out around our favorite tool, UiPath. So you're very welcome. Get the addresses here: ruclips.net/video/C6xmGfEL07I/видео.html Have a great day. Kind regards, Anders
Hi Anders,
Case 1: I tried by scrapping URLs and description for the same scenario using table extraction. I am able to get 684 links in the datatable.
"Read node Orchestrator object from a stringified file and use its function again" link is missing in the datatable. Actual result is 685
Case 2: I tried the same using Table extraction, by adding votes, answers and views counts as additional data.
The datatable contains only 485 rows
Case 3: I tried case 1 using Data scrapping. I am able to get 635 rows in the datatable
Case 4: I tried case 2 using Data Scrapping, I am able to get only 100 rows in the datatable
I tried to find the root cause, But I couldnt. can you please help me
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4900+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ruclips.net/video/xWFz-S96XGo/видео.html Kind regards, Anders
Is this the new version? I don‘t have these activities
Hey crash96nt, yeah the newest. You just need to change a setting: ruclips.net/video/OVXf1zXUSvY/видео.html
Utrolig spændende Anders.
Mange tak, Niels - fedt der også er danskere, der ser det 😊