Hey all :) I found out that sometimes the script gets confused about the website_url because there are two aria labels with the "website" tag - one in the list of the companies and one in the side tile. This could result in displaying a striped square and only the word "Website". To fix this, right-click the website row > customize field > select other fields > href. It won't change the preview, but by running the loop, it will only take the URLs. I'm not sure if this is a bug or if it's a problem with the two elements.
Great as always. Is there a way to automate the tasks? for example lets say i want to use this same flow for every city of a state, is there a way in octoparse to do it? thanks
the xpath for the loop item doesn't seem to work for me, could it have changed? Also when I try clicking it only seems to return the result I click (only one A in the list)
Hi, thankyou for sharing. But I think I followed all the steps and still can’t scrape a data. I think there’s something wrong with the scroll xpath, but I already watched your xpath tutorial and use many tools to find the right xpath, still it just doesn’t working out. Do you have any idea about this?
I am trying to scrape latitude and longitude from items in the side-scroll. Everything is working well, but many of the latitude and longitude items that I retrieve from the URL are matching, even though the locations are different. When I check Google Maps, and click on the various results of a search, the latitude and longitude in the URL also do not appear to change. Is this a known issue with Google Maps? Is there any way to fix this or get the latitude and longitude from somewhere else?
Hi, my Titles is going wrong, its getting Sponsered, a think google changed something. Title: (//div[@role="main" and @aria-label]//h1)[last()] Could you help how identify the new path?
Thanks so much for the tutorial!! I got a question that my photos didn't show, and I did exactly the same. Also how can we learn and how to find Xpath in other cases. TYSM!!
Salut, j'ai configuré une tâche en suivant le tuto disponible sur le site Octoparse. Mais le gros problème que j'ai, c'est qu'au bout d'un moment, il commence à scraper que des doublons. J'ai l'impression qu'il n'arrive pas à changer de page ou défiler la page correctement. Pourtant j'ai vérifié le paramétrage plusieurs fois pour voir s'il est bien pareil au tuto et tout est bon. Est-ce que tu pourrais m'aider ?
Hi! Thanks for your video! Still... I don't know what Im doing wrong... When configurating the loop item, it does only give 1 or none loop item.s as a result
@@francoisfromoctoparse what do you mean.? I have the link and when I enter url it directs to another website. Original website has all the information I want to scrab. can you try on your end?
To get your first 100 B2B leads for free:
scrap.id/s/1xY
For a Web Scraping request:
fdufaurboidin@gmail.com
Hey all :) I found out that sometimes the script gets confused about the website_url because there are two aria labels with the "website" tag - one in the list of the companies and one in the side tile. This could result in displaying a striped square and only the word "Website". To fix this, right-click the website row > customize field > select other fields > href. It won't change the preview, but by running the loop, it will only take the URLs. I'm not sure if this is a bug or if it's a problem with the two elements.
I am facing to the same issue for placeid, website, phone number. Do you know how to solve this? and I am not sure how to get lat and long too.
Thanks for sharing this tip, you're a star
A fantastic video that has been invaluable for our newcomers. We greatly appreciate your generosity in sharing it!
Great as always. Is there a way to automate the tasks? for example lets say i want to use this same flow for every city of a state, is there a way in octoparse to do it? thanks
Technically speaking, yes.
But you have to scrape your cities beforehand.
Why this has to be so difficult and such a steep learning curve. I follwed your video but page scrolling thing didnt work.
Hi, I am following your tutorial but the second Loop Item with the Variable List did not work for me? Do you know why?
Hi,
You mean the loop item with the different companies?
In that case, did you try to rewrite the XPath?
@@francoisfromoctoparse you have a space after maps( could be because chrome checkmarks safe links) if he removes the space it, works
the xpath for the loop item doesn't seem to work for me, could it have changed? Also when I try clicking it only seems to return the result I click (only one A in the list)
Did you run your task?
It is the most concrete way to indentify a potentiel mistake.
Hi, thankyou for sharing. But I think I followed all the steps and still can’t scrape a data. I think there’s something wrong with the scroll xpath, but I already watched your xpath tutorial and use many tools to find the right xpath, still it just doesn’t working out. Do you have any idea about this?
Hi,
If you can't scrape a data, maybe the problem is coming from the loop item and not from the scroll.
Try moving the loop item within the scroll
Salut François, Une question. Quand tu obtiens tes 120 leads, comment fais-tu pour générer les leads suivants après le 120 eme ? Merci
Salut,
Tu ne peux pas obtenir plus de 120 leads à la fois avec cette méthode. La seule façon de faire serait de segmenter la recherche.
I am trying to scrape latitude and longitude from items in the side-scroll. Everything is working well, but many of the latitude and longitude items that I retrieve from the URL are matching, even though the locations are different. When I check Google Maps, and click on the various results of a search, the latitude and longitude in the URL also do not appear to change. Is this a known issue with Google Maps? Is there any way to fix this or get the latitude and longitude from somewhere else?
If the places are very close to one another, it might not change.
Otherwise, it does.
How about scraping some reviews for each business? reviews based on a specific rating (worse and best)? how to achieve that?
How do you save a workflow? I checked the documentation on OP but didn't find anything. Is this a premium feature? Thank you.
By clicking on "Save" I guess ;)
Hi Francois, Thank you very much for this video😊, i would like to ask is this method possible without xpath, with only pointing and clicking.
Hi,
Of course , it is possible ;)
But it will be more likely that there is an error.
And the accuracy will be lower.
Can you make a video on it please if possible
Hi, why is the data extracted stop at the 7th row? it should have more rows..
Hi, It is likely because the scrolling process doesn't work in your case.
How can I export locations codes plus from my map to Excel?
Hi, my Titles is going wrong, its getting Sponsered, a think google changed something.
Title: (//div[@role="main" and @aria-label]//h1)[last()]
Could you help how identify the new path?
I am facing the same issue, did u find a solution
@@minhvuongluu7644 I really dont remeber, but you have do inspect the element on the page to find the rigth path
Thanks so much for the tutorial!! I got a question that my photos didn't show, and I did exactly the same. Also how can we learn and how to find Xpath in other cases. TYSM!!
Salut, j'ai configuré une tâche en suivant le tuto disponible sur le site Octoparse. Mais le gros problème que j'ai, c'est qu'au bout d'un moment, il commence à scraper que des doublons. J'ai l'impression qu'il n'arrive pas à changer de page ou défiler la page correctement. Pourtant j'ai vérifié le paramétrage plusieurs fois pour voir s'il est bien pareil au tuto et tout est bon. Est-ce que tu pourrais m'aider ?
Bonjour,
Pour une prestation en Web Scraping:
fdufaurboidin@gmail.com
Everything works fine except phone number. Whats wrong with it?
would it be possible to scrape a pulse code and link from share from places as well?
I am not sure to understand the question.
Thanks a lot François. Really appreciate your efforts. Just in time.
You are welcome.
See you in 2025.
Hi! Thanks for your video! Still... I don't know what Im doing wrong... When configurating the loop item, it does only give 1 or none loop item.s as a result
Hi,
Did you "refresh" the loop item as shown on the video?
I strictly follow the video@@francoisfromoctoparse
Merci pour le tuto François ! Bonne continuation
No problem. Je vous remercie.
Bravo pour le courage de faire la vidéo en anglais 👏
Is there a way to scrap data from a map within a website? Like real estate listings?
Thank you for your useful content 🙏❤
It depends on the website.
But I would rather say "yes".
I have a question
Yes?
yeah, its not "freemium", its "paidmium"
I've been using it without payment
This was an amazing tutorial, thank you!
Thank you ;)
Sir can we use the same xpath fir the difference locations @francoisfromctoprad
Hi, can i fetch the review by using octoparse?
Hello,
Yes you can.
how to scrap pages that is redirecting to another page
If the page is from another website, I don't think you can do that with Octoparse.
@@francoisfromoctoparse what do you mean.? I have the link and when I enter url it directs to another website. Original website has all the information I want to scrab. can you try on your end?
Thanks for the video, do you know if it's possible to extract mail address ?
With Octoparse, no.
With the link in the description, yes.
Will Google allow me to use Octoparse? I heard it isn't allowed.
Yes, you can scrape Google with Octoparse.
thanks for the amazing video, somehow I do not get website and phone number. but your xpath worked with the xpath helper.
You can try with the "point & click" method instead.
Thank you
You are welcome.
thanks
You are welcome.
Lets gooo
the info is valuable for sure, but the way u teach is so boring
thank you
No problem.