Unfortunately couldn’t pass from step on 5:18, the command driver = web_driver() didn’t work. Just giving up on trying to use selenium on colab. Visual Code has been better to me…
bro, try using this method again to scrape all the product review components on the Lazada website, when I tried it like in the video and just adjusted what I wanted to scrape by copying the inspection results and then running the code, the results didn't appear like at minute 08:21
@@ScrapingNinja sir in my project there are some queries which i want to search on Google and then i want to scrape 300 results from each query, is it possible
Yes you can edit your link to get up to 40 results per page and also include query inside the link this way you will keep minimum requests to google and get more results
SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 114 Current browser version is 126.0.6478.126 with binary path /usr/bin/google-chrome error
Unfortunately couldn’t pass from step on 5:18, the command driver = web_driver() didn’t work. Just giving up on trying to use selenium on colab. Visual Code has been better to me…
Can you share the error?
It works perfectly fine on Colab. I'm using the selenium on colab.
I am from Korea. I love you, Guy
Thanks.. 🤩
I am from Thailand. I love you, Guy
Thank you so much dear.. ❤️
bro, try using this method again to scrape all the product review components on the Lazada website, when I tried it like in the video and just adjusted what I wanted to scrape by copying the inspection results and then running the code, the results didn't appear like at minute 08:21
make sure you are using correct xpath and also try to print page source to see if the correct page is being loaded
i want to ask brother, how to Bypass Cloudflare anti-bot service detected ? With undetected_chromedriver doesn't work. Still got blocked.
Use playwright with playwright_stealth.
Perfect, you saved my day!
Glad I could help! don't forget to subscribe.
@@ScrapingNinja You earned it, for sure
debir haber visto este tutorial de primeras muchas gracias thank you so much
I am glad you find this helpful.
Can I scrape sites using this that use captchas
You will need to use proxies to avoid captcha.
@@ScrapingNinja I’m new to code. Can I do this in Google colab? Does it cost money to implement?
Salam Sir,
I want extract data like url and titles from Google search page
Ap guide kr kr skty, ap sirf ek roadmap bata dein? Waiting for your reply
you can do it following the same steps, install selenium, get the google link and start extracting data like i did in this video
@@ScrapingNinja sir in my project there are some queries which i want to search on Google and then i want to scrape 300 results from each query, is it possible
Yes you can edit your link to get up to 40 results per page and also include query inside the link this way you will keep minimum requests to google and get more results
SessionNotCreatedException: Message: session not created exception: Missing or invalid capabilities
(Driver info: chromedriver=2.41.578700 (2f1ed5f9343c13f73144538f15c00b370eda6706),platform=Linux 6.1.85+ x86_64)
Check your code to make sure you have set compatibilities correctly
Options
SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 114
Current browser version is 126.0.6478.126 with binary path /usr/bin/google-chrome
error
You need to update chromedriver using apt-get