awesome stuff! it's hard to find best practices around data scraping so it's always great to see an actual helpful "advanced" video. Keep em coming, I'd love to see more of your workflow as well!
Hello John, I have been learning web scraping from your videos for quite some time. I am currently struggling with web page analysis prior to deciding which scraping approach to follow between Requests, Playwright and Selenium or API. If you could make a video around this topic i would really appreciate it. PD: Greetings from Argentina.
Hi John, Do you have perhaps a Udemy or similar course that you are holding, or at least any learning material that you recommend for obtaining the exact knowledge that you have, ecomerce scraping and analysis. BTW you are amazing, and I honestly suggest investing your time in making a full on course. Id pay for it and Im sure many many more would too.
Awesome. Yeah conceptually I understand the separation of concerns. It would be great to see the second part where the data is consumed out of mongo. Looking forward to it.
awesome stuff! it's hard to find best practices around data scraping so it's always great to see an actual helpful "advanced" video.
Keep em coming, I'd love to see more of your workflow as well!
Thank you for delivering such content. Keep it up
Hello John, I have been learning web scraping from your videos for quite some time. I am currently struggling with web page analysis prior to deciding which scraping approach to follow between Requests, Playwright and Selenium or API. If you could make a video around this topic i would really appreciate it.
PD: Greetings from Argentina.
Very handy advices and techniques 👍
Ah. I thought everybody did it like that. Ok.
Good as always ❤
Always lovely content
Hi John,
Do you have perhaps a Udemy or similar course that you are holding, or at least any learning material that you recommend for obtaining the exact knowledge that you have, ecomerce scraping and analysis. BTW you are amazing, and I honestly suggest investing your time in making a full on course. Id pay for it and Im sure many many more would too.
Im a proxy noob and have no clue why async-ethics a proxy is essential. Rate limits?
If the data has some structure, turn it into markdown and use your imagination.
What happens after saving to mongo? That’s the part I was hoping to see 😂
Haha sorry! Connect and pull the data out, parse what you need and move on! I’ll do a follow up full project with this method
Awesome. Yeah conceptually I understand the separation of concerns. It would be great to see the second part where the data is consumed out of mongo. Looking forward to it.
@@JohnWatsonRooney Makes no sense. Why not parse everything immediately and save money on storage?
nice