+1 Sub, I don't think I ever saw this type of content with such quality of information and easy to follow along, would love if you linked the code for the test website with anti-scraping features, that would be a the cherry on top of the cake, Good work
Thanks, man! Really helpful. Which model would you recommend for production? Have you tried the Craw4i with Gemini 2.0? With the new pricing, it seems like a solid competitor.
Thanks for the feedback! I've been using either gpt-4o, deepseek or one of groq's llms are awesome too (and free). Haven't tried gemini for a while now though, I'll test it today!
That’s a great point, and I overlooked it. Rotating proxies cause IP changes that could get flagged when reusing cookies. Logging in at each access helps, but with residential proxies, it’s very unlikely you’ll face bans or rate limits. If you want a persistent IP, just change your proxy settings to a sticky session.
Link to the code: leonardo467.gumroad.com/l/xezswi
Finally someone did this 🎉
+1 Sub, I don't think I ever saw this type of content with such quality of information and easy to follow along, would love if you linked the code for the test website with anti-scraping features, that would be a the cherry on top of the cake, Good work
Welcome aboard! Thanks a lot for your feedback, it means a lot to know my content is actually helping!
Thanks man you are pushing amazing content
Teu conteúdo é ouro! Só aula cara! Muito obrigado por compartilhar!
tmjjjj
Thanks, man! Really helpful. Which model would you recommend for production? Have you tried the Craw4i with Gemini 2.0? With the new pricing, it seems like a solid competitor.
Thanks for the feedback! I've been using either gpt-4o, deepseek or one of groq's llms are awesome too (and free).
Haven't tried gemini for a while now though, I'll test it today!
amazing video
Thanks, man! Using the cookie with changing proxy can't be risky and being banned in some websites?
That’s a great point, and I overlooked it. Rotating proxies cause IP changes that could get flagged when reusing cookies. Logging in at each access helps, but with residential proxies, it’s very unlikely you’ll face bans or rate limits.
If you want a persistent IP, just change your proxy settings to a sticky session.
Great video!
Glad you enjoyed it!
Can you possibly do this on Quora?