My daily business in the past.. thx to John who helped me with his videos to become better and better in it.. now i am a Flutter Dev and i miss sometimes my scrapping time with Python.
As far as i know some people need informations and you can do it by scraping. Yes you can earn money by doing this if you find clients. You can also use this knowledge to automate your work.
Every big Industrie, especially those that work with consumer goods (Nestle, Unilever, Scjhonson, etc..) needs to know the price, availability, content of their products AND products of their competitors to capitalize on this information. There're companies that actually offer services like these that John just showed us, like Intellibrand for example.
That's just a way of getting data. In any project you're working on you can have the need of getting some data from some website, and when there is no available API for you to get that data you get it that way, unless you want to do that work manually and update things by hand, which isn't at ll convenient if we aren't just talking about more few rows that need to be updated every once in a while.
Use JWR at checkout to get +2GB of proxies for free: go.nodemaven.com/scrapingproxy
this was insane! more full end to end project please!
My daily business in the past.. thx to John who helped me with his videos to become better and better in it.. now i am a Flutter Dev and i miss sometimes my scrapping time with Python.
You are a legend 🙏🏽
Very nice work as usual.
I have a question
Is there any specifics when scraping a Magento website ?, protected with customer login ?
Is there a repository to view the code of this project? Thanks for teaching.
Scrapy is the best 👌
Why you do this scraping and all? Do you earn income with this ? Or you need it in your job?
Or its just a hobby of yours, to scrape everything?
As far as i know some people need informations and you can do it by scraping. Yes you can earn money by doing this if you find clients. You can also use this knowledge to automate your work.
Every big Industrie, especially those that work with consumer goods (Nestle, Unilever, Scjhonson, etc..) needs to know the price, availability, content of their products AND products of their competitors to capitalize on this information. There're companies that actually offer services like these that John just showed us, like Intellibrand for example.
That's just a way of getting data. In any project you're working on you can have the need of getting some data from some website, and when there is no available API for you to get that data you get it that way, unless you want to do that work manually and update things by hand, which isn't at ll convenient if we aren't just talking about more few rows that need to be updated every once in a while.