SO cool! Can not wait to use this! Unrelated question, how do you deliver scrapers to clients? Are you scraping yourself and delivering data or are you sharing repos with code?
Man, this totally unblocked me! I've been struggling for a few days trying to scrape lowes product urls. I kept getting 403 forbidden errors and could never get raw fetches working, no matter the headers I set. I worked around it with puppeteer but it's a slow and heavy solution. Using got-scraping got a 200 response first try. With one line of code!
@@the-web-scraping-guy Yeah, I was able to remove puppeteer from the project entirely. So nice! Thanks for sharing. Great addition to my scraping toolbox
This works! Thanks man.
SO cool! Can not wait to use this!
Unrelated question, how do you deliver scrapers to clients? Are you scraping yourself and delivering data or are you sharing repos with code?
Depends. CSV's, sometimes I build them a dashboard, insert into a DB, etc
thx man
Absolutely bro 🙌
Man, this totally unblocked me! I've been struggling for a few days trying to scrape lowes product urls. I kept getting 403 forbidden errors and could never get raw fetches working, no matter the headers I set. I worked around it with puppeteer but it's a slow and heavy solution. Using got-scraping got a 200 response first try. With one line of code!
Nice! can you make them without puppeteer?
@@the-web-scraping-guy Yeah, I was able to remove puppeteer from the project entirely. So nice! Thanks for sharing. Great addition to my scraping toolbox