I also followed step by step and even though the script ran through many links, my csv came out empty. And also, importing scraper_api could not be resolved on vscode for some reason also, if you could help, Id greatly appreciate it.
sorry for late response, i shared it on one of my blogs i moved the blog website to another server and lost some blogs in the process, i will upload and share..
At 29:00 , how are you able to paste more than one line of code, I couldn't do that, and because of that I couldn't test out the for loop and whatnot
I also followed step by step and even though the script ran through many links, my csv came out empty. And also, importing scraper_api could not be resolved on vscode for some reason also, if you could help, Id greatly appreciate it.
do you mean past the code in shell?
could be because the scraperapi module is not installed.. try pip3 install scraperapi-sdk@@beamishmen7218
Your content is so good☺
thanks Wahab, don't forget to subscribe the channel..
This video very useful. Can you tell me which version of scrapy are you using.
i don't really remember but this should work on latest version.
How can I go over more then 5 pages ? It's stops on page number 5
use proxies..
When i try to get data with response.xpath, it returns empty list. Anyone know how to fix it?
Try different xpath could be because html has changed since i made this video
I learned python now i start scrapping from which video can start? Can you share link
Watch this its Complete Python Web Scraping Tutorial: Scrapy, Selenium, Requests, BeautifulSoup and lxml
ruclips.net/video/5UVi1__7lLM/видео.html
@@ScrapingNinja ok I need your WhatsApp number can i get your number?
I am not very active on whatsapp but i try to be as responsive as possible
I scrape items specific but not print output
You just need to do scrapy crawl ebay -o output.csv and its going to save the fields to output.csv file
@@ScrapingNinja Yes I am using scrapy crawl ebay -o output. Other information save but item specifics not save
try printing them but before running crawling try the same in scrapy shell
How to extract product URL? I tried extract urls according your tutorial but not get print result.
check your xpath and also try to get without @href to see if you are getting the html
How to remove duplicates data during web scraping
Create list and use if statement before appending it to make sure the link doesn’t already exist in the list.
Can you post the code?
sorry for late response, i shared it on one of my blogs i moved the blog website to another server and lost some blogs in the process, i will upload and share..
how do i contact you, need some work sorting
my email is in channel bio