imad kerzazi there is no way it won’t work if you do everything right, I have used beautiful soups for some of my tricky projects.. make sure the html tags are right.. soup can work only with the right src.. also the code loops through all the images and then writes 10 images so make sure your looping looks good.. if you still have issues link me to your code.. github or somewhere else..
Thanks a lot. I tried the code in the video but when trying to print the links I got empty list. Printed soup but it seems there are no links to the images.
@@vigneshrao5679 same here I've tried with the tutorial example link but it gives no output. I printed the html code that html.parser gives and i noticed it don't show tha images links.
Note that this type of parsing can only be used for websites that have their data publicly available. I'll be working on a project which can simply act as an image downloader plugin. That should be able to pick images from any website. Once done, I will post it on my github github.com/vignesh1793/
@Eriko. Oy You're right google blocks all urllib requests so the only way you can do with python is to use something like selenium, open an automated browser and make it download images..
BTW this video was very awesome and it gave me alot of things like 1. how interviewer thinks, 2. Many free hosting websites, 3. why I should follow full instructions. 4. There is huge difference btwn number of applicant and competitor. Not all applicant are competitor. Stuffs like these Was very interesting and helpful for me(a beginner coder)
Hello sir, Thanks for making so many videos. I am one of regular visitor of your youtube channel. If you have some time please make a series on python programing language. I am very thankful of you. Thanks in advance. love you sir
Getting this error : Traceback (most recent call last): File "crawl.py", line 6, in soup2 = BeautifulSoup(r2.text, "html.parse") File "C:\Users\win10\PycharmProjects\crawl\crawlenv\lib\site-packages\bs4\__init__.py", line 225, in __init__ raise FeatureNotFound( bs4.FeatureNotFound: Couldn't find a tree builder with the features you requested: html.parse. Do you need to install a parser library?
This is a waste of time. This guy is just promoting his paid training videos. I am not going to waste my own time typing in his code. Where is the github link to the code file ??
Sir I am currently learning about programming logics from a book by Joyce Farrel. Can I learn a programming language simultaneously or learn about logics first?
Sir, I am making a project on Vehicle detection & speed Tracking using videos. So can you please suggest some info. And what should I used and approach to make it...
Hi Hitesh, Please make a video on web crawling using python and how to send data to webpage and further open another webpage based on that very data. For example if we want to search on a search engine and get the data on the search result webpage
Hi, Hitesh: great video, except...it didn't work. The file folder is made, but nothing is inside. The problem seems to be in your line 10, or your lines 11 and 12. When I print, nothing happens. Here is the code, if anyone can help: from bs4 import * import requests as rq import os r2 = rq.get("www.pexels.com/@hiteshchoudhary") soup2 = BeautifulSoup(r2.text, "html.parser") links = [] x = soup2.select('img[src^="images.pexels.com/photos"]') for img in x: links.append(img['src'])
*Sir, create video on google pay integration from responsive mob web site, mobile app to google pay redirect and pay money and redirect to website, mob app* *Its helpful college projects with out buying payment gateway. Pls sir, its really helpful for many peoples*
Thank you for taking the time to explain every line of code. This was very helpful!
Would it kill you to upload code to github?
Hello! Im not getting any error but my code doest return any link! What am I doing wrong
currently traveling, will watch later.. but i know, it will be awesome
The code is running but I'm not getting any output
If you're still having problems, link me your code here. I can take a look.
@@vigneshrao5679 The code is the same as sir should in the video and even the site but im not getting any pictures
@@devshetty1435 link me your code if you have it on github or somewhere in a common repo
@@vigneshrao5679 same thing i copied the code from your video character by character !!!
imad kerzazi there is no way it won’t work if you do everything right, I have used beautiful soups for some of my tricky projects.. make sure the html tags are right.. soup can work only with the right src.. also the code loops through all the images and then writes 10 images so make sure your looping looks good.. if you still have issues link me to your code.. github or somewhere else..
Thanks a lot. I tried the code in the video but when trying to print the links I got empty list. Printed soup but it seems there are no links to the images.
I am having the same problem, have you got the solution to it?
I ran ur code But the photo is not downloading in the folder
Hi, I've tried running this code to get some image links from github. The code is running but it gives no output
I iterated this style to build image scrapping script, works fine for me. If you're still having problems, link me your code here. I can take a look.
@@vigneshrao5679 same here I've tried with the tutorial example link but it gives no output. I printed the html code that html.parser gives and i noticed it don't show tha images links.
@@handresr1338 I replicated this just for the sake of comments here. hope this helps. github.com/vignesh1793/image_scrapper
Note that this type of parsing can only be used for websites that have their data publicly available. I'll be working on a project which can simply act as an image downloader plugin. That should be able to pick images from any website. Once done, I will post it on my github github.com/vignesh1793/
@Eriko. Oy You're right google blocks all urllib requests so the only way you can do with python is to use something like selenium, open an automated browser and make it download images..
No need to use f.close() this is inside context manager
thanks for this tutorial, this help me to complete my first project.
where to run it?
Is there a real world case why I should do web crawler?
what software did you use for that coding?
BTW this video was very awesome and it gave me alot of things like
1. how interviewer thinks,
2. Many free hosting websites,
3. why I should follow full instructions.
4. There is huge difference btwn number of applicant and competitor. Not all applicant are competitor.
Stuffs like these
Was very interesting and helpful for me(a beginner coder)
Why got the incomplete source code from the mentioned webpage? Anyone can help me? Thanks a lot
It's a very helpful video. Really need something like this. Hope IOS 13 vlog will also come today.
how to download specific resolution images
@hitesh why are you using earphones/headphones. Do you record a video then do a voice over
he is listening to music , i think
@@preyasprathap he use headphone to keep check on audio of his currently recording video . he told it many times .
Like a lot of others here.
The folder is coming back empty.
Does anyone have an update on this by any chance?
Thanks
Yes it is not able to find any images tag.
Hello sir,
Thanks for making so many videos. I am one of regular visitor of your youtube channel.
If you have some time please make a series on python programing language.
I am very thankful of you.
Thanks in advance.
love you sir
Nice video.. will SwiftUI video come today? .. also is that washing machine buzzzz sound in the background?
I used enumerate in the terminal but not the indexes value instead the value is repeated
Does anybody know the VSCode theme Hitesh is using?
line 23, in
f.write(img_data)
TypeError: a bytes-like object is required, not 'Response'
Getting this error :
Traceback (most recent call last):
File "crawl.py", line 6, in
soup2 = BeautifulSoup(r2.text, "html.parse")
File "C:\Users\win10\PycharmProjects\crawl\crawlenv\lib\site-packages\bs4\__init__.py", line 225, in __init__
raise FeatureNotFound(
bs4.FeatureNotFound: Couldn't find a tree builder with the features you requested: html.parse. Do you need to install a parser library?
you made a mistake with '"html.parse" change it to "html.parser" notice the missing (r)
This is a waste of time. This guy is just promoting his paid training videos. I am not going to waste my own time typing in his code. Where is the github link to the code file ??
Sir I am currently learning about programming logics from a book by Joyce Farrel. Can I learn a programming language simultaneously or learn about logics first?
learn basics then practice one programming language using projects
Sir, I am making a project on Vehicle detection & speed Tracking using videos. So can you please suggest some info. And what should I used and approach to make it...
open cv
opencv for tracking speed and yolo v3 for vehicle detection
Hi Hitesh, Please make a video on web crawling using python and how to send data to webpage and further open another webpage based on that very data. For example if we want to search on a search engine and get the data on the search result webpage
sir, please make the whole course for web scraping.
Hello , thank you for this video, it works great. How can i do if i want to scrape high resolution images(to keep the high resolution)?
Is crawling is faster than scraping using spiders
Which editor r u using ?
.... is using VISUAL CODE STUDIO!!!
Everything seems fine except that the files downloaded aren't downloaded properly.
"It looks like we don't support this file format."
Hi, Hitesh: great video, except...it didn't work. The file folder is made, but nothing is inside. The problem seems to be in your line 10, or your lines 11 and 12. When I print, nothing happens.
Here is the code, if anyone can help:
from bs4 import *
import requests as rq
import os
r2 = rq.get("www.pexels.com/@hiteshchoudhary")
soup2 = BeautifulSoup(r2.text, "html.parser")
links = []
x = soup2.select('img[src^="images.pexels.com/photos"]')
for img in x:
links.append(img['src'])
for l in links:
print(l)
Yes, it didn't worked for me as well. Have you fixed it now , if yes please share
Same here.....did you find the reason it's not working?............edit: I can use it for other websites
This code is not running anymore now.
Your videos are great.Keep going...
Awesome video sir.
The video was really awesome . Sir can we implement OpenCV here !!
sir you are explaining everything so wonderful but stil my brain cant understand 🤣 i dont understand why i cant understand coding hahaha
which os is it
Mac OS
This was helpful!
Bro can you make video on block chain and tigerbox please!!!
How to Import Instagram Photos Using Python ??
Why do you wear earphones? 🤔
dude, how can i craw instagram image ?
i made a program for it before i watched this video
@@techtalkpro10 github link?
Sirrr plzz make more videos on web scraping....
*Sir, create video on google pay integration from responsive mob web site, mobile app to google pay redirect and pay money and redirect to website, mob app*
*Its helpful college projects with out buying payment gateway. Pls sir, its really helpful for many peoples*
Sir what are you doing
I was watching till the time when you said "no one is watching here".
Amazing video
thanks dude
Awesome
First one!
+
the page www.pexels.com/@hiteshchoudhary' doesn't exist Dude !!!!