Object Detection & Identification using ESP32 CAM Module & OpenCV
HTML-код
- Опубликовано: 20 сен 2024
- Up to 20%-30% off for PCB & PCBA order:
Only 0$ for 1-4 layer PCB Prototypes:
www.nextpcb.co...
Register and get $100 from NextPCB:
www.nextpcb.co...
𝗣𝗿𝗼𝗷𝗲𝗰𝘁 𝗗𝗲𝘀𝗰𝗿𝗶𝗽𝘁𝗶𝗼𝗻:
This tutorial introduces the topic of ESP32 CAM Based Object Detection & Identification with OpenCV. OpenCV is an open-sourced image processing library that is very widely used not just in industry but also in the field of research and development.
Here for object detection, we have used the cvlib Library. The library uses a pre-trained AI model on the COCO dataset to detect objects. The name of the pre-trained model is YOLOv3.
In this tutorial, we will go through its features, pins description, and the method to program ESP32 Camera Module using FTDI Module. We will also set up the Arduino IDE for the ESP32 Camera Module. We will also upload the firmware and then work on the object detection & identification part. The script for object detection is written in the python programming language, thus we will also have to install Python and its required Libraries.
𝗣𝗿𝗼𝗷𝗲𝗰𝘁𝘀 𝗟𝗶𝗻𝗸𝘀 & 𝗦𝗼𝘂𝗿𝗰𝗲 𝗖𝗼𝗱𝗲: how2electronic...
....................................................................................................................................................................................................................................
Drop a like if you liked this video.
Don't forget to subscribe to our channel for more Electronics projects and tutorials.
Website: www.how2electr...
Facebook: / how2electronics
Instagram: / how2electronics
The processing is being done on the host computer and not on Esp32 stop misleading on title of the video. Just wasted my time.
exactly mate its a fake video!!
The title isn't misleading at all , the word "using" is correct. "Run" opencv on a ESP32 would be misleading. Imagine how slow and how hell of a headache it would be to handle opencv data with only 34 GPIO and 4MB of flash memory. Don't blame on others your misconception of the world
@@fb846 microcontrollers can be surprisingly efficient since they don’t have to waste a large part of their power on keeping an operating system running.
In the fast moving it-world you can’t keep up with everything - it wouldn’t surprise me if there were some rudimentary solutions for object detection on such devices. And while I agree that the title is probably not misleading on purpose, it can still be misleading for people which are not up to date with every spec sheet
👍🏼😃
@@schlingelgen yes some microcontrollers are designed with AI and object detection in mind like the "Arduino Nicla Vision" but in this case the title clearly mentions ESP32 wich is not. For object detection there is the Pixy2 wich is compatible with most general microcontrollers. But my point was that the title wasn't misleading because it's very specific. "Using OpenCv & ESP32" is different than "object detection run on a microcontroller"
@@fb846 I get that, I just wanted to say that it’s not just black and white, misleading or not misleading. I think that depends, and all the information you just gave is not common knowledge you can expect everyone to have. I don’t think the creator is the one to blame, but I can also understand why some people are not satisfied with the solution since they were looking for something different.
The chickens in the background, are making this video so much more enjoyable to watch.
Another amazing video back to back from you 😍😍 thank you so much 🥰😍
At 00:10, you say that the ESP32 module identifies objects. Isn't the ESP32 not just used for the video feed? Your Windows PC with openCV does the identification, no?
You are first science sceam students I saw on yt. ☺️☺️☺️
It's very cool !! I will do this project when I 'll have my Esp32 cam thank you for your work ! 👍😉
Hlooo
Excellent video, thank you. Could this camera be used for edge detection/avoidance?
Who is this new girl in how2electronics
She has a nice voice 🙂but the first one is very good i fell in love with her voice
Thanks for your efforts...it works well and is impressive.
Ma'am we are unable to run the python code for some unknown reason.... it asks for tensor flow.. Please help
nice video but some many information missing.. Is it the ESP 32 CAM that is doing the object detection or the laptop?
Another awesome video 👍👍
Multiple libraries were found for "WiFi.h" getting this error how to solve it
Nicely done! Thanks for the video and the info!
Dog in the pic: Ma'am! Im an animal, not an object, thank you!
My heart detected 💘 your sweet voice 🥰🤩😅😅
Mom, I ask for a tutorial to change the name of the detected object into sound, this is for my blind sister, please🙏
Theres tts library for python. Perhaps you can use that
Mam not mom
After finishing the programming and configuration, how do you power the card after installing it in the case?
It shows:
ModuleNotFoundError: No module named 'cv2'
Your tutorial on the link provided on description is not helpful enough. Please make a more detailed tutorial or video on how to get it working
Very nice tutorial. Thank you.
Thanks very much my dear for this beautiful tutorial. Please, can you teach us how to make our esp32 cam detects people and show their name. Is it possible to connect it to the database so that we can add people and their name there. Waiting for your reply. Thanks
A video will come on that very soon.
Thanks my dear. I waiting for it
@@Charles-lt9rr 😁😜 Charles, i like your humour, you have forgotten to recognise the single women only, and theirs fb profile, so we can send friendship request 🥳🌿 haha
@@HowtoElectronics , i would like to ask, is it possible to add a GPS module to this project, and to record the camera's and the object's position and distance from the camera ?
I guess it is possible, and we can build this project up more and more with our imagination.
If you would like to tell me please, did you try to attache an SSD disk to an Arduino board ?? It would be faster R/W , with bigger disk space and more reliable device than SD card.
For the reliability, i try to design a system of 2 SD cards connected in parallel as a RAID system
did this program work if you discoonect esp cam from pc/laptop?
Excellent video..thank you
Very cool and awesome project, WELL DONE. How to play a sound when object is identified ?
Use NodeMCU & Fire HTTP Request using Python
Spots dog* Starts playing mexican fiesta music*
this project should work without internet. that is, directly connected to the esp32 camera's wifi. because if it works without internet, the camera will work without freezing? can you help me?
I have a problem of the window tab created by cv2.inshow() always crashes automatically once running. I've installed all required library... Please help
thank you hopefully it can help me in my project
hi....... in my pc detection not responding. how can i fixed it?
Hi friends, after finishing Python coding, what should I do next? transferred to ESP32 Cam or what? If it is transferred to ESP32, does the transfer coincide with the coding on Arduino (the Python coding is combined with the coding on the Arduini IDE)?? Please make a tutorial please..
Thank you..
Cool video, please I need to understand something.. how exactly does the computer communicate with the Esp32? is it via WiFi?
Everything running but detection window is not responding. I've tried it many times . Please reply it's very important
Good day everyone. Can this microcontroller be used for object counting?
I will watch the rest later. I had to slow down the speed to .75 of normal.
How to use Arduino instead of ftdi programmer? Will there be any change in code?
Hi,i received my ESP32 CAM but the supply is missing 😢😢😢 what i do???
Can you add a voice that the device says what they detect
i like this video but i wanna ask about calculate the destance between the camera and things
When the press on the "Run" , the syntax error (invalid non-printable character U+00A0 , why ?
After python code run live transmission is not detected 😢
Does this have to be connected to the computer or through wireless
Would this application need wifi connection at all times. Is there any library function to convert the objct detected to speech.
when face detection and recognition turn on, why esp 32 cam is black and serial monitor is martix3du item alloc failed?
Could this recognise bored, surprised, or happy expressions?
After execution, a different window for detection does not open.
😍😍This is super cool object detection & identification project, keep up your great work!
Hlooo
How can I make a trigger signal after detecting a person to a relay module for home automation using this same concept. As for image processing we need more RAM which is not possible in esp32 cam. So is it possible to trigger a relay after detecting humans (in this case you have done using laptop)?
How much time it takes to open the 2 windows?
hello i have had a question i wanted to ask that is can it detect medicine pills kept on a flat surface?
Hello, how can I install cvlib package in Anaconda
i got the following error while uploading the code "does not exist or your board is not connected"
Hi! Does it require wireless network connectivity to work? Or it just needs the wireless connectivity as a way to view what the camera can see?
It requires wifi network
How many pictures did you use to train?
This is AI board. You are using it just like a camera. What's the difference between this and a normal usb camera?
Hey. When I try to run the code in Python IDLE I get this error: "Failed to open the IP camera stream". While if I copy and past the camera's url in the web browser it works fine! Any ideas on how to fix it?
Very good 👏
can we record a video and send to mobile, using this project
hello, sorry to ask why when my python program is running it says unterminated string literal (detected at line 9)?
how can i read the text like text and numeric from camera and get it into my excel
I tried it, somehow the detection window freezed while the transmission window shows and worked normally. I've followed all the steps. Any help?
It's the same for me. Which operating system do you have on your PC?
@@FilipVucinic win10. I guess some library is missing, or some dependencies required
yes same also for me. detection window not working. I think errors occur because cvlib library has a problem or not working. please let me know friend when you found a solution
Hello , please reply if you have found out the solution to this problem .
@@sltechgalaxy1677 , did you find any solution to the detection window problem , sir ?
miss what software to make a 3d model for 3d printer ?
I think I really need that, a camera with object tracking, not just an object tracker but it can identity a specific object from which I want!!!!!
Well how much is that??:?
Very very very good!!!!!!!
Awesome project
Amazing video ♥
Where can I buy one that works and is assembled? Thanks
I already installed matplotlib library, but it didnt work, may you provide me the right matplotlib library, please?
I am looking for computer vision powered fire dector , i want to make it with arduino or pico becuse of my budget can u plz help me
@HowtoElectronics plz help k ow I'm getting error saying No module found tensorflow.python
why my live trasmission is on but my detection is load and can see ?
how to use it for pick and place on moving conveyor belt. can you develop we can buy the software from you
Sir ...
How many faces we can enroll in Esp32 cam module?
how to fix the problem of wifi failure in serial monitor pls reply
Can you make a detail video step by step on this. I found this video very much helpful. If I have to use this system in Poultry to count hen and eggs will this work? Thanks 👍
Yes it will definitely work. The tutorial is written on website article too with full details. You can follow the guide.
hello does this work without a ftdi module and just using arduino UNO
this is a pain !!! really no drivers no port !!! program is not matching with the video program !!!
Hey, I have a question. I ran the Python Code and both camera windows opened, but the detection window doesn't show any box at all, I tried showing different objects and even faces but it didn't show a single box. I literally only changed the IP address and added some comments to the code, but still no boxes. I was wondering if you would know a reason behind this. It's weird since I tried the Face Detection method from cvzone course, and it showed boxes.
for me too, did u solve it?
Can someone help me pls
I am just getting two black box
Means not responding
bro I try to do this. actually my live stream is open but the detection window is not loading and it is showing that not responding. what i need to do. please reply bro
Hi, How can I implement this in my raspberry pi 4B?
When i compile the arduino code, the esp32cam.cpp showed many errors!!!!
Is using OpenCV for object identification, the same thing as machine-learning?
I get confused by all the tools and terminology out there.. for example, how does 'TinyML' fit into all this?
In general, do people collect the data from the embedded system, and then transfer it to a cloud services (ex. Edge Impulse) or PCs (TensorFlow, Kera, etc) in order to train it? I assume the output of this training is an algorithm that must be ported to your embedded device?
hello guys , I wanted to ask why does the live transmission and the detection windows not responding..? i have checked my ip address and it was correct..
How did you solved your issue?
This project not working i found the reason , cvlib library not working
ModuleNotFoundError: No module named 'cv2'
Can someone help?
Like it, thanks for the info :)
Informative video 👍👍
Excellent thank you
Amazing!!
Can you help me out to detect the fire using this esp 32
in the detection dialoge it says not respondig please help me to fix it
I find any TCP protocol is just to laggy. I was a little disappointed with the esp32cam.
How can I detect fire by using esp 32
Is CVLIB compatible to OV5640?
Can i detect facemask using that technology ? How?
hello, i have some problems after compiling the arduino code after using the esp32cam library from github. its says "error: 'esp_camera_sensor_get_info' was not declared in this scope". so, how can I solve this problem?
thank you
I had the same problem, what solved it for me was to update esp32 in the board manager to at least 2.0.2. But after that I'm having difficulties identifying it in python, when asked to make the bounding boxes and the class simply doesn't show any image. however the transmission itself is working.
@@jonimortal how did you update it cause from what i'm seeing it only stop at 1.0.6
same problem here. how to solve please tell me
Good work
Do I need to turn the wifi or internet on to use this project?
Yes
Is this work wirelessly?
please give me the esp 32 Ai-Tkinder firmware file or dowload link
Can it be all computes in esp32?
Hi. I hope to get a response to my question. If I use the esp32 Cam Dev board downloader, the Project can still run as expected in the video?
Sorry to say I havent tested it. But you can try once, may be it might work.
@@HowtoElectronics okay. Thank you i appreciate your response.