ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification, Image Processing

Поделиться
HTML-код
  • Опубликовано: 31 май 2023
  • ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification
    Altium Designer: For Schematic and PCB designing
    www.altium.com/yt/electronicl...
    Altium 365:
    www.altium.com/altium-365
    Octopart, components search engine:
    octopart.com/
    download programming:
    www.electroniclinic.com/esp32...
    ESP32 Cam projects: related videos
    Watch the same video in Hindi/Urdu
    • ESP32 CAM with Python ...
    ESP32 Cam and Arduino-based Car Parking Gate / Barrier control
    • ESP32 CAM with Python ...
    ESP32 Cam based Human Pose landmarks detection, security camera
    • ESP32 Cam Python OpenC...
    How to make IoT camera using ESP32 Cam and Telegram:
    • IoT Camera using ESP32...
    ESP32 Cam with ESP8266, google drive, and Google spreadsheet
    • ESP32 CAM and ESP8266 ...
    ESP32 CAM getting started video
    • ESP32 Cam: ESP32 Camer...
    ESP32 CAM DOOR LOCK CONTROL SYSTEM USING HUMAN RECOGNITION
    • ESP32 Cam Face Recogni...
    ESP32 CAM SEND IMAGES TO GOOGLE DRIVE
    • ESP32 CAM Send Images ...
    ESP32 CAM SMART IOT DOOR BELL
    • ESP32 CAM Smart IoT Be...
    ESP32 CAM SAVE IMAGES IN SD CARD
    • ESP32 Cam save Image t...
    Support me on Patreon and get access to hundreds of projects:
    / electroniclinic
    Subscribe to my New RUclips Channel, if you want to watch my videos in Hindi/Urdu
    / @letsgetstartedd
    Project Description:
    ********************
    In this video, I am going to use ESP32 Camera module with Python OpenCV Yolo V3 for object detection and Identification. I am only using ESP32 Camera module for the live video streaming whereas for the image processing I am using Yolo V3.
    I will test it on three different machines and you will be amazed with the end results. First I will test it using the Raspberry Pi 4 and it has 8GB RAM. Then I will test it on Core i3 Laptop. And finally, I will test it on my MSI Intel Core i7 with Nvidia Geforce 16GB GPU and 16GB RAM. I specially purchased this laptop for video editing and image processing.
    Anyway, after performing initial tests then I will share with you the final code, which can be used for the detection and identification of specific objects. Let’s say you want to send an alert message when a specific object is detected.
    In my case, I send an alert message when a bird and cat are detected both at the same time. While all the other objects are totally ignored.
    We have a long list of the objects that we can detect. So, after watching this video you will be able to detect all these objects at the same time or you can select one or multiple objects of your choice and this way you can build amazing image processing based projects.
    ********************
    Amazon Purchase links:
    *****************
    ESP32 Camera Module
    amzn.to/45yPi9D
    ESP32 CAM W-BT Board
    amzn.to/3N24vbY
    MSI Intel Core i7 Laptop check this out.
    amzn.to/42ayHpL
    Other must-have Tools and Components:
    ESP32 WiFi + Bluetooth Module (My recommendation), more IO pins, improved speed, and supports a Lipo Battery:
    amzn.to/3v40DkE
    Arduino Uno, Nano, Mega, Micro "All types of Arduino Boards":
    amzn.to/3fk5OTi
    Top Arduino Sensors:
    amzn.to/3vZbnfM
    Super Starter kit for Beginners
    amzn.to/3cq56C5
    Top Oscilloscopes
    amzn.to/3ctF3d8
    Variable Supply:
    amzn.to/2PEAqE7
    Digital Multimeter:
    amzn.to/2QGRPg1
    Top Soldering iron kits: "best"
    amzn.to/39nqDtb
    Top Portable drill machines:
    amzn.to/3suQMh7
    Jumper Wires:
    amzn.to/2NYPEDA
    3D printers:
    amzn.to/3ruG1dt
    CNC Machines:
    amzn.to/3cuZWVv
    DISCLAIMER: This video and description contain affiliate links, which means that if you click on one of the product links, I will receive a small commission. This helps support the channel and allows me to continue to make videos like this. Thank you for your support!
    ****************
    For more Projects and tutorials visit my Websites
    Electronic Clinic:
    www.electroniclinic.com/
    Programming Digest:
    programmingdigest.com/
    Follow me on Instagram:
    / electroniclinic
    Follow my Facebook Page Electronic Clinic:
    web. profile.php?...
    Follow my Facebook Group, Arduino Projects:
    / 190031841821771
    Email:
    stu_engineering@yahoo.com
    About the Electronic Clinic:
    Electronic Clinic helps the students and other professionals to learn electronics, designing, and programming. Electronic Clinic has tutorials on Arduino, Arduino Nano, Raspberry PI, image processing, gsm based projects, Bluetooth based projects, esp8266 projects, Nodemcu projects, robotics, desktop application designing and programming, PLC, SCADA, RC Planes, Electronics, Power Generation, HMI, and much more. Check my Playlists.
    #esp32cam #yolov3 #opencvpython
  • НаукаНаука

Комментарии • 99

  • @ElectroniClinic
    @ElectroniClinic  7 месяцев назад +2

    Watch my Latest Video on
    ESP32 Cam, Python, OpenCV, & Mediapipe based Diy Security Camera using Human Pose Landmarks
    ruclips.net/video/pUByI_5saRs/видео.html

    • @ackj9766
      @ackj9766 7 месяцев назад

      what is you esp32 board version camear ip didnt appear

    • @jerroldleung8065
      @jerroldleung8065 2 месяца назад

      hello, I have a problem with detection. The Detection window pops up but stays black.
      There is a live transmission window, this works well.

  • @muhammadsalem9924
    @muhammadsalem9924 8 месяцев назад

    Thank you, professor
    Excellent work

  • @shivaraghav2899
    @shivaraghav2899 Год назад +1

    Mind blowing.... Super project

  • @muhammadhamza6536
    @muhammadhamza6536 Месяц назад

    amazing really helpful

  • @benj5279
    @benj5279 Год назад +3

    You really help me a lot with your videos i hope i can support you somehow ❤️

    • @ElectroniClinic
      @ElectroniClinic  Год назад +2

      you can support me and my channel by subscribing, or liking the videos, and comments. And by sharing videos with your friends.
      Today, i will upload a new video about car tracking and gate/barrier control system. I hope you will like the idea.

  • @vedmaheshkale5943
    @vedmaheshkale5943 4 месяца назад +2

    your cat is cute!!!!!!!!!
    🐈

  • @wdew1927
    @wdew1927 10 месяцев назад

    Very nice subject !
    During compiling a message "cannot find webserver.h". My board version is 2.0.10 Do you have a solution for this ?

  • @Radar131
    @Radar131 2 месяца назад

    Want request may you make video about helmet and plate number detection ?

  • @unik8985
    @unik8985 Месяц назад +3

    Hi, I've done everything right and have the live camera working but whenever I try to run the object detection code it gives me an error where:
    outputNames = [layernames[i[0]-1] for i in net.getUnconnectedOutLayers()]
    ~^^^
    IndexError: invalid index to scalar variable.
    and I can't seem to fix it

  • @sam-el
    @sam-el 9 месяцев назад

    I want to ask.
    Can you help me with a guide to create object detection using de1-soc

  • @user-cc5cj2ty7y
    @user-cc5cj2ty7y 27 дней назад

    What should be the specification of camera for image detection or image processing into camera and then send only a small amount of data such as number of people passed through it etc to the network ?? Please help...🙂

  • @CharlesMashava
    @CharlesMashava 7 месяцев назад +1

    I watch your videos.I find them very helpful for my own going project. However i am running the an application with same weights but its supper slow on detecting and sending information to the esp32. How can i optimize it to be fast??

    • @glennimmanuel9338
      @glennimmanuel9338 5 месяцев назад

      maybe you can try to use freeRTOS to manage the tasks

  • @bberil4834
    @bberil4834 6 месяцев назад

    Thank you for the video. I want to do the exact same project but I will use the ESP32 as a soft access point. How should I modify the code?

    • @aneshk425
      @aneshk425 3 месяца назад

      You got any solution bro?..even am looking for the same thing

  • @manishuike3830
    @manishuike3830 8 месяцев назад

    can you make one for nut and bolt identifying

  • @PraveenKumar-vz4dy
    @PraveenKumar-vz4dy Месяц назад

    8:10 we can't do image processing in esp32 cam (not enough computational power ) is this what u r trying to say ?

  • @deeptanshugupta4241
    @deeptanshugupta4241 3 месяца назад +1

    Is it possible to do this without connecting it to pc

  • @nagababumarthi1942
    @nagababumarthi1942 4 месяца назад

    Pls make esp32 cam based pick and place robot

  • @user-fq6yi5fu3f
    @user-fq6yi5fu3f 7 месяцев назад

    ERROR: Could not find a version that satisfies the requirement open-cv-python--4.5.3.56 (from versions: none)
    ERROR: No matching distribution found for open-cv-python--4.5.3.56
    in cmd 2nd step installing open cv

  • @chideraagbasiere7868
    @chideraagbasiere7868 2 месяца назад

    Where did the "Cat and Bird Detection" file come from @3:39 ?

  • @user-zm7qi7et3r
    @user-zm7qi7et3r 4 месяца назад +1

    why did you do the image processing and objec detection on Raspberry Pi or Laptop, can't it be done on the ESP32?

    • @sanakabanerjee4462
      @sanakabanerjee4462 2 месяца назад

      esp32 has very less ram and is only good for capturing image, it can no way run such a heavy model

  • @Shykidss
    @Shykidss 6 месяцев назад

    Does it work with Yolo nas

  • @user-ds3zg5xs7i
    @user-ds3zg5xs7i 2 месяца назад

    how do i incorporate the same for yolo v8 model?

  • @parthimahi
    @parthimahi 3 месяца назад

    6:41 for its coming for me "camera fails"what should I do plse anyone suggest me

  • @vikasreddy4864
    @vikasreddy4864 7 месяцев назад

    Does object detection works for similar objects ?
    Does object detection works for identification of safflower stigma from saffron stigma?

    • @Shykidss
      @Shykidss 6 месяцев назад

      You can train custom dataset to the model

  • @muhammadsalem9924
    @muhammadsalem9924 8 месяцев назад +1

    Please tell me what are the appropriate computer specifications for deep learning and machine learning ? Please answer

    • @harshwardhansingh9915
      @harshwardhansingh9915 3 месяца назад

      Any computer with a GPU will work fine. But if you don't have that, you only need an internet connection. There are online tools like Google Collab that will provide you with an online jupyter notebook free of charge, you can use it for learning machine learning

  • @user-fy3bh8ie2v
    @user-fy3bh8ie2v 8 месяцев назад

    Hi, I want to make something similar, but instead of object detection, I want to make face detection system using esp32cam which will be used for storing student attendance, can you please help or provide some reference related to this.

    • @ElectroniClinic
      @ElectroniClinic  8 месяцев назад

      for this you will need to train faces. I am working on a similar project. Its object the identification of other objects not available in the coco.names list.

  • @haven-hw2wl
    @haven-hw2wl 7 месяцев назад +1

    Hi sir your project is awesome, but when i try all of your instructions im having a problem with coco.names even if it's in the same folder but always displaying error that no coco.names found 😢

    • @aymanmrwan2410
      @aymanmrwan2410 7 месяцев назад

      Yes me too

    • @haven-hw2wl
      @haven-hw2wl 7 месяцев назад

      @@aymanmrwan2410 bro i already did it, just use different format not notepad

    • @kris8167
      @kris8167 6 месяцев назад

      @@haven-hw2wl Then I would like to ask what format you use, thank you.

  • @didzi6728
    @didzi6728 11 месяцев назад

    Hey. When I try to run the code in Python IDLE I get this error: "Failed to open the IP camera stream". While if I copy and past the camera's url in the web browser it works fine! Any ideas on how to fix it?

  • @joaogouveia4497
    @joaogouveia4497 Месяц назад

    im trying to do the same thing the only diference is that im using an esp32s3 camera that creates a webserver for the video but when i try to access the webserver ip my opencv crashes. Do you know what could have caused this?

    • @kevinchang0527
      @kevinchang0527 20 дней назад

      Been running into similar problem. Do you see your IP in serial monitor? I had it when I tried it some time ago, and now I can't get my IP built

  • @user-ul2em8lv3v
    @user-ul2em8lv3v 7 месяцев назад

    does this process can be run on raspberrypie without a computer after starting the process? i want make this for blind people which they can carry with them?

  • @janarthanandayalan
    @janarthanandayalan 3 месяца назад

    Hi sir, is there a way we can give our very own data to train the camera?

    • @ElectroniClinic
      @ElectroniClinic  3 месяца назад

      Very soon I will make a video about this.

  • @orphaeel
    @orphaeel 4 месяца назад

    i have this problem...
    cv2.error: OpenCV(4.5.3) C:\Users
    unneradmin\AppData\Local\Temp\pip-req-build-sn_xpupm\opencv\modules\dnn\src\darknet\darknet_io.cpp:900: error: (-212:Parsing error) Unknown layer type: in function 'cv::dnn::darknet::ReadDarknetFromCfgStream'
    anyone have the solution for this problem???

  • @benj5279
    @benj5279 Год назад

    Can this work if laptop and esp32 are connected to different wifi?

  • @juantellez2176
    @juantellez2176 7 месяцев назад

    would this work with a pretraining yolov8?

  • @waleedhussain4409
    @waleedhussain4409 10 месяцев назад

    can you please give the code for alert as an email or for arduino using gsm that you tell in last part of video it would e very helpul if you give code for it

    • @manojshyaam6683
      @manojshyaam6683 10 месяцев назад +1

      Search for SMTP protocol for ESP 32
      Best wishes

  • @digitronix532
    @digitronix532 2 месяца назад

    If my camera senses "Car" , any one of gpio should turn on in ESP32CAM . Help me

    • @ElectroniClinic
      @ElectroniClinic  2 месяца назад

      I have done it. Check playlist or the related projects list in the description.

  • @Jarniwan
    @Jarniwan 8 месяцев назад +3

    you should have at least tell us if the middle part was a sponsor segment. that was awful.

  • @benj5279
    @benj5279 Год назад

    What do you use to run the python code?

    • @benj5279
      @benj5279 Год назад +1

      Nvm i figured it out

    • @juantellez2176
      @juantellez2176 7 месяцев назад

      I havent figured out what did u use to run python?

  • @Mmorpg347
    @Mmorpg347 4 месяца назад

    When I open the serial monitor it shows me to write a message how can I fix this

    • @parthimahi
      @parthimahi 3 месяца назад

      Press reset button

  • @rockstarsk4023
    @rockstarsk4023 5 месяцев назад

    where is the main program file??

  • @palindrome3212
    @palindrome3212 11 месяцев назад +1

    i have this error in line 71 saying:
    outputNames = [layernames[i[0] - 1] for i in net.getUnconnectedOutLayers()]
    IndexError: invalid index to scalar variable.
    Can you help me with the error?

    • @BuddhiniJayakody
      @BuddhiniJayakody 11 месяцев назад

      did you fix the issue? I also get the same issue

    • @auburngold4958
      @auburngold4958 10 месяцев назад +1

      Fixed the issue, just remove the [0] and run the program. This only works on windows

    • @attacker21
      @attacker21 6 месяцев назад

      @@auburngold4958 thanks a lot

  • @sontruongpham6883
    @sontruongpham6883 11 месяцев назад

    Your guide is very helpful.
    But I got this error in line 30 of esp32cam.cpp file while compile the esp32camera test code:
    error: 'camera_sensor_info_t' was not declared in this scope
    camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id);
    error: 'info' was not declared in this scope
    camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id);
    error: 'esp_camera_sensor_get_info' was not declared in this scope
    camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id);
    Could you help me? Thanks.

    • @sontruongpham6883
      @sontruongpham6883 11 месяцев назад

      Turn out the problem is I have the old arduino esp32 version which is 1.0.6. When upgrade to 2.0.x its run normally.

    • @albertobesozzi5825
      @albertobesozzi5825 10 месяцев назад

      I've got the same problem but my arduino is already updated to 2.1.1

  • @tyronetyrone2652
    @tyronetyrone2652 11 месяцев назад

    How to use IP CAM instead of ESP32CMA

    • @ElectroniClinic
      @ElectroniClinic  11 месяцев назад

      I will cover this in my upcoming videos.

  • @CsabaDzsurnik
    @CsabaDzsurnik 9 месяцев назад

    Hello! It's awesome! But I get the following error on my PC:
    File "C:\Users\PC\Desktop\esp32\ ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification, Image Processing\esp32CamTest-PC.py", line 19, in
    net = cv2.dnn.readNetFromDarknet(modelConfig,modelWeights)
    cv2.error: OpenCV(4.8.0) D:\a\opencv-python\opencv-python\opencv\modules\dnn\src\darknet\darknet_io.cpp:902: error: (-212:Parsing error) Unknown layer type: in function 'cv::dnn::darknet::ReadDarknetFromCfgStream'
    could you help me please?

    • @AkuDapi
      @AkuDapi 7 месяцев назад

      same case

    • @orphaeel
      @orphaeel 4 месяца назад

      have you found the solution???

    • @CsabaDzsurnik
      @CsabaDzsurnik 4 месяца назад

      @@orphaeel unfortunately not, but I found another tutorial that works on the same principle and is flawless.

    • @orphaeel
      @orphaeel 4 месяца назад

      @@CsabaDzsurnik with same model and config??? Anyways can you give me the link... really need it for my final project... TIA

    • @orphaeel
      @orphaeel 4 месяца назад

      @@CsabaDzsurnik can you tell me that tutorial, please???

  • @huanle4109
    @huanle4109 2 месяца назад

    The serial monitor just show "CAMERA OK
    ", it did not show "......" line. How can i fix it ?

    • @anhviettran160
      @anhviettran160 Месяц назад

      Check lại tên wf và mk đúng chưa. Nếu đúng thì nó sẽ hiện ip của wf

    • @jaimeabug9090
      @jaimeabug9090 Месяц назад

      Bro I have same issue. Have you fix you?

  • @eidgames8761
    @eidgames8761 8 месяцев назад

    Failed to open the IP camera stream
    Process finished with exit code 0

    • @parthimahi
      @parthimahi 3 месяца назад

      You solved this problem man! I also getting this

    • @dhivyabharathy3032
      @dhivyabharathy3032 Месяц назад

      ​@@parthimahi Did you solve this?

    • @parthimahi
      @parthimahi Месяц назад

      @@dhivyabharathy3032 yes I solved

    • @dhivyabharathy3032
      @dhivyabharathy3032 Месяц назад

      @@parthimahi how ?

    • @parthimahi
      @parthimahi Месяц назад

      @@dhivyabharathy3032 where are you facing the problem?

  • @panduaksoro8845
    @panduaksoro8845 9 месяцев назад

    where is the alert?

    • @ElectroniClinic
      @ElectroniClinic  9 месяцев назад

      When it detects a cat and bird at the same time.

    • @panduaksoro8845
      @panduaksoro8845 9 месяцев назад

      @@ElectroniClinic so the alert just like log in python app?