Object detection with ANY camera in Home Assistant - Tensorflow and DOODS
HTML-код
- Опубликовано: 26 окт 2020
- In this video we are looking at Object Detection with Home Assistant or HASSIO using Tensorflow and an awesome community service called DOODS from Snowzach. This allows us to use Home Assistant to send motion alerts or notifications straight to our phones that can look for specific objects or people in your security cameras.
Hardware to run Home Assistant:
Raspberry Pi 4: amzn.to/2Dviwyh
Micro SD Card: amzn.to/3lqBk2v
Micro SD to USB Adapter: amzn.to/2GcAk1P
If you'd like to support me and future projects:
Patreon:
/ everythingsmarthome
Buy Me a Coffee:
www.buymeacoffee.com/EverySma...
Written Article:
everythingsmarthome.co.uk
EVERYWHERE YOU CAN FIND ME:
Everything Smart Home Community Discord:
/ discord
Twitter: / everysmarthome (@EverySmartHome)
Instagram: / everythingsmarthome
Facebook: / everythingsmarthomeoff...
#homeassistant #smarthome
________________________
Some of the links above are affiliate links, where I earn a small commission if you click on the link and purchase an item. You are not obligated to do so, but it does help fund these videos in hopes of bringing value to you!
Music:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Blue Boi by LAKEY INSPIRED / lakeyinspired
License: Creative Commons - CC BY-SA 3.0 goo.gl/1uPfiz
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 
Наука
![Eminem - The Death of Slim Shady [Graveyard Album Trailer]](http://i.ytimg.com/vi/vOJD-6vQpXU/mqdefault.jpg)
I genuinely thought I could keep this under 10 minutes this time 😅
No worries, mate. It’s all good.
I think you found a good topic here to expand on and carry much further. Not only to help us subscribers , but possibly a good way to get your channel to blow up with popularity. Good content very well explained.
Thanks Andy! Please let me know what else you want to see, open to suggestions!
@@EverythingSmartHome I would start with expanding and taking this object recognition as far as you can. If you search for doods and Home assistant, there are not many options on here. AI / Object detection is perfect for those of use with many cameras out side to reduce storage space and false automation triggers.
@@EverythingSmartHome See my comment below for some ideas you could follow up on. Basically performance improvements / tweaks would be great. Also I'd like to use this to replace MotionEye - but need something to tie into this to record the video stream when, say, a person is detected. Ideally buffering so starting 10 seconds before and the person was detected, and some time afterwards too. Ideally this would be video stream and not the Doods output as currently that's too slow
I was looking for this video since month! Thanks for the very good video and keep on going with the channel!!:)
I must have read your mind 😅 thank you, I appreciate it! 🙏
A massive help this was. wow! i changed the file output to put the images in a folder /config/www/image_processing_doods/cameraname_doods.jpg. just to make it more interesting and not to clutter up the homeassistant www-folder. do not forget to create the extra folder :)
Thanks for a great video mate, this opens up a whole host of possibilities. Once again thanks for introducing me to such an interesting topic
Anytime, thanks for watching!
And 6 months later, over 15,000. Your videos are very good, if this subject wasn’t for just a few nerds, well, you know. Thanks for your efforts, very helpful videos.
Haha thank you sir! Appreciate the comments and support!
First video of yours I've seen. Garnered my subscription in the first few minutes. I like the video length. Long enough to cover the details, no more, no less. Keep it coming.
Thank you, really appreciate that 🙏
Cracking vid and really well explained. Thank you.
Thank you very much, appreciate it 🙏
great session, awesome detail - Thank you
Thank you!
A good guide of Object detection with Home Assistant to me. Thanks.
Thanks my friend!
Love youre vids ! Subbed liked and commented ! Great man !
Thank you very much, appreciate your support!
Thank you for letting me take this feature for a test drive through your demoing of it. (Wanted to know if integrating my cams are even worth it. I think that's a yes!)
This is great! I just got something similar set up using AWS object recognition, but I would rather have it run fully local. Looks like I'm off down another Home Assistant rabbit hole.
Thanks appreciate it! Haha enjoy! Let me know how it goes!
really great video! thanks!
Thank you! 😅
Nice video. Will stay here for more awesome content. Thank you.
Thanks for the support!
Very, very interesting. Thank you
Thanks for watching!
Thanks for the great info and tutorials. Keep-up the good work. You mentioned your platform can detect the image in 0.3sec, what hardware you are using? And do you know about what frame rate would be on the RPI4?
Great video
Sweet! Very well done, clear, concise and very useful ! Many thanks. Is there a way to personalise the base of recognizable objects or even recognize specific persons ?
Super video!
Thanks!
Great guide.. 👍🏻👍🏻
Thank you for watching 🙏
dude! very cool!
simple and perfect !
Thanks my friend!
Love this! Would love a follow up showing how to setup notifications and maybe face detection?
Hey, thank you! Sure I'd definitely be interested in doing that!
Yes yes yes!!!!!
Hardware recommendations?
great video!
Thanks very much!
Bravo! The speed of your video is somehow much better now...
;)
Haha context 😜😂
awesome!! thanks!
Thank you for watching!
Hello, i just stumbled upon the world of home automation, and then found this gem of a channel. I am planning on building the whole house with my own electronics and firmware (just wanted to let you know what type of viewer i am in case it helps with detailed analytics).
I like your aesthetic very much, so maybe you could also do a video where you explain your way of choosing colours, shapes, overall design philosophy?
Maybe show us something you do differently when you approach a project, for example your way of thinking about every step from idea to final "product?"
Hello, thank you for the support and for watching! I'll take your ideas on board thanks!
Once again thanks for a great video. I love the great balance between technical knowledge and practical application.
A question pertaining to this video; is it possible to train the system to recognize a particular person?
Thanks Andre! And I see your question was answered by yourself! 😅
Very nice video. I think I’ll subscribe if they are all this good! Ps. How about a version which does facial recognition next?
Thank you 🙏 sure I'll look into that!
Great topic and information as always. I would've liked to see you hold the phone in one hand and a black wallet in the other to see how Tensorflow detected the two.
I got an idea to look into later (for me that is - it is very specific). I'm breeding Great Danes and have a bunch of them. I would like to have Tensorflow determine who it is on camera by, for instance, looking at the collar. Even more interesting would be having GPS trackers on them to help with determining which dog is which when there is more than one in the picture based on where they are in the pic (getting a bit complicated, but with the tech nowadays there's almost no limit). All that would of course need more than a Pi, I don't know if Tensorflow can utilize GPUs on a PC?
Great video, I'd love to see someone do a video on setting up openalpr (number plate recognition) would be handy to open garage door, or warn if my mother in law has arrived 😂
Thanks! I've tried it before a few months back and it's pretty easy, problem is the results were really underwhelming unfortunately, the amount of variance using the same still image was very surprising to me!
I'd love to see how to train the models and also how you did the notification aspect of it. In any regard, here take my sub!
Also what to troubleshoot if the object identified image doesnt show in lovelace?
Thanks 🙏 take a look at my actionable notifications video and you'll see how to make this exact notification 😅 to troubleshoot, check the logs in HA under configuration, logs.
@@EverythingSmartHome Ah the logs!!
I was able to fix my issues, since i have HTTPS with duckdns I had to do the following,
1. set the image URL from HTTPS://.duckdns.org:8123/local/www/image.jpg to HTTPS://127.0.0.1:8123/local/www/image.jpg
2. in the config.yaml, set doods cameras to disable ssl authentication with command, verify_ssl: false
Reboot and its working well. Just need to see also how to train the AI using ML?
Thanks for another great video, although this is an older one ;-)
I decided to give DOODS another go, as Frigate or Deepstack ask a lot of recourses and I don't have a Coral yet.
Well, after your video it all worked out very well! I was happy to find out, that my first summary of my frontyard (before entering any names/confidence numbers) contained:
6 persons, 3 cars and .... a GIRAFFE!
I ran downstairs, but unfortunately no Giraffe, LOL
Hahaha damn, no Giraffe?! That's disappointing
really cool! Now to work out how to change my camera feed from mpeg to jpeg...
Great introduction and setup guide.
I would love to see a follow-up video hov to program a usecase in SmartHome and Tensorflow, e.g.
IF a Human is detected with confidence rating above 80%,
THEN turn on staircase lights.
But IMHO the background music is not necessare, I personally prefer only the speaker in this kind of explanatroy videos.
Thanks for the video, really interesting! Could you recommend any cameras for indoor and outdoor to use with home assistant and face/object recognition? Thanks, Alex
Thank you for watching! 🙏 It depends on your needs and environment but make sure to watch reviews and comparisons and see if the camera does what you hope or expect, that's the one bit of advice I would give! Stick with brands like Reolink, Annke, Hikvision or Dahau and check image comparisons. I've got a video review with some Reolink cameras with image comparisons and I'll hopefully have more coming soon of other cameras too.
Hope that helps!
Awesome tutorial.
for the record, I couldn't make the generic camera work with doods images. But it worked with this camera platform:
# Example configuration.yaml entry
camera:
- platform: local_file
file_path: /tmp/image.jpg
Great video , thanks alot! Do anybody know if there's a way to make a non-horizontal top area line? so it is one percentage in the left and another in the right side?
I run DeepStack ai which is free docker image that can run locally. It’s a bit flakey though but this video really makes me want to try tensor flow out. Thanks for posting.
Thank you! Let me know how it goes if you decide to give it a try, I'm interested to know the difference!
Louis, this video is awesome...hats off to you!!
Here is a question that is very specific to my situation, I am running Home Assistant and Zoneminder on a dedicated single rack sever (with Nvme card for hard disk). In the past I found that Zoneminder had better capabilities to handle cameras, motion detection and camera related things. But your video shows quiet the contrary, do you think it makes sense to remove ZM from the machine (since it is using same hardware) and go all in with HA?
Thank you Pankaj!
Hmm I guess only you can answer that unfortunately, perhaps you want to install it side by side and see if it has the features you need and want and then evaluate from there?
Awsome!! Could you make a video explaining how to trigger events based on this? I want to trigger my sprinklers whenever it see cats in my plants
Hi. Great video. Question: Are you running HA and docker on the same server? Any benefit on separating in different servers?
Hello! HA generally runs on docker unless you are using the python version. Hope that helps!
Great walk through thanks, you have a new subscriber :), just one follow up question, how would doods handle multiple cameras (say 4) what would the config be? ( if it can do it)
Hey Mark, thanks! You just add multiple entities right below your existing entity. Just make sure you have the hardware to handle it! Hope that helps
thanks
Thanks for watching!
Subscribed! Question are you able to set zones so dood only detects in certain areas?
Thanks! Yep sure can, check the integration documentation, you can set an x and y coordinate to limit the detection area
How would my configuration.yaml look like for 2 cameras? I tried to duplicate the block of lines for a second camera (adjusting the camera entity, of course) but I think as they have the same indentation the last block overwrites the previous one. Any guidance would be appreciated!
So for future videos I would find it more helpful if you pip yourself and keep the screen up. I found I lost my spot a lot when you bounced from your camera to the code, but thanks for the assistance. This is really cool.
Thanks for the feedback!
I cant seem to get this to work with my CCTV cameras. You might need to change the "ANY" in the title 😜 but I can get it to work with my WYZE Cam. I'll give it another go 👍 very good video.
So with this object detection, can one also set up automations as a trigger? Like, if a person is detected, turn on patio lights. etc
Landed here from the Reddit r/HomeAssistant post. This is a really great post and gives me another approach to experiment with.
META: my last three of four online interactions have been with people having a Scottish brogue. How cool is that?
Hey Devin! Thank you, I appreciate the support!
Haha that's awesome, is it really that obvious in my voice?!
@@EverythingSmartHomeNay. I’m a linguistics nut and just love “decoding” the “where in the world has this person spent enough time to be influenced by the local language/dialect?” I’m originally from NW U.S. and grew up in the rural SE so I was always picked out as “you ain’t from around here”. We hosted many exchange students in my high school years and my NW family is quite multi-cultural, so I learned about other cultures and ways they celebrate their heritage.
Then I married into the House of Neal (O’Neal) and Clan Lindsay so wearing a kilt with the family tartan was seen as “normal” during certain times of the year. :-)
Haha awesome man I love that! I always think I don't have a strong accent, particularly compared to certain areas of Scotland but I've had a few comments now so I'm guessing I do 😅
Thanks for sharing man!
I have a question that could be basic one. The docker command is not recognized in home assistant terminal!
Hi, thank you so much for this! You explain things so well. Is there any chance you could also include a Google Coral into this setup and show us how to configure that? It would be super super awesome! :)
Thank you for the kind support! I'd love to one day if I can get my hands on one 😅
@@EverythingSmartHome cool thank you. Can I get you a few cups of coffee to motivate? :)
If you'd like to support the channel to do more projects like then it's always very much appreciated but please don't feel obliged! Your comments and feedback are great too!
What do you have HA installed on? I am running it as a virtual box on my Macbook Air and I can't run these commands.
Hey, great video I always wanted to do object detection. I was wondering about the minimum system requirements on running a system like this. I am looking to run foods and home assistant in the same system
You can run it on a Pi, you just might get slower results and detections and probably will only manage to do a single camera!
Very cool video! Just to make sure I understood the setup. Do you have to run DOODS on the same device as HA? If not is it possible to run DOODS on a separate RPI so that it doesn't burden the main HA RPI?
Thanks! You can run it wherever you want, that's kind of the entire point of the project that you can run it anywhere! Install wherever you would like then change the address in the config. Hope that helps!
is there a way to have your vm hass run on a laptop set on a low poer state so that it makes less noise?
i got it right next to my head and can't afford to set it up otherwise... Also, how low would it go?
Like sleep or hibernate even an option? I know it wouldn't make much sense, still just thought I'd ask.
Thanks for the tutorial! Is this install method on Home Assistant Core? Or hypervised (HassIO)? What difference would there be in getting this to work through the add-on store?
Hey Bob, it will work on both since we are using Docker in the background. Technically the install of DOODS doesn't require Home Assistant. Hope that helps!
Hi, great videos with great content! Lenght is perfect. Do you think it would be possible to trigger recording in BlueIris? I’m thinking about having a low res continuous recording a plenty of Doods motion detection videos in 4K. Thanks!
Thanks Pavol! It should be possible yes, I think BlueIris supports MQTT doesn't it?
@@EverythingSmartHome Yes, it supports mqtt. And I’m hoping also http, because I prefere not to have mqtt middle-man if possible.
I’m just waiting for my cameras to come so I’m preparing all for it in my head in advance :)
Did not look that much into doods but frigate can use google coral for accelerating image processing. (yeah looked into it and DOODS also can use google coral)
What kind of hardware would be required to run DOODS - I assume it will require some CPU power to process the stream(s) ?
Great video! One thing: I think you should mention that the www folder is NOT protected by auth, meaning everyone on the internet knowing the link can access the image (assuming you’ve exposed your HA with an external URL).
Better set the file_out Parameter to another location and set up the camera with platform local_file.
Thanks! Yes that's a good point, I did mention it in previous videos but yes for sure, it's definitely worth mentioning! Cheers
@@EverythingSmartHome ah okay :D anyways, thanks a lot for the video and for bringing DOODS to my attention! Works like a charm!
Great video, thanks. Is the DOODS Docker install method possible on a HassOS based system if accessed as root over SSH on port 22222? I was fizzing when I saw you pull a new Docker container on Hassio but assume your running that on Ubuntu?
Hey Pete, thank you! Yes you can do this on Home Assistant OS if you login as root, or you can do it on Ubuntu or fedora or anything that runs docker. You can run it on a separate machine you for home assistant is machine too!
Hope that helps
@@EverythingSmartHome Thanks for the prompt reply. While I knew Hassio ran as Docker containers, I had not thought to leverage the power of my NUC i7 by directly installing other containers. I use Docker on my NAS but assume DOODS is going to suck plenty of juice so better off on faster hardware. I see there is an add-on version so might go that route first.
Yeah it's a good little addition to be able to run some containers, hopefully the performance is good enough but there is some parameters you can tune to improve performance
@@EverythingSmartHome thanks. I'll give it a whirl.
Hi Great video still cant get mine to run . Are you running hassio in docker or running portainer in home assistant
Hello, thanks! I don't use portainer no and yes Home Assistant is running in Docker. If you need help jump over into the community discord and I'll be happy to help out!
Wow! This is a great video. I have looked into this topic a lot recently. I've considered zoneminder in a docker container with the event server, but would prefer to have this setup. Then I can use ZM or motion to record constant video.
Is there a way to use a notifier to trigger the doods detection. For example have motion or another service notify doods to start when it detects motion instead of doods processing images every couple of seconds?
Thank Alex, I appreciate it 🙏 hmm that's a great question, love the idea. It would depend on your camera and if it supports the "motion" sensor within HA.
I suppose you could hardwire your own motion sensor as an alternative. Or you could fire an MQTT event in from Zoneminder to start it
@@EverythingSmartHome ... i never knew this was an integration untill seeing this video !!
so did some digger and on the HomeAssistant page it does list a way to only activate a scan when motion is detector.... basically making scan interval very large, and then calling it as a service, when motion is triggered ( of course you would need that in place, via a different method like via MQTT etc etc)
ive not tried but the setting are there at bottom of this page .. www.home-assistant.io/integrations/doods/
Hi there i just run across your yt channel and i must say great way of explaining things .. i am running HASSIO as a VM on unRAID any ideas on how do i implement this ??? How do i do the docker part ?? Thank you
Thanks for the support! You can follow the same steps in the video and it will work 😅
Really nice video! Keep up the good work mate! Quick question. Is it possible to get the number of detected objects (i.e. cars) and pass that information to home assistant?
Thank you very much! Yes all that information is already passed through by default. Hope that helps!
@@EverythingSmartHome Awesome! I had this idea a while back to point a camera to the parking spots across the street where my permit allows me to park and get notifications when a spot is free in case I parked somewhere else. Not useful for long period as I will move out soon but sounds a fun task for the weekend.
Oh that sounds really cool!! Let me know how that goes I'm really interested!
@@stevez182 Leaving a comment here for notification on an update. This is a superb use case.
is it possible to get this running remotely for instance in a car? really would love to have a system that alerts me when a scanning car drives trough my street(they scan your number plate for parking) because that would save me allot of fines every year.
Thank you for this awesome tutorial (and other tutorials too). I've leaned a lot from you. I have a quick question (and open to anyone). My setup keeps getting a lot of the following warning messages at my HA log. Updating doods image_processing took longer than the scheduled update interval 0:00:03. According to Developer->States, it says process_time averages under 0.12. Is there any way that I could "debug" to find out what's causing these warning messages? FYI, I'm running HA+Doods with Docker on my MBP'16.
Thank you! Hop in the discord server someone will be able to help!
Would this work on a Mac using a Hikvision NVR and cameras?
Great tutorial. Can you make tutorial on how to make the notification appear on iPhone if a person show up in camera? Thanks
Thanks! Already did it, the very next video after this one :)
Can you help me? how to add rasp camera on the same raspberry where hassio is? Can't find any documentation, i added integration like urs, like in forums, but nothing worked. Before i had hass on docker and installed jpeg... something and worked, but cant access camera on the same device. Thank you
Great Tutorial thanks, very usefull, Have you ever tried to create a custom dataset / model for doods ? I'm currently trying to detect eggs in my chicken coop but I'm struggling to create the model, any tips ?
Thanks! I have indeed, tensorflow models are insanely complicated to do unfortunately, I'd look for a pre-trained one if I were you
This is exactly what I’ve been looking for!! Hopefully my RPi4 8gig will handle it all. Nicely done sir! Question: I looked on your sit for a written version so I could check the configuration easier, but could not find even this video linked yet. Any chance you could through the config variables into a file for us please? Easier to look back and make changes with. Secondly, can you get this to detect specific people? Like it would know if it’s me or my family with a confidence of 90% so unlock the door? Thanks again man and keep up the very cool work!
Thank you, appreciate the support!
Sure I'll try and get that up for you! Unfortunately no not possible with this I don't think but you might look into OpenCV if you want to try to recognise specific people. Hope that helps
@@EverythingSmartHome Well I was able to get it up and running on my 3 outside Wyze cameras. Now these are Wyze Pan Cams with the newest rstp firmware installed and then an rstp stream in Home Assistant through an ffmpeg camera. I can get the streams Into HA ok but they can sometimes loose the rstp stream and I have to reboot the camera. I have each of the 3 cameras output to their own file. And then only look for people and cars. I then setup a basic automation that if the image_processing.sidedoorcam changes from “0” to “any” to send a notification to my phone. Now I just need to figure out how to attach the processed image to the notification. It does seem to be a bit slower with rstp but that might also be an issue with the beta firmware and instability that Wyze has right now. Hopefully we’ll see more native Wyze support in the future as the price point for these cameras make them too attractive not to be functional with HA.
Currently with 3 cameras processing at 5 seconds each my RPi4-8gig is running between 20-30% processor utilization. Even though that’s low it doesn’t seem to be able to process the images any faster. I’ll have to look into optimizing and setting up custom detections. Of course I’m running my entire HA environment on the same Pi so I can’t have all the processing power for image rastorization. It’s currently running about 50 various devices on my property and more are coming lol. Eventually I’d like it to recognize me and my family and if our phone is also in the geofence to unlock the door and play an announcement.
Anyway, please let me know what you think or if you have any ideas or suggestions. I’m also wanting to tie the cameras motion detection into a sensor I can use in my Home Alarm. I’m using the one in HACS under automations. And thanks again!
@@EverythingSmartHome ohh one other thing. I added the DOODS component directly through HA add ons by just adding that guys repository. Doing so I notices he has another app up there called RSTP 2 Proxy. From what I can tell it should take and recreate an RTSP stream from any ip based camera and seems to allow for some image tuning prior to processing the image with doods. I’m going to look further down this path as all of my cameras rely on rstp and currently @Wyze has basically no support for this minus their beta firmware. Have you had any chance to look into this or any other software that might preprocess the image prior to output as a stream? I know motionEye also has a similar feature but is such a processor hog
Hmm your camera's shouldn't be dropping the streams if they are just RTSP, hopefully you can get that working first.
For performance tuning you can modify the settings inside the DOODS container to tune for performance, you can also change the models used for detection and change cores, image width etc which should hopefully help
@@EverythingSmartHome do you happen to have any documentation on that by chance? Right now I’m just trying to get the image into a iOS notification. One of the things I’ve found is that DOODS doesn’t actually write a file unless it has a detection. So even if the scan_interval is set low, if it currently doesn’t detect anything, the generic camera appears offline or static.
Hey, I'm loving your videos but... can you add the written article withhhh the article? Or right the commands in the description? Oooor add a search button in your website? Thanks
Great job mate, cheers
Hey! Yes I hope to get back to the written articles at some point, unfortunately they are a lot of work along side the video and I don't have enough time as I'd like but I'll do my best!
Thanks for the excellent video! I'm trying to follow this guide but am having trouble running the docker command via the built in Terminal & SSH addon (getting the error 'docker: command not found' even though the docker command is one that's listed as an available command). I'd rather not set up remote SSH into the Pi4b that I'm running HA on, but can if needed. Any suggestions on how to do this without setting up remote/debug SSH access? Thanks!
Disregard. I installed DOODS by adding his github repository to the add on store.
Glad you got it working!
Great video. what if i need to add more than one cam?
Thanks Thomas! You can simply add another entity underneath the existing one! You'll need to adjust the file_out parameters - make sure to check the HA docs for this integration as there is an example in there of how to use it.
Amazing video! Is there a way of having a log of the detections?
Thanks! You could log via the photos or use the HA log book/history to view the sensor history, or bring it into Grafana to log it further. Hope that helps!
@@EverythingSmartHome Thank You👍
Is doods in the video running on a RPI4? You mentioned a processing time about 0.3 s, this seems not to be the case on a RPI4?
Why didn't you use the Hasson addon from the doods author? This would be easier for most people instead of using docker straight from Hassio?
Hello, no DOODs is not running on a RPI in this video, only the camera is. I wasn't aware there was an add-on to be honest, I checked supervisor store and HACS and didn't see it, can you let me know where it is?
@@EverythingSmartHome Looks like you'll have to add a new Repo by going to Supervisor > Add-on Store > Burger top right > Repositories and add github.com/snowzach/hassio-addons
Then it will show up under the Add-on Store tab
Oh cool didn't even know that existed! Thanks for letting me know. Although to be fair the docker instructions don't take long at all but still that's good to know!
Thanks, based on your video I found the DOODS add-on for home assistant which doesn't require to SSH into home assistant etc, so it's even easier this way. It's a shame that DOODS doesn't work for me as persons will be standing on the other side of a glass door which has a couple of white metal strips running horizontally. This confuses DOODS. I would have to train it to recognise a person with white bars in front of it :). Are you planning on making a video on training DOODS?
Thank you! Yes I believe that came out after the video was made. Yeah I guess that's kind of understandable. I probably won't have a video training tensorflow, but...keep your eyes peeled tomorrow (shh don't tell anyone!)
@@EverythingSmartHome haha thanks, looking forward to tomorrow's video! I remember you made some comments that you were looking Into to person recognition (i.e. recognising a specific person). Wonder whether that might be the topic 😉
This is really good but it would be good if you could show is an example using RTSP.
Thanks! There is no way to use a direct RTSP stream on it as far as I know, but you need to create a camera first inside Home Assistant with an RTSP stream and then use that camera, which is what I demo'd in this video.
@@EverythingSmartHome i managed to get it working with a camera but I can't get the nice moving doods image like you have here.
Could you train it to detect you about a certain car or van? Like be able to tell you when UPS Van turns up? Or your own car?
Perhaps you might be able to yes, I haven't experimented with it but it should be possible
Is it possible to limit the detection to objects within a specific polygon?
Thank for the video. So am I understanding this correctly, Tensorflow is bundled in with the DOODS software, you don't download and install Tensorflow separately?
Yep that's right, DOODs is essentially a web UI ontop of tensorflow and includes it in the docker image
@@EverythingSmartHome Understood, thanks for responding, much appreciated
Of course anytime! Feel free to hop into discord with us if you get stuck and I'll help out! Or just want to hang out with us :)
hello sorry again, I noticed that the command "docker pull snowzach / doods" works for me in the ubuntu terminal but not in the home assistant terminal, and consequently it doesn't work, can you explain why?
Ah OK, you are meant to use it in the Ubuntu terminal not in the HA terminal, hope that clears up the confusion!
Whery nice tutorial! my doods cam suddenly stopped on a image and wont refresh, have tryed to make ah new name to the jpg file but that dont worked.
Great content Lewis! Thanks for sharing it! I followed all instructions but I do not see image_processing running. I installed it in my desktop (Docker desktop on W10) and informed the ip_address of my notebook in the url field. Do you have any idea of what could be the problem?
Hello thank you! Did you make sure to restart HA?
@@EverythingSmartHome Yes, many times.
Make sure to check the HA logs for errors
@@EverythingSmartHome Got this error message: "Source: components/doods/image_processing.py:85" - Error while setting up doods platform for image_processing. Have no idea how to fix it.
hello, would you like to share github / repository for computer vision code?
hi. Would you now prefer frigate or this?
Frigate for sure!
Hi is there a way to save files when pictures are detected like a nvr?
as is, it doing an "file_out" but can it save each person that is detected?
thanks
Hello, you can indeed save the images using the timestamp in the file name. Check the Home Assistant docs for this integration and you will see on of the examples they give you is able to save the files.
Can I use a USB webcam?
hello. thanks for this great tutorial. I am using doods and it works fine with IP camera. but how did you set up a PI camera to work with HA? I mean how to stream the camera video that installed in the same PI with HA too?
I was using an MJPG program to stream the camera from the Pi
@@EverythingSmartHome thanks a lot. Do you use the camera in the same PI with HA.?
I do not but if you do you can use the pi camera integration
@@EverythingSmartHome very helpful information. Thanks 🙏🏼
Can this be installed if I am running home assistant using proxmox?
Sure!
Hi, thank you for the video, how can i separate file_out for two differents cameras?
Hello, thanks for watching! You can add a second platform in the config with a seperate camera or you can use a template in the file name to name it the same as the camera, hope that helps!
@@EverythingSmartHome works great, with a DVR from rtsp now trying to improve the false positives in order to use as alarm.
Can i use ESP-32 cam for this purpose?
Sure!
Nice video. I have it up and running on my NUC. A few comments that might be useful:
If Doods doesn't detect an object it doesn't output an image at all. I spent quite a lot of time head scratching that one, and to be honest it's not really the behaviour I want - is there anyway to change this? I couldn't see anything in the component webpage to force an picture when no obejcts are found
Even on my NUC performance is slow. I'm managing one sample every 5 seconds. Is the processing speed dependent upon image size, and if so if there a way to downsample the image size to speed up processing.
Despite my slow processing speed, none of the cores of my CPU are maxed out. Again - anyway to speed up the processing that way?
What's the threading on Doods like? If I have one camera processing one image in 5 seconds, does that mean I would need to put the update interval to 10 seconds if I add an additional camera - or would they run in parallel and make better use of the available CPU?
Thank you, appreciate it!
Yes there is away to "tune" DOODS since it is running Tensorflow, but you might need a little bit of Docker knowledge in order to access the config. Nothing too complicated but I'm unsure on how much docker you have done before. This allows you to set the width and height, set the number of cores to use for processing and also to change the models used, you might want to try some different tensorflow lite models.
One other way to approach it is to add a second "lower resolution" stream to HA that is not visible, but that you can use for processing. Hope that makes sense and answers the question!
Hi man,
Appreciate your video, can I do this on Home Assistant OS?
Thanks! You sure can!
@@EverythingSmartHome Thanks for your reply , like im following your step but in my home assistant , i cant pull the docker command , im doing some research that you can only do that on the hassio?or am i missing something?
Join the discord server, I'm sure we can get it sorted out!
@@EverythingSmartHome Okay , finally did it !!! Thanks for your tutorial.
btw any cheap ip cam recommend? my esp32 cam performance seem not very nice ...
H there. Nice video. Manged to get it running for one camera. Unfortunatley i can't get it running with more then one. Can you help?
Thanks! Sure feel free to jump into our discord server, it'll be easier to troubleshoot there!
Question: i've set it up with Home Assistant as you said in the video and the first time I got an SSL error saying its not the right version. I've installed duckdns and http(s) functions and when I commented out the SSL lines from the http component it worked, but I could acces my server externally anymore. The documentation says I can enable SSL/TLS but I have no idea how to exactly. Ive tried numerous things inside portainer to modify the container but it doesnt seem to work. Does any of you have an idea of what to do?
Hey David, where abouts did you get the SSL error? You can definitely have SSL enabled throughout that's how I use it.
Yeah, it works for me too now with SSL on. The error showed in my HA log when I first installed the docker image. It said I had the wrong SSL certificate version or something, but after deleting everything and redoing it using the official Docker site I managed to get it working instantly
Can it detect individual playing cards such as the 8clubs
Most likely but you would have to train your own model
Can I use a wyze cam v3 for this
Sure if you can integrate it into HA then yes!