EVEN MORE Free Local Object Detection with Home Assistant - Frigate Install
HTML-код
- Опубликовано: 31 июл 2024
- The first 1000 people to use the link will get a free trial of Skillshare Premium Membership: skl.sh/everythingsmarthome04211
Thanks to skillshare for sponsoring this video.
We all know how much I love looking at Object Detection and Face Recognition videos, so here is another one! Today we are taking a look at the install and configuration of Frigate, which is a fully featured NVR for Home Assistant and other platforms, with built-in object detection using Tensorflow. It's highly configurable and in this video I will take you through most of the important features you will need in order to configure it, including Masks, Zones, Snapshots and Clips, Recordings and adding additional objects. We also run through how to integrate with Home Assistant.
If you'd like to support me and future projects:
Patreon:
/ everythingsmarthome
Coral Boards:
USB: amzn.to/3u5Lbis
Others: amzn.to/2R66mlw
Links (thanks Blake!):
Supervisor add-on: github.com/blakeblackshear/fr...
Home Assistant Integration: github.com/blakeblackshear/fr...
Documentation: blakeblackshear.github.io/fri...
Docker install (standalone): blakeblackshear.github.io/fri...
Buy Me a Coffee:
www.buymeacoffee.com/EverySma...
Written Article:
everythingsmarthome.co.uk
EVERYWHERE YOU CAN FIND ME:
Everything Smart Home Community Discord:
/ discord
Twitter: / everysmarthome (@EverySmartHome)
Instagram: / everythingsmarthome
Facebook: / everythingsmarthomeoff...
#homeassistant #smarthome
________________________
Some of the links above are affiliate links, where I earn a small commission if you click on the link and purchase an item. You are not obligated to do so, but it does help fund these videos in hopes of bringing value to you!
0:00 - Intro
2:12 - Things you will need
4:49 - Frigate installation
6:48 - Initial basic Frigate configuration
12:02 - Frigate dashboard overview and tour
16:39 - Integrating Frigate with Home Assistant
20:10 - Adding more objects to track to Frigate
24:06 - Adding image snapshots, clips and recordings
31:33 - Media browser to view clips and recordings
32:58 - Adding privacy masks, zones and object masks
38:56 - Talk about notifications as well as other useful options for Frigate 
Наука
What's up guys, hope you enjoy this video, sorry it was so long I wanted to make sure I covered all the essentials! I am excited to start using Frigate in my own setup! What plans do you have?
Remember if you want to check out Skillshare, the first 1000 people to use the link will get a free trial of Skillshare Premium Membership: skl.sh/everythingsmarthome04211
Nice video as always. I personnaly use Shinobi (shinobi.video/), it's really easy to set up, there is no Home Assistant integration, but it uses MQTT as well.
Awesome video, everything was crystal clear. I'm definitely going to be using this. One thing of concern though, the recordings are saved on the OS drive of the machine. Would it be possible for you to explain (or maybe you have somewhere else?) how to move the recordings to say an external USB drive?
Mouser now have the Coral stick in stock.
Not for me in the UK unfortunately, are you in the UK??
@@EverythingSmartHome Yes - I back ordered a couple of weeks ago and it arrived today but they'd emailed me on Friday to say they were back in stock.
Just wanted to clarify that frigate does not require an RTSP camera. It is running ffmpeg for reading video feeds, so it can ingest any video source supported by ffmpeg, which is just about everything imaginable. The ffmpeg parameters are tuned for an RTSP feed, but you can modify them as needed in the config for mjpeg, HLS, etc.
Hey Blake, thanks for the amazing work you've done and also for clarifying that, that's great to know and definitely could be useful.
Thanks again for all your hard work
I could not get it to work at all with mjpeg stream and judging from the numerous issues raised online - I'm not the only one. Frigate just doesn't recognize the stream.
There are other setups besides rtsp mentioned in documentation, yes, but have you actually managed to get frigate working with mjpeg streams?
I take it back. Managed to get it working now. Some of the config must have changed with updates.
@@luk1505 Thanks for the update! was going to not try this until I saw your second reply
You sure are the best! Been running Frigate for a couple of months now, but it was a pleasure to watch your video! Keep it up!
Thanks my friend, really appreciate the comment!
Yes.... i am also an object detection guy. Start with motion sensor, hp wifi mac address sniffer and last weekend after 5 months you upload the tensorflow n doods video, i manage to complete the project. Thank for your videos...
Excellent material.. Among the burgeoning masses of IoT/Home Assistant/Home Automation RUclipsrs, you do stand out with your excellent delivery - very listenable. With some presenters, I sometimes find I am forcing myself to stay watching to get the information. In your case, you nail it!
Thank you so much, appreciate it! Means a lot!
I don't think anyone minds the length! Thorough, easy to understand video (as usual)! Thank you! 😊 👌
Thank you, appreciate your comments and for watching as always 🙏
WOOOTTTT 100K!!!! I've been rooting for this day since I asked how was this not a 100k+ channel. Great job bro you earned it.
Great video! I had a few questions after getting Frigate up and running. I went back and watched you video again and my questions were answered! Frigate is well worth the effort.
An amazing video which helped me get up and running without any issues! Thank you for your time in creating these videos.
🙏
This is perfectly detailed. Not too much, not to little. Great content!
Epic video 42 Minutes! I am so pumped! Need to get to watching!
Hope its useful Mark! Thanks for watching!
Always just as nice and educational to see and learn from your lessons!
Feels so good!
Thanks so much! :-)
Thanks my man, always appreciate your kind comments!
3 years later this was still a great guide to get Frigate setup. Thanks Lewis :)
For those who are struggling to find the correct host name (@18:18) check under: Settings, Addons, Frigate, it shows the host name there. =)
I really like this. I have been working on a custom made video doorbell and this will be a total game changer for my use.
Nice, let me know how that goes!
Woooohoooo! bought my Google Coral some months ago but was not able to get it working.
Epic video! thanks a lot for detailed instructions - followed step by step and got it instantly working on hass!
Excellent, glad you got it working! Thanks for the kind words!
Thank you! Love your videos and keep up the amazing work! 👍🏻👏🏻
Thanks my friend, appreciate it! I certainly will!!
Excellent video very well made clear/concise. Frigate is now the weapon of choice for my CCTV/HA. Now, onto NODE RED??? come on... you know you want to...
Another awesome video as usual, thanks! :)
Thank you, appreciate the comment and for watching!
Awesome video as usual mate, Thanks :)
Thanks for watching and commenting!
Thank you for another great video!
Thank you for commenting and watching!
Awesome video!
42 Minutes! Love this is solely based on your fans recommendation!
Best get recommending some cameras to integrate.
Thank you sir!
Are you using hass.IO? How did you get the Edge TPU runtime and the PyCoral library on your Hass.io?
Amazing video and top notch instructions as usual. Surprised there's not a packages model. Would be cool to be notified when an amazon package has arrived :D
Thanks Kyle! That would be cool but could be difficult with all the different shapes and sizes but definitely worth investigating!
Great video! The one thing I got stuck on was the actual coral driver install, but your advice of looking at logs helped me get to bottom of that - thanks!!
Nice! Thanks that's good to know, still don't have a coral to test with unfortunately!
hey there! can you explain how you installed the google coral drivers? am trying to do it on the same machine running home assistant but following the official coral documentation doesn't seem to work
@@mikepriest3340 Did you ever figure this out?
This is an excellent tutorial!
Thank you sir!
Thanks for another great video, your videos regarding anything HA, have to be the best out there. I would really love to see a follow up video to this showing how to setup IOS notifications with picture attachments and or url's to camera live or recording. I have read the documentation from frigate and HA and fail to get it to work correctly. Keep up the good work
Thanks, really appreciate it! I've already done a full iOS and Android notification video not long after this one which has everything you are asking for!
Thanks for your cool Video!! It helps me a lot...
fantastic! thanks for your continued efforts, certainly help with my learning curve. My goal is to use firgate to switch on security lights in place of having to install PIR detectors.... next chapter in the discovery of Home Assistant...
Thank you I will! Good luck!
Great video again, good job. I don't mind having something that is difficult to setup. I want something advanced. Also, both of my neighbors are pretty active at Friday and Saturday night and I don't want to spend to much storage on them. What setup do you recommend me to go for? Frigate, Doods, Deep stack, or something I haven't mentioned?
What camera do you recommend me to buy? I was thinking about a Reolink as they're pretty cheap for a good quality. Now I see you use a Pi cam. What's the best, small, high quality footage option?
Also, how do I control a relay (for a floodlight) if a motion is detected in the zone you set?
I LOVE frigate!
Me too!
Thank you for introducing Frigate. I noticed your Displaying Speed (at Camera Dashboard) is 5fps, which is what I'm getting too. Just wondering if there is a way to set/improve this speed. I couldn't find anywhere in the docs to set this speed. Thanks again.
hello, nice videos. I done and love it. do you have plan to add double-take with frigate ?
Very well done. Tks
Cheers!
Thanks for your great tutorial. Min 12:26 I cannot see a clear video as you do. I only see gray and green lines.
I tested in HA VM running with Proxomox and with a raspberry pi 4 with HA - OS
IF I add the RTSP video path as video card with a Lovelace it works but not for motion detection.
how is possible to change folder and doesn't use the internal storage ?
With Home assistant Os + supervisor ?
thanks again! a question.. im moving to a house.. looking for cameras and the reolink looks great.. due the constrain of chips its dif to get a coral.. its really needed to have a good frigate system?
Super nice video. I have it running with HA in Proxmox. Quistion.... I want to store te record files on a extern USB drive otherwise the drive where HA is running on is in a sort time compleet full. Is there a possibility to use the Media folder from HA on a extern drive ?
Is there a way to change where Frigate stores files?? I have HA OS running in a VM and I have a much larger drive mounted vs where HA is running.
I've been struggling with this for the last 3 days. I can't even get Frigate to start! I'm using it within Home Assistant on my Unraid server, but the Frigate log says 'ERROR : Unable to connect to MQTT server: [Errno 111] Connection refused'. I typed exactly what you did in your frigate.yml. I tested MQTT within HA just as you said, and it works. I opened all ports. I can't figure out what to do, it's driving me nuts!
Any ideas?
Hi, Can I run my avigilon intercoms and get the same / Similar funktion as With ACC 7 - Live feed via dyn dns.
Is it possible to run the frigate on our custom object detection models because I want frigate detect the objects which are not there in labelmap.txt file.
Hey again, thanks a lot for covering this. I think I’ll need to rewatch previous videos on Doods and Deepstack when I’ll finaly get to my cameras installation, but honestly now I’m thinking about not using Blue Iris with DeepStack as I intended before this video but actually use Frigate for everything. If I understood you correctly at the end of the video, you’re aiming the same? If yes, I would love to see a demo how you end up in real life with Frigate (or anything else) with actionable notifications, alarms with live video to phone and also retrospective search for some event at desktop and phone too. Cheers!
I forgot to mention that I have the same Reolink 4k camera as you already reviewed. So saving full footage of 5-6 cameras would be a storage killer. So I’m thinking about storing a full 720p stream and clips in 4k. How does this sound to you?
Thank you for your informative work, i am a beginer in home assistant, i dont have an existing NVR camera system..but i want to implement one. I am stuck on how am going to connect the physical network system between NVR network and HOME ASSISTANT server
Hey Lewis love your videos do you have a video or documentation on how to buid a pi camera to make it as a rtsp? or what would you recomend
Do you know how I can use maybe something like Node-RED to send out a notification and user inputs for if 'Y' then save the video forever? Maybe I have to use another datastore?
Will the m.2 coral keys work with this? They are almost cheeper
Great video - BUT - note, some of the syntax has changed (eg clips now record) so make sure you check the latest documentation.
Thanks!
You talked about the Google Coral in this video. Is the stick mainly for running object detection or is it also capable of doing face recognition? I plan on doing a setup for face recognition and my server hardware isn't the best.
You're great ! thank you !
One optimization i did was enabling dual RTSP feeds from all my cams a 1080p for clips and a 640*360 for detection. Default AI tensor flow have been trained on 300x300 anyway and the instructions says it will compress the RTSP feed down so any larger feed just seems wastefull. I started using a 1080p for detection and clips, so my whole CPU usage was at 68-70% on my synology. Changed it so detection used a 640*360 feed and clips used the 1920*1080 feed, this way i lowered my overall idle cpu usage to 7%.
Definitely not a bad idea at all!
cant find any information on how many camera streams this supports? and at what fps..
I got frigate working great, just in time for my camera to die :( now to play the warranty game!
I also have had zero luck finding a Coral, they're pure unobtainium! Frigate can handle the one camera on the CPU, but my end goal is 4 total cameras, and that seems like an issue without an edge TPU, I just wish there was some hope of actually finding one!
Hi,
Does someone know how I can use a "MAiX BiT SiPeed" board instead of the coral USB
Thanks
Just Order my Coral AI stick From RS the best price @ AUD$95.19 inc GST and Shipping That I have found in Australia and due to ship on 14/6/21 Keep up with the great Video
Thanks Paul, appreciate it! Have fun with Frigate and the Coral!
Great tutorial!
It took me a while to set up a rstp stream. Eventually I had to open a port (8554) on the raspberry pi to stream the video to the raspberry pi where home assistant is installed. I'm using frigate now to analyse the traffic in my street. I was wondering where the images and data is stored so I could copy them and use them in a deeper analysis?
Thanks appreciate it, glad you got it working! They are stored in the /media directory
Allready one year ! Did you managed to find a coral since last year?
One big problem for me is to archive clips on a nas with frigate installed like this.
Do you still uses frigate one year after ?
Thanks for the wonderful instruction, very easy to follow! But I stumbled upon the camera setup on the other pi. Is there another video where we can see how to setup the rtsp feed and get the camera address?
Thanks! I do not unfortunately, it wasn't ever intended to be a guide. You may be able to find some articles on the internet
Getting a 502 gateway when starting frigate. Thoughts?
Is it possible to install Frigate on my laptop (running Chrome OS Flex with Linux environment enabled)? I'd like to use the built in webcam only.
Hey Lewis, if you love dark mode (as I do too) why don’t you change Visual Studio Code to dark mode too? Open it > gears icon for settings in bottom left > Color theme 😉
Now I’m going to finish watching the video 😄
Thanks, just turned it on!!! Life saver!
@@EverythingSmartHome I’m glad I could help you a little too 😄 Enjoy the dark side 😈😂
Hi everyone. Can you tell me if I can install friget on stand alone bare metal machine that communicates locally with another bare metal machine running home assitent?
On my system I see no gear for options. I see the feed and below that Tracked Objects but no icons for changing anything
I had the config for cameras ect in ha supervised but can’t work out how to get frigate in docker and link the 2 hubs
Will pay you £100 to get this running for me. Can do screen share n chat on phone please help
When I add Blake's repository it just gives me "Unknown error, see supervisor logs". I then checked supervisor logs and it says "Failed to to call /store/repositories -" Please help me
Hi Mate, finally got down to re-watching this and getting it all setup. Works like a charm, still waiting on my Google Coral to arrive but works great on the i5 & 8GB ram PC. I have a question, using this as a NVR will take up HDD space, so is there a way to have the clips and recordings save on a external mounted HDD which would then allow for a 2TB or greater HDD to be used
Any progress on the Coral TPU?
I know you said you used a cpu but which one was it and did you limit the fps? I'm wondering as the fps is quite low for just 1 cam.. What if there's 12 haha
Is it possible to run frigate and save to synology NAS?
can you please share a good network security structure for smart home, i know you are a network engineer, and I'm confused on how Should i separate my iot devices from my local nvr from the nas , your help is really appreciated.
Thanks! Maybe you could do your perspective in which tech is better? frigate vs doods vs blue iris/deepstack - LIKE the full comparison! I'm really in doubt which one to use! Thanks again my friend. Cheers from brazil!
Thanks for watching Ricardo!
+1 I‘d be interested too in an overall What‘s best video comparing the various options.
one question i'm running home assistant with a rpi camera module v2 i wanted to find a rtsp adress of it or url but i don't really get how to go ab i found some forums that say it's not possible from home assistant i have access to it through opera gx browser and some forums say you have to have a seperate os for the raspberry. The thing is i don't want to lose all my progress with my home assistant is there an easy way to go about this? (for contex i searched around the documentation of the module but found nothing useful or worth mentioning)
Thanks for the video, I tried putting few of the values (like mqtt username and password) in the secrets.yaml file but seems like frigate.yml cannot read the values from secrets.yaml file.
Love the vids dude.
If I could make a request, could you do one on how to set up some Zigbee(?) smart plugs with Home Assistant on a Pi?
Sorry if you already have, or if there's good documentation on this, I just can't find it!
Thanks! Sure hopefully can do some stuff! Check out the Sonoff Zigbee bridge if you want also!
@@EverythingSmartHome Appreciate the starting point, will look into it!
What pci-e adapter do you need for the non-usb coral models? G650-06076-01 looks awesome with 2 chips, but what adapter works to get it plugged into a regular pci-e slot?
From doing some research the M.2 A+E is a M.2 for WiFi adapters, typically on laptops. I'm guessing this won't work on most PCI Express to M.2. These are M.2 SATA adapters for storage. There are some cards that are for M.2 A+E, they seem kind of weird for this purpose, as they have antennas. They do have the correct slot. Search for M.2 Wireless Card to PCI-e. That's my best guess.
hey cool video,
Hey, cool work you do here. I am from Europe. And like most from the German-speaking area, I use ioBroker. I have now created a VM with Home Assistant and am currently looking at the whole thing. Powerful tool! But I totally miss Blockly :(
That is also the reason why I have not yet made the change. And let all my technology (Homematic IP Wired) still run on CCU / Raspberrymatic and ioBroker. But this video with Frigade convinced me very much, uninstalled Shinobi a few days ago .... The interface was just too ugly for me. I hope Blockly is still coming.
And I still have one question, is it possible to set Frigade so that it only records, when the door contact is triggered/open. With Pre/Post Record.
Great video! 2questions: is it possible to only record clips on certain zones?if so can you share yaml code? Is it possible to save the clips to an dedicated drive/external hdd connected to my home assistant device (intel nuc, ubuntu 20.04.2 LTS? Thanks!
Thank you! I think that's possible yes, make sure to check the docs. Saving to an external drive should be possible yes but haven't verified yet
Thanks for the awesome video - anyway, I'm just interested how you got the thumbnails working in the media browser?
Thanks for the comment! Hmm I didn't do anything to make it work, they just worked 😅
Hmm ... Ok, then I don't know what I'm doing wrong xD Did you also activate snapshots and do the thumbnails work there also?
Hello friend! Please help me set up frigate? so that it doesn't detect stationary objects.
Can a Google Coral can be installed under the standard Homeassistant?? Btw great videos and so clear and clean communicated. Pro-work! :-)
Sure that should work no problem! Thank you, your support is so appreciated!
Great video and very well explained, saved me quite some time. Thank You!
It seems that you use a PI with a raspicam as input stream to demonstrate.
If so, how did you manage to convert this ffmpeg (what seems to be required according to the docs)?
I managed to use raspivid and pipe this to vlc and rtsp, but frigate shows an error and complains its needs a valid ffmpeg format.
Thank you in advance.
Hello, that's pretty much what I did was to generate an RTSP stream on the Pi through raspivid and VLC!
@@EverythingSmartHome thank you. Would you mind sharing the exact command from your Pi?
I'm sorry I don't have it anymore, I only set it up for the video I don't actually use it permenently!
@@stahelpeter i have the same issue, did you find a solution?
OK - nice rabbit hole. I think i'm sold. Question: at 27:50 you show snapshots => bounding_box -> True, and i'm not seeing a bounding box on your recording at 32:00
Let me know how it goes! The bounding box on the snapshots is for the still images, not the recordings! Hope that makes sense.
Can you make a video width Frigate Notification on email, something like hunterjm blueprint, but email not app notif? could be useful to many
FYI Coral usb is now available to PiHut. I know it has been a while since the release of the video but I thought I should give you a head up. I just purchased mine and I came back to check your video.
My man! Your a legend! Haven't been able to get one still and I've been checking quite frequently, looked yesterday and didn't have any but managed to order one this second! Thanks again!
@@EverythingSmartHome Anytime mate! Just keep up with all those great videos! I remembered that you were after one so I thought I should give you a shout. Thankfully I set an email notification when Coral becomes available..
Will do, thanks for the support appreciate it!
Ha, turns out I too had alerts setup from Pi hut, I got an email from them 10 minutes after I ordered saying it was back in stock, there system must have took a bit of time to send the emails 😂
@@EverythingSmartHome Ha, same here I forgot that I had it on but I am glad that this worked tbh. I was ready to purchase Blue Iris license and go down the Deepstack road. But if frigate person/vehicle detection works with HA I think I will keep it this configuration and I will buy a Reolink NVR for 24/7 recording.
Awesome tutorial man !! Thanks for sharing! Qq: Would it be possible to use Frigate with an Intel Neural stick rather than the Coral one in a RPi4 ? All coral ai products are sold out everywhere!
I don't think it supports it at the moment but could be wrong. Thanks for watching!
So are all of these configurations on a per camera basis? I have 4 cameras and I was wanting to track 4 different objects on all 4 cameras. Is there a way to do global options? Also I am having issues getting clips and snapshots into my notifications. I am using Frigate in a separate docker outside of Home Assistant. I have the snapshots working locally but when I am out of the house no image but I get the message of the notifications.
Regarding the snapshot, that would seem to indicate an issue with external access maybe?
Hi just adding Frigate to HAS, does the Coral have a 20x42mm form factor for my Intel NUC 11 by Chance?
how to delete all events in frigate? is any way??? thanks
G'day Lewis. Is there any way to use a camera entity (such as camera.front_door) in the frigate.yml? or does it only support rtsp streams? I've got a Nest Door bell now integrated as a camera in HA that I'd love to use with frigate!
Unfortunately I don't think so at this time, you may be able to use something else to convert the doorbell stream into RTSP?
What if you also want to be able to look at the live feed and watch clips remotely (ie. Through WAN, not LAN)?
Check out the remote access video!
can frigate do its detection using a GPU, like on a graphics card? if so, you wouldn't need that coral doohickey.
Hi. I'm really struggling with the mqtt snapshot data. I am receiving the snapshot data via mqtt into nodered but cannot figure out how to render/format that mqtt image data to a picture to send. Can you point me in the right direction please? Thanks
Sorry I don't use NodeRED, we have some good guys in the discord server who do though if you need help!
I just found Coral available in seeedstudio (usb version). Could you please explain what to do differently with Coral on RPi (if that's possible) ?
Can you get me one?! Haha kidding. I already called out the points in the video where you need to make changes which should help
Nice video, do you know any way to get license plate recognition done with frigate ? That would be awesome 😎
Not possible at the moment unfortunately! Thanks!
Great Video as always.. although there should have been cake recognition instead of mouse.. :-)
Thanks man! Haha that would have been a good tie in...and required some actual forward thinking on my part 😅
You can buy the coral in Mouser electronics. At least the M.2 versions are available.
Yeah you can, was more looking for the USB version at the moment...unfortunately for me!
Is that a Prusa 3D printer at the back?
when you say frigate is cpu intensive is that just when its doing object detection or does it put cpu under constant load?
It's always doing detection since it runs constantly (unlike Deepstack which runs on demand) so there will be an increased load unless using something like the Coral
Super Videos. Well explained. demand. I have a Hikvision DS-2CD2722FWD-IZS. Can I use this camera with Frigate? I am an enthusiastic Home Assistant user from 66 years old and I have learn a lot of your Tutorials. Yhanks again.
I have it running.
Great tutorial man.
Can I use coral m.2 on pi4 running ha?
Thanks appreciate it! I believe so yes!
Hi, Great video! I was able to get everything up and running. I also was able to find a usb coral for my raspberry pi and it has made a large difference with the speed. I have question about actionable notifications. I see in the documentation there is a way to get an image to show up in the notification but I am struggling to use the correct url. I can't seem to get the images from my media browser to show up in my notification. Please let me know. Thanks for all the great videos!
Thanks and that's great! Jump in the discord server I'm sure we can help you out!
Hey Danny, are you running hass.io? did you have to do anything special getting the coral USB running on the rp?
Any particular reason why other frigate install wouldn't show the options below camera at 14:42 it does for you.
Nothing at all in my case no bounding box, no timestamp, nothing at all :)
Another Awesome Video, no doubt.
I think the version of Frigate in this video has a few differences from the newer versions. I was able to find those options by clicking the Debug > Selected my camera from the list> switched from live to Debug> Show options is now showing on the screen!
@@stryk3rr3al Thanks man, I was seconds from scrap frigate... :)