@@FutureProofHomesdrywall ceiling is fairly common in many places around the word or at least all the places I’ve been living, but there might be some additional requirements regarding inset devices compared to US.
@@sygad1 I'm partial to PoE. Provided you have PoE switch already, it's much easier and cheaper to run and connect Cat5. Romex is expensive and requires larger holes to run, a conveniently located junction box with constant power, and is much less DIY friendly for most people. You'd also be getting the benefit of wired networking. Of course, both options would be best.
Both will be possible! I'll address this in a Q&A video, but mmWave can be added easily since all the GPIOs are exposed and the future enclosures will give us mmWave too. Also, a PoE to USB-C adapter will be available.
Shout out from one of the Music Assistant devs. Great to see MA enabled products like these come to fruition. I would love to get my hands on one to start playing around with it🎉
Having this with a HAT option for mmWave presence detection with zones would be my dream right now. Having a ceiling mounted mmWave with zones, that can take either verbal instruction or take actions based on your location in the room would be a game changer for me. I imagine that there are loads of scenarios and different use-cases that people could come up with. So having your device able to select a series of options in HAT format could make this a real winner for LOADS of people! Wishing you all the best in getting this scaled up!
This is already so awesome. Really excited to see how this develops. I appreciate all the time and effort you have put into making this product. I think it has the potential to be huge. Especially if more sensors like PIR/mmwave are added. Great work demo and professional Brad.
Looks dope! Mostly commenting for the algorithm :) This is my first exposure to your channel but I've been hoping to migrate to home assistant from a Google Home setup, and the last thing I really need for a complete replacement is solid voice control. I used home automation for accessibility/assisting in managing a chronic health condition, and I'm really excited by the prospect of a private, self hosted system that still helps me in the way I'm used to with my google home setup! Really excited to see the eventual final product!
This is going to be such an awesome kit. I love all the companies developing for a future-proof home. The market is really beginning to value products like this.
Thank you. Yes, I want FPH to be a full-blown consumer electronics startup for regular consumer electronics. It's a lofty goal, but that is where we're heading.
Yesssss! Finally a local voice assistant! I wanted to ditch alexa for so long.... Love to see updates on this project and have opted in for an dev kit (HW dev for 20+ years :-) Would be nice to have the STL for the case and an speaker which would fit into it. Please keep this going
Hey congrats on your launch! This is some really exciting tech. It’s at times like this I wish I was a hardware dev but I look forward to creating dope software around this though 😁
Thanks @technithusiast! I'll send you one for review during private beta if you're interested? Hack away on it and push the thing to it's limit! You have my email. Cheers man!
I am so looking forward to this. I had the exact same product idea 2 years ago but I lacked the experience to build it. I am even leaning into the idea that this should be standard in every future house!
If built with top notch hardware and software to give a flawless user-experience (will take years of R&D) I too believe this product would transform the common home.
Congratulations on this!!! I do have a suggestion for gen 2… if you integrate POE into the board it would make a in ceiling option a lot easier and probably enable a longer longevity. I can’t imagine having to dig in a ceiling to replace a hidden 120 to usb adapter would be very fun. Yet having a cat5/6 dongle that has POE to it can remain dormant in the ceiling with no drawbacks.
It’s early, but the mission is clear. I get excited when I think about achieving all our goals and this channel documenting all the milestones. Thanks for the support!
This is a very exciting development! I'm not tech savvy enough to buy and set up the dev kit, but I'll be following closely and eagerly await a fully fledged commercial product!
That sounds great, happy to be a guinea pig if you need a test subject 😂 the idea of having an AI voice assistant is very exciting. I currently use Alexa and have a lot of smart home devices. All my lights, thermostat, smart plugs, fans. But I'd love to ditch Alexa! I'm a huge advocate for not relying on cloud services. However, at the moment I still need them.
Looking forward to this! Glad you’re thinking of it as a music player - that’s a core piece of a voice assistant that many esp based devices aren’t supporting (yet). Would be a perfect device if you can add Spotify Connect functionality and/or chromecast audio. Keep up the good work on this device!
just to make a note, to the date, I built the same thing and currently in the testing phase, using 2 Esp 32 models in 1 device, 4 mics, speaker and all the most common sensors. If i fail for sure i will buy many from you, great work
@@FutureProofHomes connectivity/protocols on one and sensors on the other, they seem to work very well together. S3/C6, the mics i wanted also needed C6 so spread the load
Does it mean the user would need to juggle multiple serial USB connections and flash multiple ESPs individually, or did you find a way to flash both simultaneously such that the S3 is a "master" and the c6 is a "slave"?
First year or so is within the community. But I REALLY want to take HA and our suite of products out to average consumers in primary markets. To hit that goal we must build a great team and something very reliable and intuitive. That will take years and I would love to do exactly this for many years to come.
Great job! Congrats on the launch! In the past you talked satellite and a Jetson server. Are you now focusing on Satellite, hoping everyone with HomeAssistant will have the right hardware to manage the LLM crunching needed?
Having a voice assistant start the conversation is something I've wanted for a couple of years. Using dev tools it's apparently possible with Google Home but it all seemed too hard. This looks great!
I’m very excited about this project. I’ve slowly become more disenchanted with Alexa. I’ve been hoping something like this would become available so that local control was possible. I’ll keep an eye out for this. Please keep up the good work.
YES! Intercom capability would be sick. This will be a bit in the future, but I'll look into what it might take to pull this off (probably a lot, but not impossible).
Yes, audio playback is aiming to be best in industry. The Amp1 product will help us achieve this. See the roadmap on FPH website. Music playback is critical for me too. It's coming.
I'm on the waitlist and really looking forward to this hardware. You're doing an awesome job, thank you and best of luck! I do have one request/suggestion, as an electronics engineer it drives me insane when companies make stupid design choices for powering equipment. I have seen a trend toward powering sensors with USB power supplies, what are people thinking? I know it's easy and simple to use a USB power supply when many of the designs incorporate an ESP32 or similar inside and all you have to do is jam in a micro USB connector to power it but you have to think about the practical aspects of form and function. When you want to place a sensor like a millimeter-wave sensor or any other occupancy or motion sensors it's ridiculous that with so many products on the market now you have to use a USB power supply and then try hide the power supply and cable going to the sensor. What am I missing? I want a nice clean installation and not have a sensor on my wall with a cable running down to an electrical outlet where it's plugged in. In a perfect world the device would support PoE, not an adaptor that I saw mentioned in another post, you want it integrated into the PCB design. RJ45 connectors are, unfortunately, large and I concede that is not ideal and a challenge to keep the device form factor small but this hardware is going to be a little larger because of everything it supports so I feel a RJ45 connector can be accommodated. If PoE proves to be too much of a challenge then please, please, please make provision for DC power terminals. A lot of homes don't have CAT5/6/7 running everywhere but most do have basic, two conductor security wiring that you can send 12 or 24VDC over (5VDC not ideal over long, small gauge copper). I frequently replace old PIR motion sensors with newer technology and use the 12 or 24VDC that was previously powering the device to power the new hardware which then keeps the installation of the device nice and clean and aesthetically pleasing (no stupid power cables hanging down the wall). Thanks to PoE being a power and low latency data/network solution it is ideal but at the very least it would be nice to have flexible power options. A while ago I purchased an ESP32 PoE Development Kit (EST-PoE-32) from Everything Smart Technology (EST) and it supports PoE, USB-C and 9-28VDC for power, it is a great, flexible, little board and proof that it can be done. One final point I'll add to this comment, that has become rather long, I really like being able to power all my devices in my home with a single PoE Ethernet switch which means I only have to worry about a single power source that is plugged into a UPS and not dozens of USB power adaptors plugged in all over the home. Great solution to keep everything protected and operational no matter what happens with mains power. Keeping a spare PoE Ethernet switch also makes for easy redundancy in place of dozens of USB power supplies that easily have their cords pulled out. Okay, perhaps I went a little overboard making my point 😁.
Great comment. I hear you. Here’s what is happening behind the scenes. Let me know your thoughts. What you saw in the video is the “HAT” and “CORE” boards. Behind the scenes we have a third board we call the “SHOE”. This SHOE board is responsible for all the I/O connections at the bottom of the hockey puck enclosure (3.5mm headphone jack, USB-C, 30w PoE+, and the available GPIOs). So if you’re running the CORE and HAT “naked” (with no enclosure) then you don’t get PoE unless you add-on the third SHOE board dangling from a ribbon cable. Obviously this decision is being made so that all the boards can fit in the enclosure. I know this isn’t ideal for hackers but we’re trying to avoid two variants of the HAT. Thoughts on this?
Dude, this is amazing. I plan on buying several if the first dev kit works well. I already use Assist more than Alexa while sitting at the PC, would love to have a good solution off the shelf for all rooms (so I don't have to build 10 DIYs)
Looking forward to get the final consumer products😆!!! I know that's a little bit early but, Man, what you'v done is so cool and perfectly matchs my thoughts. I'm a software engeener also a fan of homelabing, but I have no idea about hardware things...I really need a stable product that has features like satellite1 to build my smart home. No joke, I'm planing pre install some cables (poe) on my new house celling for your products🤣. So keep going pls!!!
Love this project and will keep an eye on it. I think a lot of homeautomation geeks want this product and the other less geeks also in the end if it is simple to setup and looking nice with an enclosure to protect their privacy and a product to host the AI is an important thing for the less geeks I think and nice that this is also in your project. An all in one solution. It’s a logical way that this innovation first will be for homeassistent, but it would also be nice if you can make it work with the homeautomation system homey from athom because this is a nice looking/working product for geeks and less technical homeautomation enthusiasts that is gaining adoption. I think if you can manage this that you will have a nice working business 😊
Subbed & liked. Very interested in the final product. As someone who utilizes Google Home for Whole-Home Audio via Groups (Bluetooth in-wall receivers connected to in-ceiling speakers, connected to the Google Home via Bluetooth), I'm hoping this supports this sort of configuration. In addition, id recommend allowing the Assistant to respond on the same Bluetooth speaker too, as it's one major reason I love using the Google Home still during cleaning or kitchen work. I haven't messed that much with the AI in Home Assistant, but this is the sort of thing that may get me to give it a shot. I do use HA for pretty much all actual smart-home & automation tasks, but I have vocal search & music still on the Google platform.
Yep. My goal is to win over users like you with reliability and functionality. Stay tuned. I really want this tech too. So selfishly I'm building it for me and my customers too.
This is awesome! With something like this that's planned to be placed evenly all around the house I've always wondered if it could also be a Zigbee/Thread router as well? Google/Apple Home products are starting to add that in their satellites.
I'm looking forward to the day I can get rid of my Alexa devices. I know you can achieve local voice assistant capabilities with DIY solutions currently.. but I've never quite been satisfied enough from videos I've watched to actually try it. Looking forward to seeing this idea develop! Subscribed! Edit: I just went back through your channel and watched your video about local LLM and Home Assistant voice assistant. Yes, it did also blow my mind haha. I may give it a go this evening.
Thanks for watching and playing catch up on previous videos. If you've watched all the videos and read the website then you can see the bigger picture of what we're building. The bar is set high, but I want to build a really solid and reliable product here. Stay tuned!
Definitely didn’t forget about that. You’ll be able to connect externally amplified speakers via the 3.5mm headphone jack on the Sat1. Also, after our AMP1 product launches later in 2025 you’ll be able to connect speakers directly to the amplifier.
Very excited for this. It's exactly what I wanted and then some. I'd really like to see how you get responses faster from a local AI server. I wonder if there is a slimed down version. Where you can select categories of information. I'd be very interested what information you could pass from the web, like weather and air quality. Maybe that's just buikt into HA with other intigrations
Congrats. I've managed to have a working and stable enough system with a Korvo and tweaking, but I really hope your project is gonna work and become the perfect solution, cause nothing is for now.
@@FutureProofHomes Also, it might interest you but i've managed to make an reply function when the assistant (Assist in HA, with your A.I of choice) is asking a question. Basically, it checks the text of the answer and looks for a question mark. It works pretty well and avoids having to repeat the wake word (i don't know if your system has a solution like this).
Finally. A local voice assistant that’s even better than amazons offering. It won’t be long before Amazon want to charge for basic Alexa so this is brilliant.
I hear rumors they're building a product internally they call "Remarkable Alexa" which is powered by their LLM in the cloud. Amazon will supposedly charge monthly for this. We'll see!
OK this looks very cool, so I wanted to share with you my 'wishlist' for the ultimate smart device to place troughout my house: Devices liek the "Everything Presence Pro" or the "UltimateSensor" check many of the below boxes, but there is note that checks all of them :--) Some of these could be great to add to your sensor, some it could be nice to ensure that end-users can add them themselves if they want to. * ESP-based (for ESPHome): check * With all the features for voice: check * Speaker can be used as a media player: check * Bluetooth proxy support: check (I think) * Bluetooth presence detection: check (I think) * MMWave Sensor * PIR Sensor (for an alarm system) * CO2 Sensor (to monitor air quality, i.e. when to open a window or increase ventilation) * PoE support: (powering + networking over an ethernet wire). * Alarm cable support: allow it to be powered by an alarm system and also have it include a relay that can trigger the alarm system when the PIR sensor detects motion. * Colour LED's (to show a status)
Bluetooth proxy - check Bluetooth presence - check PoE - check (with adapter or future enclosure) mmWave -check (via GPIOs or future enclosure) LEDs for status - check All other ideas - TBD
lol sorry thought of another improvement. Me being passive house enthusiast.. I think you should make a mounting part where you can drywall the mount and then just snap in the satellite. That way we can make the device install easy and air tight between the living space and the attic.(if there is an attic above the room).. I would make a round mounting device with ethernet jack(Poe) so that above the device in the attic you just plug in the ethernet cord and on the other side (satellite side) the satellite just snaps to the mount. or we make the mount flush with the ceiling with mic holes.. etc.. either way.. We need to make sure when this is mounted it provides an air tight connection.. (safe for insulation..).. thanks :)
very interesting, waiting for more updates about the hardware. one question, are you using nvidia jetson nano for home assistant and openAI ? the delay on the responses are very low, I am impress.
I running all forms of the AI pipeline in many places. What you witnessed in this particular video is me using the standard Home Assistant conversation agent (no AI) on standard server hardware (not Jetson).
Sounds too good to be true.. I subscribed and will be waiting on new updates.. So far amazing job. Quick question? I know this is work in progress, but what's the chance of being able to integrate AI into the voice assistant?
Yes. The Sat1 will work with all of today's AI/LLM experiments. Set up a local LLM and connect it to HA (see HA's Ollama Integration) or use HA's OpenAI Conversation Integration to hook into ChatGPT (always be weary of connecting your home to any AI though, especially cloud based ones).
this is awesome and can't wait to try it out. I think you did say there was a plans to maybe add a case for if ??? I plan on using home assistant to replace all of my echos in the house ( one in every room), one thing that was asked on my by mom and wife is can this have a clock on it, so that is my request is can you try and add a clock
Looking forward to this! Is there going to be a software disable mic feature? That's my biggest gripe with existing smart home speakers. I want to be able to control when to have the devices listening. IE: If I'm not home, I want the mics disabled and hardware button won't override the software disabled.
Should design the PCB so that it fits into a google home mini. There are so many of them at it would be great to reuse them for a cool project. I want it to reach out to my Ollama server and talk to an LLM running on my local AI machine. Then respond in nice natural voice. Regardless I will buy one of these.
The claims are dubious because the xmos chip doesn't rival the latest smart speakers as it uses some of the early technologies the 1st gen Alexa/Google devices used. Google with its latest devices uses some called targetted speech extraction and is the oppisite in design as you enroll your voice so its known and extraction of known and the models they use has been a huge step up to cancelling what is likely unknown noise. Without any targeting the technologies on show are what you would call a conference microphone which is not really the as modern smart speakers and also its not opensource as the xmos algs are behind a commercial paywall...
Any update when this is going to release? Been on the waitlist for a minute. Was about to buy all the parts to make my own satellite from a pi today from your old video, but I calmed down. Really trying to replace my Alexa devices.
Given how unique this product is, I reckon you would have a decent chance of a collab with one of the major channels like LTT. I know you're just as dev kit stage at the moment, but some of their best videos are when they are trying out new/not quite ready stuff. Linus often does 'upgrades' to his home system and I bet he would be interested in something like this. Defo worth an email I would think.
Noice. On the waitlist. Just wondering, given the shape, would this maybe fit into a Google Nest mini shell? I'm guessing it's probably bigger though 🤔
Waiting for this hardware and further video to explain the different how tos. But also have a question: Will there be a version with all the needed Software preinstalled and a nice case?
@@FutureProofHomes absolutely awesome. I currently have 15 mmWave sensors ceiling mounted and they are so chatty that I had to create a zigbee network just for them and they all have different controls....nightmare. Absolutely looking for a better alternative
We will be shipping to Europe upon launch and have inventory there. Shipping across all of Europe looks like it will be less than $10 and 3-5 business days.
Great idea, satellite looks exactly what should be, can you provide more info on the server specs that will perform all voice recognition go be as reactive as the one in you video?
I'm just thinking this device could be as an amazing all-in-one room device, including using it as thermostat... Not sure how feasible would be to install it in the wall. Thinking on it as you can use the Sonoff NS-Panel that come with European and American versions (for the standard size).... So looking forward for the development. I would totally install one per room.
![Seungmin "그렇게, 천천히, 우리(As we are)" | [Stray Kids : SKZ-PLAYER]](http://i.ytimg.com/vi/kAzmhLHePqU/mqdefault.jpg)
Looking forward to watching the development of this product.
Thank you! We've got a solid roadmap ahead of us. But we'll need these dev kits to sell so we can make revenue and blast to the next stage. :)
Stealth ceiling mounted FINALLY someone is thinking about this
Agree! Recessed mount for US (common with our drywall ceilings) and something slightly different for rest of world.
@@FutureProofHomesdrywall ceiling is fairly common in many places around the word or at least all the places I’ve been living, but there might be some additional requirements regarding inset devices compared to US.
Yep. Gotta follow proper protocol/regulations/codes for in-ceiling devices. Hence why a bit later in roadmap.
@@FutureProofHomes mains powered will ne a necessity as low voltage will be a pain the A$$
@@sygad1 I'm partial to PoE. Provided you have PoE switch already, it's much easier and cheaper to run and connect Cat5. Romex is expensive and requires larger holes to run, a conveniently located junction box with constant power, and is much less DIY friendly for most people. You'd also be getting the benefit of wired networking. Of course, both options would be best.
Add Poe and mm wave and this,would be the all in one room sensor of my dreams. I’d buy 20!
Both will be possible! I'll address this in a Q&A video, but mmWave can be added easily since all the GPIOs are exposed and the future enclosures will give us mmWave too. Also, a PoE to USB-C adapter will be available.
+1 for PoE.. biggest PITA for all these devices is finding a suitable way to power.. especially if will be ceiling mounted...
Shout out from one of the Music Assistant devs. Great to see MA enabled products like these come to fruition. I would love to get my hands on one to start playing around with it🎉
Awesome work over there at MA @Marvin060591! We'll be in close contact. Love all that you guys do!
Congrats on your launch! I know from my own startup experience how exhilarating it is. I look forward to seeing where this goes!
Thanks so much!
Hardware companies are tough, but the rewards are big. Godspeed to you.
100%. Learning a lot and learning fast. Determined to succeed. Thanks for the well wishes!
@FutureProofHomes We'll help you succeed brother, as soon it's out we buying and telling our friends too.
So glad you followed up with this, I have been waiting!
It’s been rewarding. We’re going to go all the way too. The fun has just begun.
Having this with a HAT option for mmWave presence detection with zones would be my dream right now. Having a ceiling mounted mmWave with zones, that can take either verbal instruction or take actions based on your location in the room would be a game changer for me.
I imagine that there are loads of scenarios and different use-cases that people could come up with. So having your device able to select a series of options in HAT format could make this a real winner for LOADS of people!
Wishing you all the best in getting this scaled up!
Yoo congratulations!!!! Love your iterative approach! Can’t wait to put these all over our house!
Hey Gregor! Thanks man. Enclosure is next. :)
This is already so awesome. Really excited to see how this develops. I appreciate all the time and effort you have put into making this product. I think it has the potential to be huge. Especially if more sensors like PIR/mmwave are added. Great work demo and professional Brad.
Thank you for all the support @techdad6135! More to come. Looking forward to sharing all milestones as we move towards the future.
I am stoked about this project. I'm surprised there haven't been more projects taking local voice assistant hardware on.
Congratulations on your hard work and bringing such a great product to the community....I'm on the list..!
Thank you so much! Appreciate the support @222inverter.
Cool beans! It's a long road and you're still moving forward!
Long road indeed. Gotta keep going though.
Looks dope! Mostly commenting for the algorithm :)
This is my first exposure to your channel but I've been hoping to migrate to home assistant from a Google Home setup, and the last thing I really need for a complete replacement is solid voice control. I used home automation for accessibility/assisting in managing a chronic health condition, and I'm really excited by the prospect of a private, self hosted system that still helps me in the way I'm used to with my google home setup!
Really excited to see the eventual final product!
Thanks for the support Chris! I sincerely hope this product can increase your quality of life as the tech gets better and better.
This is going to be such an awesome kit. I love all the companies developing for a future-proof home. The market is really beginning to value products like this.
Thank you. Yes, I want FPH to be a full-blown consumer electronics startup for regular consumer electronics. It's a lofty goal, but that is where we're heading.
Yesssss! Finally a local voice assistant!
I wanted to ditch alexa for so long....
Love to see updates on this project and have opted in for an dev kit (HW dev for 20+ years :-)
Would be nice to have the STL for the case and an speaker which would fit into it.
Please keep this going
Im excited about this project and supporting it as well
Hey congrats on your launch! This is some really exciting tech. It’s at times like this I wish I was a hardware dev but I look forward to creating dope software around this though 😁
Thanks @technithusiast! I'll send you one for review during private beta if you're interested? Hack away on it and push the thing to it's limit! You have my email. Cheers man!
this looks fantastic! can you put a radar like the LD2450 on there, would be awesome to have an all in one satellite with decent presence detection.
Yes! mmWave will be in the enclosure.
Definitely excited for this. Looking forward to the final product and ceiling mount.
Yea, I’m really excited for ceiling mount too!
Yea, I’m really excited for ceiling mount too! The user-experience is almost magical when your whole room talks to you.
This is so cool! I am very excited about this product being released!
I am so looking forward to this. I had the exact same product idea 2 years ago but I lacked the experience to build it. I am even leaning into the idea that this should be standard in every future house!
If built with top notch hardware and software to give a flawless user-experience (will take years of R&D) I too believe this product would transform the common home.
This looks promising! Thanks for the work you have done for the community!
You bet! Love doing this stuff. The whole FPH team really appreciates the opportunity to build such cool stuff for the community.
Congratulations on this!!! I do have a suggestion for gen 2… if you integrate POE into the board it would make a in ceiling option a lot easier and probably enable a longer longevity. I can’t imagine having to dig in a ceiling to replace a hidden 120 to usb adapter would be very fun. Yet having a cat5/6 dongle that has POE to it can remain dormant in the ceiling with no drawbacks.
Our enclosure which will come out in early 2025 will have PoE. :)
How exciting. Congratulations on your launch 🎉
Thanks so much!!
How exciting! I've been waiting for this - thanks for all your hard work!
It’s early, but the mission is clear. I get excited when I think about achieving all our goals and this channel documenting all the milestones.
Thanks for the support!
Whoooosh, finally some prototypes of XMOS satellites! :)
Good luck, and will be waiting for news!
More to come!
This is a very exciting development! I'm not tech savvy enough to buy and set up the dev kit, but I'll be following closely and eagerly await a fully fledged commercial product!
I will do my best to get this to a point that most people watching this channel can follow less than 10-steps to be operational.
That sounds great, happy to be a guinea pig if you need a test subject 😂 the idea of having an AI voice assistant is very exciting.
I currently use Alexa and have a lot of smart home devices. All my lights, thermostat, smart plugs, fans. But I'd love to ditch Alexa!
I'm a huge advocate for not relying on cloud services. However, at the moment I still need them.
@@FutureProofHomes So for us non-tech people, what will we need to do in our homes? Do we need to sign up with HA, and
be proficient in it?
Looking forward to this! Glad you’re thinking of it as a music player - that’s a core piece of a voice assistant that many esp based devices aren’t supporting (yet). Would be a perfect device if you can add Spotify Connect functionality and/or chromecast audio. Keep up the good work on this device!
Yes. Consideration of music playback capabilities is critical for this product. We have a plan to get us Spotify Connect & Airplay2.
Thank you for doing this. Can't wait until the final hardware will be there.
Thank you!
I couldn't get Onju Voice working at all so I am extremely excited for this to be released!
I would love to see this with an integrated millimeter wave sensor
Enclosure will have mmWave. And it's simple to connected mmWave to the HAT's exposed GPIOs.
Looks great cant wheit for the final product.
just to make a note, to the date, I built the same thing and currently in the testing phase, using 2 Esp
32 models in 1 device, 4 mics, speaker and all the most common sensors. If i fail for sure i will buy many from you, great work
Why two ESP32s? One for ESPresense? :)
@@FutureProofHomes connectivity/protocols on one and sensors on the other, they seem to work very well together. S3/C6, the mics i wanted also needed C6 so spread the load
Does it mean the user would need to juggle multiple serial USB connections and flash multiple ESPs individually, or did you find a way to flash both simultaneously such that the S3 is a "master" and the c6 is a "slave"?
It looks great! Intrigued as to how far it will eventually reach!
First year or so is within the community. But I REALLY want to take HA and our suite of products out to average consumers in primary markets. To hit that goal we must build a great team and something very reliable and intuitive. That will take years and I would love to do exactly this for many years to come.
Great job! Congrats on the launch! In the past you talked satellite and a Jetson server. Are you now focusing on Satellite, hoping everyone with HomeAssistant will have the right hardware to manage the LLM crunching needed?
Having a voice assistant start the conversation is something I've wanted for a couple of years. Using dev tools it's apparently possible with Google Home but it all seemed too hard.
This looks great!
It’s magical when the ceilings of your home start talking to you at the right moments for the rights tasks.
I’m very excited about this project. I’ve slowly become more disenchanted with Alexa. I’ve been hoping something like this would become available so that local control was possible. I’ll keep an eye out for this. Please keep up the good work.
Thank you! Many people feel like you and me it seems. If we can deliver then there is success for everyone.
Omg I've been waiting for this for ages. Adding an intercom feature between nodes would be amazing
YES! Intercom capability would be sick. This will be a bit in the future, but I'll look into what it might take to pull this off (probably a lot, but not impossible).
Oh! For a final product the audio quality for music playback is just as important if not more important than voice input reception 😊
Yes, audio playback is aiming to be best in industry. The Amp1 product will help us achieve this. See the roadmap on FPH website.
Music playback is critical for me too. It's coming.
Also is PoE in the mix?
Yep! See all the other comments.
Super excited about this 🎉🎉
Me friggin' too!
Ben Jackson looks very oddly like Bill Murray... hah. Looking forward to the development, great stuff!
Ben Jackson is one of Bill’s many cousins.
I'm on the waitlist and really looking forward to this hardware. You're doing an awesome job, thank you and best of luck! I do have one request/suggestion, as an electronics engineer it drives me insane when companies make stupid design choices for powering equipment. I have seen a trend toward powering sensors with USB power supplies, what are people thinking? I know it's easy and simple to use a USB power supply when many of the designs incorporate an ESP32 or similar inside and all you have to do is jam in a micro USB connector to power it but you have to think about the practical aspects of form and function. When you want to place a sensor like a millimeter-wave sensor or any other occupancy or motion sensors it's ridiculous that with so many products on the market now you have to use a USB power supply and then try hide the power supply and cable going to the sensor. What am I missing? I want a nice clean installation and not have a sensor on my wall with a cable running down to an electrical outlet where it's plugged in. In a perfect world the device would support PoE, not an adaptor that I saw mentioned in another post, you want it integrated into the PCB design. RJ45 connectors are, unfortunately, large and I concede that is not ideal and a challenge to keep the device form factor small but this hardware is going to be a little larger because of everything it supports so I feel a RJ45 connector can be accommodated. If PoE proves to be too much of a challenge then please, please, please make provision for DC power terminals. A lot of homes don't have CAT5/6/7 running everywhere but most do have basic, two conductor security wiring that you can send 12 or 24VDC over (5VDC not ideal over long, small gauge copper). I frequently replace old PIR motion sensors with newer technology and use the 12 or 24VDC that was previously powering the device to power the new hardware which then keeps the installation of the device nice and clean and aesthetically pleasing (no stupid power cables hanging down the wall). Thanks to PoE being a power and low latency data/network solution it is ideal but at the very least it would be nice to have flexible power options. A while ago I purchased an ESP32 PoE Development Kit (EST-PoE-32) from Everything Smart Technology (EST) and it supports PoE, USB-C and 9-28VDC for power, it is a great, flexible, little board and proof that it can be done. One final point I'll add to this comment, that has become rather long, I really like being able to power all my devices in my home with a single PoE Ethernet switch which means I only have to worry about a single power source that is plugged into a UPS and not dozens of USB power adaptors plugged in all over the home. Great solution to keep everything protected and operational no matter what happens with mains power. Keeping a spare PoE Ethernet switch also makes for easy redundancy in place of dozens of USB power supplies that easily have their cords pulled out. Okay, perhaps I went a little overboard making my point 😁.
Great comment. I hear you.
Here’s what is happening behind the scenes. Let me know your thoughts.
What you saw in the video is the “HAT” and “CORE” boards. Behind the scenes we have a third board we call the “SHOE”. This SHOE board is responsible for all the I/O connections at the bottom of the hockey puck enclosure (3.5mm headphone jack, USB-C, 30w PoE+, and the available GPIOs).
So if you’re running the CORE and HAT “naked” (with no enclosure) then you don’t get PoE unless you add-on the third SHOE board dangling from a ribbon cable.
Obviously this decision is being made so that all the boards can fit in the enclosure. I know this isn’t ideal for hackers but we’re trying to avoid two variants of the HAT.
Thoughts on this?
Dude, this is amazing. I plan on buying several if the first dev kit works well. I already use Assist more than Alexa while sitting at the PC, would love to have a good solution off the shelf for all rooms (so I don't have to build 10 DIYs)
Sounds like you’re a great fit for the Sat1 too! Thanks for the support. Launching soon!
Fantastic project... I'm looking forward to the developments.
Thanks for staying tuned. I’ll keep sharing updates.
Awesome can't wait for the finished product, ceiling mount assistant is such a good idea
Coming soon!
I'd certainly be interested in this, depending on the price point.
Checkout FutureProofHomes.net… prices are there!
Looking forward to get the final consumer products😆!!! I know that's a little bit early but, Man, what you'v done is so cool and perfectly matchs my thoughts. I'm a software engeener also a fan of homelabing, but I have no idea about hardware things...I really need a stable product that has features like satellite1 to build my smart home. No joke, I'm planing pre install some cables (poe) on my new house celling for your products🤣. So keep going pls!!!
Pre-install those cables. Smart! It’s coming…
Flight enshittification! I'm all up to it!
I just want to say "Computer, open garage door" and here Majel Barrett reply "Garage Doors are open... Captain"
I am very looking forward to this!
Coming soon! Thanks for the support!
You're welcome, and thanks to you for making an amazing (hopefully!) product! I'm on the email list, and will definitely be backing you!
Love this project and will keep an eye on it. I think a lot of homeautomation geeks want this product and the other less geeks also in the end if it is simple to setup and looking nice with an enclosure to protect their privacy and a product to host the AI is an important thing for the less geeks I think and nice that this is also in your project. An all in one solution. It’s a logical way that this innovation first will be for homeassistent, but it would also be nice if you can make it work with the homeautomation system homey from athom because this is a nice looking/working product for geeks and less technical homeautomation enthusiasts that is gaining adoption. I think if you can manage this that you will have a nice working business 😊
Subbed & liked. Very interested in the final product. As someone who utilizes Google Home for Whole-Home Audio via Groups (Bluetooth in-wall receivers connected to in-ceiling speakers, connected to the Google Home via Bluetooth), I'm hoping this supports this sort of configuration. In addition, id recommend allowing the Assistant to respond on the same Bluetooth speaker too, as it's one major reason I love using the Google Home still during cleaning or kitchen work. I haven't messed that much with the AI in Home Assistant, but this is the sort of thing that may get me to give it a shot. I do use HA for pretty much all actual smart-home & automation tasks, but I have vocal search & music still on the Google platform.
Yep. My goal is to win over users like you with reliability and functionality. Stay tuned. I really want this tech too. So selfishly I'm building it for me and my customers too.
This is awesome! With something like this that's planned to be placed evenly all around the house I've always wondered if it could also be a Zigbee/Thread router as well? Google/Apple Home products are starting to add that in their satellites.
Zigbee/Z-Wave/Thread radios could definitely be added in later iterations of the product. It's on the list.
Congrats on the project, looking forward to seeing the next steps! What are you planning for power? PoE for the in-ceiling concept?
Yes, can connect PoE adapter to USB-C.
Can't wait for this.
I'm looking forward to the day I can get rid of my Alexa devices. I know you can achieve local voice assistant capabilities with DIY solutions currently.. but I've never quite been satisfied enough from videos I've watched to actually try it.
Looking forward to seeing this idea develop! Subscribed!
Edit: I just went back through your channel and watched your video about local LLM and Home Assistant voice assistant. Yes, it did also blow my mind haha. I may give it a go this evening.
Thanks for watching and playing catch up on previous videos. If you've watched all the videos and read the website then you can see the bigger picture of what we're building. The bar is set high, but I want to build a really solid and reliable product here. Stay tuned!
Looks awesome! added myself to the wish list! pleaseee allow it to use external speakers as well!!!!
Definitely didn’t forget about that. You’ll be able to connect externally amplified speakers via the 3.5mm headphone jack on the Sat1. Also, after our AMP1 product launches later in 2025 you’ll be able to connect speakers directly to the amplifier.
any updates here?
Very excited for this. It's exactly what I wanted and then some. I'd really like to see how you get responses faster from a local AI server. I wonder if there is a slimed down version. Where you can select categories of information. I'd be very interested what information you could pass from the web, like weather and air quality. Maybe that's just buikt into HA with other intigrations
Congratulations !!
Thank you! Cheers!
Pls consider Australia as well...
Will do. We’re discussing this in discord channel. I’ll try and get logistics setup there.
Congrats. I've managed to have a working and stable enough system with a Korvo and tweaking, but I really hope your project is gonna work and become the perfect solution, cause nothing is for now.
Yep. I also pushed the Korvo to its limits and bumped into those limits. Hence why we’re building this. Thanks for the well wishes!
@@FutureProofHomes Also, it might interest you but i've managed to make an reply function when the assistant (Assist in HA, with your A.I of choice) is asking a question. Basically, it checks the text of the answer and looks for a question mark. It works pretty well and avoids having to repeat the wake word (i don't know if your system has a solution like this).
There it is!
I saw a pcb replacement for google nest mini that looked like this (not as fancy imo) but it would be interesting to put it into a nest chassis
this is fantastic! Congrats!
Thank you so much!!
Heck yea! I'm excited!!
Thank you! Us too. :)
LETS GOOOOOO!
Heck yea. Go, go!
Finally. A local voice assistant that’s even better than amazons offering. It won’t be long before Amazon want to charge for basic Alexa so this is brilliant.
I hear rumors they're building a product internally they call "Remarkable Alexa" which is powered by their LLM in the cloud. Amazon will supposedly charge monthly for this. We'll see!
OK this looks very cool, so I wanted to share with you my 'wishlist' for the ultimate smart device to place troughout my house:
Devices liek the "Everything Presence Pro" or the "UltimateSensor" check many of the below boxes, but there is note that checks all of them :--)
Some of these could be great to add to your sensor, some it could be nice to ensure that end-users can add them themselves if they want to.
* ESP-based (for ESPHome): check
* With all the features for voice: check
* Speaker can be used as a media player: check
* Bluetooth proxy support: check (I think)
* Bluetooth presence detection: check (I think)
* MMWave Sensor
* PIR Sensor (for an alarm system)
* CO2 Sensor (to monitor air quality, i.e. when to open a window or increase ventilation)
* PoE support: (powering + networking over an ethernet wire).
* Alarm cable support: allow it to be powered by an alarm system and also have it include a relay that can trigger the alarm system when the PIR sensor detects motion.
* Colour LED's (to show a status)
Bluetooth proxy - check
Bluetooth presence - check
PoE - check (with adapter or future enclosure)
mmWave -check (via GPIOs or future enclosure)
LEDs for status - check
All other ideas - TBD
lol sorry thought of another improvement. Me being passive house enthusiast.. I think you should make a mounting part where you can drywall the mount and then just snap in the satellite. That way we can make the device install easy and air tight between the living space and the attic.(if there is an attic above the room).. I would make a round mounting device with ethernet jack(Poe) so that above the device in the attic you just plug in the ethernet cord and on the other side (satellite side) the satellite just snaps to the mount. or we make the mount flush with the ceiling with mic holes.. etc.. either way.. We need to make sure when this is mounted it provides an air tight connection.. (safe for insulation..).. thanks :)
Check the roadmap. You're describing what we're building. :) ;)
very interesting, waiting for more updates about the hardware.
one question, are you using nvidia jetson nano for home assistant and openAI ?
the delay on the responses are very low, I am impress.
I running all forms of the AI pipeline in many places. What you witnessed in this particular video is me using the standard Home Assistant conversation agent (no AI) on standard server hardware (not Jetson).
Wow. Can’t wait. This is so what I was looking for. Any thoughts on maybe making it POE so if we want to mount it in the ceiling?
Yep. We will have small USB-C to PoE adapter.
Sounds too good to be true.. I subscribed and will be waiting on new updates.. So far amazing job. Quick question? I know this is work in progress, but what's the chance of being able to integrate AI into the voice assistant?
Yes. The Sat1 will work with all of today's AI/LLM experiments. Set up a local LLM and connect it to HA (see HA's Ollama Integration) or use HA's OpenAI Conversation Integration to hook into ChatGPT (always be weary of connecting your home to any AI though, especially cloud based ones).
@@FutureProofHomes absolutely can't wait... Be steadfast and stay healthy.. We need more people like you in the world.. 👍
Made mine with a Raspberry pi 😊
what is it using as the media player? will it be compatible with snapcast for whole home audio?
I'm going to buy this! Don't know if i'll succeed to make it work, but this is a great project and I want to help!
Oh and THANK YOU for not being Google and make it available for Europe 😂
We’re going to do our best to make it as easy as possible to set up w/ good documentation. Thanks for the support!
@@FutureProofHomes I really hope so! 🙏🏾🙏🏾🙏🏾
I'd suggest making the waitlist link clickable. It took me a second to find the link in the description and then it required a copy and paste.
Done! Thank you for heads up.
this is awesome and can't wait to try it out. I think you did say there was a plans to maybe add a case for if ??? I plan on using home assistant to replace all of my echos in the house ( one in every room), one thing that was asked on my by mom and wife is can this have a clock on it, so that is my request is can you try and add a clock
Clock capability (and timers and alarms too) are already there (thanks to the Home Assistant team).
Enclosure is early 2025.
Looking forward to this! Is there going to be a software disable mic feature? That's my biggest gripe with existing smart home speakers. I want to be able to control when to have the devices listening. IE: If I'm not home, I want the mics disabled and hardware button won't override the software disabled.
Yes! Software and hardware mute.
Imagine a mic speaker lights and presence sensor and Poe Ethernet. Then put one in the ceiling of each room. And get all talk to home assistant.
That’s exactly what we’re imagining/building. :) it’s time!
@@FutureProofHomes excited
Should design the PCB so that it fits into a google home mini. There are so many of them at it would be great to reuse them for a cool project. I want it to reach out to my Ollama server and talk to an LLM running on my local AI machine. Then respond in nice natural voice. Regardless I will buy one of these.
Excellent.
Thank you! Cheers!
The claims are dubious because the xmos chip doesn't rival the latest smart speakers as it uses some of the early technologies the 1st gen Alexa/Google devices used.
Google with its latest devices uses some called targetted speech extraction and is the oppisite in design as you enroll your voice so its known and extraction of known and the models they use has been a huge step up to cancelling what is likely unknown noise.
Without any targeting the technologies on show are what you would call a conference microphone which is not really the as modern smart speakers and also its not opensource as the xmos algs are behind a commercial paywall...
Is the response time always like that in the demo? Until now, everything local with Home Assistant seems to take ages.
Any update when this is going to release? Been on the waitlist for a minute. Was about to buy all the parts to make my own satellite from a pi today from your old video, but I calmed down. Really trying to replace my Alexa devices.
Hell ya
Oooooo yeaaaaa!
Given how unique this product is, I reckon you would have a decent chance of a collab with one of the major channels like LTT. I know you're just as dev kit stage at the moment, but some of their best videos are when they are trying out new/not quite ready stuff. Linus often does 'upgrades' to his home system and I bet he would be interested in something like this. Defo worth an email I would think.
Our Sat1 enclosure should arrive in Q1 2025 and it gives the PoE connection. :)
Is there a way to presence detection without bluetooth? using 5mm micro wave sensors?
Yep! See all the other comments. :)
Noice. On the waitlist.
Just wondering, given the shape, would this maybe fit into a Google Nest mini shell? I'm guessing it's probably bigger though 🤔
Actually. It might. If I remember correctly, the hat is 3.14 inches in diameter. I’m curious what the Onju voice is.
Waiting for this hardware and further video to explain the different how tos. But also have a question: Will there be a version with all the needed Software preinstalled and a nice case?
That is the goal, yes. All components in one box. We will launch with a dev kit first though, then iterate until we have everything in one box.
If this comes with the optional extra of mmWave then i'll be 1st inline to buy
Yes! Will work with any mmWave since all GPIOs are exposed. Stay tuned as the future enclosures may also give you this mmWave. ;) ;)
@@FutureProofHomes absolutely awesome. I currently have 15 mmWave sensors ceiling mounted and they are so chatty that I had to create a zigbee network just for them and they all have different controls....nightmare. Absolutely looking for a better alternative
Nice can't wait.... Will it be able to play a music playlist by voice per unit, pause and play by voice
Yes! Short set up time, but yes!
POE would be ideal
agree. We'll have it.
Nice! Now please find a friend in Europe so we can enjoy the ride to! Maybe team up with QuinLED?
We will be shipping to Europe upon launch and have inventory there. Shipping across all of Europe looks like it will be less than $10 and 3-5 business days.
@@FutureProofHomesthis is awesome news. Now this is a Christmas present I'll be looking forward to.
Great idea, satellite looks exactly what should be, can you provide more info on the server specs that will perform all voice recognition go be as reactive as the one in you video?
The LLM server-side product part of the suite will come a bit later in the development cycle. I will keep us posted on the progress there.
Beamforming Sound localization can be done using the 4 mics?
Nice work!
Thank you! Cheers!
I'm just thinking this device could be as an amazing all-in-one room device, including using it as thermostat... Not sure how feasible would be to install it in the wall. Thinking on it as you can use the Sonoff NS-Panel that come with European and American versions (for the standard size).... So looking forward for the development. I would totally install one per room.
Perhaps a few years from now we could have a high quality in-wall panel too. That’d be a fun addition to the ecosystem.