Portable AI Voice Assistant using ESP32 & Gemini AI 🔥🔥 |

Поделиться
HTML-код
  • Опубликовано: 11 дек 2024

Комментарии • 154

  • @kaloprojects
    @kaloprojects 3 месяца назад +11

    Hi @techiesms, awesome .. thank YOU so much for using/featuring my KALO Recording & Deepgram transcription libraries and your kind ‘Shoutout’, it is my pleasure that i could help you a little bit and your community!. I love your cool projects, and you know: Nobody can explain all tech stuff better than you, your videos and explanations are best !.

    • @kaloprojects
      @kaloprojects 3 месяца назад +1

      Btw: cool hardware details, nice too see e.g. your headphone audio connector, the powering circuits, your auto-reset idea and replay button is a great idea too. So go forward with your great projects .. and i am always happy to support further. Thank you Techiesms for all your great daily work !

    • @techiesms
      @techiesms  3 месяца назад +1

      Thank you so much....

    • @hemanthkumarmp1886
      @hemanthkumarmp1886 3 месяца назад

      Sir can you send me the complete circuit diagram not schematic​@@techiesms

    • @DarylChris
      @DarylChris Месяц назад

      Hello @kaloprojects please is there a way to contact you, through email or something, I am stuck on a project and desperately need your help

  • @francegall-web9819
    @francegall-web9819 3 месяца назад +8

    In the next one you build, add an AI-THINKER VC-02 so that it is automatically activated by voice without pressing the switch.

  • @HLX01Creater
    @HLX01Creater 3 месяца назад +5

    I am trying to make all this using ESP8266, and I have actually worked on it for the last 30 days, not continuously but with a little change according to your thinking. Like, I have put this system in my wristwatch like a hidden spy. I have already made the script for ESP8266, it is working but only the part of STT and TTS is left. This is very challenging for me, like custom script or something more. But now I am copy-pasting and thank you very much for this video.

    • @lavanyabhamidipati992
      @lavanyabhamidipati992 2 месяца назад

      hi what speaker and mic did you use for this project

    • @HLX01Creater
      @HLX01Creater 2 месяца назад

      @@lavanyabhamidipati992 use the ESP32-C3 Super Mini. For the microphone, I use the xcluma INMP441 Omnidirectional High Precision MEMS Microphone Module with I2S Support.

  • @dipanshudhote5671
    @dipanshudhote5671 3 месяца назад +3

    Hi everyone, i tried this project and found the way to avoid use of SD card by directly using SPIFFS memory which can be able to store 220 seconds of audio at 8k and 8 bit which is more than enough, for this AI assistant purpose we genrally need about 5-10 seconds, so i think it is the most reliable way to use it, also it will boost some speed for reading and writing files...

  • @johnny14794
    @johnny14794 3 месяца назад +13

    Wow! Super interesting project! How about porting that sketch to a device available in the market like a M5 Cardputer, a Lilly-Go T-Deck, a Lilly-Go T- Embed, etc? Those devices include everything needed to just get it up and running as long as the proper libraries are placed into the Arduino Library, then burn the sketch on them. Since many of us don't have the skills to assemble stuff on a PCB board, get the parts needed and can't even solder a button? Other pre-made devices that have ESP32 S3 chips, SD card slot, speaker, buttons, battery connector, lights, screens, microphone, etc, the ones I mentioned would save many of the pains on building our own from scratch. I do see your point of creating home made projects though. I wish I had the skill you have and the talents of creating these IoT's. I love gadgets, but lack the programming aspects of these ESP32's. It's why it's a blessing to have you available in YT. Thanks for sharing this video brother! Stay safe and blessings!

    • @techiesms
      @techiesms  3 месяца назад +4

      Based on your suggestion I’ll try to do with other boards that I have

    • @johnny14794
      @johnny14794 3 месяца назад +1

      @@techiesms Looking forward to seeing your next video related to the sketch on other boards/devices. Take care and blessings. 🙏✨

  • @jeremygeorgia4943
    @jeremygeorgia4943 19 дней назад

    As has been mentioned, it would be nice for the project to be operated with a wake word, so that you didn't need to push a button. It might also be nice, for it to recognize certain words and phrases & activate some subroutines, to control devices attached to it. If there aren't enough I/O ports, maybe it could send messages to nearby ESP32 devices & activate equipment that way. What I'd like to use it for, is for creating a voice interactive robot, that you could control with your voice. Perhaps, it could follow you, or take pictures with its camera, after being to told to do so, with a voice command. Maybe, it could communicate with a Raspberry Pi or other computer, to figure out answers, without the Internet.

  • @marshallmann7620
    @marshallmann7620 3 месяца назад

    WOW AMAZING DETAIL!! THANK YOU!! YOU ARE AWESOME!!!!!!!

  • @dishsadanu8979
    @dishsadanu8979 20 дней назад

    Thank you for what I learned from you in Sri Lanka

  • @jaydebkarmakar624
    @jaydebkarmakar624 3 месяца назад +1

    I would like suggest you to make a Google assistant device using raspberry pi zero. There are no detailed tutorial videos on this topic.

  • @anlpereira
    @anlpereira 3 месяца назад

    Very interesting project. From this you can make a project that can send commands to control your house. I love it.

  • @sriharin8641
    @sriharin8641 Месяц назад +2

    can you make a simple circuit just like gpt in esp? please!

  • @braveonder
    @braveonder 3 месяца назад

    Great work. Thank you for your great support.

  • @yashrajshah7766
    @yashrajshah7766 2 месяца назад

    You can bulid a live language translator with this, which will be super useful.

  • @DreamScapeRobloxStudio
    @DreamScapeRobloxStudio 3 месяца назад +1

    Just wanted to know how did you guys solder the small components with the pcb ?

  • @Talha80777
    @Talha80777 10 дней назад

    Hello. First of all, thank you very much for sharing each and every detail of the project. I have one query regarding the schematic, what is the purpose of Q1 MOSFET?

  • @mukulsunda
    @mukulsunda 3 месяца назад +1

    Can we add a ov2640 module and send a frame to gemini api when a particular word like “what am i seeing” and get response?

  • @ShayanV-w2c
    @ShayanV-w2c 3 месяца назад

    bro you are really intelligent

  • @iOT_India
    @iOT_India Месяц назад +1

    please integrate more AI MODELS like LLAMA, etc.

  • @fusseldieb
    @fusseldieb 3 месяца назад

    I literally had the same idea one week ago. Even built a prototype hahaha
    Best of all: With the same components, even.

    • @sarathkumar785
      @sarathkumar785 3 месяца назад

      teach me bro

    • @techiesms
      @techiesms  3 месяца назад

      LOL
      No issues, Now you can easily make it with the help of this video

    • @SarathkumarP-mu3ob
      @SarathkumarP-mu3ob 3 месяца назад

      @@techiesms bro did u have any connection diagram

  • @its_yuno.
    @its_yuno. 3 месяца назад +2

    use sim for internet connection please . Then we can use it without wifi and mobile

  • @60pluscrazy
    @60pluscrazy 3 месяца назад +1

    Good one, but instead of onboard coding, we should use a free cloud hosted endpoint. It will be better allowing us our own custom knowledge and more 🎉🎉🎉

    • @techiesms
      @techiesms  3 месяца назад +1

      I didn't get your point. Can you elaborate

    • @artisticyeti22
      @artisticyeti22 3 месяца назад

      The esp code cannot be off loaded 😂. The software that can be off loaded has already been off loaded and mentioned as so in the video

  • @RealSnail3D
    @RealSnail3D 3 месяца назад

    Awesome video!

  • @SallyCrest
    @SallyCrest Месяц назад

    Amazing project! Do you think that maybe you'll be offering the gerber files for this project in the future so some of us can order custom PCBs from PCBGOGO in the future?

  • @tsshadowff
    @tsshadowff 3 месяца назад

    Please make a video of making it with easy ways! ❤

  • @shashivadhangunti3411
    @shashivadhangunti3411 3 месяца назад +1

    yha hai i am a B-Tech final year student i thought of making a smart device with Raspberry pi 4 where the os look like Ai, And if we ask any thing it will show in display and respond like alexa indirectly an alexa with a display any idea for it

  • @apexdc07
    @apexdc07 2 месяца назад

    @techiesms I have an esp32 lyraT 4.3 board on which I have installed alexa using esp32-adf sdk, just curious if I can use this code on same with all required components already present on the board.

  • @basicelectronics6324
    @basicelectronics6324 Месяц назад

    Please make a video on streaming the song from Spotify using esp32 and audio decoder module, it's very useful for us.

  • @k2r.253
    @k2r.253 3 месяца назад

    Thank you sir ❤

  • @bens4446
    @bens4446 3 месяца назад +1

    Wow, bravo. I did something similar (in python) on a 2gb RAM le Potato (minus the convenient button features, BMS, etc.). Didn't think this would be possible on a microcontroller with 520kb RAM. It does seem a bit slow at times in your demonstration, at least compared to my 2gb version. Could this be sped up with streaming? Or do you already include streaming in your .ino code? Very nice project!

    • @kaloprojects
      @kaloprojects 3 месяца назад +2

      I am also working on the idea to extend my recording library with Streaming (streaming I2S bytes realtime from microphone to Deepgram 'during' recording).. but this is crazy complex at least for me (with ESP32 & C, maybe easier in Python, which i won't use on ESP due several reasons), not sure i will ever get int work :D . We will see.

    • @devbiceps1628
      @devbiceps1628 3 месяца назад +1

      ​@@kaloprojects would love to check that out

  • @baotrangia3417
    @baotrangia3417 3 месяца назад

    Fantastic Assistance Portable (FAP) !!!

  • @Shorts01-f3h
    @Shorts01-f3h 3 месяца назад +1

    Kaise kharede ya wala circuit board

  • @sinmim1
    @sinmim1 3 месяца назад

    Nice project 🎉

    • @techiesms
      @techiesms  3 месяца назад

      Glad you like it!

  • @Rgkroger
    @Rgkroger 5 дней назад

    lindo seu projeto amigo
    seria possivel acopla esse seu projeto a rede de comunicação na rede can do veiculo para comandar algumas funções

  • @electriquefarmaci
    @electriquefarmaci 3 месяца назад

    Maintenance mode is on
    Site will be available soon. Thank you for your patience!

  • @takayasushuto4176
    @takayasushuto4176 3 месяца назад

    最高です!
    Tシャツ欲しい。

  • @ajuxx
    @ajuxx 3 месяца назад +1

    Hlo bro can you share the circuit diagram for making it on a zero pcb board without the smd components
    I seen the Schematic diagram i dont understand that make it simple plz

    • @ajuxx
      @ajuxx 3 месяца назад

      @techiesms reply me

  • @ha13151
    @ha13151 3 месяца назад

    Perfect!

  • @TheRajeev7778
    @TheRajeev7778 3 месяца назад +1

    Hello,Any plans to provide this as building kit?

    • @techiesms
      @techiesms  3 месяца назад +1

      Building Kit Means?

    • @TheRajeev7778
      @TheRajeev7778 3 месяца назад

      @@techiesms components and pcb

  • @pravinabaldha7240
    @pravinabaldha7240 3 месяца назад +1

    I have interesting idea and I am currently working on that I want to make tutorial of that like how to mke fully independent ai pocket device compact in size and has voice assistants and object recognization and has display on it and showing captions on that portable and use with sim card maybe thats great idea for your channel can you please make that ❤

  • @KiteTurbine
    @KiteTurbine 3 месяца назад +1

    Brilliantly clear tutorial. The soldering seems to happen by magic

  • @shock2k3
    @shock2k3 3 месяца назад

    make an 3d printed case for better convinence

  • @NOOBKRISH
    @NOOBKRISH 3 месяца назад

    Can we add multiple wifi said and pass so it will connect to any avilable

  • @UniqueIdeas151
    @UniqueIdeas151 2 месяца назад

    Bro can i use esp32 with micro USB port with out using USB to ttl converter system

  • @rummankarin6332
    @rummankarin6332 2 месяца назад

    bro can you please make a voice module price frendly in veroboard with deepgram and esp32 which is full pack of (alaxa or chtgpt)

  • @shardulambikecs1192
    @shardulambikecs1192 2 месяца назад

    Can this Gemini AI control things over esp32 like house automation , or servos , or leds in any project ?

    • @techiesms
      @techiesms  2 месяца назад +2

      Not exactly
      But to do that you can use the speech to text response and compare it to control the appliances

  • @mabrurareefinroll4625
    @mabrurareefinroll4625 2 месяца назад

    brother, your schematic doesnt show all the components you used. like resistors, battery monitoring circuit. can you please please tell me every component you used and how many

  • @gopash
    @gopash 3 месяца назад

    It can be turned into the business of bilingual interpretation .
    But can it be operate offline?

  • @chandrakalashinde8960
    @chandrakalashinde8960 2 месяца назад

    We can make device to anytime listening

  • @MikaKaito
    @MikaKaito 10 дней назад

    Hello sir, Can I get this product along with display extension to check text, if you make so, I will buy this product sir, please add this on?

  • @2butgaming991
    @2butgaming991 Месяц назад +1

    I want to buy this completely assembled hardware but on ur website its showing it will be back on 30th November can u help me out to get it sooner 🙏

    • @techiesms
      @techiesms  Месяц назад +1

      Sir it’s not in stock
      We ordered it and waiting for the delivery of components

    • @cerlpearl
      @cerlpearl 21 день назад

      @@techiesms how many days after 30th will we get the product ( living in Mumbai )

    • @techiesms
      @techiesms  21 день назад

      @cerlpearl kindly share the pincode on our WhatsApp
      8200079034

  • @ShubhamSen-dn1ub
    @ShubhamSen-dn1ub 3 месяца назад

    Add NXP local voice recognition ic to this

  • @sudharsana5439
    @sudharsana5439 2 месяца назад

    How is this different from Google assistant?

  • @armisis
    @armisis 3 месяца назад

    It's rabbit r1 with the latest patches.

  • @usmanumer9871
    @usmanumer9871 3 месяца назад +1

    Maza a gaya is project say . Alampana Tusi great ho tofa Kabul Karo .🎉🎉

    • @techiesms
      @techiesms  3 месяца назад +1

      Bs kr pagle, Rulayega kya....

  • @Sri_Harsha_Electronics_Guthik
    @Sri_Harsha_Electronics_Guthik 3 месяца назад

    try edgetts?

  • @darshandarshu1906
    @darshandarshu1906 2 месяца назад

    Which software used for 3d vision

    • @techiesms
      @techiesms  2 месяца назад

      It was 3-D view in easy EDA

  • @VYR4Z
    @VYR4Z 2 месяца назад

    I would like to integrate it with a sim card so that it doesn't require to connect to any hotspot

  • @harshsaini5979
    @harshsaini5979 2 месяца назад

    Kitne paise lg jayenge ise bnane me including all parts and pcb and assembling them

    • @techiesms
      @techiesms  2 месяца назад

      We are selling it already through our website

  • @hippopothomas1980
    @hippopothomas1980 3 месяца назад

    Thanks!!!

  • @m.shayanshamim1202
    @m.shayanshamim1202 3 месяца назад

    Plz Send the circuit diagram in easy manner for without PCB makers

  • @MikeNugget
    @MikeNugget 3 месяца назад

    Awesome

  • @JohnKourdomenos
    @JohnKourdomenos 3 месяца назад

    Can the code be entered into a Panel touch screen ESP32-4848S040 so that we can see the answer on the screen ?

  • @ArtBuddyIndian
    @ArtBuddyIndian 3 месяца назад

    what will be the application of this project

  • @harshsaini5979
    @harshsaini5979 2 месяца назад

    Hi @techiesms can you name all the parts or components used in this project and also all things simply and easy to understand because i am just a beginner and don't know about it anything but I want to make this

    • @techiesms
      @techiesms  2 месяца назад

      You can refer this schematic to check out all the parts

  • @kavinesar4559
    @kavinesar4559 3 месяца назад

    bro is this capable of real time data like time date and weather

  • @NOOBKRISH
    @NOOBKRISH 3 месяца назад

    can u pease make a 3d case fr this

  • @clips4399
    @clips4399 3 месяца назад

    what if we add a display to it, please make it

  • @_s2700
    @_s2700 3 месяца назад

    Can we run this locally......?

    • @techiesms
      @techiesms  3 месяца назад

      no. its over internet

  • @anbur1790
    @anbur1790 3 месяца назад

    Bro your chatgpt voice assestant v2 speech to text library file is error occur (compile time)give me any solution

  • @elisalant
    @elisalant 3 месяца назад

    Do you ship to Australia

    • @techiesms
      @techiesms  3 месяца назад

      Yes.
      Kindly WhatsApp us on +91 82000 79034

  • @VettivelSivakumari
    @VettivelSivakumari 3 месяца назад

    Does the hardware cimw in srilanka

    • @techiesms
      @techiesms  3 месяца назад +1

      Yes
      Kindly WhatsApp on +918200079034

  • @harshsaini5979
    @harshsaini5979 2 месяца назад

    Can I buy the complete built hardware part without buying pcb from pcbgogo

    • @techiesms
      @techiesms  2 месяца назад

      You can buy complete hardware assembled on PCB from our website

  • @Patapom3
    @Patapom3 3 месяца назад

    That's great but you're entirely dependent on 1) an internet connection and 2) 3rd party services...

    • @techiesms
      @techiesms  3 месяца назад

      It’s a DIY project so I guess it’s ok…

  • @ridwanmulyana99
    @ridwanmulyana99 3 месяца назад

    can you make faster reply from the device ?

  • @vimal_jayavel3007
    @vimal_jayavel3007 3 месяца назад

    Where did get pcb bro ?

    • @techiesms
      @techiesms  3 месяца назад +1

      We are not selling PCB, rather we are selling the complete project

    • @vimal_jayavel3007
      @vimal_jayavel3007 3 месяца назад

      @@techiesms assemble project or compounds of project?

  • @gjreditor9835
    @gjreditor9835 3 месяца назад +3

    You can use Deepgram itself for text to speech too. You won't have the hassle of chunking the response text. Just like 750 hours of voice to text free, Deepgram text to voices is free up to 250 hours.

    • @kaloprojects
      @kaloprojects 3 месяца назад +1

      you are right, Deepgram offers TTS .. but as I know they do NOT offer any languages beyond English (as today). The Open AI TTS voices are multilingual, each of the 6 voices can speak multiple languages (even changing language in one sentence). And i could not find any ESP32 library supporting their 'steaming concept' for TTS. If you know a library or function call, let us know please!

  • @ManoranjanMithas
    @ManoranjanMithas 3 месяца назад

    Sir di chij bata do google tts free kaise mile Or sir second chij sir ye esp8266 se kar sakte h

  • @syedmutahir1917
    @syedmutahir1917 2 месяца назад

    good vido

  • @inhlapngo1601
    @inhlapngo1601 3 месяца назад

    Could you please share your PCB gerber file?

  • @phamhuan3187
    @phamhuan3187 2 месяца назад

    Please guide free speech to text without entering a credit card

    • @techiesms
      @techiesms  2 месяца назад

      It uses free speech to text using deepgram
      Watch out this video to learn in detail ruclips.net/video/j0EEFXmikvk/видео.htmlsi=zB3m56n5FjoxvULI

  • @hassansiddiqui5282
    @hassansiddiqui5282 2 месяца назад

    can u provide the gerber file for the pcb?

    • @techiesms
      @techiesms  2 месяца назад

      No sorry
      But you can find the schematic in the video

  • @jesus__voice_for_all8865
    @jesus__voice_for_all8865 Месяц назад

    Sir can I know the actual cost of the product

  • @rockfireist
    @rockfireist 3 месяца назад

    Helo bro where is schematic diagram,, can u provide link plz...

    • @techiesms
      @techiesms  3 месяца назад

      Its in the GitHub repo.
      the link is in the description

    • @rockfireist
      @rockfireist 3 месяца назад

      @@techiesms thanks bro....

  • @sakaidosan
    @sakaidosan Месяц назад

    ERROR in Record_Start() - I2S not initialized, call 'I2S_Record_Init()' missed, I'm getting this error when pressing record button, please help

  • @hmalamgir3489
    @hmalamgir3489 3 месяца назад

    Price

  • @eyeofsanatan
    @eyeofsanatan 3 месяца назад

    sir i am buying one iot project from your website but i have only 1500 rs, and it is of 2922, its multi pursose gps tracker kit, please tell me u can help me or not because i requre it for my project please sir 😢

  • @CuriosityChronicles-we5cu
    @CuriosityChronicles-we5cu 3 месяца назад

    I am really intrestest in build various kind of project but due to the cost and desire component availability i cant build one , i have a request if u could develop a affordabe micricontroller board under 200 rupess having type c interface for programming and power wifi connectivity, as well as consisting of all type of communication interface if possoble like i2c,i2s,uart,spi and also if possible can bus having small foothprint with castaleted pins and also inbuilt charging ic if possible but i know it difficult to build this within such a low cost , but even if u could add a type c port to the node mcu esp8266 and launch it on your website i would really like to purchase it even my friend ones one for our project i really want a affordable mcu under 200 to tinker and learn on it plz share this comment as much as possible

  • @VYR4Z
    @VYR4Z 2 месяца назад

    Can i get the files for pcb pls?

  • @electriquefarmaci
    @electriquefarmaci 3 месяца назад

    can we get in touch

  • @hemanthkumarmp1886
    @hemanthkumarmp1886 3 месяца назад

    Sir can you send me the circuit diagram

    • @techiesms
      @techiesms  3 месяца назад

      Schematic is provided in GitHub
      Check description for link

  • @meetpatel5142
    @meetpatel5142 3 месяца назад +1

    ❤❤🤩🤩🤩🤩

  • @cgkinggaming5258
    @cgkinggaming5258 Месяц назад

    Hey sir i am ur customer can i know how to charge it ?

    • @techiesms
      @techiesms  Месяц назад

      Via Type C connector

  • @hemanthkumarmp1886
    @hemanthkumarmp1886 3 месяца назад

    Sir can u send the code

  • @psykopat81
    @psykopat81 3 месяца назад

    Why do I need such a device when it is installed on my phone (I ask to learn, not to criticize)

    • @gjreditor9835
      @gjreditor9835 3 месяца назад

      For making standalone device. If you can program in Android, everything being done by ESP32 OR any microcontroller can be done with mobile phone. One more thing to note is that phones have become more and more restrictive - even Android kills apps if running in background . So, unlike in past , you can't even run GPS apps or sms responder apps or any such interesting program in background for long.

    • @destiny_02
      @destiny_02 3 месяца назад

      ​@@gjreditor9835you must be using some Chinese phone with their custom android variants. They are known to aggressively kill background apps, but with some effort that behaviour can be changed in settings.
      this is not an issue in stock android as long as you have ample ram.

  • @huyifan83
    @huyifan83 3 месяца назад

    Why it has an Indian accent? 😂😂

    • @techiesms
      @techiesms  3 месяца назад +1

      lol
      May be I Choose language as Indian English

  • @looloopo2449
    @looloopo2449 3 месяца назад

    😂😂😂😂😂

  • @ajuxx
    @ajuxx 3 месяца назад

    First

    • @techiesms
      @techiesms  3 месяца назад +1

      WOAH...
      Thanks for your first view 👍🏻👍🏻

  • @adityajain3485
    @adityajain3485 3 месяца назад

    I am not able to use smd component pls help

    • @techiesms
      @techiesms  3 месяца назад +1

      Just try to get the DIP component of the same value from the market and try to build one
      We have already shared the schematic on GitHub

    • @navneetdhal0021
      @navneetdhal0021 3 месяца назад +1

      ​@@techiesms DIP is still smd. I guess you mean THT.

  • @mohammedsafwan9168
    @mohammedsafwan9168 3 месяца назад +1

    Wow so nice
    Great idea keep it up bro 👍🎉
    Can I get your WhatsApp number?

  • @UniqueIdeas151
    @UniqueIdeas151 Месяц назад

    Bro can i use esp32 with micro USB port with out using USB to ttl converter system