AI Body Language Decoder with MediaPipe and Python in 90 Minutes

Поделиться
HTML-код
  • Опубликовано: 6 ноя 2024

Комментарии • 373

  • @hargobindsingh9763
    @hargobindsingh9763 3 года назад +24

    One of the most professionally made video tutorial on the whole of youtube, keep making brilliant videos like these
    I find this to be the best video under the mediapipe series. Congratulations for the gift you have and thanks for sharing it with us

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +2

      Thanks sooo much @Hargobind, so glad you enjoyed it!!

  • @NiKiTjA_OFF
    @NiKiTjA_OFF 8 месяцев назад +2

    I wanted to detect my hand pose as an object. So I went to tensorflow - 2 days of configuring. Made autolabel with groundingDINO - 3 days of configuring. And now I found this. 1 Hour and the model's ready to detect in real time... DAIM what I was doing this 5 days?!
    And thanks A LOT for your effort, also for that particular thing, when you shown how to add a bunch of new staff to the existing model

    • @one_done_facts
      @one_done_facts 5 месяцев назад

      HI. you can send requirements.txt string , please!

  • @friedafrikadelle9483
    @friedafrikadelle9483 3 года назад +18

    I just discovered your channel and I‘m obsessed. Thank you so much for doing such great content🙏🏻🙏🏻🙏🏻

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +3

      Thank you so much @Frieda, so stoked you're getting value from it!

    • @Virtualexist
      @Virtualexist 3 года назад +2

      Me tooo !!!!!

  • @francis3725
    @francis3725 3 года назад +5

    One of the best programmer guide out there! I love how you explain into detail on what you did and why you did it, helps someone like me who is learning just from youtube! I'm gonna try and create my own project based on this program for boxing. Which can detect what time of move a person is doing and can give pointers if that person is not using the proper technique, wish me luck!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      🙌🙌🙌 sending you all the luck, you'll smash it @Francis!

    • @harshdasila6680
      @harshdasila6680 2 года назад

      have anyone actually implemented this code Please let me know Very urgent !!

  • @ameensamhan751
    @ameensamhan751 2 года назад +1

    The most professional easy to understand and implement tutorials on youtube. You really are the best.

  • @shivlymizi3211
    @shivlymizi3211 8 месяцев назад

    Hey I'm working in a body and face emotion detection for my paper, but I couldn't find sources that could help me, but after seeing your video and the way everytime you'll explain every bit of code is really appreciated, this actually sparked that interest in coding for me again, thank you for being very caring you're amazing

    • @one_done_facts
      @one_done_facts 5 месяцев назад

      HI. you can send requirements.txt string , please!

  • @KriGeta
    @KriGeta 3 года назад +1

    So awesome, is there any way to control a 3D model in blender using this body estimation technique? Like motion capture?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Haven't seen it in blender but I've seen it in Unity using the Barracuda framework!

    • @KriGeta
      @KriGeta 3 года назад

      @@NicholasRenotte may you pls tag me a tutorial?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      @@KriGeta don't have anything yet but will shoot it through once it's up!

    • @KriGeta
      @KriGeta 3 года назад

      @@NicholasRenotte that's great 😍

  • @EduardoGarcia-tv2fc
    @EduardoGarcia-tv2fc 3 года назад +1

    your tutorials are the best tutorials I have seen in my life, congratulations!

  • @VikramSaigal
    @VikramSaigal 3 года назад +4

    Hi Nicholas, great stuff. I thoroughly enjoy your tutorials as they are mind blowing, I'd love to have a tutorial on pose deviation comparing poses of two people. Awesome work man!!!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +2

      Awesome usecase, I'll add it to the list. Never even thought about comparing poses!

  • @isaackay5887
    @isaackay5887 3 года назад +2

    Looking forward to watching this later!! Thank you for all the quality videos. Have a great one!

  • @danielamemba5307
    @danielamemba5307 3 года назад +1

    The 210th comment is dedicated to the best content on RUclips. Period! Though late, I am lucky to have discovered your channel. Subscribed and notifications turned on!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Anytime my guy, better late than never, WELCOME TO THE FAM!!!

  • @srirammadduri8078
    @srirammadduri8078 3 года назад +2

    Man! Your tutorials are really really cool!! And DAMN RIGHT we want a bigger data science series!!!!!
    Awesome work man!!! Cheers!!!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +2

      YESSS! So glad you enjoyed it!

    • @srirammadduri8078
      @srirammadduri8078 3 года назад +1

      @@NicholasRenotte Mann! I thought you wouldn’t respond!
      Im in my junior year of college and am currently doing a machine learning project. I have few doubts and I believe you could help me with it. It would great if you could tell me how to reach out to you and I can get them clarified!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      @@srirammadduri8078 nah man! I try to get to all comments. Hit me up on Discord, I check every night and if crazy every second night. bit.ly/3dQiZsV

  • @emelsoylu3002
    @emelsoylu3002 2 года назад +1

    Your videos are very descriptive and useful. Your content is of high quality. Thank you.

  • @CalebSchantzChristFollower
    @CalebSchantzChristFollower 3 года назад +6

    Awesome content!! I know I mentioned this in a previous video but I would still love to see a “virtual coach” type implementation. Something that goes beyond just static poses but actually tracks a movements key points over time and could detect form quality by comparing them to a “good form” and “bad form” example.

    • @eddysaoudi253
      @eddysaoudi253 3 года назад

      Exactly.

    • @friedafrikadelle9483
      @friedafrikadelle9483 3 года назад

      Yes!!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +2

      Yup! Got it planned but it'll be a longer tutorial, just taking a little recovery break from long vids this week. Should do it in the next couple of weeks though @Caleb!

    • @CalebSchantzChristFollower
      @CalebSchantzChristFollower 3 года назад +2

      No hurry, you are already putting out content at a crazy pace! Take that break!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +3

      @@CalebSchantzChristFollower oh thanks man, I honestly needed to hear that it's okay! Been feeling a little bad I haven't hit my two a week since I released the big TFOD tutorial.

  • @nurulsyifa9035
    @nurulsyifa9035 3 года назад +2

    so can i actually use this to detect more sign languages using those joints...... man u actually helped a lot in giving people ideas and inspiration. will always support ur youtube channel!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Thank you so much @Nurul! You could particularly with the hand models! Could even pass to a RNN for action detection!

    • @yuriemond7340
      @yuriemond7340 3 года назад

      @@NicholasRenotte I tried to look online to find documentation on how you would pass to a RNN for action detection, but didnt find anything significant. Do you have documentation or video you could share with us? :D

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      @@yuriemond7340 definitely, take a look at some of these action models: tfhub.dev/s?q=action

  • @marcfinger4549
    @marcfinger4549 2 года назад +1

    Your channel has helped me so much when working on my dissertation. Thank you 🙏

    • @NicholasRenotte
      @NicholasRenotte  2 года назад +1

      YESSSS, go getem Marc! Hope you smash it out of the park!

  • @brucewayne9708
    @brucewayne9708 3 года назад +3

    hey can we use this to do real time sign launguage . If we can use this please do a video on it.Thank you

  • @priyambordoloi771
    @priyambordoloi771 3 года назад +3

    Good job brother. I will always appreciate the tasks that you do.

  • @shahdsg4527
    @shahdsg4527 2 года назад +1

    Thank you so much!!!!!
    Please can i do same steps for sign language recognition instead of using mediapipe+LSTM ???

  • @firthmanee7735
    @firthmanee7735 3 года назад +1

    Thanks for the great video as always !!, May I ask a question If I want to count how long for the specific position what should I do , do you have any suggestion ? , Thanks in advance.

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Could look at counting the number of frames that position had the top score!

    • @firthmanee7735
      @firthmanee7735 3 года назад

      @@NicholasRenotte Thanks !!

  • @shortcomedyclip
    @shortcomedyclip 3 года назад +1

    Thats Awesome!
    For facial expression recognition do you recommend using facial landmarks as the base features for training with DNN, or using CNN directly on the image dataset?
    Thanks

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      I prefer using the base features with a classifier as if you were to detect multiple faces you could apply the model across each face (FYI this model only detects a single face) but also because it's faster to train on tabular data!

  • @prodbyrish
    @prodbyrish 3 года назад +2

    This is so cool! Can I set this up to only detect poses I make with my hands?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Yup, there's mediapipe models that only detect hands as well. I've got a vid on the channel!

    • @prodbyrish
      @prodbyrish 3 года назад

      @@NicholasRenotte Got it! Il check it out!!

  • @wanjohichristopher8556
    @wanjohichristopher8556 3 года назад +2

    Hi Nicholas,i love the content you make.Much thanks for sharing. Can we deploy this??

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Sure can! Been messing around with Kivy for CV (could probs do that).

  • @shalomsonekar6985
    @shalomsonekar6985 3 года назад +1

    This is really awesome , loved the way how you explained everything, great Job. Really Thankful for this. 💯
    THANK YOU SO MUCH BRO ! KEEP HUSTLING ❤️

  • @prtdesh25
    @prtdesh25 3 года назад +1

    Heyy!! Nice video actually I was looking for something like this but is this way generalized. Will this model work on different faces.

  • @KamalMahss
    @KamalMahss 6 месяцев назад

    first, i want to thank you about this big effort.
    second, can you make a video about fall detection using media pipe please
    this video will help me a lot

    • @one_done_facts
      @one_done_facts 5 месяцев назад

      HI. you can send requirements.txt string , please!

  • @fisiologicageral
    @fisiologicageral 7 месяцев назад

    Hi there. Great video, tanks. Can I use a ply file instead a live webcam? I need to evaluate some children and want to use 3d scan (kinectics) and posterior analisys.

  • @victormustin2547
    @victormustin2547 3 года назад +1

    I'd love to have a tutorial where you use the face geometry module from mediapipe. And maybe add some 3D models tracked to the face like glasses ! Great video as always :)

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Yah, agreed! Working on a bunch of stuff in that space rn @Victor!

    • @victormustin2547
      @victormustin2547 3 года назад +1

      @@NicholasRenotte Amazing ! I’ll be there to see it as soon as it comes out !

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      @@victormustin2547 yesss! Thanks a bunch for checking out the vids so far as well!

  • @stanley-elmagico
    @stanley-elmagico Год назад

    Awesome video btw, I'm currently trying to recreate the model in my local machine. However, seems like I fail to append the different classes of poses/facial expressions, how can I change this?

  • @finance315
    @finance315 3 года назад +2

    thats so cool! i have a question, how can we fix the flickering at then when it's running?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      It would need a more powerful GPU or machine. The lag is due to the FPS drag from the ml model.

    • @finance315
      @finance315 3 года назад +2

      @@NicholasRenotte i have fixed it!! now running at 10 to 12 FPS, thats still good. thank you so muchhhh

  • @ima_lc
    @ima_lc 3 года назад +1

    Only you have the best python vidos on RUclips. Greetings from Russia)

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Thanks so much @ONE! What's happening from Sydney!?

  • @talhaeneskoksal4893
    @talhaeneskoksal4893 2 года назад

    Thanks buddy for really helpful videos. Keep going, Wakanda Forever!

  • @FindMultiBagger
    @FindMultiBagger 3 года назад +1

    Thanks lots for great approch and hardwork 🙏♥️
    Question :-
    1) does it work for multiple person in frame ?

  • @mayamayonnala1712
    @mayamayonnala1712 3 года назад +1

    Awesome content. Is it also possible to train the csv file with tensorflow instead of sklearn? Looking forward to watching your other videos!!

  • @adityasawant1672
    @adityasawant1672 Месяц назад +1

    what will be chenges, if i wanted to make a .h5 model ?
    please replyy

  • @jonathonvandyke6328
    @jonathonvandyke6328 3 года назад +1

    Hi Nick, loved this video! I was wondering if you could go more into how to do hyperparameter tuning and building more advanced pipelines? Do you have other videos going more in detail on those? Thanks!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Nothing around it yet but will probably do something soon @Jonathon!

  • @abcd-zw9oh
    @abcd-zw9oh 3 года назад +1

    Love the content! Just curious would it be possible to use other videos and images to generate the landmark for different poses or facial expression and then our webcam to see if the model can detect ourselves doing the poses or facial expressions?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Sure can! I actually did it in the past with a video of the Royals being interviewed.

    • @satishchandrasekaran3045
      @satishchandrasekaran3045 3 года назад

      @@NicholasRenotte Hi Nicholas, wanted to commend on the awesome content, and format of presentation. Makes it easy to understand. Great job, and a huge thank you.
      Could you please point me to the video where you use other videos/pictures to train the model?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      @@satishchandrasekaran3045 still a work in progress at this stage!

  • @shai8559
    @shai8559 2 года назад

    really amazing content. im currently working on my final cs project and this video (and some others) were tremendous help for me.
    amazing job man!

    • @harshdasila6680
      @harshdasila6680 2 года назад

      have anyone actually implemented this code Please let me know Very urgent !!

    • @shai8559
      @shai8559 2 года назад

      @@harshdasila6680 i did. What you need?

    • @harshdasila6680
      @harshdasila6680 2 года назад

      @@shai8559 i am getting error

    • @shai8559
      @shai8559 2 года назад

      @@harshdasila6680 you can type the error and ill see if i can help

  • @nicolasabosch
    @nicolasabosch Год назад

    Great tutorial, i wish your channel have more visibility

  • @houstonkoh7614
    @houstonkoh7614 2 года назад +1

    thanks for the video
    I have a question:
    i was trying to export the coords but it didnt export to excel

  • @danielkristioutomo1344
    @danielkristioutomo1344 2 года назад

    Hey, Nicholas Thank you so much. Very useful. Highly appreciated. But can you help me how to make the decoder like the in the video works with hands too? specifically how to extract the hands landmark? thankyou

  • @faraazmohammed3693
    @faraazmohammed3693 3 года назад +1

    Hey, Nicholas Thank you so much. Very useful. Highly appreciated. you have awesome teaching skills. One Question is what it takes to extend this to Action detection. Can you please make one tutorial for custom action detection? Thanks

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Check this out! ruclips.net/video/doDUihpj6ro/видео.html

  • @soothingrelaxation8725
    @soothingrelaxation8725 3 года назад +1

    Your videos are amazing, still waiting for using unity to import those keypoints and rig them to a hand model. In the meantime any clue on how to do that? how to ring and which hand model to use?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Heya @Imane, was actually talking about it on Discord yesterday. I actually found someone that had an example on it the other. Let me know if you want me to try to dig up the link!

    • @soothingrelaxation8725
      @soothingrelaxation8725 3 года назад +1

      Heyy @@NicholasRenotte, yes if u can do that will be great! Thanks a lot for your help.

  • @이주현-r4w2b
    @이주현-r4w2b 11 месяцев назад

    Hi Nicholas! Depending on the position of the wrist, can you tell me the coordinates of the joint at that time??

  • @jmacron4652
    @jmacron4652 3 года назад +1

    Great tutorial....Can you do a tutorial where you can save body and facial motion to BVH or FBX files to use with a 3D Character..

  • @deepshrivastava229
    @deepshrivastava229 2 года назад +1

    Great Tutorial, very professionally and amazingly done. Thanks a lot !!! just an issue in loading the model again after restarting the kernel. Have to train the model every time when I open my jupyter notebook(cuz when loading the model in this condition it is not making predictions even after saving in pickel). Is there any way that I can keep the model intact even after I close the notebook or I have to train it everytime I open my notebook ? Please guide. Is there any way wherein I can save it not using pickel but using h5 format. Please guide !!

    • @NicholasRenotte
      @NicholasRenotte  2 года назад +1

      Pickle should work fine, are you sure the model is being saved? h5 is normally reserved for keras/tf models.

    • @deepshrivastava229
      @deepshrivastava229 2 года назад

      @@NicholasRenotte Firstly, A Big Thanks for the reply !!!! You Are AWESOME❤️❤️. I am saving the the model with pickel and its working fine for when I am making detections for the first time (just after training), but as soon as I close the notebook and open it the next time and load the same model its not making the detections, and I have to train it everytime. Hence I am unable to save/load it (i.e pickel might not be working or maybe I am doing something wrong in the last part). Can I do it using joblib as well ? Please guide. Thank you.

  • @shwetapatil1726
    @shwetapatil1726 3 года назад

    Hi Nicholas, your videos are great and they provide a lot of value. I have tried implementing many projects from your tutorials. I have one query regarding the accuracy of computer vision algorithms. Can we ever achieve accuracy around 99 percent for computer vision applications?

  • @hungduongquang795
    @hungduongquang795 3 года назад +1

    Do you know how to optimize the model for production? Great tutorial brother

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +2

      Probs a bunch of stuff to do so, want a vid on it?

    • @SohamMangore
      @SohamMangore 7 месяцев назад

      @@NicholasRenotte Yess !!

  • @shivamsingh-vv9vm
    @shivamsingh-vv9vm 3 года назад +1

    Let's try something in 3D. That will look great. The AI gym trainer in 3D would be great!!

  • @amilakelum2670
    @amilakelum2670 2 года назад

    This video help me in creating my final year project thanks lot ❤

  • @joinushugabear5847
    @joinushugabear5847 2 года назад

    Hi @Nicholas Renotte thank you for this nice tutorial. I was wondering how you could give the face detection data a bit more weight? So that I can do a classification that relies more on if i for instance smile or not? Or is that a training thing mostly? I still want the body language to count, but give more weight to the face in the model. Hope that makes sense? Cheers

  • @ZoeyZHANGYQ
    @ZoeyZHANGYQ Год назад +1

    Awesome content! But I have an error when running, how should I deal with it?
    UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names
    warnings.warn(

    • @SohamMangore
      @SohamMangore 7 месяцев назад

      facing the same error, did u find any solution ?

  • @gameofwealth12
    @gameofwealth12 3 года назад +1

    I just discovered your channel and Learned So much about Machine Learning. Could you help me in my project? My Project is Classification of Bad and Good Sitting Posture. How would you deploy this in raspberry pi and send data to mobile application? Hoping for your response and tutorials on this. Thanks! I totally in love with your contents

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Heya, you couldi fine tune this model for good and bad posture and deploy the same code to RPi!

  • @nadila3416
    @nadila3416 3 года назад +1

    hi! awesome video bro! what if we want to convert it into a desktop application or web application?

  • @CreatingUtopia
    @CreatingUtopia 9 месяцев назад

    @Nicholas Renotte , please reply, instead of classifying body language, we can detect spoken words with lip movement right?? Using lips coordinates

  • @tasarm4939
    @tasarm4939 3 года назад +1

    hey man ıhave been followin you for a while you done greeaaat jobs your channel is like a full stack course of data science thank you so much for that.
    but ı really wantto know why are you doin that ı mean beside of a youtube content what do you expect from your projects ? is that something about your IBM carreer ? (like a part of portfolio ? )

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +2

      Ayyye, anytime man, glad you like it. I'm just doing it because I enjoy it at the moment 🙂

  • @MsSonoFelice
    @MsSonoFelice 3 года назад +1

    Hi Nicholas !Thank you for nice work sharing. May i know the way to increase the fps for mediapipe . i have very low fps as 1 to 2 fps only. Kindly advice. thank you

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Heya @MsSonoFelice, what type of machine are you running this on? Possibly try a different machine, something with a GPU perhaps?

  • @amalendhu8610
    @amalendhu8610 3 года назад +1

    Hey brother, I like your content, your presentation. And a request, can you build a project on a sentence generator when some words are only given.

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Yup! Check this out: ruclips.net/video/cHymMt1SQn8/видео.html

  • @aysuncag4545
    @aysuncag4545 2 года назад +1

    This is a perfect project.. Does anyone know, can I use my Keras model for this code?

    • @NicholasRenotte
      @NicholasRenotte  2 года назад

      Yep, sure can, in place of the sk classifier!

  • @mohammadadnan5988
    @mohammadadnan5988 3 года назад +1

    I trained my model and it's working fine. I have one issue. My application has to do the estimation on a whole classroom. How can we apply this to a group of people? It just detects one face per pic. Would really love some suggestion.

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      There's a new pose estimation model available that supports multi person! Check this out tfhub.dev/google/movenet/multipose/lightning/1

  • @naratilife
    @naratilife 2 года назад

    Excellent Presentation. Just loved it.

  • @shudarshankongkham198
    @shudarshankongkham198 2 года назад

    how do we put the threshold on the prediction?
    also, thank you for all the effort you put into each modules.

  • @tedbryantesoro
    @tedbryantesoro 2 года назад

    hello thank you for this tutorial i was wondering if you can use a group of still image as a dataset instead of manually recording pose

  • @danieladama8105
    @danieladama8105 3 года назад +1

    Just what I needed. Thank you

  • @creathyang9413
    @creathyang9413 2 года назад +1

    Excellent vid man, thanks

  • @אביטלמהגרפטה-ס4ו
    @אביטלמהגרפטה-ס4ו 2 года назад

    Hi Nicholas , thank you about the stuff , now in my study i work about AI application of fitness training . I would like to get help from you, I need the detection all the body joints.

  • @winniepooh2533
    @winniepooh2533 3 года назад +1

    Hey Man...! You are really cool!!!! I love this project, I'm your new subscribers!!!!

  • @lakpatamang2866
    @lakpatamang2866 3 года назад

    My model is very confident to non trained labels. Suppose, if i do nothing and just stay in the frame, the model still predicts one of the action with high confidence value. How can we solve such problems? Do you have any idea regarding such issues?

  • @hazemhossam2645
    @hazemhossam2645 3 года назад +1

    Great video!! I have a question, how can I enable the code to detect more than one person in the frame (scene)?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Heya @Hazem, not supported in MediaPipe unfortunately, check out OpenPose for multiple person tracking!

    • @hazemhossam2645
      @hazemhossam2645 3 года назад +1

      @@NicholasRenotte What library would you recommend if I want to make a counting system for people in a scene ?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      @@hazemhossam2645 take a look at OpenPose, you could then count the number of detections!

    • @hazemhossam2645
      @hazemhossam2645 3 года назад

      @@NicholasRenotte Tysm. Do you recommend any video/link about Openpose to start with?

  • @anthonysoronnandi1459
    @anthonysoronnandi1459 2 года назад

    I want to combine pose recognition and face recognition to enable me recognize the person that is posing. How do I go about it? Please can you share more lights on this? Thanks.

  • @leonelp9593
    @leonelp9593 3 года назад +1

    Such a cool content !
    Thanks for sharing this

  • @harshad-v8s
    @harshad-v8s Год назад

    hi nick can you make a more detailed video on explaining the libraries you imported and how the code works in detail?

  • @jeffreylin2488
    @jeffreylin2488 2 года назад

    underrated channel

  • @pierrehachey
    @pierrehachey 3 года назад

    Awesome videos on object detection and great teaching ability. Great video on sign language detection. I wonder if you can create or already have a video on this. Scenario: User takes phone and hovers over an object, like a credit card, where entire credit card must be captured within the defined outlined box. Once the full object is detected "within" the outline a success message appears notifying user that they are centered and can now take a picture. Do you have any videos like that? Kinda like google lens but entire object would have to be inside outline. Thanks!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Closest I'd have is the ANPR series ruclips.net/video/0-4p_QgrdbE/видео.html

  • @prateekxx
    @prateekxx 3 года назад +1

    55:47 that mic glitch made me spill coffee on myself

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Oh shit 🤣, didn't even know that was in there.

  • @stannisozbov
    @stannisozbov 2 года назад +1

    at [1:03:13], you told that we could use in a different use cases. But you told like action detection could be different so could you please explain what is the differences and what we have to do if you could say like 'follow this way' advices? thank you so much..

    • @NicholasRenotte
      @NicholasRenotte  2 года назад +1

      Check this out: ruclips.net/video/doDUihpj6ro/видео.html

    • @stannisozbov
      @stannisozbov 2 года назад

      @@NicholasRenotte at first, thanks for your all attention. I already checked this out but when I implement and test all these processes in that video I cannot obtain efficient and accurate results. Do you think may I implement and train for the push up action by using LSTM units? Cuz I couldnt get good results even in basic arm and hand actions. Watcha think about it?

  • @gavel8888
    @gavel8888 2 года назад +1

    Thank you so much. Great tutorial. There is only one problem. The hands landmarks do not record coordinates if I use one of the hands to turn off camera. basically, both hands should be in the view of videocamera from the start till the end to record coordinates. I cannot figure out how to stop recording automatically after certain time. Could you please help with this?

    • @NicholasRenotte
      @NicholasRenotte  2 года назад

      Try using a loop rather than a key, could use something like for x in range(3000) to record 3000 frames!

    • @gavel8888
      @gavel8888 2 года назад

      @@NicholasRenotte Thank you!

  • @olatundeolukoya1788
    @olatundeolukoya1788 11 месяцев назад

    2 years but the video still Lit

  • @demonxsave9471
    @demonxsave9471 3 года назад +1

    can you show how to run this code on pycharm

  • @庄鹏-l1s
    @庄鹏-l1s 2 года назад +2

    hi, thanks for you video lesson. I have a issue, when I load model and run, has a waring prompt: /Users/mac/miniforge-pypy3/envs/mp/lib/python3.7/site-packages/sklearn/base.py:446: UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names
    "X does not have valid feature names, but". what's I make mistake? thanks.

    • @Greygasm
      @Greygasm 2 года назад

      Did you find a fix for this?

  • @rupendrakrishnaraavi4217
    @rupendrakrishnaraavi4217 3 года назад

    Hi Nicholas, first of all, it's really a great piece of work but here again, I have a scenario where I will train my model with different signs(Alphabetical blind signs) and I wanted all of them to come up in a phrase/sentence that may be in a new window any clue how to do that?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Heya @Rupendra, check this out: ruclips.net/video/UPS54i7Km30/видео.html

  • @yuriemond7340
    @yuriemond7340 3 года назад +1

    Is there a way to know to which joint the x1, y1, or x2, y2 are associated to? Am I mistaken to say that x1 would be associated to the first value of the Pose Landmark Model which is the nose?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Check this out @Yuri, it shows the index mapping: google.github.io/mediapipe/images/mobile/pose_tracking_full_body_landmarks.png

  • @caqbme
    @caqbme 3 года назад +1

    Thank you very much for the great tutorial! Will be looking forward to your future projects. The MP hand detection works with multiple detection when max_num_hands = n. Would it be possible to edit the pose .py to have max_num_poses to detect multiple human poses like openpose/yolo?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Heya @Charles, yeah was looking into this, unfortunately the pose model it only works for a single pose/body.

    • @caqbme
      @caqbme 3 года назад +1

      Let's hope the model gets updated in the future. Really appreciate your work, can't wait for your next video. 😀

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      @@caqbme I'm with you on that one! YESS, just released today: ruclips.net/video/EgjwKM3KzGU/видео.html

  • @somyatomar6292
    @somyatomar6292 2 года назад

    Hi, this is an amazing project! I followed the method discussed here for exercise pose classification. It worked good. But now I have a doubt that's very different from pose classification. How can I rate a user's exercise pose accuracy given that I know the class of the pose?

    • @harshdasila6680
      @harshdasila6680 2 года назад

      have anyone actually implemented this code Please let me know Very urgent !!

  • @joshlenuelpontillas5202
    @joshlenuelpontillas5202 3 года назад

    Hi! What do I need to learn about if I want to detect motion instead of a pose? and compare my shooting motion(basketball) from the shooting motion of a pro? Thanks for the videos, I struck goldmine from your channel!

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Check this out: ruclips.net/video/doDUihpj6ro/видео.html

  • @namangoyal8477
    @namangoyal8477 2 года назад +1

    Hey Nick, need a help.
    Can you please create a tutorial where i pass images to mediapipe holistic and it will create coords.csv on the basis of those images.

  • @modyngs5985
    @modyngs5985 2 года назад

    Hey Nicholas, Thanks for this tutorial ... i was wondering if there is a solution for training a model with sentence instead of single word? lets say for training a sentence of ""HI, How are you doing?"" and then use it to recognize the sign language or for generation of sign language using animations. I dont want you to go through the whole process but my question is about teaching sentence(instead of single word) to the model using webcam and csv
    Thanks
    Best regards

  • @vishalm954
    @vishalm954 3 года назад +1

    Amazing stuff! Getting to learn a lot:)

  • @TheMarkaay
    @TheMarkaay 3 года назад +1

    Which CPU and GPU did you use?
    I'm looking for a live tracking of 10 persons in a 720p 25fps stream. Holistic Tracking with pose_landmarks and face_landmarks. Is it possible to do this on a affordable PC?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Heya @Markaay, sure can. Just be mindful that mediapipe doesn't offer multi-person tracking for poses anymore. You could check out OpenPose for that though.

    • @TheMarkaay
      @TheMarkaay 3 года назад +2

      @@NicholasRenotte Could you please do a comparison video(performance, features) of the following Tracking algorythms: MediaPipe, OpenPose, BlazePose, PoseNet, wrnchAI, YogAI

  • @anishaudayakumar1778
    @anishaudayakumar1778 3 года назад

    Hola !! This is so much fun to implement and decode the pose.... Thanks a million

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Heya @Anisha, thanks so much!! Unfortunately, it looks like mp only supports single poses. I'm taking a look at OpenPose for multi pose estimation.

    • @anishaudayakumar1778
      @anishaudayakumar1778 3 года назад

      @@NicholasRenotte Back with another fan request❤️!
      I'd love to see a tutorial on exploring Mediapipe's 3D face mesh to render some kind of face filters like in Insta. Digging deep on their graphs and calculators 😀

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      @@anishaudayakumar1778 oh that's a hotly requested one, definitely got that one planned!

  • @TejrajParab
    @TejrajParab 3 года назад +2

    I want that pipeline video.

  • @micheletufano6848
    @micheletufano6848 Год назад

    Amazing work! Thank you so much!

  • @sagarsingh2601
    @sagarsingh2601 3 года назад +1

    Good morning sir hope you have a great day thanks for this one

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Anytime @Sagar Singh, what did you think of it?!

    • @sagarsingh2601
      @sagarsingh2601 3 года назад +1

      @Nicholas Renotte that is super awesome...😁

  • @秀优-c5q
    @秀优-c5q 2 года назад

    Hello, why does 'str' object has no attribute 'decode' when learning mechanically.

  • @priyambordoloi771
    @priyambordoloi771 3 года назад +1

    Hey Nicholas. Hope you are doing well. Just want to know how to use Mediapipe to target a particular person among many persons.

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Hmmm, it would depend on what the defining characteristics are for that person @Priyam.

    • @priyambordoloi771
      @priyambordoloi771 3 года назад

      @@NicholasRenotte can you please explain me in a very short manner?

    • @priyambordoloi771
      @priyambordoloi771 3 года назад

      Like the mediapipe it always detects the first person in the frame.

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      @@priyambordoloi771 hmm, that's just the way it works. It'll pick up the highest likelihood for a person. You could probably use an alternate method by training for a specific person, haven't tried this out before though :S

  • @tharindudamith4927
    @tharindudamith4927 Год назад +1

    hey is there any way to train the model with images ,without doing it by ourself

    • @muhammadahmed9647
      @muhammadahmed9647 6 месяцев назад

      Hi bro are you still doing it, if you have done it, can you help me with that as I am stuck in training a CNN model on MPII dataset

  • @nazihafamily
    @nazihafamily 3 года назад +1

    Hye. I prepare project same as this. But, when I add timer on it, the Opencv imshow freeze. Would you mind to help me?

    • @NicholasRenotte
      @NicholasRenotte  3 года назад

      Haven't really played with adding a timer unfortunately @Naziha, it might be slowing down the frame rate.

  • @rony3044
    @rony3044 3 года назад +2

    can we use LSTM for this

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Yup, could apply a RNN layer using the landmarks @Rony!

    • @denisdj6180
      @denisdj6180 3 года назад +3

      A tutorial using LSTM would be amazing , the documentation is really poor

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +2

      @@denisdj6180 yah, working on an action detection tutorial atm!

    • @rony3044
      @rony3044 3 года назад

      @@NicholasRenotte Thank you!

    • @rony3044
      @rony3044 3 года назад +2

      @@denisdj6180 exactly :(

  • @yousseffarhan8901
    @yousseffarhan8901 3 года назад +1

    محتوى ممتع ومفيد، شكرا جزيلا لك 🙏🏼
    تستحق المدح والتشجيع

    • @NicholasRenotte
      @NicholasRenotte  3 года назад +1

      Thank you so much @Youssef! So glad you enjoyed it!

  • @ahsanmansiv9698
    @ahsanmansiv9698 Год назад

    Hi Nicholas, I didn't understand the process for CSV file work...in this video (Capture and Landmarks using openCV and CSV part.).Can you provide the CSV file

    • @yungzed
      @yungzed Год назад

      mine isnt writing to the csv file for some reason