One of the most professionally made video tutorial on the whole of youtube, keep making brilliant videos like these I find this to be the best video under the mediapipe series. Congratulations for the gift you have and thanks for sharing it with us
I wanted to detect my hand pose as an object. So I went to tensorflow - 2 days of configuring. Made autolabel with groundingDINO - 3 days of configuring. And now I found this. 1 Hour and the model's ready to detect in real time... DAIM what I was doing this 5 days?! And thanks A LOT for your effort, also for that particular thing, when you shown how to add a bunch of new staff to the existing model
One of the best programmer guide out there! I love how you explain into detail on what you did and why you did it, helps someone like me who is learning just from youtube! I'm gonna try and create my own project based on this program for boxing. Which can detect what time of move a person is doing and can give pointers if that person is not using the proper technique, wish me luck!
Hey I'm working in a body and face emotion detection for my paper, but I couldn't find sources that could help me, but after seeing your video and the way everytime you'll explain every bit of code is really appreciated, this actually sparked that interest in coding for me again, thank you for being very caring you're amazing
The 210th comment is dedicated to the best content on RUclips. Period! Though late, I am lucky to have discovered your channel. Subscribed and notifications turned on!
Awesome content!! I know I mentioned this in a previous video but I would still love to see a “virtual coach” type implementation. Something that goes beyond just static poses but actually tracks a movements key points over time and could detect form quality by comparing them to a “good form” and “bad form” example.
Yup! Got it planned but it'll be a longer tutorial, just taking a little recovery break from long vids this week. Should do it in the next couple of weeks though @Caleb!
@@CalebSchantzChristFollower oh thanks man, I honestly needed to hear that it's okay! Been feeling a little bad I haven't hit my two a week since I released the big TFOD tutorial.
@@NicholasRenotte Mann! I thought you wouldn’t respond! Im in my junior year of college and am currently doing a machine learning project. I have few doubts and I believe you could help me with it. It would great if you could tell me how to reach out to you and I can get them clarified!
Hi Nicholas, great stuff. I thoroughly enjoy your tutorials as they are mind blowing, I'd love to have a tutorial on pose deviation comparing poses of two people. Awesome work man!!!
first, i want to thank you about this big effort. second, can you make a video about fall detection using media pipe please this video will help me a lot
I'd love to have a tutorial where you use the face geometry module from mediapipe. And maybe add some 3D models tracked to the face like glasses ! Great video as always :)
so can i actually use this to detect more sign languages using those joints...... man u actually helped a lot in giving people ideas and inspiration. will always support ur youtube channel!
@@NicholasRenotte I tried to look online to find documentation on how you would pass to a RNN for action detection, but didnt find anything significant. Do you have documentation or video you could share with us? :D
Hi Nick, loved this video! I was wondering if you could go more into how to do hyperparameter tuning and building more advanced pipelines? Do you have other videos going more in detail on those? Thanks!
hi, thanks for you video lesson. I have a issue, when I load model and run, has a waring prompt: /Users/mac/miniforge-pypy3/envs/mp/lib/python3.7/site-packages/sklearn/base.py:446: UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names "X does not have valid feature names, but". what's I make mistake? thanks.
Hi there. Great video, tanks. Can I use a ply file instead a live webcam? I need to evaluate some children and want to use 3d scan (kinectics) and posterior analisys.
Hey, Nicholas Thank you so much. Very useful. Highly appreciated. you have awesome teaching skills. One Question is what it takes to extend this to Action detection. Can you please make one tutorial for custom action detection? Thanks
1. you are not training the hand gesture 2. I didn't understand how when you train the AI the AI knows which column of the csv is asociated with each point of the face or the body i don't know if i explained myself well but i have this doubt
Hey, Nicholas Thank you so much. Very useful. Highly appreciated. But can you help me how to make the decoder like the in the video works with hands too? specifically how to extract the hands landmark? thankyou
Hey Nick, need a help. Can you please create a tutorial where i pass images to mediapipe holistic and it will create coords.csv on the basis of those images.
I just discovered your channel and Learned So much about Machine Learning. Could you help me in my project? My Project is Classification of Bad and Good Sitting Posture. How would you deploy this in raspberry pi and send data to mobile application? Hoping for your response and tutorials on this. Thanks! I totally in love with your contents
Hi Nicholas , thank you about the stuff , now in my study i work about AI application of fitness training . I would like to get help from you, I need the detection all the body joints.
Nick, information is top, in general, as always, this time I loaded it in full)) Considering that you put everything on the shelves. It will take a long time to digest = D
YESSSS! You checked it out! It's definitely a lot more sophisticated than the angle calculation method which is why I was so excited to put it out. It'll perform a lot better in complex scenarios and can have additional logic applied over the top of it to do rep counting, form correction etc.
Your videos are amazing, still waiting for using unity to import those keypoints and rig them to a hand model. In the meantime any clue on how to do that? how to ring and which hand model to use?
Heya @Imane, was actually talking about it on Discord yesterday. I actually found someone that had an example on it the other. Let me know if you want me to try to dig up the link!
I trained my model and it's working fine. I have one issue. My application has to do the estimation on a whole classroom. How can we apply this to a group of people? It just detects one face per pic. Would really love some suggestion.
Awesome video btw, I'm currently trying to recreate the model in my local machine. However, seems like I fail to append the different classes of poses/facial expressions, how can I change this?
Hi Nicholas, your videos are great and they provide a lot of value. I have tried implementing many projects from your tutorials. I have one query regarding the accuracy of computer vision algorithms. Can we ever achieve accuracy around 99 percent for computer vision applications?
My model is very confident to non trained labels. Suppose, if i do nothing and just stay in the frame, the model still predicts one of the action with high confidence value. How can we solve such problems? Do you have any idea regarding such issues?
Love the content! Just curious would it be possible to use other videos and images to generate the landmark for different poses or facial expression and then our webcam to see if the model can detect ourselves doing the poses or facial expressions?
@@NicholasRenotte Hi Nicholas, wanted to commend on the awesome content, and format of presentation. Makes it easy to understand. Great job, and a huge thank you. Could you please point me to the video where you use other videos/pictures to train the model?
Thats Awesome! For facial expression recognition do you recommend using facial landmarks as the base features for training with DNN, or using CNN directly on the image dataset? Thanks
I prefer using the base features with a classifier as if you were to detect multiple faces you could apply the model across each face (FYI this model only detects a single face) but also because it's faster to train on tabular data!
I want to combine pose recognition and face recognition to enable me recognize the person that is posing. How do I go about it? Please can you share more lights on this? Thanks.
Heya @Mikolaj, you would need to update the code to work with the hands model. So instead of the face and pose rows you would need to do it for the left hand and right hand models!
Awesome content! But I have an error when running, how should I deal with it? UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names warnings.warn(
Hello Nicholas. I'm new to your channel and I'm glad that I found you. I saw someone can find bounding box of the face using mediapipe's pose estimation. I don't know how he can do that. I think he can find the width of bounding box by calculating distance between left ear and right ear key points, the center of bounding box probably is nose key point. But I don't know how to find the height of bounding box. Hope you can help me out. Thanks so much.
hey man ıhave been followin you for a while you done greeaaat jobs your channel is like a full stack course of data science thank you so much for that. but ı really wantto know why are you doin that ı mean beside of a youtube content what do you expect from your projects ? is that something about your IBM carreer ? (like a part of portfolio ? )
One of the most professionally made video tutorial on the whole of youtube, keep making brilliant videos like these
I find this to be the best video under the mediapipe series. Congratulations for the gift you have and thanks for sharing it with us
Thanks sooo much @Hargobind, so glad you enjoyed it!!
I wanted to detect my hand pose as an object. So I went to tensorflow - 2 days of configuring. Made autolabel with groundingDINO - 3 days of configuring. And now I found this. 1 Hour and the model's ready to detect in real time... DAIM what I was doing this 5 days?!
And thanks A LOT for your effort, also for that particular thing, when you shown how to add a bunch of new staff to the existing model
HI. you can send requirements.txt string , please!
I just discovered your channel and I‘m obsessed. Thank you so much for doing such great content🙏🏻🙏🏻🙏🏻
Thank you so much @Frieda, so stoked you're getting value from it!
Me tooo !!!!!
One of the best programmer guide out there! I love how you explain into detail on what you did and why you did it, helps someone like me who is learning just from youtube! I'm gonna try and create my own project based on this program for boxing. Which can detect what time of move a person is doing and can give pointers if that person is not using the proper technique, wish me luck!
🙌🙌🙌 sending you all the luck, you'll smash it @Francis!
have anyone actually implemented this code Please let me know Very urgent !!
The most professional easy to understand and implement tutorials on youtube. You really are the best.
Hey I'm working in a body and face emotion detection for my paper, but I couldn't find sources that could help me, but after seeing your video and the way everytime you'll explain every bit of code is really appreciated, this actually sparked that interest in coding for me again, thank you for being very caring you're amazing
HI. you can send requirements.txt string , please!
The 210th comment is dedicated to the best content on RUclips. Period! Though late, I am lucky to have discovered your channel. Subscribed and notifications turned on!
Anytime my guy, better late than never, WELCOME TO THE FAM!!!
Awesome content!! I know I mentioned this in a previous video but I would still love to see a “virtual coach” type implementation. Something that goes beyond just static poses but actually tracks a movements key points over time and could detect form quality by comparing them to a “good form” and “bad form” example.
Exactly.
Yes!!
Yup! Got it planned but it'll be a longer tutorial, just taking a little recovery break from long vids this week. Should do it in the next couple of weeks though @Caleb!
No hurry, you are already putting out content at a crazy pace! Take that break!
@@CalebSchantzChristFollower oh thanks man, I honestly needed to hear that it's okay! Been feeling a little bad I haven't hit my two a week since I released the big TFOD tutorial.
your tutorials are the best tutorials I have seen in my life, congratulations!
Thanks a tonnn @Eduardo!!
Man! Your tutorials are really really cool!! And DAMN RIGHT we want a bigger data science series!!!!!
Awesome work man!!! Cheers!!!
YESSS! So glad you enjoyed it!
@@NicholasRenotte Mann! I thought you wouldn’t respond!
Im in my junior year of college and am currently doing a machine learning project. I have few doubts and I believe you could help me with it. It would great if you could tell me how to reach out to you and I can get them clarified!
@@srirammadduri8078 nah man! I try to get to all comments. Hit me up on Discord, I check every night and if crazy every second night. bit.ly/3dQiZsV
Looking forward to watching this later!! Thank you for all the quality videos. Have a great one!
Anytime @Isaac! Thanks a bunch 🙏
Hi Nicholas, great stuff. I thoroughly enjoy your tutorials as they are mind blowing, I'd love to have a tutorial on pose deviation comparing poses of two people. Awesome work man!!!
Awesome usecase, I'll add it to the list. Never even thought about comparing poses!
Your videos are very descriptive and useful. Your content is of high quality. Thank you.
Only you have the best python vidos on RUclips. Greetings from Russia)
Thanks so much @ONE! What's happening from Sydney!?
55:47 that mic glitch made me spill coffee on myself
Oh shit 🤣, didn't even know that was in there.
Your channel has helped me so much when working on my dissertation. Thank you 🙏
YESSSS, go getem Marc! Hope you smash it out of the park!
first, i want to thank you about this big effort.
second, can you make a video about fall detection using media pipe please
this video will help me a lot
HI. you can send requirements.txt string , please!
Let's try something in 3D. That will look great. The AI gym trainer in 3D would be great!!
Agreed, on the R&D list as we speak!
I'd love to have a tutorial where you use the face geometry module from mediapipe. And maybe add some 3D models tracked to the face like glasses ! Great video as always :)
Yah, agreed! Working on a bunch of stuff in that space rn @Victor!
@@NicholasRenotte Amazing ! I’ll be there to see it as soon as it comes out !
@@victormustin2547 yesss! Thanks a bunch for checking out the vids so far as well!
Good job brother. I will always appreciate the tasks that you do.
Thanks so much @Priyam!
so can i actually use this to detect more sign languages using those joints...... man u actually helped a lot in giving people ideas and inspiration. will always support ur youtube channel!
Thank you so much @Nurul! You could particularly with the hand models! Could even pass to a RNN for action detection!
@@NicholasRenotte I tried to look online to find documentation on how you would pass to a RNN for action detection, but didnt find anything significant. Do you have documentation or video you could share with us? :D
@@yuriemond7340 definitely, take a look at some of these action models: tfhub.dev/s?q=action
This is really awesome , loved the way how you explained everything, great Job. Really Thankful for this. 💯
THANK YOU SO MUCH BRO ! KEEP HUSTLING ❤️
Thanks buddy for really helpful videos. Keep going, Wakanda Forever!
I want that pipeline video.
hey can we use this to do real time sign launguage . If we can use this please do a video on it.Thank you
Bruce! Heya, yup, got something in mind!
Great tutorial....Can you do a tutorial where you can save body and facial motion to BVH or FBX files to use with a 3D Character..
2 years but the video still Lit
Great tutorial, i wish your channel have more visibility
Hi Nick, loved this video! I was wondering if you could go more into how to do hyperparameter tuning and building more advanced pipelines? Do you have other videos going more in detail on those? Thanks!
Nothing around it yet but will probably do something soon @Jonathon!
underrated channel
Thank you so much!!!!!
Please can i do same steps for sign language recognition instead of using mediapipe+LSTM ???
Hey Man...! You are really cool!!!! I love this project, I'm your new subscribers!!!!
YESSS! Welcome to the fam!
Excellent vid man, thanks
Just what I needed. Thank you
YESS! So glad to hear Daniel!
This video help me in creating my final year project thanks lot ❤
hey is there any way to train the model with images ,without doing it by ourself
Hi bro are you still doing it, if you have done it, can you help me with that as I am stuck in training a CNN model on MPII dataset
Such a cool content !
Thanks for sharing this
hi, thanks for you video lesson. I have a issue, when I load model and run, has a waring prompt: /Users/mac/miniforge-pypy3/envs/mp/lib/python3.7/site-packages/sklearn/base.py:446: UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names
"X does not have valid feature names, but". what's I make mistake? thanks.
Did you find a fix for this?
really amazing content. im currently working on my final cs project and this video (and some others) were tremendous help for me.
amazing job man!
have anyone actually implemented this code Please let me know Very urgent !!
@@harshdasila6680 i did. What you need?
@@shai8559 i am getting error
@@harshdasila6680 you can type the error and ill see if i can help
what will be chenges, if i wanted to make a .h5 model ?
please replyy
Amazing stuff! Getting to learn a lot:)
Thanks so much @Vishal 🙏!
Excellent Presentation. Just loved it.
Hi Nicholas,i love the content you make.Much thanks for sharing. Can we deploy this??
Sure can! Been messing around with Kivy for CV (could probs do that).
Hey brother, I like your content, your presentation. And a request, can you build a project on a sentence generator when some words are only given.
Yup! Check this out: ruclips.net/video/cHymMt1SQn8/видео.html
hi nick can you make a more detailed video on explaining the libraries you imported and how the code works in detail?
This is so cool! Can I set this up to only detect poses I make with my hands?
Yup, there's mediapipe models that only detect hands as well. I've got a vid on the channel!
@@NicholasRenotte Got it! Il check it out!!
Good morning sir hope you have a great day thanks for this one
Anytime @Sagar Singh, what did you think of it?!
@Nicholas Renotte that is super awesome...😁
Hi there. Great video, tanks. Can I use a ply file instead a live webcam? I need to evaluate some children and want to use 3d scan (kinectics) and posterior analisys.
thanks for the video
I have a question:
i was trying to export the coords but it didnt export to excel
YOU ARE THE SH**!!! Props my man and thank you for making such great content!!
I love your videos and your work
Thanks a bunch @John!
Hey, Nicholas Thank you so much. Very useful. Highly appreciated. you have awesome teaching skills. One Question is what it takes to extend this to Action detection. Can you please make one tutorial for custom action detection? Thanks
Check this out! ruclips.net/video/doDUihpj6ro/видео.html
1. you are not training the hand gesture
2. I didn't understand how when you train the AI the AI knows which column of the csv is asociated with each point of the face or the body
i don't know if i explained myself well but i have this doubt
thats so cool! i have a question, how can we fix the flickering at then when it's running?
It would need a more powerful GPU or machine. The lag is due to the FPS drag from the ml model.
@@NicholasRenotte i have fixed it!! now running at 10 to 12 FPS, thats still good. thank you so muchhhh
you amaze me
Ohhh shucks 😅
Amazing work! Thank you so much!
Excellent video!!!
Thanks so much @01bit!
Do you know how to optimize the model for production? Great tutorial brother
Probs a bunch of stuff to do so, want a vid on it?
@@NicholasRenotte Yess !!
Nice video sir
محتوى ممتع ومفيد، شكرا جزيلا لك 🙏🏼
تستحق المدح والتشجيع
Thank you so much @Youssef! So glad you enjoyed it!
Hey, Nicholas Thank you so much. Very useful. Highly appreciated. But can you help me how to make the decoder like the in the video works with hands too? specifically how to extract the hands landmark? thankyou
Hey Nick, need a help.
Can you please create a tutorial where i pass images to mediapipe holistic and it will create coords.csv on the basis of those images.
Awesome content. Is it also possible to train the csv file with tensorflow instead of sklearn? Looking forward to watching your other videos!!
Sure can!
I will be forever greatfull to you
So awesome, is there any way to control a 3D model in blender using this body estimation technique? Like motion capture?
Haven't seen it in blender but I've seen it in Unity using the Barracuda framework!
@@NicholasRenotte may you pls tag me a tutorial?
@@KriGeta don't have anything yet but will shoot it through once it's up!
@@NicholasRenotte that's great 😍
How to calculate the accuracy of the model in this project
Can anyone please tell me ?
Hi Nicholas! Depending on the position of the wrist, can you tell me the coordinates of the joint at that time??
I just discovered your channel and Learned So much about Machine Learning. Could you help me in my project? My Project is Classification of Bad and Good Sitting Posture. How would you deploy this in raspberry pi and send data to mobile application? Hoping for your response and tutorials on this. Thanks! I totally in love with your contents
Heya, you couldi fine tune this model for good and bad posture and deploy the same code to RPi!
how do we put the threshold on the prediction?
also, thank you for all the effort you put into each modules.
wooow thanks for Avery think u real eng
🤩🤩🤩🤩
Awesome 👍 work appreciated ♥️
Thanks a ton @AiPhile!
Hi Nicholas , thank you about the stuff , now in my study i work about AI application of fitness training . I would like to get help from you, I need the detection all the body joints.
so... well, let's go!!)) It looks cool)
01:03:00 - Yes, we did, thank you)))
compared to the previous classification method, using image markup, this method looks more promising, but also more complex
Nick, information is top, in general, as always, this time I loaded it in full)) Considering that you put everything on the shelves. It will take a long time to digest = D
YESSSS! You checked it out!
It's definitely a lot more sophisticated than the angle calculation method which is why I was so excited to put it out. It'll perform a lot better in complex scenarios and can have additional logic applied over the top of it to do rep counting, form correction etc.
The angles are not Nicholas. I tried with your code but it's not showing in rhe webcam. Please help me.
Your videos are amazing, still waiting for using unity to import those keypoints and rig them to a hand model. In the meantime any clue on how to do that? how to ring and which hand model to use?
Heya @Imane, was actually talking about it on Discord yesterday. I actually found someone that had an example on it the other. Let me know if you want me to try to dig up the link!
Heyy @@NicholasRenotte, yes if u can do that will be great! Thanks a lot for your help.
Awesome awesome work.
Thanks a bunch @Kirti, so glad you enjoyed it!
I trained my model and it's working fine. I have one issue. My application has to do the estimation on a whole classroom. How can we apply this to a group of people? It just detects one face per pic. Would really love some suggestion.
There's a new pose estimation model available that supports multi person! Check this out tfhub.dev/google/movenet/multipose/lightning/1
Awesome video btw, I'm currently trying to recreate the model in my local machine. However, seems like I fail to append the different classes of poses/facial expressions, how can I change this?
@Nicholas Renotte , please reply, instead of classifying body language, we can detect spoken words with lip movement right?? Using lips coordinates
Hi Nicholas, your videos are great and they provide a lot of value. I have tried implementing many projects from your tutorials. I have one query regarding the accuracy of computer vision algorithms. Can we ever achieve accuracy around 99 percent for computer vision applications?
can you show how to run this code on pycharm
My model is very confident to non trained labels. Suppose, if i do nothing and just stay in the frame, the model still predicts one of the action with high confidence value. How can we solve such problems? Do you have any idea regarding such issues?
Love the content! Just curious would it be possible to use other videos and images to generate the landmark for different poses or facial expression and then our webcam to see if the model can detect ourselves doing the poses or facial expressions?
Sure can! I actually did it in the past with a video of the Royals being interviewed.
@@NicholasRenotte Hi Nicholas, wanted to commend on the awesome content, and format of presentation. Makes it easy to understand. Great job, and a huge thank you.
Could you please point me to the video where you use other videos/pictures to train the model?
@@satishchandrasekaran3045 still a work in progress at this stage!
Thats Awesome!
For facial expression recognition do you recommend using facial landmarks as the base features for training with DNN, or using CNN directly on the image dataset?
Thanks
I prefer using the base features with a classifier as if you were to detect multiple faces you could apply the model across each face (FYI this model only detects a single face) but also because it's faster to train on tabular data!
Awesome work! sir but also make some AI project for mobile devices
i.e gesture recognition or body language decode using android phone
You got it @Mutaher!
@@NicholasRenotte yeah
Thanks lots for great approch and hardwork 🙏♥️
Question :-
1) does it work for multiple person in frame ?
Unfortunately no @Vinay, check out OpenPose for that!
@@NicholasRenotte Thanks Nick 🙏
@@FindMultiBagger anytime!
I want to combine pose recognition and face recognition to enable me recognize the person that is posing. How do I go about it? Please can you share more lights on this? Thanks.
can we use LSTM for this
Yup, could apply a RNN layer using the landmarks @Rony!
A tutorial using LSTM would be amazing , the documentation is really poor
@@denisdj6180 yah, working on an action detection tutorial atm!
@@NicholasRenotte Thank you!
@@denisdj6180 exactly :(
After train data
fit_model ['rc'].predict(row)
It make a """ string cannot be changed to float"""
This is a perfect project.. Does anyone know, can I use my Keras model for this code?
Yep, sure can, in place of the sk classifier!
What kind of Type of neural networks is this? CNN, RNN or ANN?
I do the same thing but only with hands and it doesn't save cords. It just save x1,y1,z1,v1,x2,y2,...
Why?
Heya @Mikolaj, you would need to update the code to work with the hands model. So instead of the face and pose rows you would need to do it for the left hand and right hand models!
this one is amazing
It's pretty slick right? There's so much you can actually do with the workflow @Ameer!
Can you please provide a code version for doing it on a recorded video instead of the live webcam?
Awesome content!!
hello thank you for this tutorial i was wondering if you can use a group of still image as a dataset instead of manually recording pose
hi! awesome video bro! what if we want to convert it into a desktop application or web application?
Could wrap it in Streamlit or Kivy!
Awesome content! But I have an error when running, how should I deal with it?
UserWarning: X does not have valid feature names, but StandardScaler was fitted with feature names
warnings.warn(
facing the same error, did u find any solution ?
Hello Nicholas. I'm new to your channel and I'm glad that I found you. I saw someone can find bounding box of the face using mediapipe's pose estimation. I don't know how he can do that. I think he can find the width of bounding box by calculating distance between left ear and right ear key points, the center of bounding box probably is nose key point. But I don't know how to find the height of bounding box. Hope you can help me out. Thanks so much.
Heya @Nguyen Vu, they might have been using this model instead: google.github.io/mediapipe/solutions/face_detection.html
hey man ıhave been followin you for a while you done greeaaat jobs your channel is like a full stack course of data science thank you so much for that.
but ı really wantto know why are you doin that ı mean beside of a youtube content what do you expect from your projects ? is that something about your IBM carreer ? (like a part of portfolio ? )
Ayyye, anytime man, glad you like it. I'm just doing it because I enjoy it at the moment 🙂