I have to say that this was the best coding video I have ever watched, by a long mile. Slick, quick and straight to the trick. The half hour I’ve spent watching this has saved me about two days on my project. Many thanks.
thank you very much nicholas, I was on the verge of giving up on my research work. but thanks to you and your videos I was able to have a new lease of life to continue. Thank you very much again.
😅 thought you might like it! This code base isn't but when I took a look it's super similar to what's available using Tensorflow.Js. I think I'm eventually going to extend out some of the TF.js use cases but with the additional components, e.g. kinematics, rep counting etc!
you are the best on youtube really, please keep up, thank you, will be useful if you can make a tutorial about how to define a particular hand gesture and how to send it to be assigned for an action like play a video or something else. thanks again
What is the hardware you're running mediapipe on? I've tried running gesture recognition on Raspberry PI4 and noticed quite a lag between image capture and hand tracking...
Hi, I have a quick question. I'm really new to this but I followed everything like you did but when I run "mp_hands.HAND_CONNECTIONS" I get a somewhat empty result. Even though the tracking works and the XYZ coordinates too this is part of the 'result' i get: frozenset({(0, 1), (0, 5), (0, 17), (1, 2), (2, 3), (3, 4), (5, 6), (5, 9), (6, 7), . . . Do I have to import something else for those missing landmark connections? Sorry if this is a silly question
I get "ImportError: libGL.so.1: cannot open shared object file: No such file or directory" when it tries to import mediapipe... just copied everything to pycharm and works fine, ignore this
hello.....each time i try to run the code,,,i face this kind of error ' cv2.VideoCapture' object has no attribute 'isOpend' ' can you please help me???
I can't install !pip install mediapipe , it throws me error ERROR: Could not find a version that satisfies the requirement mediapipe ERROR: No matching distribution found for mediapipe help
Thank you for this video. what lines of code are needed to display angles on the screen. Also, how can I save the angles to a dataset or an excel file. Thank you
excuse me, i read the documentation of mediapipe it said that hand detection model depends on palm detection model and hand landmark extraction model for my application it just need the palm position do you know how can i stop the process when i detect the palm just in case to increase the fps
How do you capture the movements and bring it to the Blender? I've hit myself all over the internet, including with the BlendArMocap addon and I couldn't
Bro you are superb. Buddy just one favor bro can you please please make one video in real time object detection along with frame around object in React Native (mobile) using tensorflow . Trust me buddy I am struggling a lot since a long but can't find any good resources to completely execute it
Ya! It's been on the cards for a while, just need to tighten up my RN coding. But definitely it's on the list @Adarsh, ideally using tflite and RN for end to end object detection!
@@NicholasRenotte Thanks buddy for your reply. If you are gonna go for it in coming days, I would request you to do something similar to this heartbeat.fritz.ai/turning-the-mobile-camera-into-a-real-time-object-detector-with-flutter-and-tensorflow-lite-f412962b1805
I'm a beginner at this, could you please tell me how to do foot pose estimation (there's no model specifically for foot pose in the mediapipe framework right?)
Hi, I keep getting this error, can anyone help me ? binary_graph_path=os.path.join(root_path, binary_graph_path)) FileNotFoundError: The path does not exist. [ WARN:0] global C:\Users\appveyor\AppData\Local\Temp\1\pip-req-build-oduouqig\opencv\modules\videoio\src\cap_msmf.cpp (434) `anonymous-namespace'::SourceReaderCB::~SourceReaderCB terminating async callback
hey, I want to ask a question about the confidence score for each joint. Mediapipe doesn't provide these scores but is there a way to get these confidence scores for each joint of a hand??
Traceback (most recent call last): File "D:/pythonProject2/name.py", line 2, in import mediapipe as mp File "D:\pythonProject2\app_d\lib\site-packages\mediapipe\__init__.py", line 16, in from mediapipe.python import * File "D:\pythonProject2\app_d\lib\site-packages\mediapipe\python\__init__.py", line 17, in from mediapipe.python._framework_bindings import resource_util ImportError: DLL load failed: The specified module could not be found. please help iam getting this error
Hi Nicholas a great video I extracted the key points trained them but while detecting I am getting this error "X has 63 features, but this StandardScaler is expecting 84 features as input" (I used your holistic code for detection) any idea bro how to solve it?
Heya @Rupendra, might be missing features when passing through. 63 features is synonymous with the handpose keypoints, but 84 I think is close to the posenet features. Might need to retrain if you're making a model for handpose detection!
Hi this is very helpful. Actually I have to detect hands in a video where the person is wearing gloves, the mediapipe is not giving consistent detections, any suggestions to get better detections?
hi, im trying to get an executable output of this project but i get an error of none existing path of solution in mediapipe and the .exe doesnt run. could you create a video of how to create a .exe file from these kind of projects like hand detections?
This is a great video, I loved it! One question I have though that I hope you could answer: is this a 2D hand pose estimation or 3D? I seem to have a bit of trouble figuring if it’s 2D or 3D so I would appreciate it if you could explain as to which one it is!
Hi mp.solution.drawing_utils where can we find ‘solutions’ in mediapipe as to know what this function does and weather to put something in it or not because the whole code is given on mediapipe, can you help me with this?
Dear Nicholas, How can i input those finger skeleton points into Recurrent Neural Network to training a gesture recognition model. Can you please make a tutorial about it? Thank you for your help.
Good afternoon! I decided to write the code one - to-one as in the video. As a result, I reached the usual output of the image from the camera. Then I inserted the code: with mp_hands.Hands(mine_detection_confidence=0.8, min_tracking_confidence=0.5) as hands: and gave a bunch of errors. Although mediapipe has installed (pip install mediapipe on the command line). What should I do? Mistakes: Traceback (most recent call last): File "C:\python_work\hello_world.py", line 13, in with mp_hands.Hands(min_detection_confidence=0.8, min_tracking_confidence=0.5) as hands: File "C:\Users\Виктор\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\mediapipe\python\solutions\hands.py", line 129, in __init__ super().__init__( File "C:\Users\Виктор\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\mediapipe\python\solution_base.py", line 229, in __init__ validated_graph.initialize( FileNotFoundError: The path does not exist. [ WARN:0] global C:\Users unneradmin\AppData\Local\Temp\pip-req-build-1hfhc_rd\opencv\modules\videoio\src\cap_msmf.cpp (438) `anonymous-namespace'::SourceReaderCB::~SourceReaderCB terminating async callback
Oh man, actually got the code working but it looks like the library is broken so it maxes out at 293 words generated. Been meaning to raise a GH error for it. But yep, will eventually be coming @Rob!
Hi Nicholas, very nice tutorial really, I have followed last year already. I got one question I did not find any answer so far and maybe can help someone else as well. I hope you can help me out. Can I get the confidence level of only particular hand's landmark? I mean e.g. for somewhat reason the confidence level of landmark n. 8 - INDEX_FINGER_TIP solely. Is there any way to obtain/extract that? THX and keep up very good job!
Dear Nicholas, Can you please make a hand sign recognition with google colab using our webcam in python that does real time recognition? Please it would help because the other video you posted about real time sign language detector does not work for google colab. From a college student
Heya @SharCie, unfortunately the latecy between colab and your webcam doesn't really make this feasible, that's why I do it locally. Training on colab is fine but inference should ideally be done on a local machine!
@@NicholasRenotte tfod is good but I don’t prefer doing it with JS or react js I can do it with tfod for object detection yolov4 is mostly used for object detection
I have to say that this was the best coding video I have ever watched, by a long mile.
Slick, quick and straight to the trick.
The half hour I’ve spent watching this has saved me about two days on my project.
Many thanks.
Cheers Charlie, so pumped you enjoyed it!
thank you very much nicholas, I was on the verge of giving up on my research work. but thanks to you and your videos I was able to have a new lease of life to continue. Thank you very much again.
I'm so appreciative of you! I could not understand this until your broke each step down-thank you so much!!
Really loved it. We need a long playlist on this. Make more videos.
Nice intro 🔥🤘😂
Media Pipe is quite interesting, I saw it's repo on GitHub, not very compatible with JS huh? Yet lol
Can't wait for part 2 of this! 🔥
😅 thought you might like it! This code base isn't but when I took a look it's super similar to what's available using Tensorflow.Js. I think I'm eventually going to extend out some of the TF.js use cases but with the additional components, e.g. kinematics, rep counting etc!
Great content! This was the exactly kind of introduction to mediapipe that I was looking for. Thank you so much!
Really appreciate your work. well explained and a breeze to follow.
you are the best on youtube really, please keep up, thank you, will be useful if you can make a tutorial about how to define a particular hand gesture and how to send it to be assigned for an action like play a video or something else. thanks again
Yesss, will definitely dig into this @Lory4 Kids!
Great content !!!
Hope you continue making awesome videos like this.
Bravo, Nick. Without words. It helped me so much Thanks!
Thank you for this tutorial. Very concise and clear!
Another amazing video man, please do the learning without forgetting and incremental learning, keep up the great content bro 😉
Definitely got it planned for one of my non-techy vids!
Heya @Hugo, the vid is out! ruclips.net/video/cCmGg_Pn9K8/видео.html
What is the hardware you're running mediapipe on? I've tried running gesture recognition on Raspberry PI4 and noticed quite a lag between image capture and hand tracking...
Hi, I have a quick question. I'm really new to this but I followed everything like you did but when I run "mp_hands.HAND_CONNECTIONS" I get a somewhat empty result. Even though the tracking works and the XYZ coordinates too
this is part of the 'result' i get:
frozenset({(0, 1),
(0, 5),
(0, 17),
(1, 2),
(2, 3),
(3, 4),
(5, 6),
(5, 9),
(6, 7),
. . .
Do I have to import something else for those missing landmark connections? Sorry if this is a silly question
It says unexpected indent on cv2.imshow(‘Hand Tracking’, image)
What do I do
It is impossible for me to install MediaPipe Library
I get "ImportError: libGL.so.1: cannot open shared object file: No such file or directory" when it tries to import mediapipe...
just copied everything to pycharm and works fine, ignore this
friend thank you very much for this great video, I'm ready to see the next video.
Thank you so much for teaching us such great things.
hello.....each time i try to run the code,,,i face this kind of error ' cv2.VideoCapture' object has no attribute 'isOpend' ' can you please help me???
Amazing again bro you always bit faster than me
Baby steps man! Have you checked it out?
It is neither giving any error nor any output. What to do now
I can't install !pip install mediapipe , it throws me error
ERROR: Could not find a version that satisfies the requirement mediapipe
ERROR: No matching distribution found for mediapipe
help
What version of Python are you using? Could try Python 3.7.3?
same error
Where is my images saves in jupyter. I can not finds my images like video time duration 34:50. how to find my directory where the images save
Thank you for this video. what lines of code are needed to display angles on the screen. Also, how can I save the angles to a dataset or an excel file. Thank you
not printing results.multi_hand_landmarks
even after i show my hand pls help
Got hand landmarks in the frame? Double check your hand is in the last frame and see if it is still apparing there.
@@NicholasRenotte thank you
how would i get the x and y values for my left and right hand?
Will run through this on Sunday!
Excellent video, thanks a bunch.
really good content, love your work!!!
Thanks so much @Codista!
excuse me, i read the documentation of mediapipe
it said that hand detection model depends on palm detection model and hand landmark extraction model
for my application it just need the palm position
do you know how can i stop the process when i detect the palm just in case to increase the fps
In one word, Awesome...
оууу😱🔥🔥🔥🔥 будет чем вечером заняться😁😁😁 Thank you very much! 🥰🥳
YESSSS! So pumped you liked it!
I ALWAYS read the description 😂
Me too!! 😂
There's always one! 😂
Me too.. It's a fun summary :)
How do you capture the movements and bring it to the Blender? I've hit myself all over the internet, including with the BlendArMocap addon and I couldn't
Can someone tell me when I do results.multihandlandmarks, it's empty, why?
Bro you are superb. Buddy just one favor bro can you please please make one video in real time object detection along with frame around object in React Native (mobile) using tensorflow . Trust me buddy I am struggling a lot since a long but can't find any good resources to completely execute it
Ya! It's been on the cards for a while, just need to tighten up my RN coding. But definitely it's on the list @Adarsh, ideally using tflite and RN for end to end object detection!
@@NicholasRenotte Thanks buddy for your reply. If you are gonna go for it in coming days, I would request you to do something similar to this heartbeat.fritz.ai/turning-the-mobile-camera-into-a-real-time-object-detector-with-flutter-and-tensorflow-lite-f412962b1805
@@adarshjaiswal7334 awesome, will take a look into it!
Amazing tutorial, gonna try this for sure, thanks for the tutorial, subscribing u for some more such videos
I'm a beginner at this, could you please tell me how to do foot pose estimation (there's no model specifically for foot pose in the mediapipe framework right?)
How do fix this problem
If cv2.waitKey(10) &0 *FF = ord('q'):
Problem is FF is not defined
it is this:
if cv2.waitKey(10) & 0xFF == ord("q"):
break
Can i know which algorithm is used in detecting the hands..
Posenet :)
Hi, I keep getting this error, can anyone help me ?
binary_graph_path=os.path.join(root_path, binary_graph_path))
FileNotFoundError: The path does not exist.
[ WARN:0] global C:\Users\appveyor\AppData\Local\Temp\1\pip-req-build-oduouqig\opencv\modules\videoio\src\cap_msmf.cpp (434) `anonymous-namespace'::SourceReaderCB::~SourceReaderCB terminating async callback
hey, I want to ask a question about the confidence score for each joint. Mediapipe doesn't provide these scores but is there a way to get these confidence scores for each joint of a hand??
Really amazing. Keep it up.
Can the capture data be output as a fbx or bvh animation format for 3d applications?
A few people have been asking for it! Will be working on it soon!
Tnx a Lot !!!! That was great !!!
Traceback (most recent call last):
File "D:/pythonProject2/name.py", line 2, in
import mediapipe as mp
File "D:\pythonProject2\app_d\lib\site-packages\mediapipe\__init__.py", line 16, in
from mediapipe.python import *
File "D:\pythonProject2\app_d\lib\site-packages\mediapipe\python\__init__.py", line 17, in
from mediapipe.python._framework_bindings import resource_util
ImportError: DLL load failed: The specified module could not be found.
please help iam getting this error
Check this out: github.com/google/mediapipe/issues/1839
Hello i want to collect data and train the model with mediapipe, how should i use?
Hi Nicholas a great video I extracted the key points trained them but while detecting I am getting this error "X has 63 features, but this StandardScaler is expecting 84 features as input" (I used your holistic code for detection) any idea bro how to solve it?
Heya @Rupendra, might be missing features when passing through. 63 features is synonymous with the handpose keypoints, but 84 I think is close to the posenet features. Might need to retrain if you're making a model for handpose detection!
Hi this is very helpful. Actually I have to detect hands in a video where the person is wearing gloves, the mediapipe is not giving consistent detections, any suggestions to get better detections?
Hello friends, is there any way to use it to export FBX to blender or connect to blender in real time? It would be great, thank you
Working on it @day spring :)
@@NicholasRenotte ohhhhhhhhhhhhhhhhh，yes，yes
Instead of using my webcam feed can I use a prerecorded video? And how do I do this? Pretty new to this stuff, thanks.
Sure can, just sub out the 0 in cv2.VideoCapture(0) for the path to your video. E.g. cv2.VideoCapture('pathtoyourvideo.mp4')
hi, im trying to get an executable output of this project but i get an error of none existing path of solution in mediapipe and the .exe doesnt run. could you create a video of how to create a .exe file from these kind of projects like hand detections?
Ya, can do.
@@NicholasRenotte thanks man, im looking for to it
Hand tracking is not responding while I move my hand then what should I do ?
What's happening, just not picking it up or?
@@NicholasRenotte when I move my hand ...then system stop performing ,look like hanging my system..
@@RohitKumar-oz7wn any errors in the terminal or notebook?
@@NicholasRenotte no sir
hey dude can you do the sign language detection using this one
Yup, working on something special with it!
Sign Language with mediapipe.
Ya! Been thinking about how to best do this!
When i raise my hand my webcam window gets stuck😢😢
This is a great video, I loved it! One question I have though that I hope you could answer: is this a 2D hand pose estimation or 3D? I seem to have a bit of trouble figuring if it’s 2D or 3D so I would appreciate it if you could explain as to which one it is!
It's 3D, x,y,z with z being estimated depth from the camera @Rohit!
thanks!
Hi mp.solution.drawing_utils where can we find ‘solutions’ in mediapipe as to know what this function does and weather to put something in it or not because the whole code is given on mediapipe, can you help me with this?
Only can use jupyter to train the dataset?
I really like your video
Ayyyee, thanks!
Dear Nicholas,
How can i input those finger skeleton points into Recurrent Neural Network to training a gesture recognition model.
Can you please make a tutorial about it?
Thank you for your help.
Check this out: ruclips.net/video/doDUihpj6ro/видео.html
@@NicholasRenotte Thank you very much.
How did you set up the enviroment?
how can we import a json file to the above code ?
Besides the code, I'm curious about the screen recorder you're using. What is it ??
OBS obsproject.com/
Why use the "& 0xFF" if the comparison will work anyway? Is it somehow making the execution of the comparison faster overall?
waitKey checks if a key is pressed, the second part checks what key was pressed!
Thank you. How do you grab a specific landmark from a specific hand ?
Stay tuned, will go through it in pt two!!
Hey, great video! Just a question, is it necessary to set writeable to False initially?
Helps speed things up but not necessary!
can someone tell me how i can make these green lines thick cz these are too thein in my case
got it at 25:00
if someone else need it
What's the difference between connections and landmarks?
Landmarks = dots
Connections = lines
great video 🔥🔥🔥 , Can you do an activity recognition AI using MediaPipe pose estimation next?
Thanks a bunch @Javian! Like this: ruclips.net/video/We1uB79Ci-w/видео.html
Good afternoon! I decided to write the code one - to-one as in the video. As a result, I reached the usual output of the image from the camera. Then I inserted the code:
with mp_hands.Hands(mine_detection_confidence=0.8, min_tracking_confidence=0.5) as hands:
and gave a bunch of errors. Although mediapipe has installed (pip install mediapipe on the command line). What should I do?
Mistakes:
Traceback (most recent call last):
File "C:\python_work\hello_world.py", line 13, in
with mp_hands.Hands(min_detection_confidence=0.8, min_tracking_confidence=0.5) as hands:
File "C:\Users\Виктор\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\mediapipe\python\solutions\hands.py", line 129, in __init__
super().__init__(
File "C:\Users\Виктор\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\mediapipe\python\solution_base.py", line 229, in __init__
validated_graph.initialize(
FileNotFoundError: The path does not exist.
[ WARN:0] global C:\Users
unneradmin\AppData\Local\Temp\pip-req-build-1hfhc_rd\opencv\modules\videoio\src\cap_msmf.cpp (438) `anonymous-namespace'::SourceReaderCB::~SourceReaderCB terminating async callback
Python 3.9.5
Not sure if this is the source of the error, but this should be min_detection_confidence not mine_detection_confidence?
Great video! Can you please do GPT3 level content creation?
Oh man, actually got the code working but it looks like the library is broken so it maxes out at 293 words generated. Been meaning to raise a GH error for it. But yep, will eventually be coming @Rob!
Hi Nicholas, very nice tutorial really, I have followed last year already. I got one question I did not find any answer so far and maybe can help someone else as well. I hope you can help me out. Can I get the confidence level of only particular hand's landmark? I mean e.g. for somewhat reason the confidence level of landmark n. 8 - INDEX_FINGER_TIP solely. Is there any way to obtain/extract that? THX and keep up very good job!
Dear Nicholas,
Can you please make a hand sign recognition with google colab using our webcam in python that does real time recognition?
Please it would help because the other video you posted about real time sign language detector does not work for google colab.
From a college student
Heya @SharCie, unfortunately the latecy between colab and your webcam doesn't really make this feasible, that's why I do it locally. Training on colab is fine but inference should ideally be done on a local machine!
@@NicholasRenotte Oh okaie..cebause
I don't have a gpu :(
Thank you for the reply tho.. Your content is so much fun to learn.
@@shayinmontreal137 anytime! Stoked you're enjoying it!
can you do a video about installation about mediapipe for python?
thank! How I can get coordinates some point?
Is there any chance to get landmarks for every 2 frames?
Yup, you could just pause or skip a frame as you're running through each!
@@NicholasRenotte Thank you very much :d
Hi, Can you please tell me how to implement a "real-time 3d virtual trial room using webcam."
In theory this is what I think is needed @Arun:
1. Detect keypoints
2. Convert keypoints to a rig
2. Render 3D overlay for clothes to a rig
why do you use jupyter??
I like it! In all honestly it allows for rapid prototyping and exploratory analysis.
Sir write the program for yolov4 object detection
you will find lots of code on github but I'm sure this will create the video on that
Yeah I've been hearing a lot about it. Any reason why yolov4 versus something like TFOD?
@@NicholasRenotte tfod is good but I don’t prefer doing it with JS or react js I can do it with tfod for object detection yolov4 is mostly used for object detection
@@_ShrutiRawat but you can use TFOD in Python as well for Object Detection!
how to fix this NameError: name 'cv2' is not defined?
Run !pip install opencv-python