ml5.js Pose Estimation with PoseNet

Поделиться
HTML-код
  • Опубликовано: 26 авг 2024

Комментарии • 100

  • @TheCodingTrain
    @TheCodingTrain  4 года назад +22

    Thanks to Dan Oved who let me know that you can read more about the model and how it was trained in the research paper! arxiv.org/abs/1803.08225

    • @subschallenge-nh4xp
      @subschallenge-nh4xp 4 года назад

      Are you give me a link of a website can I install the framework that your use

    • @revtane9
      @revtane9 4 года назад +1

      the index.html just says "Loading...", do you know what's the problem?
      thanks a lot

    • @TheNewton
      @TheNewton 4 года назад +1

      The Coding Train COCO dataset
      "We train our model on the standard COCO keypoint dataset [1], which an-
      notates multiple people with 12 body and 5 facial keypoints"

  • @vrdash
    @vrdash 4 года назад +57

    3:01 "if you found you way here it's because you are making some interactive projects". Well no no, we just love your videos and whether they are relevant or not to my daily life, I watch it chooo choooo! :p

  • @ritwikrm771
    @ritwikrm771 4 года назад +40

    I just want to stand up and applaud for the great work you are doing... You are funny, enthusiastic, full of so much energy literally all the time ... Your tutorials are so easy to understand and follow... I am lucky that I came across a teacher like you.... Keep up the Good Work..!!

    • @vkray
      @vkray 4 года назад +1

      Ritwik R M Thanks to me.

  • @Bhooklgihai
    @Bhooklgihai 3 месяца назад

    I feel I am watching cartoon and learning... You made it so easy and enjoyable to learn😎

  • @spaarks84
    @spaarks84 4 года назад +9

    I. love. this. man.

  • @RodrigoStuchi
    @RodrigoStuchi 4 года назад +1

    Awesome, really appreciate what you are doing!
    The applicability of this topic is huge.
    keep doing and Thank you!

  • @louamacademie5837
    @louamacademie5837 6 месяцев назад

    thank you for the great explanation man :)

  • @michalbotor
    @michalbotor 4 года назад +6

    dear daniel,
    a few days ago i bought myself an arduino, and i've been playing with it since then, and to my honest surprise i've found out, that the ide that the arduino uses is build on top of the one, that.. processing uses! so, first of all, congratulations! but.. that brings me to my question to you: would you be willing to make tutorials on the visualization of arduino's data coming from its serial port in processing?
    also i would love to see you make some arduino project in your cabana, like a plant watering system, or a lamp that lights up either because of your movement or lack of sunlight.

  • @anubhav200
    @anubhav200 3 года назад

    This video was perfect at so many levels. Thanks for making such awesome videos.

  • @jaggyjut
    @jaggyjut 4 года назад +3

    Hi Dan, thanks for the awesome content. I wanted to know how I could use the posenet model to compare if dancer A (student) is able to move like dancer B (dance teacher) and calculate a score on how close the student pose was to the teacher

  • @ahalyasubramanian2315
    @ahalyasubramanian2315 4 года назад

    Awesome!!! Really helps me to understand the working of posenet.. Thanks a lot!!!

  • @kisame_5331
    @kisame_5331 4 года назад +1

    I like how some of the parts are sped up... Anyhoo I love your work!!

    • @masonsickler2878
      @masonsickler2878 4 года назад +1

      he does this a lot, i just love that these sped up parts at the beginning are like 2 seconds of footage

  • @tejasnareshsuvarna7948
    @tejasnareshsuvarna7948 4 года назад

    You are a teaching jewel. Great content, great background, great music and great you m 🙃

  • @yashwanthd1998
    @yashwanthd1998 4 года назад +1

    Great as usual..Would like to see build such models in processing..

    • @TheCodingTrain
      @TheCodingTrain  4 года назад +2

      You can use PoseNet in Processing with RunwayML! ruclips.net/video/7btNir5L8Jc/видео.html

  • @bobg3camcallaghang3cam5
    @bobg3camcallaghang3cam5 4 года назад

    I would love to see the followup video on classifying poses! Great mix of info and detail!

  • @user-ko7hd7wi5k
    @user-ko7hd7wi5k 11 месяцев назад

    Hi sir,I loved the way of presentation of the matter,could you please tell me on how to implement a sitting posture correction model under ML domain where in we need to detect whether a person's sitting position is correct or not?

  • @amansales4226
    @amansales4226 4 года назад

    I always love your codes and perfection in them

  • @radh3y-_-
    @radh3y-_- 4 года назад +6

    Hi sir, can you teach us to make a qr/barcode scanner.
    Thanks....... otherwise great video

    • @imporbis345
      @imporbis345 4 года назад

      1. Go to your appstore of your belief
      2. Search for "QR/Barcode Scanner"
      3. Choose the one you like most
      4. Download the choosen app
      5. Finished - Your QR/Barcode Scanner is now on your phone

  • @MoMoGammerOfficial
    @MoMoGammerOfficial 4 года назад

    Omg! I was looking for something like this.... This is awesome! I got a perfect idea for my next project :) Thanks man.

    • @vkray
      @vkray 4 года назад

      Mopeio Official What’s ur idea? Could u share with the world? So, I can copy the idea.

  • @geoffwagner4935
    @geoffwagner4935 11 месяцев назад

    I have heard that eye retina spacing is useful for security,our eye gap is as unique as our fingerprints

  • @petrsehnal7990
    @petrsehnal7990 2 года назад

    Great work, sir!

  • @PcGamerz21
    @PcGamerz21 4 года назад +1

    Thanks for this Dan.
    I was wondering if you could make car recognition using license and color. From photo detect if it is vehicle and from there extract license plate & vehicle color and output it using only javascript? I have seen this in python but not javascript, would be glad if there is video from you on this :D

  • @StarContract
    @StarContract 4 года назад

    Absolutely amazing

  • @MrGeorgeTheCat
    @MrGeorgeTheCat 3 года назад

    Subscribed, great video! Thank you

  •  4 года назад

    Very interesting. Thanks. Each time you completed a task, can we have access to your final code?

  • @geekelectronics1369
    @geekelectronics1369 3 года назад

    Great video.
    how can we measure the distance between one keypoint(shoulder) to Another key point(hip)?

  • @adanzeyeasaglik
    @adanzeyeasaglik 4 года назад

    Hello Dan
    This series is really amazing just like your other Code Train series. Thanks a lot to give us this valuable and understandable training opportunity.
    I just started to learn P5 and ml5 with your videos. Pose detection is great using trained model. I am curious how can I start to an object tracking, not human pose, not object detection but tracking an object coordinates? How should I start, do you have and advice for any documentation using p5 and ml5?

    • @TheCodingTrain
      @TheCodingTrain  4 года назад

      Hey! This might change soon but you can use this class to get started. Are you in the discord? We can help you more there too! ml5js.org/reference/api-YOLO/

  • @akamfoad
    @akamfoad 4 года назад +1

    That is wonderful😍

  • @crypt1n4
    @crypt1n4 4 года назад

    Really good editing!

  • @4541047
    @4541047 4 года назад

    Amazing!!!
    One question. Can you teel when the knees are touching the floor?

  • @Lyrik-Klinge
    @Lyrik-Klinge 4 года назад

    You are so inspiring!

  • @rahishkansal2212
    @rahishkansal2212 3 года назад

    Awesome Tutorial, do there is any model which provide Z coordinate as well?

  • @keshavkumar-yb7ss
    @keshavkumar-yb7ss 3 года назад

    Ohh ok let's suppose I have all the coordinates and skeleton kind of the how you will draw that point over an image like opencv does(my concern is for browser)

  • @javierzepeda5258
    @javierzepeda5258 3 года назад

    Great video, very usefull
    i have a question, if i want to use a canvas of html to stylish them with CSS, how could be?

  • @krishnakini6263
    @krishnakini6263 2 года назад

    thanks , how to flip vedio ?

  • @tx6723
    @tx6723 4 года назад

    I would enjoy some Java implementations/videos aswell with Java libraries with processing and javafx and deeplearning4j/tensorflow Java on eclipse or maybe even thought ik it's a stretch but some c++ with sfml and open source libraries like imgui

  • @user-fr7mz3ft8s
    @user-fr7mz3ft8s 9 месяцев назад

    the cam image looks fixed on my labtop as soon as I added green ellipse...ㅠㅠ

  • @ozgurkutlu1730
    @ozgurkutlu1730 4 года назад

    Hi daniel good job. Do you know to way for reducing following point's delay time in video

  • @izox3530
    @izox3530 4 года назад

    Hi,coding it's life 👍💛💪

  • @emilievaneps8858
    @emilievaneps8858 3 года назад

    thanks for the video! works perfectly on j5.js but not when I do it locally. Why is this?

  • @jonleinena9398
    @jonleinena9398 3 года назад

    Can you upload any example using Mediapipe? Thanks

  • @rony3044
    @rony3044 3 года назад

    how can i teach to detect exercises like squats and pushups?

  • @arnavsirigere2877
    @arnavsirigere2877 4 года назад

    Love it!

  • @Randomness960TVX
    @Randomness960TVX 3 года назад

    Hi all, i have an issue with posenet with ml5 and p5. There is a preloaded function that permit to export the keypoints ? How can i export the keypoints of each frame to JSON or CSV files?

  • @mordiaky
    @mordiaky 4 года назад

    @The Coding Train , can you do a video on Voronoi Tessellation?

  • @pranavkushare5109
    @pranavkushare5109 3 года назад +1

    Can we use our own trained models ?

  • @himanshumangal483
    @himanshumangal483 4 года назад

    The 17 coordinate which we are getting is dependent or independent from location of user from the webcam ??

  • @DeepteshLovesTECH
    @DeepteshLovesTECH 4 года назад

    Please HELP:
    Uncaught ReferenceError: createCapture is not defined (sketch: line 5)

  • @hussainsalih3520
    @hussainsalih3520 4 года назад

    Thanks

  • @fernandosanchezvillanueva4762
    @fernandosanchezvillanueva4762 4 года назад

    great!!

  • @heloiserozes8230
    @heloiserozes8230 4 года назад

    Hello ! Did you try PoseNet with Swift (for Apple developers)?

  • @ivanbezerra3531
    @ivanbezerra3531 3 года назад

    Hi, I am working into a project and need to capture and call two points in different bodies. I was able to use pose net to identify the 2 bodies. However, I was not able to call in the code a specific point of each body. Wrist or nose 👃 only for one of the bodies and the code switches on who is more close to the cam. Any good soul out there with a lead on how I might solve? Thanks in advance. I love this channel

    • @TheCodingTrain
      @TheCodingTrain  3 года назад

      Hey Ivan!
      I'm sure our amazing community might have some people that can help you out!
      Take a look at our help section on Discord! discord.gg/hPuGy2g
      ~The Coding Train Team🚂

  • @ronyra
    @ronyra 3 года назад

    Heyyy, i have a question, how can we train a model to classify which exercise is being done?

  • @jeyashreekothai2526
    @jeyashreekothai2526 3 года назад

    hi Dan , one new requirement..
    I have a project wherein I want to have this webcam feed(which works from createCapture func) and a video from my desktop.. but am not finding the command/function to load a video from my local.. can you please advise

  • @ayusharyal6346
    @ayusharyal6346 4 года назад

    Can we use posenet to compare dynamic pose with some other pose

  • @rachmadimamtarecha5736
    @rachmadimamtarecha5736 4 года назад

    I got some problem in browser console such as "The AudioContext was not allowed to start" and "OMException: Could not start video source", how to fix this problem?

  • @jeremymarks8587
    @jeremymarks8587 3 года назад

    Anyone have any idea if this would work for classifying poses while riding a bodyboard. I need to somehow be able to classify each flip or trick while riding a bodyboard, but I feel the actual board may mess up the pose estimation because it will cut off parts of the body much of the time during the flips

  • @arpanmondal2126
    @arpanmondal2126 4 года назад

    While running the sketch on my laptop I was not getting much accurate results as my webcam is not so good, could U just tell me How to use an external camera to connect to my p5js canvas?

  • @Johnyindo387
    @Johnyindo387 7 месяцев назад

    Haruda bhonela tunggal ika😊

  • @wgalloPT
    @wgalloPT 3 года назад

    What is the code if instead of webcam i have a video in my drive and want to import it?

  • @rkkmmmkkr
    @rkkmmmkkr 4 года назад

    can anyone tell me which software he used for video....please pleasse

  • @martinascomazzon906
    @martinascomazzon906 4 года назад

    did you ever try to get ground level value? I been trying to detect it for a while now, and there is no possible way to do it. I tried getting the right and left ankle value after like 50 iterations, and it gives me idk 440, and in the next iteration, say iteration 51, it gives me 330, so there is no possible way to detect if for example; the person jumped.
    Do you have any ideas on how to get around this ?

  • @dvaVivy
    @dvaVivy 4 года назад

    Is it possible to use this on the processing environment?

  • @young_7412
    @young_7412 2 года назад

    Anyone has following problem when using p5, "TypeError: Cannot read properties of undefined (reading '_report')"? How to solve this problem?

  • @fedemaster15
    @fedemaster15 4 года назад

    Can someone help me i was following all the steps in the video but the shapes never showed up

  • @miguelguty399
    @miguelguty399 4 года назад

    Hi.
    will there be any way to link an IP camera?

  • @ZerofeverOfficial
    @ZerofeverOfficial 4 года назад

    Anyone know if theres a way to get an FBX out of this?

  • @swaruptripathy9071
    @swaruptripathy9071 4 года назад

    Can anyone please help me on how to access the IP camera in p5 ?

  • @warrenchilambe3927
    @warrenchilambe3927 4 года назад

    please do a trending algorithm in javascript..please please please, only you can do it in a way i can understand please please

  • @ankitsolanki6490
    @ankitsolanki6490 3 года назад

    Can we find the angle between joints ?

    • @TheCodingTrain
      @TheCodingTrain  3 года назад

      Yes, the new video I'm about to release called "angles and vectors" will have some tips!

  • @Johnyindo387
    @Johnyindo387 7 месяцев назад

    Ora le University 😊

  • @DeepteshLovesTECH
    @DeepteshLovesTECH 4 года назад

    please help: Windows 10
    16: Uncaught ReferenceError: ml5 is not defined

    • @coulomb1
      @coulomb1 4 года назад

      I looked at thier website... You have to go to the index.html and write under all of the script tags:

  • @sannaiac
    @sannaiac 3 года назад

    Thanks,very interesting in this example kemtai.com, How They have to build a PoseNet experience in a WordPress Webisite?

  • @geoffwagner4935
    @geoffwagner4935 11 месяцев назад

    and it is almost Halloween

  • @govindkatyura7485
    @govindkatyura7485 4 года назад

    I want to use posenet in python for kick detection is it possible ??

    • @TheCodingTrain
      @TheCodingTrain  4 года назад +1

      See this discussion! github.com/tensorflow/tfjs/issues/572

    • @govindkatyura7485
      @govindkatyura7485 4 года назад

      @@TheCodingTrain thank you so much for the response , but if you have any other suggestions for the kick detection in a video please help me .

  • @etherealdude791
    @etherealdude791 4 года назад

    5:04

  • @Johnyindo387
    @Johnyindo387 7 месяцев назад

    Nuvo😊

  • @peterhayman
    @peterhayman 4 года назад

    music while drawing is super distracting, good video tho :)

  • @sayochikun3288
    @sayochikun3288 3 года назад

    12:48 "I used ml5 to beat ml5"

  • @museerasyed2504
    @museerasyed2504 3 года назад

    this has stopped showing keypoints

    • @museerasyed2504
      @museerasyed2504 3 года назад

      TypeError: Cannot read property 'html' of null
      at modelReady (about:srcdoc:93:20)
      at unpkg.com/ml5@0.4.3/dist/ml5.min.js:124:28684
      at unpkg.com/ml5@0.4.3/dist/ml5.min.js:56:26100

  • @jamesking2439
    @jamesking2439 4 года назад

    pose.nose

  • @ZK-im6er
    @ZK-im6er 4 года назад

    Coding your own vr body tracking camera, anyone?

  • @peterkovinski8476
    @peterkovinski8476 4 года назад

    It teaches you how to use a Coconut to make a Coconut hat.