Hand Tracking in TouchDesigner with MediaPipe - TouchDesigner Beginner Tutorial

This tutorial is inspired from the Genuary (generative art month in January) prompt from day 3 to create something in the style of a Droste effect / a Picture in a Picture. I use the MediaPipe hand tracking plugin created by Dom Scott and myself to controll the motion. This also features a bonus Reaction Diffusion effect.
Link to Genuary: genuary.art/
Link to the MediaPipe plugin: github.com/torinmb/mediapipe-...
Link to my Patreon: / blankensmithing
0:00 Intro and Overview
0:33 Genuary Overview
0:46 Setup MediaPipe
2:51 Move The Video with Hand Tracking
4:57 Picture in Picture
5:24 Reaction Diffusion
6:40 Outro

[@manaaloomerbhoy5264]

so cool, thank you!

[@user-fw5yh1cs7e]

good work

[@rishabhgandhi6869]

Hey, the effect looks amazing! I'm very new to TD, when i do video device in, I can see my webcam but unable to see it in the mediapipe webcam section, any suggestions on how i could fix this?

[@WorldWideBasementVibes]

Good stuff, Torin!

[@blankensmithing]

Thanks!!

[@aa-qb1bt]

Great. How should I input a video that was originally shot vertically into MediaPipe, instead of trimming it vertically? I captured the video using OBS and set the resolution in TouchDesigner to 1080x1920, but the bottom half is covered in black and not displayed properly.

[@pollyyyyyyy6759]

I have successfully used Mediapipe in real-time applications, but I'm unsure how to apply it to recorded videos. I noticed the use of a web browser in TD, but I'm not sure how to adapt it for recorded video.
Apart from that, the hand tracking tutorial has been incredibly helpful. I've been searching for this for a long time!
Thaaaaaaanks a lot!

[@blankensmithing]

Glad the hand-tracking has been helpful. Are you trying to pipe a recorded video into MediaPipe to analyze it?

[@pollyyyyyyy6759]

@@blankensmithing Ohhhhhhhh, I get it now! At first I had no idea what "pipe a video” meant, but then I found your earlier video showing how to pipe a video, which is exactly what I’ve been searching for! Learned a new term. Thanks for your reply!!!

[@blankensmithing]

@@pollyyyyyyy6759 yay glad you got it working!

[@liyanahanif5152]

This is so helpful! Are you using a Mac?
Can you please do more tutorial using the mediapipe plugin pleaseee?

[@blankensmithing]

Thanks! Yeah I'm on Mac, but this works on Mac and PC. Looking forward to putting out some more tutorials soon!

[@HeLevi]

I am doing a face-tracking vfx project right now, your Mediapipe is an actual life saver, but there is an issue that the Mediapipe container node keeps showing the loading animation, how could I fix this? Thanks in advance!!!!

[@danger_design]

"In the common section, set it to the parent panel size"
Set *what* to the parent panel size? What parameter am I interacting with?
"Set the *output resolution* to the parent panel size" would be the only instructive way to describe what you're doing. I'm really not sure if this deserves to be described as a 'tutorial'.

[@blankensmithing]

thanks for the feedback I’ll try to be clear in the parameters that I describe. seems like from the visual reference you were able to put it together though 😄

[@danger_design]

@@blankensmithing I managed to put together the demonstration, yes.
I'm sure that if I did 30 of these in a month, I'd also miss some details here and there.