Interactive Particles - TouchDesigner + Kinect Tutorial 1
HTML-код
- Опубликовано: 13 июл 2024
- In this TouchDesigner tutorial we look at how to create a basic interactive particle system by using the Kinect v2 (works with Azure too), Optical Flow and particlesGPU. We especially have a closer look at the particlesGPU, so you can easily customize the look and behaviour of the particles to your needs.
OpticalFlow with Webcam: • Easy movement detectio...
Generative Particles with Kinect: • Generative Visuals wit...
-----
00:00 Intro / Overview
01:20 Other Techniques & Explanation
06:32 Kinect Input
08:16 Optical Flow
09:23 particlesGPU Setup
13:30 Interaction & Behaviour
18:05 Look & Texturing
25:21 Outro
-----
Files, exclusive content and more:
/ elekktronaut
Special thanks to: Daniel Garcia, Sylvain Després, Nix Campbell, Rob, Paola, Teruhisa, Simón Jaramillo Vallejo, Jeppe Vinum, Danny, guojian, hans mortelmans, Yeah, Llyod Marsden, Acid JOhnny, Anti Alias, Lucas Vogel, martn kern, connor carnes, Lora Shopova, Gonzalo Gelso, Christian Bagass, Nisan Baskin, 岳夫 宇田川, Kelsie Hoffman, david robert, Jarren Lau, swirledBridger, Roberto Mucchiut, Greg, David Salaun, tassso treis, Digital FUN, Brian Smith, Nic Goodrich, zufallsgeneriert_, Jay Wrkr, Daniel Clarke, sacha safretti, Low Rez Lab, seanthefrotographer, Péron Yann, cyyy, Lotto Andrea Carlotto, Uriah Sav, Masayuki Azegami, JohnDoh, Louise Macfadyen, im_pakt, graziano de vecchis, Leo Torres, Anton Orlov, Abinash Mallick, 선용 김, neo murai, Tmdjn YhN, Octave, Callummis, Michael Christiansen, 욱쓰 유, JEONGMIN PARK, Helin Ulas, Milkorva, Ryan Zell, Aurelio Adoratorio, Drasko V, throughthewoods, Adam Scheirman, Samiksha Nair, Jacob Golden, Ezra Ranz, fxsan, Federico Rusconi, Émilie Laplante, Migu Mianizt Leung, Hastral, Sam Chilton, Not Invader Zim, claudio leggieri, 瑀 鄭, Samvel Krajian, K. KØX, dfluid, Dan Howard, Arshiya Vij, Byron Dickey, Janina Ebner, Annie Yang, Herman Balbaera, Daniel Kass, Gab Doucet, 구섭 김,khumeia, Mike Pastore, zia, Ken Kobayashi, Gökhan Doğan and こ ちょ
If you have any questions, feel free to ask.
IG: @elekktronaut
/ elekktronaut
Wonderful. I hope to see more interactive tutorials from you in the future. Thanks a lots.
Thank you so much for making this video! I’ve been so interested in interactive projection mapping for months but kinda was afraid to even try to learn it because it seems so advanced. This video taught me so much about what thinking goes behind it and what I could start by learning. So, thank you so much for this!
amazing. this is the first video I have watched on learning touch designer and I am excited to get started. Loved the banana particles
when the circle was added, I jumped on the chair.😄 It's so cool)) Thanks for the great tutorial!
Amazing! your tutorials rly help me a lot!! Thanks and keep up good work~
This is really nice, great explanations. I like that you refer to past TD works that helped inform you on how to do things. And I use your particle repulsion component when I VJ, I forget it was from you... thanks!
Thanks for the detailed explanation of Particles GPU. Now it makes sense to me.
Thank you for the lesson! beautiful movements and a pleasant voice)
Love it, great tutorial as usual
Perfect! I just decided to create something like this and look what pops up. Thanks
Thank you for always the best lectures.
This is one amazing tutorial. i have been looking how to.... For a long while. THANKS!!!!
you always have what im looking for! thanks a lot.
Amazing tutorial! Learnt alot in a very short time :)
Cool! Funny coincidence with making Kinect tutorials in about same time, but totally different topics :)
Yea I thought so too! Nice to see the different approaches :)
You two are such legends in the TD community, thank you both for everything.
the future relies on you guys for sure, thx for that
@@RusticRaver factd
you are the best!!!! all other tutorials are simply useless!!!
🙌🙌🙌 thanks so much !
Would be amazing to have a series of kinect tutorials 😯💣💥🔥🌈
I agree, would absolutely love that!
Thank you for sharing this!
Thank you! Learn much from it
Thank you for this!
Thank you for this amazing video! Touch Designer changed the Optical flow node quite a bit...but I managed to make my way through.
the one in the palette is pretty much the same :)
Thanks for sharing this video.
Amazing teacher
Merci beaucoup pour ce tuto très clair.
could you do an updated version regarding the particlesgpu? apparently there has been a new 1.1 version which is so different that we cant follow your tutorial anymore. there's no grid and things changes so much
you can find the information you need here ruclips.net/video/xODS0pZ6CEo/видео.html&ab_channel=TheInteractive%26ImmersiveHQ
Have you found a way?
Yes, I agree. Since I tried but after rgbkey I couldn't follow the video
I founded it! Some parameters moved to the Particle source panel. Choose Particle source - Shape - disk and change the Orientation - XY plane. To change the Camera, click Viewer Active and click RMB - Parameters - Camera - Xform. It will zoom in. Finally, we meet many particles like stars :) When connect rgbeky OP, Output has to be Output 0(Top Render). Output1 sends TOP Position data. Also check connetion of Input 3(TOP Opitcalflow). If I have some errors, or you have other good ways, please give the feedback.
@@camino8596 Help! Can you explain the part about camera and RMB? How do I get to the RMB part? I
This is very fun and is just what I was looking for. Thanks! How would I go about triggering the camera from further away? Right now it's only working pretty close up to the camera. Can't wait to share the tweaks I've done with you design! Thanks again!
Thanks bro!!
Thanks a lot!
THANK YOU
This was really helpful, thank you. Is there a way to reverse the forces of the particles? So the kinect's input is attracting particles, instead of pushing away the effect.
Brilliant tutorial. Thanks a million! Would there be a quick-ish way that you could explain here to set up the particle system to only output data / leaves when it receives movement from the kinect. So blank screen until the sensor picks up movement and passes it to the optical flow / particles gpu, then the leaves are created to follow the flow of the hand crossing the sensor, for example. Hope that makes sense. Thanks!
Hi Bileam, Thank you for this tutorial. It was really good and helpfull. I have question. How can I change the background? I want to use a photo as background instead of the black background.
Great Tutorial !
could you show how to change and distort an image interactively through the Kinect?
That would be so nice ! :)
Hi, this is a wonderful video. Touchdesigner is new for me. I have a question. Instead of particles, could I use a video made with after effects and interact with it through the kinect modifying it? I don't know if my request is clear. For example, I have a moving grid made with after effects. Could I transform it using kinect as you do with the particles in this tutorial? I tried with MovieIn TOP but I cannot connect Kinect TOP as input for the video.
hey nice tutorial! how do you get the particles Gpu to use that leaves preset?? mine only shows white lines moving around.
Firstly thank you for the video I love it! I would like to change the colour of the particles when they got moved by the hand interaction. Have you any idea how I could do that pls? Thank you in advance for your response. :)
Do you think you can do a tutorial and combines this with your Ableton tutorials? Gestural control of a synth with visuals?
Hey this is really cool and informative. However, I have a quick question, can this experience be built using Unity3D and Kinect?
Tq!!!!
Hi Bileam, I am trying to create random flying typography animation for VR in unity. I animate the typo in after effect but when I export to the unity they look like 2D flat animation which is I need a 3D flying typo can I do it in Touchdesigner? if you can share some tips I would be so grateful !!!
Could you possibly do a new tutorial with the new particlesGPU?
Did you find a solution for new?
whats up, bileam! one issue I ran into: once I reached the interaction & behavior portion, the movement felt fluid and in-sync based on the settings I used following the tutorial. however after a few minutes of using, it began to lag heavily. tried closing and re-opening, still being met to the same lag...any ideas? still a bit of a beginner to the program.
thanks for your work bro.
Hi, where did I find the grid op inside the particleGPU? I'm working on a new version of TD and it seems a bit different... tnks!
im having the same problem do let me know if youve found it
Hello, amazing tutorial!!
I just wanted to ask 2 things is it possible for the particles to be more connected? and if its possible to start the "wave" when hands appear
Thank you so much for your time!
hi! thank you so much for this!! i would love to know what kind of PC do you prefer for touchdesigner. i currently have a dell G15, but the particle GPU is super slow and the over all performance is laggy. would you have any PC recommendations?
hi, thank you so much, but i'd like to ask, what if i wanted to make my particle gpu a water fall, or an ocean, or i wanted to bring in a totally different content into it to make it interactive, please how do i go about it. thank you
What should I modify for non-flat particles? e.g. spheres?
Can you point me to a tutorial to change it so the particles avoid hands and input or are repelled like the walking floor video you showed?
“Kinect death map” 😂❤
Hey, working on a newer version of TD, I was unable to make it past the inside of particles. Wasn't sure what the "grid" was replaced by..
Have the same issue and i stop there also ...is there any help
Same problem, my pariclesGpu is completely different
Could you found a solution?
anyone found the solution?
Hi! Do you know if it would work with intel realsense as well?
Could you pleaseeee make a tutorial on how you did the interaction of the hallway in the Dubai bar?
Could this be combined with Vr glasses like oculus so a person could experience this and the particles all around the.
Instead of just on a screen???
WHAT I NEED IN MY LIFE IS ? BANANA PARTICLES!!!!
Can you use the kinect 2 for Xbox with the windows adapter to work with these tops?
Hello, is it possible to export this effect interactively?
I want to bind it to a projection. It should come to a form that I can double click and open. How can I do that?
hey do you talk about the xbox kinect camera? thanks for the videos :) really inspiring
Yea it's the xbox one kinect :)
Hello where I can get the old particleGPU? 11:25 In the current version of TD there’s much more complicated particleGPU then what you using right now. Please kindly let me know if you had some answer for this. Thank you 🙏🙏🙏
I once played around with the kinect and the nvidia flow emitter. A lot of fun, but I really missed the optical flow effect of the emitter. Think 'throwing fireballs'. Have you tried something similar? Would be nice to see a test/tut on it
I haven't tried that but I'll have a look!
fire idea!
all pun intended.
So since 2022 they've removed the optical flow input from the Particles GPU and I'm unable to get the effects you're showing, is there an update planned for this tutorial or can you point me to a work around? Thanks in advance
May I ask if Kinect Xbox 360 would work for TD?
thanks so much for the tutorial!
Great tutorial !! I was just wondering does anyone know how to change the background color of it? When the particles get displaced there's just a black background behind them and I wanna change it to a lighter color. Thanks! 😀
just can use a transform at the very end instead of a rgb key, change the color / add 1 / and turn on the transform
Hi! This is a wonderful tutorial. I was wondering if anyone else has run into the trouble of the particlesGpu not really showing up? On occasion I get a lot of particles in one go, but each time I manage to get them back, they slowly fade away again. I'm very new to this so I'm not sure what to look for to troubleshoot! Would love some advice
hey I have this problem as well. Did you happen to find a solution?
Hi can it be connected to Arduino and using a ultrasonic sensor to control the movement?
why i get a very low amount of particles? has something to do whit my graphic card? or i miss something in the tutorial?
Hey elekktronaut :)
Coud you update the part witth the Particle generator?
It doesnt work anymore with the new generator tool :S
Can I use cursor to do this interaction instead of turning on camera?
Is it possible to replace the particles with 3D objects instead of 2D textures?
I've heard it possible but very complicated.. you'd have to deep dive into the particlesGPU, I personally don't know how to change that.
do you know if it works with kinect 360?
Hello, how come my show emitter source is greyed out in my particlesGPU? It is also in my Particle Source Menu not Render, thank you
So it looks like the leaves make the photo visible when I move my hand
Can point clouds be used in place of individual texture points? Thanks!
Can you elaborate on what you mean?
@@elekktronaut sorry- eeps just seeing your response. I'm one of your supporters so I will ask in the Patreon
hi how are you? I tried to install the kinect v2 on my pc (windows 10) but I get an error message when I try to add the kinect to the program, I use my computer's webcam, I don't know if that's the problem ... I would really appreciate the help!!
Hi, Thanks for your sharing. It is very useful. As this video was taken in 2021, I am using the 2022 32120 version. I found that the particlesGPU has changed. Are there any updates or tutorials about adopting the new particlesGPU and 2021 versions? Otherwise, I might download the old version of TD. Thank you.
Hi, did you find a solution ? I have the same problem :/
yeah same did u find a solution?
you can combine this tutorial here with this one:
ruclips.net/video/xODS0pZ6CEo/видео.html&ab_channel=TheInteractive%26ImmersiveH
Your explanation is great, but since TD has been updated in the middle of this year, particlesGpu has become 2.0, and many internal nodes have changed, is it possible for you to explain again for particlesGpu 2.0? please .......
Hi, i have bypassed the "grid" problem (inside particleGpu) via rotation of the camera. There is an object in the middle left of the area (left to null3)
@@TheMomentumFour I'm a total noob to TD, but it seems that the OP that replaces the "grid" in the new particlesGPU is called "pointGenerator" on the top left part of the COMP, inside the "Particle Source" frame. You can change the size and orientation. Actually, I believe you can change them in th particlesGPU COMP parameters tab, under the tab "Particle Source"
@@TheMomentumFour hey does it work?
@@TheMomentumFour did you try it
@@hedzabel does it work for you cuz it isnt for me
good i'm alex r and i don't speak english but traduscan
I have a problem with particles GPU it says it has to do with the CUDA and OpenCL also talks about noice1 but I don't know how to solve it, can you help me, I'm using kinect 1 (1473 and 1414)
Thank you very much for your prompt collaboration.
Can i use a camera insteat of Kinnect?
I do not have Kinect how to use the webcam for this?
Is there a work around for people with mac osx - The kinect doesn't seem to work on my operating system
i believe its windows only :(
Hi, thank you for your video but I have a big problem , when I drag particle GPU then I input RGBkey they aren't same ( in particle gpu I can see the leaf but in rgb key I just see some pixel in the below
can you help me to solve it?
hey did you get the solution
Can you give me the link to the file source in patron, I can not find it and I'm not sure you even give the file for download. \thanks
Was kann ich tun, wenn ich eine Kinect und ein Adapter habe und auch schon die SDK mit 2.0 heruntergeladen habe. Aber die Kinect immer noch nicht funktioniert? Wird die Kinect noch unterstützt?
With the newest version of TouchDesigner the particleGPU node is different. Any idea what I would need to change to get the same functionality?
hey did you find it?
why doesnt particlegpu work for me?
I stuck at the grid. There’s no grid nor similar node inside my particleGpu, is it because of the version?
Yes there is no grid. He is using particle gpu 1.0, the current version is 1.1. I ran into the same problem. I tried to adapt this tutorial to the new version but there's just too many things that have changed. I can get close but it's not working that well.
Kinect? the xbox one, will it work too?
the newest version of touchdesigner has some pretty significant changes to the particlegpu. I'm downloading an older version and trying again..
did it work?
Sadly Kinect TOP doesn't work with Mac :(
Is kinect still viable for TD in 2023?
yes
Hi, I need help, instead of so many particles, can i deflect just 3 images placed already in screen.