Virtual Worlds in TouchDesigner

The excitement recently about "virtual production" is bringing attention to a technique we have used in projection mapping for years called fixed or forced perspective.
What is most interesting these days is that computer systems are finally able to do the real-time rendering possible to dynamically adjust the cameras position. We also have access to more tracking techniques making the whole thing way more accessible. None of this is new, it's just coming of age.
This project was made in one day using TouchDesigner and using a vive tracking system.

[@liverenders]

That's an awesome idea with the lamps and demonstrating a unique way of interacting with a virtual scene.
Thanks for sharing!

[@canoksas2979]

Could you make a tutorial this is so cool!

[@tokamu]

this is mind boggling

[@bluebaconjake405]

If you’re asking how they did this, this is my “speculation”:
You can see the vive tracker on the lamp and they have one on the camera too. Then they feed the tracking data and monitor location into a game engine. Finally, the rendering is shown on the screen. So this illusion only works through a camera. Maybe it can be applied to the film industry but idk

[@GooseMcdonald]

Ndisplay with vive

[@bluebaconjake405]

@@GooseMcdonald yep. Basically for virtual productions

[@HarveyMoon]

@@GooseMcdonald no Ndisplay but yes vive. I'm using "TouchDesigner" not a game engine

[@RmaNYouTube]

for game engines like Unreal, this makes sense, but is it possible to do all this without any game engine and only TouchDesigner?

[@akkkkkkkk]

@@RmaNRUclips the sensors could feed the light parameters, i think

[@RubberTag]

Soo cool!!!

[@suhyunpark9024]

I've been thinking how this thing works for almost a year and I just found out they were using vive tracker which I believe the camera is also attached with one!

[@oservoasafe]

what in the world

[@vraalten]

Great! Can you elaborate on how you have achieved this?

[@greatestever8169]

It’s called projection mapping

[@glsseagleii35]

@@greatestever8169 😂😂😂 largest oversimplification of my life!! good one 😂😂

[@greatestever8169]

@@glsseagleii35 yes! But perfect landing point for best results for understanding!

[@ygreq]

for the camera filming this setup, I am guessing he used a tracking device on the camera which changes the viewing angle of the camera in TD.

[@아이폰-1]

Can I know the diplay's model name?

[@geebee8749]

made it really cool but can you explain more precisly how you made it?

[@ooohlookitshines3944]

Wtf am I watching 👀 😮soooo intriguing

[@Winnders]

How the FUUUUU

[@M.O.L.D.EFfects]

I had a hard day but this presentation hit my hype😮

[@PabloLucio]

I always remember watching this video for the first somewhere and thinking... Woah, amazing!

[@ify105]

How does one learn to make something like this. Can you post components and what you used and what u did in touch designer

[@spectra.studio]

tutorials by Steve Mason on this page will go into perspective tricks in Touchdesigner.
derivative.ca/community-post/touchdesigner-mutek-workshop-2012-6-hours-video

[@LukeHildreth]

@@spectra.studio what a gold mine :)

[@RamirosLab]

I know how "easy" can be done ... but still... it looks amazing!

[@ElCanalDeJulca]

How 👀

[@Iไอแอมน้องเจอร์รี่]

I'm a university student. I would really appreciate it if you could give me a rough idea of ​​how to do this project. So that I can try to become a quality artist like you in the future (can Just Touch Design do this job?)

[@PneumanaBreathwork]

What is this sorcery!!!!

[@deanmarshdog]

amazing

[@everend_xyz]

Do you do those type of things in touchdesigner?

[@mariusirgens5555]

I am guessing you are using AR technology to achieve this?

[@Noiretranquility]

Fantastic!

[@everend_xyz]

What are those screens?

[@brilliantchicken4873]

@.@ This feels like black magic

[@JJZOlarte]

Wild

[@BERGie-qz9df]

plz do tutorial for this

[@nas_abraham]

WTFFFFFFFFF

[@user-ig6hg6jd1y]

That's so sick

[@ivanlam5131]

May I ask how you did that?

[@georgeclayton7565]

Yoooo I need this as a DJ facade 🤯

[@АнастасияНестеренко-ъ6в]

Looks spectacular!

[@Nancy-lb6vw]

How to do it
So magic!!!

[@nazrinbeatz]

Wtf

[@frai1012]

OMG AMAZING

[@DolzzDesign]

Wow!

[@shaynestark1550]

This is one of the coolest things I've ever seen

[@e_jmgs]

wow

[@백종훈-s8p]

But how

[@THEHOUSEOFSATIO]

Súper cool

[@Ruhgtfo]

But hoow

[@chopov11]

HOW??

[@jongo8535]

Nice work, I am the 7 777th viewer

[@ElCanalDeJulca]

OMG!!! HOWWWW???

[@Seiffouri]

How does the system track the camera position?

[@HarveyMoon]

vive tracker attached to the camera

[@CMLIGHTING]

Nicev

[@mazzonijacopo]

That’s an expensive setup

[@HarveyMoon]

i mean... not really.... It's two crappy screens that cost $70. A regular phone camera and a VIVE tracker. Under 1k in gear. (minus the computer and touchdesigner)

[@claudeofficial]

Nice work!

[@AnnebelBuntOnline]

This is so cute!

[@Wovo.]

looks hella fake

[@rgb2296]

What's fake about it? 🤣

[@PL-AD]

Impressive !

[@viewfx]

❤️❤️❤️

[@kenansuleymanov32]

Howww

[@DonBurroni]

Vive tracker with a camera strapped to it

[@lee_sung_studio]

How can to track eyes position?

[@HarveyMoon]

It's not eyes. I have another tracker on the camera.

[@lee_sung_studio]

@@HarveyMoon If so, did you install the tracker on the lamp as well?

[@SaimGulay]

If you don’t show how you did this, i am gonna die because of curiosity.

[@bluebaconjake405]

Probably has a tracker in the camera and the lamp. So it only works when you see it from the camera’s screen.

[@veronly2]

it's kinda hard to see on the lamp, but there is a vive tracker on it, that' freaking awesome!

[@bluebaconjake405]

@@veronly2 yep. It is a vive tracker

[@shanuhmd4429]

What is this tech ❤️❤️

[@GooseMcdonald]

UE4

[@cunty]

HOW