Honest question: even when this is achievable in real time, what is the point? The magic of these AI-gen filters is that we can manipulate the footage however we want after the fact. I don't really see why someone would want to bake in the look of a non-deteriministic effect applied to their footage.
Totally get what you're saying - I don't think the flower filter is a great example of why this would be useful in real time. What would be useful is if we're generating a consistent, 3D space and filming people in that space and we're able to see/generate in the camera. Like a blend of AI and virtual production. I interviewed Phil Galler about this - his company developed the tech behind The Mandalorian, AI cameras is where he sees the future. ruclips.net/video/q4ej4UQfT9Y/видео.html
@@vp-land Great point - I can't believe I didn't think of that! We shot "once upon a time in wonderland" on a completely virtual stage and it was a complex and expensive dedicated setup for the whole studio to create the entire world (not just the background and lighting like in a Volume) around the actors in real time. This could potentially solve a lot of that, even if it's just for previsualisation. Awesome, will watch the video - thanks!
This looks like a really cool passion project but not seeing why you would need specialized hardware for this. I could see an external video recorder having this ability.
✉ Get our free newsletter with all things virtual production: ntm.link/vp_land
Honest question: even when this is achievable in real time, what is the point? The magic of these AI-gen filters is that we can manipulate the footage however we want after the fact. I don't really see why someone would want to bake in the look of a non-deteriministic effect applied to their footage.
Totally get what you're saying - I don't think the flower filter is a great example of why this would be useful in real time. What would be useful is if we're generating a consistent, 3D space and filming people in that space and we're able to see/generate in the camera. Like a blend of AI and virtual production. I interviewed Phil Galler about this - his company developed the tech behind The Mandalorian, AI cameras is where he sees the future. ruclips.net/video/q4ej4UQfT9Y/видео.html
@@vp-land Great point - I can't believe I didn't think of that! We shot "once upon a time in wonderland" on a completely virtual stage and it was a complex and expensive dedicated setup for the whole studio to create the entire world (not just the background and lighting like in a Volume) around the actors in real time. This could potentially solve a lot of that, even if it's just for previsualisation. Awesome, will watch the video - thanks!
This looks like a really cool passion project but not seeing why you would need specialized hardware for this. I could see an external video recorder having this ability.
I think this’ll be really interesting when it can process in real time