Generate Normal Maps For Any Shot With ComfyUI and Nuke

With this setup you can generate temporally stable normal maps with the help of ComfyUI and Nuke's CopyCat node.
ComfyUI github: github.com/comfyanonymous/Com...
ComfyUI native implementation of IC-Light github: github.com/kijai/ComfyUI-IC-L...
Make sure the "Load and Apply IC-Light" node has the fbc model selected instead of the fc.
00:00 Intro
00:34 ComfyUI Workflow
16:37 The problem with the renders from ComfyUI
17:39 The solution - Setting up CopyCat
24:06 CopyCat results
26:36 Using the normal maps

[@madlookzvfx]

Brilliant!

[@BrandspankingFilm]

Awesome stuff ❤

[@simpernchong]

Genius

[@johnloughlin6804]

going to follow closer!, what Nuke add on are you using the get those extra 'hotkeys'(?) frame 20:24
thanks

[@alejandrovillabon7859]

That’s w_hotbox. Been using it for years, cant live without it.
You can download it here: www.nukepedia.com/python/ui/w_hotbox

[@WindfallWealth]

This is very interesting!
I feel like this could also be used in a way to fix flicker much better than Davinci Resolve's deflicker? Say you have source footage but there is some jitter in your stylized footage between frames - could you train it in a similar fashion?

[@alejandrovillabon7859]

Potentially. Im looking into relighting moving shots with comfy (without normals) at the moment. But as always, temporal consistency is the killer. There are other ways of mitigating the chatter/noise along with copycat. If I get a decent result, ill share my findings.

[@harrybardak516]

Did you manage to retrieve the details of the normal map?
I never could even after a lot more epoch. ( I have pushed it to 1 Millions)