Stable Diffusion for After Effects? | How To Use DiffusAE | AI Video Generation

Can you use generative AI inside of After Effects? Now you can! With DiffusAE, you can generate textures and images just by typing a simple prompt and messing around with some settings. In this video, Lewis shows you how to use DiffusAE, and shows you it's limitations.
Find free stock videos for your projects: bit.ly/3lSq8gI
Find free stock music and sound effects for your projects: bit.ly/3lPjVSv
Videvo.net offers completely free stock video footage, motion graphics, templates, and audio for use in your personal and professional projects. We also offer Premium stock plans with an extended library of stock materials. Visit Videvo.net today!
Check out our blog for more tutorials and filmmaking techniques like this and other useful content: bit.ly/3GsCw0b
Follow us on Twitter: Videvo
Check out our Instagram: https videvostock
Visit us on Facebook: Facebook.com/Videvo

[@zachnfine]

cool plugin. One note -- the prompt "make house into a haunted house made from different materials" contains a bit of a misunderstanding of how prompts work. "make house into" implies that Stable Diffusion is going to understand that as a command and will focus its actions on the house, but the part of the process that deals with the text doesn't understand what's in the image and doesn't understand actions as such. The prompt is going to be tokenized by CLIP all by itself in order to make an independent input to the U-Net, and the image with added noise is a separate input to the U-Net. So CLIP has no understanding of your input image as it tokenizes the text and will not know there even is a house within the image to be made into something. The prompt likely would work the same if written as "a haunted house made from different materials". There is a chance that the phrase "make house" will have an effect on the output, but it might be one you don't intend -- you may end up with bits of an image showing someone "making a house".

[@VIDEV0]

Ahh, interesting. Noted for next time.

[@user-rd2zv1xp4l]

Thanks for this. Very handy. I keep looking at this plugin! ...... and shout out to Art Attack! :)

[@VIDEV0]

THIS. IS. An art attack!

[@petersolomon5227]

Interesting I suppose. However, this seems a limited motion plugin where consistency of movement and believability of an object are paramount.

[@user-sd4lt2dp5k]

Can you teach how to install the plugin in the correct Windows folders?

[@VIDEV0]

Where are you having trouble? The downloaded folder should also give you install directions.

[@user-sd4lt2dp5k]

I install it and the plugin doesn't appear in after effects

[@narendra672]

👍

[@VIDEV0]

👍

[@FragMentt]

The sad thing is that the plugin doesn't understand masks and you have to export the footage...

[@VIDEV0]

Yep, it's a little limited in that regard.