BrushNet SDXL and PowerPaintV2 = InPaint With Any Model in ComfyUI

BrushNet SDXL and PowerPaint V2 are here, so now you can use any typical SDXL or SD1.5 models as an inpainting one :) Have fun with mask shapes and blending - all in ComfyUI!
Want to support the channel?
/ nerdyrodent
Links:
www.iopaint.com/
powerpaint.github.io/
github.com/nullquant/ComfyUI-...
github.com/TencentARC/BrushNet
drive.google.com/drive/folder...
huggingface.co/JunhaoZhuang/P...
huggingface.co/runwayml/stabl...
== More Stable Diffusion Stuff! ==
* Installing Anaconda for MS Windows Beginners - • Anaconda - Python Inst...
* Installing ComfyUI for Beginners - • How to Install ComfyUI...
* ComfyUI Workflows for Beginners - • ComfyUI Workflow Creat...
* Faster Stable Diffusions with the LCM LoRA - • LCM LoRA = Speedy Stab...
* Make an Animated, Talking Avatar - • Create your own animat...
* Make A Consistent Character in ANY pose - • Reposer = Consistent S...

[@preecefirefox]

It would be great to see these compared to Fooocus Inpaint Patch and DiffDiff

[@MrSporf]

Awesome info, thanks - going to try them out now!

[@resh6701]

It's like Hyper-SD vs lightning vs Turbo vs LCM, or FaceID vs PullID vs instantID and so on
At this point I just want to know if Brushnet is better than the fooocus nodes

[@ApPersonaNonGrata]

:) I love your content. I really hope I can learn it. I am going to enroll in some beginning classes to help me along.
--
You really are brilliant.

[@NerdyRodent]

You can do it! 😉

[@kariannecrysler640]

I’m down for all the Nerdy Geekery 💯! 🤘🥰 my rodent friend

[@NerdyRodent]

🥰

[@ericruffy2124]

yet another masterpiece, Thanks a lot.

[@NerdyRodent]

Thank you too!

[@swannschilling474]

Thanks for this one! 😊

[@pandelik3450]

that negative prompt lol
btw, what is 'scale' and 'fitting' technically doing here? and is there any point in adjusting the denoising strength anymore?

[@Hunt3rseeker]

Question! How come, at 13:51, your folders only have the safetensors files? I just downloaded and installed BrushNet via SD Forge, and it installed a whole bunch of folders and files. Looks very different! Surely they are needed?

[@pika9985]

the 492mb bin model is the same as runwayml sd1.5 clip model fp32 is also 492mb , both are same and if yes just can download the safetensor version or even the fp16 from runwayml huggingface ?

[@jasonwang1772]

@Nerdy Rodent thx for your video, I am new to comfyui, how to install sam detector for the mask making?

[@NerdyRodent]

ComfyUI manager is your friend! Also check the beginners links in the video description

[@jzilla1234]

anything for forge or a1111?

[@WhatsThisStickyStuff]

does brushnet support loras?

[@EdoardoTravagli]

Hello, i did everything (following the instruction for installation) but i get a high noise image with no error (just colored points, no image whatsoever) Any solutions? I tried to use as a model Dreamshaper XL

[@SimosFunk]

🖌🖌🖌

[@BackyardTattoo]

Hi! Itried to install Brushnet but once I use the example workflows I got the error
"When loading the graph, the following node types were not found:
BrushNetLoader 🔗".
How can I solve?

[@2PeteShakur]

make sure to update to latest comfyui

[@flyingdogsoft]

I tried BrushNet for SDXL today as well (used the default workflow from the ComfyUI extension) but got terrible results having color changes around subject 🤔

[@rockyyi27]

the same for me, maybe because the XL version of brushnet is not trained enough steps

[@rockyyi27]

the same for me, maybe because the XL version of brushnet is not trained enough steps

[@MilesBellas]

Enfugue = comparable?

[@v33tay]

It seems like brushnet xl doesn't work with IOpaint yet, there is no option for that only for 1.5 models, sadly.

[@NerdyRodent]

Yeah, shouldn’t be too long for IOPaint and SDXL support hopefully!

[@yahiiia9269]

Can you do Hidiffusion?

[@shirwan]

I'm getting a black image on all models on a GTX 1660 Super, no errors at all, any tips?

[@NerdyRodent]

For the older cards which don’t support things like fp16 you’ll need to do the same as usual and always use fp32

[@chrisgreenwell3404]

Is there a way to use this in conjunction with ipadapter plus style transfer?

[@NerdyRodent]

Yup, same as the style transfer example, basically!

[@chrisgreenwell3404]

@@NerdyRodent Fantastic , thank you bro :)

[@hikmetmertdincer6816]

where is nodes?

[@LouisGedo]

👋

[@JustFor-dq5wc]

For me PowerpaintV2 with ContentAware settings works best.

[@hikmetmertdincer6816]

can you share workflow?

[@NerdyRodent]

Yup - links are in the description!

[@nkofr]

@@NerdyRodent Hi, I can't find the link.. Cheers

[@Ilua1Sud1]

​@@NerdyRodentWhy don't I have any links under your video?

[@javakhtar5339]

why does the rodent look like skrillex :'D

[@StringerBell]

I don't really get the hype? I've been happily inpainting SDXL models with amazing results for almost 6-7 months already in Fooocus? What's the big deal?

[@NerdyRodent]

You can check the links in the video description for even more technical information!

[@StringerBell]

@@NerdyRodent Yea I checked them I still don't understand what's the fuss about when we have awesome inpainting for SDXL models for almost half a year already. Am I missing something?

[@rd-cv4vm]

@@StringerBell hello, what do you use for in painting, my issue is the lack of control net “line art” which helps a lot

[@StringerBell]

@@rd-cv4vm ControlNet and Inpainting are 2 totally different things. So far there is no good ControlNet for SDXL sadly. However for inpainting you can use Fooocus , which is absolutely amazing for inpainting.

[@hakuhyo174]

Can't tell how good this Brushnet thing is but base SDXL inpainting def doesn't give "amazing results" for anything that's remotely more complicated... and that's the reason we keep seeing new method coming up for inpainting and more control.