ControlNet for SDXL is OUT!
HTML-код
- Опубликовано: 16 авг 2023
- In this video, we are going through ControlNet Canny for SDXL V.1!
We are going to build a Colab notebook using the code provided by diffusers on HuggingFace, and we are going to use Canny with ComfyUI.
💬 Social Media:
[Discord] / discord
[Patreon] patreon.com/IntelligentArt?ut...
[Instagram] / lacarnevali
[TikTok] www.tiktok.com/@lacarnevali?i...
____________________________________________________________________
🤙🏻 Learn More:
/ membership
/ lauracarnevali
📰Article:
work in progress
📌 Links:
SD XL Paper: arxiv.org/abs/2307.01952
SD XL Base Download: huggingface.co/stabilityai/st...
SD XL Refiner Download: huggingface.co/stabilityai/st...
Canny ControlNet: huggingface.co/diffusers/cont...
Depth ControlNet: huggingface.co/diffusers/cont...
Openpose ControlNet: huggingface.co/thibaud/contro...
ComfyUI GitHub: github.com/comfyanonymous/Com...
SD XL 0.9 in ComfyUI!: • SDXL in ComfyUI!
Colab notebook: colab.research.google.com/dri...
ComfyUI .json file: drive.google.com/file/d/1XE88...
01:09 Create Colab Notebook
01:53 What is Canny ControlNet
03:45 Connect Colab to Google Drive
08:24 Low and High Threshold
10:45 Canny with ComfyUI
15:37 Importance of mask: Low and High Threshold
#aiart #stablediffusion #generativeart #stabilityai #stablediffusiontutorial
#sdxl #controlnet #canny
Great video thx.
Jesus, these guides ARE HARD.
Hi, is it possible to run multiple controlnets on colab? say canny, depth, and pose? great video, very helpful.
Yes you can, but not with SDXL yet. To run multiple ControlNet wtih SD 1.5 you need to go into settings > controlnet and increase the number of controlnet windows
thanks!, found a handy colab notebook with a manager and some custom nodes, i managed to make it work partially.. still experimenting with comfy and waiting for controlnet model updates for sdxl @@LaCarnevali
Thanks for the video. How come my prompt ask for black dog and I get a white dog?
generate in batch - or put black dog in brackets to give more importance ((black dog))
Hi
Hi Laura, instead of using colab for control net I want to use my local gpu. Please add a video on how to use local gpu with visual studio instead of using colab. Thanks.
Visual studio is just an IDE whereas colab is an environment, you'll need to replicate the environment locally I believe
@@ozziemortI think some of dependency needs vs runtime or even visual studio on windows
Doing hard cuts while explaining a ComfyUI set is a NO-GO! 😡It`s hard to follow the nodes anyway but each time you do a hard cut the viewer is kicked completely out and has to completely re-orientate again.
I can share my notebook/interface, but I don't think I have cut anything lol. If you start from the default interface should be easy to follow. Happy to help if needed :)
@@LaCarnevali 12:36 / 12:44 / 13:14 / 13:20 and so on... this is very annoying. If you did no hard cuts, your notebook may be too slow for quick movements, I don`t know. In this case, you could try to move the screen a bit slower, so it is easier to follow.
@@MikevomMars I see what you mean, I have now shared the .json file:
drive.google.com/file/d/1XE88ldcONAwGx_akqqDPDoDtFSmARPxT/view?usp=sharing
@@MikevomMarsand you could be a little bit nicer. "Please" and "thank you" are magical words....manners manners.
@@jokosalsa Oh, a lonely knight in search of love, using others to make himself look nice. We haven't had that in a long time.