oh wow 😯 we are getting to the point where we need a better interface that can take advantage of all these tools and make them easier to use, it's so cool to see what is happening though
Seriously. Outside of Invoke and all these photoshop clones, there hasnt been a simple gui to quickly integrate all these tools. Will it be adobe or blender due to the controlNET functions? Who knows
@@audiogus2651 Funny timing! Aitrepreneur just posted a video showing the new special Blender model which lets you pose the skeleton and hands and feet and you can save out the openpose colored skeleton but also a depth map and canny map of the hands and feet.
Fantastic vid mate. I was JUST asking about how to do this technique on reddit. Any chance on getting more info or the text doc for the different ratios for the regions. Love the AI video in the corner too.
I can't get this to work at all. It's only generating a single character, i don't understand what i'm missing. I'm using the same settings as the video, i've restarted and updated the webui, updated all my extensions, tried different models and different samplers, made sure latent couple is enabled, out of 40 generations, not a single one has worked, i get one character or some weird merge of the two.
There are two steps to it - 1. Define your areas in the latent couple box and enable 2. Define your area sub-prompts, separated by AND If you only have one character, like I show at 4:38, then you might have forgotten step 2.
@@IntiArtDesigns The only other thing I can think of is having too few steps, so probably worth raising an issue in the GitHub with screenshots to show.
@@NerdyRodent Ok, thanks. I've seen others raising the same issue i have, so hopefully, whatever it is, will get fixed soon. This looks like so much fun, i can't wait to use it.
Is there a way to use this when generating images from text? The way it's been shown here I don't see much advantage over using img2img and inpainting over one of the subjects with a high denoise value to get it to draw a different subject.
Unfortunately A1111 is pretty much unused at this point. If you're lucky, the update may work - sd-webui-regional-prompter - but most stuff is done in ComfyUI now
We are almost there. The ultimate version Of Stable Diffusion is almost Here. It will be a Blender Addon that will combine the recently released Blender Skeleton for MULTI-CONTROLNET. Combined with the next version of this which will allow us to assign a Prompt, Hypernetworks and Multi-Controlnets to each Skeleton and or "Control Meshs" and the Background. And once Text To 3D, AI Animation and Images to 3D are also inevitably implemented as Blender Addons The fusion of the 2D and 3D Workflows will be Complete. And with it The full democratization of animation. It Will be Glorious and at the rate we are going It will be here Sooner than we realize.
Next to cover - LoRA weight extension ? Thank you for disassembly those extensions and their mechanics, to create video with explanation what where and how.
It seems the User Interfaces for both Composable Lora and Latent Couple has changed completely, since this video was uploaded. Anybody who can provide guides, or possibly links to guides for the current (as of Sept. 23. '24) version of those two plugins for Stable Diffusion (Forge)? Am at a complete loss, for similar solutions.
The interesting part is, the language model used in SD is in theory easily capable to allow more control. But the models are not trained for that purpose, yet.
I tried this again today and still just get nightmare fuel (TM). I see there is regional prompter now but I get equally bad results. I even tried the dog/cat you demo'd but I get a dog/cat asking to be put down :(
Using chair and sofa images, I have finetuned a stable diffusion model. However, the model does not generate a living room using the chair and sofa. Please help me !!!!
I installed and copied your settings and enabled it, and it just did the same as normal and merged the prompts into one. I set it for a bird in the top and a cat in the bottom and I got a cat bird
how do you stop it from mashing to subjects together...I don't want the half faces (one half one person the other half another person), i want two entirely separate characters
Think it would be easier just to use Blender or equivalent to generate guide images for the algorithm rather than using control net or extensions like this. A little steeper learning curve but much better potential results.
Great! Very useful! Unfortunately, I speak bad English, maybe that's why I missed it: do I always have to enter the numbers manually in the "Extra generation params"? Isn't there a formula, you just have to guess? Or copy out the values that are wrongly shown in the video?
I'm using regional prompter to do roughly the same thing as latent couple. My question now is how do you generate two particular people for the image. Like I have created a LoRA for my face and a LoRA for my wife's face. If I put each LoRA in a separate prompting area with a prompt for a man in one and a prompt for a woman in the other, it just gives me a man and a woman whose faces are a blend of the two LoRA's. Any suggestion on how to resolve this?
What is this software? Is it possible to run online and yhen access with my Windows 8 PC? Are there any setup guides or videos on how to do this? How much does this all cost? I'm an old-school professional Graphic Designer since 1998 - meaning I'm excited to start becoming a master of this amazing ai toolset. Thank you in advance for any help!!
This is stable diffusion (links in the description). It can run on Microsoft Windows, but it’s best to start out something like the Google Colab as unless you’re a nerd, you probably won’t have a computer capable of running it. There you get a free Linux system with a gpu than you can use via your browser - github.com/camenduru/controlnet-colab
Good video! But I guess this can be used only for using the ai to generate two subjects? What if we want to train two people by using their photos, how could we make it happen ? Thank you very much !
@@NerdyRodent So does it mean I need to train two subjects on SD+ dreambooth first and then generate a new image by using the latent couple extension? I have tried to train two men at once but the sd+dreambooth ended up mixing them and generated two identical ones instead of two different persons. Any idea maybe ? Thank you very much !!!
oh wow 😯 we are getting to the point where we need a better interface that can take advantage of all these tools and make them easier to use, it's so cool to see what is happening though
yah someone must be cooking up a poser type interface with 3d posable hands etc etc
Seriously. Outside of Invoke and all these photoshop clones, there hasnt been a simple gui to quickly integrate all these tools. Will it be adobe or blender due to the controlNET functions? Who knows
@@audiogus2651 Funny timing! Aitrepreneur just posted a video showing the new special Blender model which lets you pose the skeleton and hands and feet and you can save out the openpose colored skeleton but also a depth map and canny map of the hands and feet.
This is perfect for parents who have young kids who refuse to stand still for portraits.
Cool, definitely very useful with ControlNet!
Indeed it is!
@00:39 So we're just gonna ignore a random bearded head hiding in the fur between the two Washington-Lincolns?
You found him! 😉
Tortoise TTS got a bunch of updates in a recent month - faster inference, finetuning. Hope you will consider making an update video on it
Cool, are you on Windows or Linux?
Fantastic vid mate. I was JUST asking about how to do this technique on reddit. Any chance on getting more info or the text doc for the different ratios for the regions. Love the AI video in the corner too.
It’s just x,y co-ordinates 😉
Hehehe 🤭
Tickled by whiskers 🐭
What a time to be alive!
You know why he is always holding onto his papers? Because he craps his pants in surprise too often :)
I can't get this to work at all. It's only generating a single character, i don't understand what i'm missing. I'm using the same settings as the video, i've restarted and updated the webui, updated all my extensions, tried different models and different samplers, made sure latent couple is enabled, out of 40 generations, not a single one has worked, i get one character or some weird merge of the two.
There are two steps to it -
1. Define your areas in the latent couple box and enable
2. Define your area sub-prompts, separated by AND
If you only have one character, like I show at 4:38, then you might have forgotten step 2.
@@NerdyRodent Check and check. Done all that. Not working for me. I don't get it.
@@IntiArtDesigns The only other thing I can think of is having too few steps, so probably worth raising an issue in the GitHub with screenshots to show.
@@NerdyRodent Ok, thanks. I've seen others raising the same issue i have, so hopefully, whatever it is, will get fixed soon. This looks like so much fun, i can't wait to use it.
HOLDING ON TO MY PAPERS!! SAY IT MAN JUST SAY IT!!!
Interesting, looks like 1.5 handles "photo of a dog and a cat" better than 2.1 ...
Is there a way to use this when generating images from text? The way it's been shown here I don't see much advantage over using img2img and inpainting over one of the subjects with a high denoise value to get it to draw a different subject.
This is generating images from text 😉
Two months later, and it still can't get hands right.
I can't get this to work
Unfortunately A1111 is pretty much unused at this point. If you're lucky, the update may work - sd-webui-regional-prompter - but most stuff is done in ComfyUI now
@@NerdyRodent i need to learn ComfyU
bonus points for Vox Machina even if you did mispronounce it :D
I tried adding Freddy fazbear to Roblox using ai
SOMEHOW
I got nsfw
Lmao
hello, thanks but this explanation was not enough .... Not running here
Remember to restart after clicking install!
There must be another way, using only the prompt...
Do let us know if you find it!
Latent couple is not listed in available would you know why?
This should help with porn scenes for sure
We are almost there. The ultimate version Of Stable Diffusion is almost Here.
It will be a Blender Addon that will combine the recently released Blender Skeleton for MULTI-CONTROLNET.
Combined with the next version of this which will allow us to assign a Prompt, Hypernetworks and Multi-Controlnets to each Skeleton and or "Control Meshs" and the Background.
And once Text To 3D, AI Animation and Images to 3D are also inevitably implemented as Blender Addons The fusion of the 2D and 3D Workflows will be Complete.
And with it The full democratization of animation.
It Will be Glorious and at the rate we are going It will be here Sooner than we realize.
The official stable diffusion Blender add on is out, in case you haven’t seen it 😉
@@NerdyRodent I Know, my introduction to AI Art was Dream Textures.
I wonder if it is possible to make 2 subject interact with each other like handshake or hug ?
Hold on to your Pap😄
Thanks for sharing and explaining, SD (with the help of automatic1111) is such a wonderous toolbox. Hard to keep up with all the new stuff popping up
Glad it was helpful!
I really gotta update my 1060 6gb soon....
Next to cover - LoRA weight extension ? Thank you for disassembly those extensions and their mechanics, to create video with explanation what where and how.
you can lower the mlroa weight on the end of the lora ,. noraly is :1 , but you can change thato :0.55 for 55%
i get an error when clicking "visualize" under the rectangular tab. Working for anybody else?
nope, i also get an error. anyone knows how do fix it..?
It seems the User Interfaces for both Composable Lora and Latent Couple has changed completely, since this video was uploaded. Anybody who can provide guides, or possibly links to guides for the current (as of Sept. 23. '24) version of those two plugins for Stable Diffusion (Forge)?
Am at a complete loss, for similar solutions.
Thank you for taking the time to share your knowledge, another excellent video.👍
So, do we need ControlNet to run latent couple and the other as I see all the videos just using it?
The interesting part is, the language model used in SD is in theory easily capable to allow more control. But the models are not trained for that purpose, yet.
lol most of them are chaising hentai tentacles as far as I can tell.
I tried this again today and still just get nightmare fuel (TM). I see there is regional prompter now but I get equally bad results. I even tried the dog/cat you demo'd but I get a dog/cat asking to be put down :(
Do you have a video on how to do the exact same thing on ComfyUI?
Multiple characters in an image was the one thing that pushed me to put my fist through the monitor. 😄
And now it’s super easy! 😉
OOhh! would you be into sharing your parameters txt file cut and pastes for areas?
It's over
Cool tech!
Very nice
this extension has been updated and it works with different words now, new video?
It hasn’t been updated for over a year. It will still work exactly the same with old versions of automatic, though may have issues with newer ones
Using chair and sofa images, I have finetuned a stable diffusion model. However, the model does not generate a living room using the chair and sofa.
Please help me !!!!
how to install "Fork with masks" on windows10 - SD AUTOMATIC1111 ???
i cant find Latent Couple script
github.com/opparco/stable-diffusion-webui-two-shot
great video! but i have a trouble, the latent couple section does not appear to me 🤧
Remember to both install and restart the UI 😉
Hi. I had the same issue. I updated the webUI to the latest version and that fixed it for me.
I installed and copied your settings and enabled it, and it just did the same as normal and merged the prompts into one. I set it for a bird in the top and a cat in the bottom and I got a cat bird
how do you stop it from mashing to subjects together...I don't want the half faces (one half one person the other half another person), i want two entirely separate characters
I use this latent couple extension!
Anyone able to use with additional-network-extension?
I dont have control model showing up in my thing
Think it would be easier just to use Blender or equivalent to generate guide images for the algorithm rather than using control net or extensions like this. A little steeper learning curve but much better potential results.
Give it a go and let us know!
Great! Very useful! Unfortunately, I speak bad English, maybe that's why I missed it: do I always have to enter the numbers manually in the "Extra generation params"? Isn't there a formula, you just have to guess? Or copy out the values that are wrongly shown in the video?
You can use the defaults for where the areas are going to be, or you can choose your own 😉
I'm using regional prompter to do roughly the same thing as latent couple. My question now is how do you generate two particular people for the image. Like I have created a LoRA for my face and a LoRA for my wife's face. If I put each LoRA in a separate prompting area with a prompt for a man in one and a prompt for a woman in the other, it just gives me a man and a woman whose faces are a blend of the two LoRA's. Any suggestion on how to resolve this?
As with the cat and dog examples, basically!
WHy your Lora have icons on them?
I just like seeing previews. You don’t have to have them, it’s simply a personal choice 😀
What is this software? Is it possible to run online and yhen access with my Windows 8 PC? Are there any setup guides or videos on how to do this? How much does this all cost? I'm an old-school professional Graphic Designer since 1998 - meaning I'm excited to start becoming a master of this amazing ai toolset. Thank you in advance for any help!!
This is stable diffusion (links in the description). It can run on Microsoft Windows, but it’s best to start out something like the Google Colab as unless you’re a nerd, you probably won’t have a computer capable of running it. There you get a free Linux system with a gpu than you can use via your browser - github.com/camenduru/controlnet-colab
How do you put an image preview on the LoRA files ?
Civitai Helper extension, will download images, prompts and even allows you to set your own thumbnail.
Man, i installed the Latent Couple and even so it not appears the box to use it. What can it be?
In the cmd log says: cannot import name 'CFGDenoisedParams' from 'modules.script_callbacks
Sure you’re running the latest a1111?
I fixed it by updating to the latest version of Automatic1111
soooo why doesnt it show up after i installed???? this is literally riving me bonkers...
nvm i finally got it
@@the_RCB_films how?
@@the_RCB_films how have you resolved not showing up?
@@AlexGNewMediaJournalism just update the webui, if that doesn't work install a new copy of it and just copy the parts you need.
Good video! But I guess this can be used only for using the ai to generate two subjects? What if we want to train two people by using their photos, how could we make it happen ? Thank you very much !
It’s for multiple subjects - your choice 😉
@@NerdyRodent So does it mean I need to train two subjects on SD+ dreambooth first and then generate a new image by using the latent couple extension? I have tried to train two men at once but the sd+dreambooth ended up mixing them and generated two identical ones instead of two different persons. Any idea maybe ? Thank you very much !!!
@@SweetieNerdygirl no, no training required. You can just use it straight away on any model exactly as shown 👍
Great video, thx a ton! One question:
Instead of diffrent LORA models, can we compose using different Dreambooth models?
Not using this, no
@@NerdyRodent Is there any other way of accomplishing that? Thx
@@arunuday8814 Not that I’m aware of, no
@@NerdyRodent Thx, appreciate your help!
@@arunuday8814 you’re welcome!
this extension seems broken. are there any alternatives you are aware of to compose regionally?
Thankfully it isn’t broken, but yes, that are a few versions of this
@@NerdyRodent sadly does not work with latest gradio. Could you suggest alternative? thanks
@@NerdyRodent also, i use the webui auto launcher, which doesnt allow patching the SAG unofficial extension. Stuck here
@@___x__x_r___xa__x_____f______ just downgrade to gradio 3.28.1
@@NerdyRodent I am on 3.28.1
act now! only 19.95, that's 19.95, for all this, void where prohibited.
Is all this free and open source, of course 😉
@@NerdyRodent I know :D