SillyTavern Noob Guide: Stable Diffusion Integration

Поделиться
HTML-код
  • Опубликовано: 23 сен 2024

Комментарии • 51

  • @FelaMartin
    @FelaMartin 5 месяцев назад +6

    Thanks for the Gandalf Ipanema ending, was hype lol

  • @FireWorm-jn1jv
    @FireWorm-jn1jv 5 месяцев назад +1

    Still new to this, so I've learned a lot and enjoyed the work you put in there. Thanks man, keep it up!

  • @GN00
    @GN00 2 месяца назад +1

    I really enjoy this video, thank you so much

  • @theworld8215
    @theworld8215 10 дней назад +1

    i keep getting the message: Couldn't launch python
    exit code: 9009
    stderr:
    Python was not found; run without arguments to install from the Microsoft Store, or disable this shortcut from Settings > Manage App Execution Aliases.
    Launch unsuccessful. Exiting.
    Press any key to continue . . .
    how do i fix this? is there anything i need to download further as a windows user?

    • @ChameleonAI
      @ChameleonAI  10 дней назад

      You'll need to install python 3.11. Once installed, if you type the command "python --version" from command prompt and it works, you should be good to go. I believe there are some compatibility issues with python 3.12 so installing 3.11 is the safest bet.

  • @ketas300
    @ketas300 3 месяца назад +1

    Could you make a step by step tutorial how to install Stable Diffusion and how to troubleshoot common errors(could not validate SD api, missing torch, etc.)?

    • @ChameleonAI
      @ChameleonAI  3 месяца назад

      I don't mind making a setup oriented tutorial, but it's hard for me to cover a lot of errors because they're very platform specific. I'm on Linux + AMD and common problems for me are completely different than common problems for someone on Windows + Nvidia for instance.

    • @MrWunz
      @MrWunz 22 дня назад

      i also would ned a tutorial since bofe webui files are doing nearly nothing. and to fix it i need to download like hundrets of files manually that only get detected when on my desktop

  • @kubilayg3200
    @kubilayg3200 25 дней назад +1

    For those who want to copy-paste the negative prompt:
    blurry, jpeg artifacts, worst|low quality, lowres, bad anatomy|hands, signature|watermark, patreon_logo, extra|missing fingers, (letterbox|letterboxed), censored|mosaic, bar_censor, collage, x-ray, loli, simple|gradient background, greyscale|monochrome, sepia

  • @chesterhackenbush
    @chesterhackenbush 5 месяцев назад

    Pretty good video - keep going!

  • @Anyfantis0
    @Anyfantis0 5 месяцев назад

    You're the man, thank you

  • @8bitstargazer
    @8bitstargazer 5 месяцев назад

    Thank you Mithrandir

  • @bryansproles2879
    @bryansproles2879 5 месяцев назад

    I have ForgeUI, Ooobabooga and Silly Tavern all set up and working. I was able to add the --api, so Tavern sees the API when I hit the connect button.
    But when I go to generate the "Yourself" image, I get "API Error: Internal Server Error"
    When I check the console, the last bit says "ValueError: No tokenizer is loaded"
    Any ideas?

    • @ChameleonAI
      @ChameleonAI  5 месяцев назад

      I'm not sure, but a cursory search of the error points to Oobabooga, not Stable Diffusion. It seems to indicate that the llm isn't loaded, but if sillytavern is otherwise working, clearly this isn't the whole story. I would try switching text models to see if that makes a difference, and I would troubleshoot by using a different format, like if you're using GGUF, try GPTQ.

  • @alexpalsingh674
    @alexpalsingh674 3 месяца назад

    My sillytavern is not sending command to automatic1111 any idea why??

    • @ChameleonAI
      @ChameleonAI  3 месяца назад

      I've seen it happen sometimes when the textgen model doesn't want to respond with anything for some reason. You should be able to see the text response on command line, followed by the request to SD WebUI if the text response isn't empty. That will at least let you know if it's a problem with text generation or a problem with Stable Diffusion. If the text response is empty, try continuing the conversation, starting a new chat, or change the prompt template.

  • @Sardar-d8g
    @Sardar-d8g 4 месяца назад

    When I try to generate a image nothing happens, even though stable diffusion works, it doesn’t work with sillytavern

    • @ChameleonAI
      @ChameleonAI  4 месяца назад

      It's hard to know what's wrong unless you look at the console of sillytavern and stable diffusion. When it's working properly, you should see sillytavern send a request and stable diffusion will print stuff about it generating the image. If something's wrong with the connection, sillytavern's console should print an error. If something went wrong with generation (i.e. out of memory or something), you should see that on the stable diffusion console.

    • @RedBigz
      @RedBigz Месяц назад

      turn on instruct mode

  • @DAVIS-ec9wl
    @DAVIS-ec9wl 3 месяца назад

    Does anyone know how to get around the incompatible python version error? I tried installing the older version but it still comes up as incompatible

    • @ChameleonAI
      @ChameleonAI  3 месяца назад

      Hmm, SillyTavern is Node.js based, so I don't think there should be python issues. Unless you're talking about Stable Diffusion. In that case it can be tricky, but you can try the python 3.11 embeddable package and run it separately from the system installed python, but that is its own ordeal to set up. I've seen Stable Diffusion complain about wanting 3.10 when 3.11 is used, but it's a warning and works just fine.

    • @DAVIS-ec9wl
      @DAVIS-ec9wl 3 месяца назад

      ​@@ChameleonAIThanks for getting back to me. I did find a work around but turns out it doesn't like my amd card so I guess I'm outta luck.

    • @ChameleonAI
      @ChameleonAI  3 месяца назад +1

      @@DAVIS-ec9wl Not entirely! There is a fork of Automatic1111 for AMD. Just go to the github page's wiki section and follow the instructions for AMD. Not sure about ForgeUI though.

    • @DAVIS-ec9wl
      @DAVIS-ec9wl 3 месяца назад

      @@ChameleonAI Thank you, I appreciate the help, I got er working.

  • @vecksims2577
    @vecksims2577 4 месяца назад

    I keep getting a error when I try connecting Stable diffusion to Silly tavern. the error says "could not validate SD webui API: SD webui returned a error". Stable diffusion runs fine and I edited the webui user.bat file and webui user.sh (set COMMANDLINE_ARGS=--api). I installed SD a while ago, I launch it with a python file and the examples I've seen all use the weui-user.bat file to launch it

    • @ChameleonAI
      @ChameleonAI  4 месяца назад

      That all sounds correct. One thing you can do is launch SD with --api-log to get more information on when SillyTavern tries to connect to the SD API. If you look at the SD command line and don't see SillyTavern attempting to connect, then something is wrong like an incorrect port or something like that. You say you installed SD a while ago. Is it up to date? It's possible that there are API compatibility issues with the latest SillyTavern vs a very old Stable Diffusion.

    • @vecksims2577
      @vecksims2577 4 месяца назад

      ​@@ChameleonAI SD command gives me nothing when trying to connect.
      SillyTavern gives me this though Error: SD WebUI returned an error.
      at SillyTavern\src\endpoints\stable-diffusion.js:68:19
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

    • @ChameleonAI
      @ChameleonAI  4 месяца назад +1

      ​@@vecksims2577 I didn't find a lot about this error in the github issues either. Try accessing the API in your browser at 127.0.0.1:7860/sdapi/v1/ and if the page doesn't load at all, the api is disabled or something. Other than that I'm afraid I'm at a loss for what's wrong.

    • @skybasee6206
      @skybasee6206 4 месяца назад

      I think you should set the webui user.bat file and .sh file with "--api" instead of just --api, I not sure if this can help you

  • @ceryx6849
    @ceryx6849 24 дня назад

    My pictures are totally blue, blurry and very low res. I can barely guess the shape of what it tried to do but that's it. Nobody seems to have the same issue anywhere on internet. It's quite frustrating.
    edit : it seems to happen to the very end of the generation. The image is sort of upscaled, but totally broken into this blue mess i talked about. Some people talk about that VAE thing, but changing it to none doesn't fix the issue. Nor does unticking upscale etc...

    • @ChameleonAI
      @ChameleonAI  24 дня назад

      That's a mystery to me too. I've never heard of such a thing. A few troubleshooting steps: try different models (maybe even different model families like SD1.5 and XL), make sure you're loading a vae, and if you're only having this problem through sillytavern and not directly in SD with manual prompting, make sure all your settings (resolution, steps, etc.) match the manual prompt. You can watch how SillyTavern is prompting in the command line and check to see if the prompt looks ok or if there are weird key words in there.

    • @ceryx6849
      @ceryx6849 24 дня назад

      @@ChameleonAI
      Thank you for your answer.
      It seems the problem persists even when directly generating through the API (not sillytavern). It does so with every model and every parameter. For example : If i generate a monkey, the image is okayish up to the end, and when it shows me the result, it is broken, blurry, and blue with a lot of artifacts.
      I'm gonna try reinstalling everything properly with a complete tutorial and see what happens. I think i'll also have to give some attention to what VAE and such.
      I also made a reddit post in r/Stable Diffusion with an example image.

    • @ChameleonAI
      @ChameleonAI  24 дня назад

      @@ceryx6849 It's definitely curious. You could try using a model that has a vae already baked in, or disable the vae altogether, just to narrow down if that's the issue. Not much point messing with highres fix, upscaling, etc. if your base output is looking like that.

    • @ceryx6849
      @ceryx6849 24 дня назад

      @@ChameleonAI Alright i finally found out that it was totally a VAE issue. Thank you for your interest.
      In case someone else has the same issue and is exploring the comments to find a solution : Just type "VAE for whatever version of stable diffusion you have" on google, click on a huggingface link and look for a safetensor file. download it and put in in the VAE file inside the model file of your SD directory. Then go on the SD api (not sillytavern), find settings, VAE section, and refresh the SD vae section. Then select your new VAE and apply modifications. Now you should be fine.

    • @ceryx6849
      @ceryx6849 24 дня назад

      @@ChameleonAI i tired to reply yesterday but it didn't show up. It was definitely an VAE issue, it's all good now.

  • @mexxer6948
    @mexxer6948 5 месяцев назад

    Mine has never connected. I have Silly Tavern on my phone.

    • @ChameleonAI
      @ChameleonAI  5 месяцев назад

      Can you get to the Stable Diffusion webui from your phone? If you're running Silly Tavern on the phone and Stable Diffusion on another machine, you'll need to launch Stable Diffusion with the --listen command line argument. By default it will reject external connections.

    • @mexxer6948
      @mexxer6948 4 месяца назад

      No. I can get Sillytavern on my phone with Kobolcpp but Automatic1111 feels impossible.​@@ChameleonAI

    • @mexxer6948
      @mexxer6948 4 месяца назад

      Ok got it! I had to open up all three things(Sillytavern, Kobolcpp, and Automatic1111) on my phone and now they all work together! Wish it wasn't such a hastle lol thank you!!

  • @PedroOttoni
    @PedroOttoni 3 месяца назад

    Garota de Ipanema me quebrou 😂

  • @Sigmatechnica
    @Sigmatechnica 4 месяца назад

    needs to use another model unrelated to the rollplay model to summarize the activity in the rollplay for SD

    • @ChameleonAI
      @ChameleonAI  4 месяца назад

      Generating image of the whole story is just another image prompt template that's sent to the main textgen model, I'm not aware of a way to use a dedicated summary model for SD (would be nice if you could). But yeah, roleplay models aren't that great at making summaries.

    • @Sigmatechnica
      @Sigmatechnica 4 месяца назад

      @@ChameleonAI Yeah, it would probably be preferable to have the summarie model just look back at a defineable number of previous tokens/messages and have it run each turn so it could generate an automatic storyboard as you go along. should be possible to have a nice small highly tuned summery/SDprompt generator model for 'only another ~5GB VRAM' :D

  • @Benedict00_ItchyManko
    @Benedict00_ItchyManko 3 месяца назад

    You said gptq but you showed gguf

    • @ChameleonAI
      @ChameleonAI  3 месяца назад +1

      Good point. I was showing the table on the gguf page that showed the memory usage since it wasn't on the page for the gptq version. But I didn't explain that.

  • @StrayWolf91
    @StrayWolf91 3 месяца назад

    I got lost in the first 2 min

    • @ChameleonAI
      @ChameleonAI  3 месяца назад

      Is there anything in particular that I should have focused on in more detail?

  • @arandomguy8572
    @arandomguy8572 2 месяца назад

    My user file only has this in it:
    @echo off
    set PYTHON=
    set GIT=
    set VENV_DIR=
    set COMMANDLINE_ARGS=
    call webui.bat
    How can i fix this?

    • @ChameleonAI
      @ChameleonAI  2 месяца назад

      To get it to work with SillyTavern you'll at least need to add "--api" to command line args, so
      set COMMANDLINE_ARGS=--api