Batch Img2Img Video with ControlNet

Поделиться
HTML-код
  • Опубликовано: 6 апр 2023
  • An overview of how to do Batch Img2Img video in Automatic1111 on RunDiffusion.

Комментарии • 65

  • @jazzNjack
    @jazzNjack Год назад +2

    Glad to have found your videos (via stalking you on Reddit). And the Discord channel. I'm really enjoying RD, and planning on upping my membership to Creator's Club soon.

    • @rundiffusion
      @rundiffusion  Год назад

      Hey thanks Jazz! We are happy to have you with us!

  • @DRPIELZ
    @DRPIELZ Год назад +1

    Thank you a lot ! This video it's really useful !

  • @rickardbengtsson
    @rickardbengtsson Год назад +1

    Good stuff thanks for the video

  • @dragongaiden1992
    @dragongaiden1992 4 месяца назад +1

    Friend, how much ram and what graphics do you have? I made a video with similar settings but in 720X1280 resolution and for the faces I used adetailer, as well as a controlnet, but I still have problems getting it to respect my hands and feet since I am replacing a person completely with a different face and clothes, but try to respect the poses although I need to be more exact.

    • @rundiffusion
      @rundiffusion  4 месяца назад

      We are a cloud service so you don't need a GPU on your computer, can be done laptop, ipad, etc

    • @dragongaiden1992
      @dragongaiden1992 4 месяца назад

      @@rundiffusion thanks friend

  • @pedro_a_martins
    @pedro_a_martins 3 месяца назад

    Thank you!

  • @royjones5790
    @royjones5790 10 месяцев назад +4

    I'm still looking for a deforum that enables frame-by-frame batching.

  • @moonbot-en-007
    @moonbot-en-007 Год назад

    thx for this video .. I'm just beginning testing Deforum/Controlnet.. I did a couple of videos of someone dancing but with Deforum/CN is wasn't tracking the movement .. like almost not at all so I did this batch image technique and it tracks almost perfectly but as you probably know the blending between images doesn't work with stitching .. do you know how I can track very closely movements in Deforum/CN .. thanks

    • @rundiffusion
      @rundiffusion  Год назад

      This is something that is constantly improving. If you want exact matching you can try WarpFusion or Temporal Net / Ebsynth on a local GPU.

    • @strangelaw6384
      @strangelaw6384 6 месяцев назад

      are the openpose matchsticks accurate? if not, motion blur might have been interfering with the openpose preprocessing

  • @danielschreiber6342
    @danielschreiber6342 Год назад +2

    Thanks for the video. Do you have any idea how Hassan Ragab makes his videos? They are fascinating :D

    • @rundiffusion
      @rundiffusion  Год назад +1

      Wow, amazing artist, I was not familiar! They do lots of Deforum. We did a deep dive with Matt Wolfe on Deforum here: ruclips.net/video/1uFK36QsqkM/видео.html

  • @eduardoponce2860
    @eduardoponce2860 Год назад

    What is the program you use for your files, it gives me a batch error when trying to use a local file on my computer

    • @rundiffusion
      @rundiffusion  Год назад

      RunDiffusion.com - we do cloud GPU and do all the install/setup so you can get to creating. Give us a shot!

  • @strangehandle8231
    @strangehandle8231 Год назад +2

    Is there documentation anywhere to explain what's going on with formatting the path in the Frames to Video tab? It's definitely less than intuitive

    • @aladdinfpv
      @aladdinfpv Год назад +2

      I couldn't seem to make it work too, but I didn't do the whole process I had the frames already, I just wanted to test deforum in making video, @stranehandle8231 any settings to do or specific documents on the path? I tried same as u said and it says wrong path, keep in mind im using local automatic1111

    • @coralheimer
      @coralheimer Год назад +2

      20:48 on his video shows you how to label them. You have to pay for a premium account if you want to upload your own photos

    • @rundiffusion
      @rundiffusion  Год назад

      We changed this, so batch img2img can be done now by any account, no need for Creator's Club! Details here: learn.rundiffusion.com/img2img-batch-processing-with-controlnet/

  • @theunderdowners
    @theunderdowners Год назад +2

    Thank you I'm thinking the previous frame tech like deforums strength schedule could be scripted ? beyond me just a thought.

    • @rundiffusion
      @rundiffusion  Год назад

      Unfortunately not with Batch Img2Img... like I said, I think the tech will evolve away from this method. Deforum Hybrid is a step in the right direction... adding controlnet will get it there!

    • @jasonsutis3387
      @jasonsutis3387 9 месяцев назад

      @@rundiffusioncan use what you are talking about here now?

  • @lilillllii246
    @lilillllii246 5 месяцев назад

    Is it possible to change the face of a character with a roop, and run a batch?

  • @sternkrieger1950
    @sternkrieger1950 10 месяцев назад +2

    I would use a LORA that never changes in appearance (including clothing) so you get the greatest consistency between frames.

    • @Arewethereyet69
      @Arewethereyet69 9 месяцев назад

      do you have a particular one you suggest

    • @rundiffusion
      @rundiffusion  9 месяцев назад

      Yes, overtrained models are great for this

  • @pickleasamara6142
    @pickleasamara6142 Год назад

    How do you upload the frames onto the site? Sorry for the question haha

    • @rundiffusion
      @rundiffusion  Год назад

      You will want the "Shared Server" version learn.rundiffusion.com/img2img-batch-processing-with-controlnet/

  • @hanzo_process
    @hanzo_process Год назад +1

    cool 💪

  • @user-gq2bq3zf1f
    @user-gq2bq3zf1f 6 месяцев назад

    Is there a way to make the outfits look exactly the same?

    • @rundiffusion
      @rundiffusion  6 месяцев назад

      It's tough with this method! Best to use some more consistent methods like animatediff these days (the video is a bit dated now)

  • @serhattatat
    @serhattatat 10 месяцев назад +1

    IndexError: list index out of range how can i solve that error

    • @rundiffusion
      @rundiffusion  10 месяцев назад

      Hop into our discord and ask in the "Deforum" channel discord.gg/y7gCC3UTzK

  • @Zmix18
    @Zmix18 Год назад

    what software did you use to split into individual frame?

    • @hyper_channel
      @hyper_channel Год назад +1

      davinci resolve

    • @Zmix18
      @Zmix18 Год назад

      @@hyper_channel standard or studio?

    • @hyper_channel
      @hyper_channel Год назад

      @@Zmix18 no idea but I imagine the most basic one can do it, splitting video into frames is a quite common operation

    • @rundiffusion
      @rundiffusion  Год назад

      I used Davinci resolve, there are also many free webservices that will do it!

  • @siegekeebs
    @siegekeebs Год назад

    Controlnet now is working with Deforum, have you tried it?

    • @rundiffusion
      @rundiffusion  Год назад

      Working on an update for that! Should be out soon after testing.

    • @siegekeebs
      @siegekeebs Год назад

      @@rundiffusion Looking forward to it!

  • @akashkumardas8424
    @akashkumardas8424 Год назад

    Hey i wanna make this type of video editing with a perticular character from a game...how should i do it...cause i tried the character name but it's not generating that character...should i create a model on that character??

    • @rundiffusion
      @rundiffusion  Год назад

      Hmm, that seems like a challenge. Not impossible though. Hop into our Discord and just into the Deforum channel so we can see if we can help guide you. It will take some learning!

  • @khalifaomani1242
    @khalifaomani1242 Год назад

    is it purple hoody or orange hoody ? or my eys is wrong

  • @iluminera
    @iluminera 10 месяцев назад

    how to rename in bulk ?

  • @adilkhanutepov
    @adilkhanutepov Год назад

    d flicker - what is that?

    • @rundiffusion
      @rundiffusion  Год назад

      Deflicker is a way to remove flickering! It is in some professional video software like Premiere and Resolve. There is also an open source one under development.

  • @nostalgicera2873
    @nostalgicera2873 Год назад

    Please tutorial on how to install run diffusion. Thanks

    • @rundiffusion
      @rundiffusion  Год назад

      RunDiffusion is a cloud service. Simply go to RunDiffusion.com and spin up a server!

  • @mlnima
    @mlnima Год назад +2

    dude I put this video on 55 inch screen, at least upload 4k, it is very picely and bad quality. hope people with small screen can see anything here

    • @rundiffusion
      @rundiffusion  Год назад

      Good point, I'll zoom in the UI next time around.

  • @liquidmind
    @liquidmind Год назад

    hello, i believe you are using the resolution settings the wrong way. With all due respect. In order to get a better face, just use IN PAINTING only face and ONLY MASKED option, but resolution size should be THE SAME ASPECT as video source...... maybe you can raise the pixels, but THE SAME ASPECT RATIO......

    • @rundiffusion
      @rundiffusion  Год назад +1

      Hello, this was before the release of 1.1 so could not use inpainting CN. Aspect ratio is a good point!

    • @liquidmind
      @liquidmind Год назад

      @@rundiffusion ah i understand, i wil be glad to help in any way, i am VERY dexterous in many things, NOT a professional, but i can help in many ways. Let me confess i DONT have control net because of the amount of GB i need. I dont have much space, after AUTOMATIC1111 folder already using more than 100GB, specially because of all the MERGED and CUSTOM models i have made myself, more than 200 files of 4GB, so imagine!! LOL, so i am not an expert in things with control net, but i do a lot of animation with deforum, animator, and now LOOPBACK student.... :D

    • @rundiffusion
      @rundiffusion  Год назад

      Great! Well we are a cloud platform for Auto1111. Come check out our discord and share your work! discord.gg/w8Jv6M66

  • @iluminera
    @iluminera 10 месяцев назад

    its not as good as warpfusion, but its easier to do. thanks so much.
    ps : i keep getting error message when running warpfusion :(

  • @push183
    @push183 9 месяцев назад

    This mathed useing Google colab???

  • @dentaorp2451
    @dentaorp2451 Год назад

    Interpolação dos frames esta toda errada