FaceFusion: The Definitive Deep Dive & Walkthrough - Everything You Always Wanted to Know About...

Поделиться
HTML-код
  • Опубликовано: 31 дек 2024

Комментарии • 83

  • @phenominc
    @phenominc 9 месяцев назад +8

    oh mate. this has been one of the best tuts ive ever seen for ai stuff. thanks heaps

    • @shadyendeavor
      @shadyendeavor  9 месяцев назад +1

      You're very welcome. Thanks for watching!

  • @RevMan001
    @RevMan001 9 месяцев назад +3

    I watched this yesterday and was working in FF today. I'm doing lip sync with face enhancer, but the enhancer is ruining the eye blink I already have in the face. Then I thought I recalled you saying something about masking and came back to watch that section again and I now have a good lip sync, without ruining my eye blink! Thanks!

  • @hansdoreen
    @hansdoreen 9 месяцев назад +2

    This is absolutely the best video explaining the features of face fusion. Thank you very much sir!

  • @PaulSinclair-i2s
    @PaulSinclair-i2s Месяц назад +1

    Great explanation of everything, man. Thanks. One thing I realized using v3 is that you can copy a path into the output field so that it outputs to somewhere you choose.

    • @shadyendeavor
      @shadyendeavor  Месяц назад

      You're welcome! And yeah, quite a few things have been updated or added since I made this video that have made FF even better. You can even setup your ini file to have a more permanent output location of your choosing. I have a video that talks about setting defaults with the ini file. Check that out if you haven't already.

  • @iheartjetaviation2764
    @iheartjetaviation2764 5 месяцев назад +1

    Thanks so much for this video. I have been searching for explanations for what these settings and sliders actually do. Came up empty handed, that is until today when I saw a Reddit post on FaceFusion, and your video was referenced as a great source of information. So glad that I did. Thanks for your efforts!

  • @amarissimus29
    @amarissimus29 9 месяцев назад +1

    Great job. Really great, thank you. It's pretty annoying to generate test frames for every combination of every model/setting. Even when a preview is lightning fast. Some of the modules are ambiguously named. It's really nice to have an overview. You've definitely saved me a ton of time. FF gives pretty amazing results right off the bat without touching anything, but dialed in... holy crap. Really, really cuts down on the post processing. A few masks here and there, some interpolation. Amazing. Thanks for your work.

  • @SplakEight
    @SplakEight 2 месяца назад +1

    So glad I found this video, excellent explanations.

    • @shadyendeavor
      @shadyendeavor  2 месяца назад

      I'm very glad you found it too! ;)

  • @katherinesera
    @katherinesera Год назад +3

    "I'm the dude, playing the dude, disguised as another dude." hilarious!

  • @stillsbyjann
    @stillsbyjann 3 месяца назад +1

    whats the best setting for face mask blur? did I miss that in the clip?

    • @shadyendeavor
      @shadyendeavor  3 месяца назад

      No, you didn't miss that clip as there isn't one. As with any settings you use with a swap, there is no such thing as a "best setting" as it all changes depending on your videos or images that you are using. The "best" overall settings are already there as the default, but those same default settings could be terrible for some projects too. So the same thing goes for the mask blur.

    • @stillsbyjann
      @stillsbyjann 3 месяца назад +1

      @@shadyendeavor sry didn't meant "the best" - just wanted to know what kind of blur they mean - the blur around the swap? I see that sth changes but I can't tell what with that little preview window^^

    • @shadyendeavor
      @shadyendeavor  3 месяца назад +1

      @@stillsbyjann yes, I agree, the size of the preview window sucks, but at the same time, that's kind of the point. If the preview window was bigger, that wouldn't really be as much of a preview as it would be the output. The only real way to see what it's doing is is to just output an image or a few frames of a video to see the effect it's having. Also, make sure to check out my basics video on face debugging that will give you more of an idea of the shape that the swapper is working with on each face. That might help out a bit. ruclips.net/video/CXPIUgCApsQ/видео.html

  • @lizardmutt
    @lizardmutt 10 месяцев назад +1

    Hi! I have a problem with the program not following mouth and eye movements, as well as retaining the same expression despite the source video changing (smiling, talking, etc). The final output thus becomes very stiff. What should I do? Thanks in advance.

    • @shadyendeavor
      @shadyendeavor  10 месяцев назад

      Without actually seeing the footage you are using and all of your settings, there really isn't anything I can do. My recommendation would be to go on FaceFusion's Discord (which should be linked in the notes) and ask for help there where you can post screenshots, etc.

  • @JosephMcChristmas
    @JosephMcChristmas 3 месяца назад +2

    This is really useful, thank you. Any plans for a FaceFusion 3.0 update? The GUI has changed a bit.

    • @shadyendeavor
      @shadyendeavor  3 месяца назад +1

      I've thought about it. It's a big undertaking to do these types of videos and considering how much more there is in it, it would be a lot of work. But maybe.
      Also, my GUI tends to look different from what most people have as I tinker with it a lot.

    • @JosephMcChristmas
      @JosephMcChristmas 3 месяца назад +1

      @@shadyendeavor Thanks for the response. This video has been invaluable, regardless of your future endeavors

  • @jessecool561
    @jessecool561 4 месяца назад +1

    Great tutorial and info.. just a quick question regarding temp files taking up alot of drive space. What temp files are safe to delete to clear up drive space? I have done a few swaps and facefusion is taking up 200gb of space.

    • @shadyendeavor
      @shadyendeavor  4 месяца назад

      I believe all temp files can be deleted, but to be clear, FaceFusion shouldn't have any temporary files after you're done creating a swap. Make sure to check that you don't have "keep-temp" turned on. Otherwise, the temp files you might be speaking of are Gradio specific ones that the interface is based on for FaceFusion. Gradio has a bad habit of keeping it's temp files, but feel free to delete those too.

  • @leandrorighini6137
    @leandrorighini6137 10 месяцев назад

    How do you handle situations when the target turns profile and the mask slips or bugs for a frame or two, any tips on settings to help?

  • @alanevans3447
    @alanevans3447 6 месяцев назад +1

    First of all, I just want to say thank you for all that you share with us.
    I truly appreciate it.
    I am impressed with the quality of the final products when using faceswap, but I work mainly with the lip-sync option. My issue is that I attempt to add my own character voices and impressions to various characters which are anamorphic, but Facefusion doesn't recognize many of the faces that I create with Fooocus. Is it possible to manipulate the facial recognition points to get the images to work, or are there any settings I can tweak to have a successful lip-sync? Thank you for taking the time to read this.

    • @shadyendeavor
      @shadyendeavor  6 месяцев назад +1

      I assume you meant "animated", as "anamorphic" is shooting widescreen on a 4:3 format. That being said, yeah, FaceFusion and almost all face swapping apps will not work well or at all with animation. It all depends on the detail of the faces. If they have distinct face landmarks. Sometimes, it will work ok with 3d animations. I got some "ok" results with How to Train Your Dragon, but not great. 2D animation, that definitely won't work. And because you're doing more of the lip-sync side, that's probably going to be more difficult. And there are no settings at all for the lip sync model. Anyway, good luck and thanks for watching!

    • @alanevans3447
      @alanevans3447 6 месяцев назад

      My goodness, I meant to say "anthropomorphic"!
      Thanks for responding, Shady.
      I was hoping that ai had brought more to the table for working with non-human faces in the lip-sync arena.
      Years ago, Reallusion made a program named Crazy Talk, which allowed you to lip-sync any face imaginable by letting you manually manipulate all of the nodal points of the face, but the actual lip-sync itself needed a lot of manual tweaking, too.
      Who knows? Maybe next week someone will make it happen.
      Thanks again for replying.

    • @shadyendeavor
      @shadyendeavor  6 месяцев назад +1

      @@alanevans3447 yeah, animated or anthropomorphic, still basically the same answer, as I'm sure you knew. But yes, it seems I've seen similar functioning apps in the past for stuff like that, but nothing I specifically remember.

  • @shitokenjpn
    @shitokenjpn 7 месяцев назад +1

    Thank you for making this video. I wanted to ask like when the view is side of the face the swap image will drop out . What should I look into to reduce this or is a bug? This was also happening in roop unleashed. thanks

    • @shadyendeavor
      @shadyendeavor  7 месяцев назад

      Sadly, it's a limitation of the model. There isn't anything that can be done to fix this. Other than someone create a better model. Roop used the same model. And it's the best model that's available currently.

    • @AGVenge
      @AGVenge 4 месяца назад

      ​@@shadyendeavor I see that there are several models from the list. Which one is best and how are they different? I also hear about something called "teaching". Can we make our own and better models and implement into Roop or?😊

  • @SurajGupta_3D
    @SurajGupta_3D 7 месяцев назад +1

    when i Download the output after face debugging the footage downloads with face trackers still intact? how to remove the tracker defore downloading the output

    • @shadyendeavor
      @shadyendeavor  7 месяцев назад

      You need to render it without face_debugger turned on. The debugger is just a tool to see what is going on "behind the scenes". Any settings you change while using it will still be kept when you turn it off.

  • @ugurergun9816
    @ugurergun9816 11 месяцев назад

    Good day, when I press the middle tab, which is the masking option next to the box on the screen, an error appears on the videos, I cannot mask.

  • @gratefuldeadkennedy
    @gratefuldeadkennedy 10 месяцев назад

    Thanks a lot for this great guide! After some hickups on installing I have faceswap up and running on a M1 16gb pro. When using just faceswap I get an output (I use a 15 sec flick) in 30 seconds. But when I use face-enhancer to booth for a smoother look the timer keeps ticking and the rendering process just never stops. Is there any adjustment I need to make in the settings or do I ask my laptop something it's not capable of?

    • @shadyendeavor
      @shadyendeavor  10 месяцев назад

      Without seeing what you are actually doing, it's very difficult to tell you what the problem is or if there even is one. When you say the time keeps ticking, are you only watching the output box in the FaceFusion interface? If that's all you're watching, that might be the perceived problem. I almost always watch the progress in Terminal that actually tells you which process it is on and what frames, etc. and the reason it might seem like it's not doing anything is because face_enhancer takes literally 10-25 times longer than the basic face_swapper.
      So with your 15 second clip - let's say that's 30fps and 1080p - that would make the clip 450 frames - on my very similarly equipped 16Gb M1, that would take about 10 minutes.
      IF that isn't the issue and I just wasted a bunch of typing 😉 it could be a few other things that I'm not really the one to diagnose. The best thing to do would be to go to the MacOS Troubleshooting channel on the FaceFusion Discord channel, which I should have linked in the video description.

  • @ismaeljoffroychandoutis508
    @ismaeljoffroychandoutis508 9 месяцев назад +1

    #3 : you mean to import multiple images of the same person with different angles to enhance to improve the result ?

    • @shadyendeavor
      @shadyendeavor  9 месяцев назад +2

      Correct. Different angles (not extreme as profiles don't work) and lighting can help the resulting image look more accurate to the target.

  • @starlightmckennah5241
    @starlightmckennah5241 8 месяцев назад +1

    Thank you for awesome vid! My exuction providers say Azure, and CPU. I do not have coreml. Does Azure also speed up processing or do I need coreml? Im on an Acer running off windows

    • @shadyendeavor
      @shadyendeavor  8 месяцев назад

      I believe you already got your answer in the Discord ;) But for those not there, coreml is for mac only. Azure is not worth using, but it's for MS Cloud Computing and I don't think it's ever really been used. Otherwise, your specific system issue was answered in Discord.

  • @yasin6904
    @yasin6904 11 месяцев назад +1

    What benefit is there to facemask debugging? Is it just to make sure that it selects the correct face?

    • @shadyendeavor
      @shadyendeavor  11 месяцев назад

      At 19:46 there is the chapter marker for Face Debugger that goes through all of the features, benefits and uses for it, which include the following three chapters that show the 3 different types of face masks. But yes, it has everything to do with the face masks - which face, how many faces, if it will select during every frame based on the score, etc.

  • @ismaeljoffroychandoutis508
    @ismaeljoffroychandoutis508 9 месяцев назад +1

    Can we drag drop 5 face photos and swap face each photo to a specific target face ? If it is a group of people in the video

    • @shadyendeavor
      @shadyendeavor  9 месяцев назад +1

      No, at the moment it isn't possible like that. You need to run through one face at a time. Then run the output video for the next.

    • @ismaeljoffroychandoutis508
      @ismaeljoffroychandoutis508 9 месяцев назад

      @@shadyendeavor thx

  • @arodg
    @arodg 2 месяца назад +1

    very good. thanks.

  • @BeratTurkbkmaz
    @BeratTurkbkmaz Год назад +1

    Could we add more than one images as source. Is it working with only one image?

    • @shadyendeavor
      @shadyendeavor  Год назад

      27:24 - I post at this time stamp this exact feature, so yes, you can. I'm not sure what you're asking about "working with only one image?" though. As yes, of course it works with only one image as that's the basic functionality and how I show it being used through the entire video.

  • @cynicalsingh3487
    @cynicalsingh3487 7 месяцев назад +1

    TRhank you so much you saved me a lot of time✌

  • @starlightmckennah5241
    @starlightmckennah5241 8 месяцев назад +1

    Also if your face doesnt change in the preview box before rendering is that okay? 😊

    • @shadyendeavor
      @shadyendeavor  8 месяцев назад

      Also answered in discord, but too much to type here now. But simply, no, it's not okay. 😉

  • @Kallan007
    @Kallan007 6 месяцев назад +1

    Can you share what you know on Face Mask Types, thanks.

    • @shadyendeavor
      @shadyendeavor  6 месяцев назад

      Not going to go into great detail here, but box is for a basic mask that allows you to pull in the side of it to mask things off in a rectangle. Occlusion is used to automatically occlude anything that goes in front of the face (hand, beer bottle, an elephant, whatever). Region - whatever you turn off will keep the original of that item from swapping. These can be mixed up. I talk a bit more about these in my FaceFusion Basics 05 video about the Face Debigger. I'd recommend checking that out.

  • @LucianaCortes-k1b
    @LucianaCortes-k1b 11 месяцев назад +1

    How is the privacy, I want to use this for fun for my family, but is there a chance that the movies can be leaked when using facefusion?

    • @shadyendeavor
      @shadyendeavor  11 месяцев назад

      Completely private. Once installed and running and whatever models you are going to use are installed, this can be run without internet connection if you were that unsure. But there is no internet activity at all while using this app, other than when downloading new models when you switch and you can see all of that live in your terminal window.

  • @broskichannel4163
    @broskichannel4163 7 месяцев назад +1

    I have an AMD gpu, how do i turn on Cuda? im on pinokio, its been taking literal days for some video's to render

    • @shadyendeavor
      @shadyendeavor  7 месяцев назад

      Cuda is for Nvidia GPUs only. There is an accelerator specifically for AMD, but my brain isn't working right now. They'd know for sure on the discord channel and know how to install it. The discord is linked in the description.

    • @broskichannel4163
      @broskichannel4163 7 месяцев назад

      @@shadyendeavor Oh ok, Thanks!

  • @kozulgaming7349
    @kozulgaming7349 8 месяцев назад +1

    What to do if i want deepfake someone eating because when the person start putting something in mouth it's just become mess up or the mouth not open

    • @shadyendeavor
      @shadyendeavor  8 месяцев назад

      It's not always going to work. But I would try turning on "occlusion" instead of "box". If there is too much going on, a clean swap just might not be possible. You also have the option to turn on "region" and turn off the mouth options. That could help, but that means you would retain the original mouth. You could kind of do the same thing if you stayed in "box" and instead adjusted the bottom of the mask so it doesn't affect the bottom of the face.

  • @Beauty.and.FashionPhotographer
    @Beauty.and.FashionPhotographer 8 месяцев назад +1

    amazing thanks so much. would be amazing to get one like this for the newest 2.5.2

    • @shadyendeavor
      @shadyendeavor  8 месяцев назад

      Most of the information is the same. But I do plan to eventually make videos of the updates.

  • @erjavid
    @erjavid 8 месяцев назад +1

    Great Video.

  • @robroufla
    @robroufla 10 месяцев назад +2

    thanks !

  • @dbog5214
    @dbog5214 4 месяца назад

    can you tell me how to run it on lightning ai?

    • @shadyendeavor
      @shadyendeavor  4 месяца назад

      Nope, because I don't know what that is. Sorry.

  • @AGVenge
    @AGVenge 4 месяца назад +1

    I find that the source image's looks like "airbrushed" or cartoonish, with no skin imperfections. As if details disappear?

    • @shadyendeavor
      @shadyendeavor  4 месяца назад

      I assume you mean the output image. Yes, this is because the main "good" swap model, inswapper_128, is just that - 128 pixels. This means that for an entire face, you're only getting a total resolution of 128 pixels swapped and it loses a lot of definition. The enhancers are there to clean up the pixelation, but they can't bring back information that is no longer there. With version 3.0 coming out soon, the new Pixel Boost feature will be added and a lot of the detail will be added back. I have a video on this feature using the developer version if you want to check that out.
      ruclips.net/video/dmFO1zrNg54/видео.html

  • @ugurergun9816
    @ugurergun9816 11 месяцев назад +1

    Hello, after downloading the video, the face was downloaded in a red frame.

    • @shadyendeavor
      @shadyendeavor  11 месяцев назад

      It sounds like you left "Face Debugger" turned on when you started the render. Just make sure you turn it off before rendering out.

    • @ugurergun9816
      @ugurergun9816 11 месяцев назад

      @@shadyendeavor Thank you, there is another problem. As soon as I press occlusion masking, which is the most important masking feature, the videos disappear and an error message appears. As soon as I press the middle masking button, an error appears.

  • @joaobrag4
    @joaobrag4 7 месяцев назад +1

    VERY GOOD! THANK YOU

    • @shadyendeavor
      @shadyendeavor  7 месяцев назад

      Glad you liked it. Thanks for watching!

  • @Dieboard
    @Dieboard 7 месяцев назад +1

    Thx, great one!

  • @PoldaranOfDalaran
    @PoldaranOfDalaran Год назад +2

    Huh. I missed the other video with this.

  • @yourkodi3945
    @yourkodi3945 7 месяцев назад +1

    how can you get rid of the nsfw filter?

    • @shadyendeavor
      @shadyendeavor  7 месяцев назад

      Sorry, you're going to have to try to figure that out on your own.

  • @coolacademy
    @coolacademy 9 месяцев назад

    Thanks

  • @hom1xide
    @hom1xide 7 месяцев назад +1

    W Video

  • @MouthBreatherCure
    @MouthBreatherCure 9 месяцев назад +1

    Man, facefusion giving me errors out the butt. I have been trying to get it to work, and it is quite frustrating, especially when the installation instructions are can be understood by a simpleton.

    • @shadyendeavor
      @shadyendeavor  9 месяцев назад

      2 options, well, 3 actually.
      1 - go on their discord and ask for help with whatever specific errors you might be getting.
      2 - Use Pinokio instead to install and run FaceFusion. I have a video for that too. ruclips.net/video/LyNxnHjU32I/видео.html
      3 - Try it out on RunDiffusion. They have a free trial and then the pricing is actually super cheap as it's based on your actual usage and so you can spend as much or as little as you want. I make a ton of swaps each week and it costs me about $2 each time with an extreme amount of time saved compared to doing it on my computer. I also have a video for that. ruclips.net/video/lzLRCSWq7Aw/видео.html
      Hopefully one of these options works for you. Good luck!

  • @choppergirl
    @choppergirl 10 месяцев назад +1

    This thing is grrbage... it fails on every video file I feed it.