This Might be The Next AI Animation Trend | IPIV’s Morph img2vid AnimateDiff Tutorial
HTML-код
- Опубликовано: 19 июн 2024
- 🎓The first 500 people to click my link will get a 1 month free trial of Skillshare skl.sh/mdmz05241
Learn how to create morphing animations with ComfyUI! From setup to fine-tuning settings for stunning results. Plus, discover tricks to speed up generation.🚀✨
1️⃣IPIV's Morph Workflow: bit.ly/3wvoP04
2️⃣List of Necessary files/models: bit.ly/44Qtkin
*Check the pinned message for the list
3️⃣Motion Animations: bit.ly/3ylZKVM
⚙️Final workflow: bit.ly/3UzSpcW
⚙️More workflows: bit.ly/3yfwEaH
❓ How to install ComfyUI: • How to EASILY Install ...
❓ How to Write good prompts: • How to Write A Prompt ?
🤖 Juggernaut Model: bit.ly/3ydr8Wh
Other good models:
- Dreamshaper: bit.ly/4dxdRYr
- RevAnimated: bit.ly/3M4R2zZ
©️ Credits:
Abe's channel: / @abeatech
⏲ Chapters:
0:00 Final result
0:08 In this video
0:28 How to start with ComfyUI
0:42 Download & Import workflow
1:59 Settings
8:59 Generate Animations
10:59 Getting creative with ComfyUI
Disclaimer: Some links in the description are affiliate links. If you make a purchase through them, I may earn a small commission at no extra cost to you.
Support me on Patreon:
bit.ly/2MW56A1
🎵 Where I get my Music:
bit.ly/3boTeyv
🎤 My Microphone:
amzn.to/3kuHeki
🔈 Join my Discord server:
bit.ly/3qixniz
Join me!
Instagram: / justmdmz
Tiktok: / justmdmz
Twitter: / justmdmz
Facebook: / medmehrez.bss
Website: medmehrez.com/
#animatediff #comfyui #ai
Who am I?
-----------------------------------------
My name is Mohamed Mehrez and I create videos around visual effects and filmmaking techniques. I currently focus on making tutorials in the areas of digital art, visual effects, and incorporating AI in creative projects. 
Кино
Need help? Check out our Discord channel: bit.ly/44Qtkin
Use these workflows to add more than 4 images: bit.ly/45lDiZD
I've added some solutions and tips, the community is also very helpful, so don't be shy to ask for help
Hey man, the link says its invalid. Could you update it please? :)
@@grovemonk fixed
@AillusoryOfficial thanks for letting me know, just updated the link
You are such a master at Comfy UI.. but also just as an educator! Having spent so many hours on youtube, your approach to teaching is just so concise, easy to follow, and generally brilliant... Thank you so much for taking the time to share your knowledge with the world.. You legend!
Wow, thank you!
As always the best tutorial ever, helped reaching dope crazy results thanks bro 🙏
Happy to help!
Just discovered this workflow today, thanks for the tips!
Happy to help!
I just wanted to express my immense appreciation for your ComfyUI Animatediff tutorial! It was incredibly clear and well-paced, making a complex topic feel so approachable. Your detailed explanations and step-by-step guidance were exactly what I needed to grasp the concepts fully. Thanks to you, I feel much more confident in implementing these animations in my projects. Looking forward to learning more from your expertise!
Great tuttorial as always! Thank you!
Glad you liked it!
Thanks! Been looking for a tut on AnimateDiff!!!
fantastic tutorial. Instant results
Great to hear!
Thank you man! This is dope
Glad you like it!
Great video and I look forward to trying it. But, do you have a link to the model list that does not require discord?
Wow Thanks
Nice
Subscribed, very complete tutorial, what video card are you using?
4090
Thank you for this! Any other morph workflows keep the image "exact" rather than reimagining it? I love these morphing loops but would love it to follow my initial images completely. I though I saw a 2 image morph that seemed to not "reimagine" the inputs. Thank you for the detailed settings walkthrough. Improved my results considerably.
I would love to have that too, I don't know of a way to do it yet
hey! i'm also interesting on what you describe! did you find something ?
Great guide thanks. I managed to produce something and this basically is what Krea ai is offering but their output is bit dark and unpolished. Really appreciate the points on using vram.
interesting, I'm gonna try Krea ai
Can you create on a video how we can increase the video length i.e adding more images then 4
I will be experimenting with that
Donde es esta lista de modelos necesarios. No la veo en discord. Ayuda.
Hi There! This is so sick, do you do anything paid or know anyone who does this for commision? Just recently have been exploring AI art and am totally new to the field. Thank you so much!
How long does your full render take and what is your gpu? It takes my 3080 about 1hr to render 720p but fails on the upscale. Any suggestions?
I use 4090, it takes around 20-30 mins to do the whole thing, try reducing the upscaling ratio, don't use your computer when it's upscaling
영상 잘보고 가빈다
응원드립니다
👏👏👏👏
To use juggernaut_reborn, where in the ComfyUI folder structure did you put it? I downloaded it and tried a bunch of different places but it wouldn't show up in the "Load checkpoint" box
hi, all the correct placements of models are included in the full list (link in the description) make sure you use the correct path
The king has answered our prayers. Just upgraded to a 4060 ti cant wait to get better quality outputs!
Congrats!! 8 or 16 VRAM ?
@@MDMZ 16!
@@ComfyCott Power 💪
I have a question that other people might have too. I am new to the AI world and don’t know how things work. In your video, you show us how to do everything step by step. But if I want to try new things or use other models, how do I do that? I think we can do more fun stuff in ComfyUI besides just changing the video. Can you make a video about that or write back to explain? This will help many people like me. Thank you for all your hard work!
I get you, I think that comes with experience, try different workflows, you can also look up tutorials on specific nodes and what they're used for
Great tutoria! Thanx MDMZ!
happy to help!
Hi @mdmz, I found the final animation output is wildly different in style & aesthetic from the initial input images. Any tips for retaining overall style? Also have you got this workflow to work with SDXL?
That's normal, it doesnt stay 100% true to the input, i tried with sdxl, couldnt gey good results
Thanks for this amazing KI Video Information. Many greetings from good old Vienna 🎡 🎩
Glad you enjoyed it!
This looks similar to sparse ctrl workflows, i'll see how they compare
AMAZING❤️
Thank you!
I can't get rid of the red notifications, and when I try to update or install anything (at video 1:13) I get errors. Reinstalled and uninstalled the program several times already and still errors. Can you please advise me what I am doing wrong?
that's werid, can you share more context on discord please ? easier to share screenshots and resources over there
anyway to set video combine to download in h264 format because the uncompress is too big also for the images anyway to always save as jpeg or webp not png? ps im not talking about previewing.
u can increase the crf to reduce file size, I think the combine node has options to change codec as well
Can u please post your workflows somewhere else? Cuz Patreon not available in many countries...
I believe the unavailability issue affects the payment stage only, I put the workflow there for FREE, can you check if you're able to see the post ?
@@MDMZ Nope. Patreon is blocked from their side, they decide which nation have privilege to join... If workflow is free, maybe u can link it via google drive?
Any suggestions on how to do a longer video? I want to use more than 4 images, how do i add nodes?
you can duplicate the image group nodes to add extra images
how can i control clip vision on this workflow my friend ?
Invalid invitation to discord, would it be possible to update the link? Congratulations on the work!!
Just fixed it, sorry about that
@@MDMZ thanks
hi, what is the resolution of the uploaded photos?
for this particular video 1024x1024, but so far I havent had restrictions with resolution or aspect ration, better quality helps tho
@@MDMZ Are these images publicly available? I can't achieve your result.
@@TheNexusRealm yes they are, together with the workflow
Can I easily create AI animation with Animate Diff/Comfy UI's help using an Nvidia Geforce 1050TI 4GB graphics card?
4GB is a bit too low
Thank you brother for being so kind doing this amazing vid ❤ , sadly i still can't get any results.. i followed all the steps and every file is in it's right place , but i always get an error once i reach to ksampler , would you please help ?
you can share the error on discord, u might be able to get help if u provide more context
The motion graphic site is down, how can I get the Video? Thx
seems to be working fine now
@@MDMZ I try many times, still can't link the site, pls help, if upload the video to somewhere else(maybe the site block some IP address)
🔥🔥
The upscaling keeps getting stuck and won't generate anything
no errors at all ? did u try upscaling to 720 or 1080 ? trying a lower res might help
Better then deforum?
depends who u ask, both can be used for different things
When I use a real person's image, it completely changes that person's face to a different man. Is there any way to fix that to maintain the same face?
By the way, great video. Keep it up.🔥🔥
check 5:00
@@MDMZ Yes, I caught this the second time I watched the video. Thank you for clarifying this, though.
love your content 🔥🔥
@@MDMZ hi sir, i know this tutorial just came out but i want to know if this is possible
hmmm. I must be missing something because I can't seem to get the video to look anything like the original images...any tips?
Fixed it, Lora's did not auto pull in settings! noobing my way through, thanks for this tut!
There is no manager option in my comfy ui what should i do now?
did you install the manager ? check this video: ruclips.net/video/E_D7y0YjE88/видео.html
@@MDMZ much respect for you bro to be very honest you and your community is great i love to be a part of your community.
please tell me：how to add 5th or 6th photo or more photos？thank U a lot
still looking into this, might need to start off a different workflow
is there a way to add more pictures to the process? and how can I make a linger video out of this?
How do you print it out in a 16:9 ratio resolution!!!???????????????????? plz
I have a problem where images from the previous generation are saved, and even though I remove them, they still appear in the generation
that's strangem try restarting comfyui, and set the seed to randomize
why does the final output video turn super dark when i use super bright images??
make sure you use the right settings and models, if it persists, try reducing the steps down to 15-20
How to open comfyui after installing it all??
open run_nvidia_gpu
How many vram and ram should i have for that? I have 32 ram- 8vram
I recommend atleast 12GB of VRAM, you can still give it a try
raise Exception("ClipVision model not found.")
make sure you download the correct clipvision files AND... rename them as described in the list
@@MDMZ it's solve but still i get error on cv2
can someone send me a link to the IPAdapter model please. I think the link mentioned here is not good. thanks.
What happens when you click on the link ? Seems to be working fine for me
Error occurred when executing ImageSharpen why always like this?
help me please
what does the error say
Amazing results indeed but wow at 1:00min lost me as wayyy to complex to use unfortunately
haha that was my exact reaction when I first saw it, don't get discouraged, it gets easier 😉
Can we have a Google colab for this please?
3.75 is insane
U don't have to go that high, 720p is still good
You can go lower and use topaz labs for pixel upscaling which does an excellent job
2.5 for 720p and 3.75 for 1080p, what about 4k?
how long is your rendertime with 3.75? thx
7.5 try at your own risk 😅
can you do this for free?
it is free!
People with links to Patreon should be banned for advertising.
Im learning too much from you sir 🙏🏻💯🫡
Glad to hear it
I went according to the same links you posted and download *ed the required files, but it gave me an error again, what's the problem?
Error occurred when executing ADE_LoadAnimateDiffModel:
'Hyper-SD15-8steps-lora. safetensors' is not a valid SD1.5 nor SDXL motion module - contained 0 downblocks.
File "D:\ComfyUI_windows_portable\ComfyUI\execution. py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj. FUNCTION, allow_interrupt=True)
File "D:\ComfyUI_windows_portable\ComfyUI\execution. py", line 74, in map_node_over_list
results. append(getattr(obj, func)( ** slice_dict(input_data_all, i)))
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ ComfyUI-AnimateDiff-
Evolved\animatediff
odes_gen2.py", line 178, in load_motion_model
motion_model = load_motion_module_gen2(model_name=model_name, motion_model_settings=ad_settings)
AAAN
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-
Evolved\animatediff\model_injection.py", line 1084, in load_motion_module_gen2
mm_state_dict, mm_info = normalize_ad_state_dict(mm_state_dict=mm_state_dict, mm_name=model_name)
AAA
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ ComfyUI-AnimateDiff-
Evolved\animatediff\motion_module_ad.py", line 136, in normalize_ad_state_dict
raise ValueError(f"'{mm_name}' is not a valid SD1.5 nor SDXL motion module - contained {down_block_max}
downblocks.")
hey, it's possible that the file 'Hyper-SD15-8steps-lora. safetensors' is corrupted, try re-downloading it, you can also share this on discord for more help
Error occurred when executing ADE_LoadAnimateDiffModel:
'NoneType' object has no attribute 'lower'
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff
odes_gen2.py", line 178, in load_motion_model
motion_model = load_motion_module_gen2(model_name=model_name, motion_model_settings=ad_settings)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\model_injection.py", line 1066, in load_motion_module_gen2
mm_state_dict = comfy.utils.load_torch_file(model_path, safe_load=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\piyus\OneDrive\Desktop
ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\comfy\utils.py", line 13, in load_torch_file
if ckpt.lower().endswith(".safetensors"):
^^^^^^^^^^
facing this error
There is no manager option in my comfy ui manger what should i do now?
You need to install it, check my comfyui installation video for instructions