If you liked this video, check out my latest video on this topic! I show you how you can render any 3D scene with AI, whether video or image. Amazing for creating assets, concept art, animatics or trippy Ai animations! ruclips.net/video/mu3JEfx3PHM/видео.html
Hahha 😂 bruh this is bitter truth but , after lots of struggle and lots of knowing a specific tool . You can create what u want if u r master in written prompt
Thank you for the video, but... Am I the only one who's got REALLY board of the special look of AI rendered (or generated) stuff? I want to see REAL artwork so bad...
This could actually be THE animatic method i will be using moving forward. Cause you get the actual scene with basic props, but able to visualize the final product in a way you couldn't before. I mean, as a final renders, it's hot garbage, but i see huge potential in this technique. Really awesome, thank you.
Oh course the real issue with this approach is that the shadows are all baked into the material, so lighting become problematic. But for a fast scene with little camera movement and lighting, this will work. Its a great approach for scene prototyping.
Really cool. Just out of interest, did you maybe try it the other way around? Meaning export a depth map animation (eg with the camera movement) out of blender and then batch process them in SD? Would be curious to see how consistent this is? Maybe in combination with Animate diff in comfyui.. Thank you
Honestly, I think you're brilliant. I love creating stories and I have been looking for a way to start creating my own from scratch. This just opened so many opportunities
Since 2010 i am dreaming about somethinglike this. I got all those images in my mind. I am a genius in 3D Moddeling. But I never got fast enough to bring any of my ideas to paper in good time. BTW for me it is "only" an expensive Hobbie. I come from CAD where my Profession came from. In my special case this brings 14 years of modelling finaly to a conclusion in that case I ever dreamed about. And for those saying "but it is only AI generated!" First those AI Machines run on our own Systems. Second to install a working Image generating KI is a real hard bunch of work with stuff I never was confronted with. Like basics of Coding in 3 different languages, deep reprogramming parts of windows or wrting (it is worth it, when u are done with it) small aplications for automatisation processes. So I was against this stuff cause I wanted to do all alone. Long Story short..... to throw away all those prejudices made my life better in any way. And there is still enough room for handmade 3d art. We only can be WAY more creative now! So take the chance! And thanku again for the Video!
Well I've got a BIG question AND no many time 😭 for the context, i'm in my Last year of a Design degree and I have three weeks for realese a video game background with your tuto. But firt of all, I used Midjourney so I don't know how to use Stable diffusion... well no problem BUT (yes thus Word resum my degree) I create my own graphic style with Midjourney and I would like to know IF I can put a reference image insted of what you selected at 5:20 the "model".
Brilliant video, thanks for sharing your knowledge! :D I have a question tho : when doing a camera-projection like that, the foreground elements' textures are bleeching on the background elements. The more you move the camera, the more you'll see those texture "errors" Do you have any trick to fix that? Beside some manual texture rework I can't come with a clever and nice way
Mickmumpits, we appreciate creative and talented citizens like you. Would you be interested in joining or simply learning about the ownerless EQORIA, United Earth, and adding your creation using AI? We like to display your ideas to other citizens so they can reward you for your contribution to Earth.
You are so good! I’m gonna have to look at your videos. I’ve been trying to find a way to use AI to create 3D images of my drawings to create characters. Can it be done?
hello sir, how much blender knowledge do we need to be doing this? I want to make children's content using your methods and different ai tools. I want to become your patreon member. But do you have content for complete beginners? How much knowledge of blender do you need for this?
How we do get stable diffusion ? It doesn’t really explain it very well what need to do to get to that part to use software stable diffusion . Can you help me out thanks
it does not works. when i select the sky and connect a second texture in the shading section then it's changing me all surrounded area, not only sky. (9:44) what can I do wrong?
I did everything as you have instructed but my Stable diffusion screen is different so I can not enter some of the parameters. It worked and generated an image but can not control it
Just do it for each visual plane instead, then combined at the end to avoid doubling effect and have more camera freedom. Heck projecting, then masking part at another angle, port back to ai, infill the masked part, project the masked area, merge all angles using the mask of each.
By generating the whole scene, you get more stylistic consistency. But you could seperate the foreground and background elements before projecting first. Although trying projection without seperating could end up saving a bunch of time if it works for what you want to do (i.e. very small camera movement)
Love it - had my head spinning when this was first announced a few months ago but damn dude your video really shows the insane potential of Video > Video AI workflows 👀 Keep it up man, just shared this with my private community 💪
Please ❤ reply sir could i do in my laptop HP PRO-BOOK 450 G9 16 GB RAM WITH ITEL IRES GRAPHICS CARD WITH CORE I 5 PLEASE 🥺 COULD I RENDER AND USED DEPT MAP IN THAT SETUP❤ 7:35
This is exactly how games are going to be down the road. Blocked in proxy models driving AI filters. Realtime will be a bit longer but way sooner than we think and VFX stuff...like shown here...is already a gamechanger.
Thanks for sharing! Been thinking about similar ideas... generative AI & Blender, specially after TripoSR was published just recently. Now there start to be so much tools with AI image making that it is more question of discovering the workflows. I'm myself visual artist working with gen AI.
Hello Mickmumpitz, 1st thank you for this tutorial. I went to Automatic 1111 but there were a bunch of names with folders. I don't want to download a virus. What should I do and how will I do it?
hi mick just follow your tutorial and my results are not really in position or image generation it is not following the depth image accordly... (looks like a little more aleatory) even adjusting CFG scale doesn't help so much. any hints or things to check? let me know cheers and thanks
I feel like we’re about a year away from someone putting this entire workflow into one plugin, complete with random primitive placement, camera placement w animations, scene changes, and character generation. Then you just use your phone camera to film yourself acting and watch the entire movie come to life! With random prompt presets to help try new layouts and styles.
If you liked this video, check out my latest video on this topic! I show you how you can render any 3D scene with AI, whether video or image. Amazing for creating assets, concept art, animatics or trippy Ai animations! ruclips.net/video/mu3JEfx3PHM/видео.html
Hi. Can you help me please ?
This was a fantastic video, I will try to watch more of your stuff
AI Workflows. It's fun. It's easy. It's never exactly producing what I want.
Can u please explain what you mean?
skill issue
Pretty well put into words!
But that is also the case if I do it myself 😂
But yeah if you’re a good 3D artist it is better to do it yourself.
Hahha 😂 bruh this is bitter truth but , after lots of struggle and lots of knowing a specific tool . You can create what u want if u r master in written prompt
It's pleasure to see how you master AI+3D in conjunction
very cool and very smart. The only problem is the limitation of the camera movements ...
Amazing video man!
Thank you! :)
Awesome work! The revolution has begun!
whenever i click on the UV mapping the image i have seems to be scaled way bigger than the models i have, idk how to solve that
Thank you for the video, but...
Am I the only one who's got REALLY board of the special look of AI rendered (or generated) stuff? I want to see REAL artwork so bad...
This could actually be THE animatic method i will be using moving forward. Cause you get the actual scene with basic props, but able to visualize the final product in a way you couldn't before. I mean, as a final renders, it's hot garbage, but i see huge potential in this technique. Really awesome, thank you.
Check out my new video! I made an updated version of the workflow and it works really well for animatics now!
Amazing was a strong word...
Good stuff.
But the title is a little misleading, because you're barely animating anything.
Do do not promote. There are young who want to be hired in the studio, when there is ai studio will ai. We will be rejected!!!!!!!
The layout process is the most interesting phase of this because it's the most creative part, everything else is a Vegas slot machine of crap.
really nice ! I am a programmer and not an artist, so these are valuable methods to leverage my games ...
Your combination of 3D and AI is very clever and forward thinking. I’ve been wanting to do something like this but haven’t figured it out. Thank you!
Oh course the real issue with this approach is that the shadows are all baked into the material, so lighting become problematic. But for a fast scene with little camera movement and lighting, this will work. Its a great approach for scene prototyping.
I don't get why people think AI will steal jobs, it is just another brush in the artist's toolkit.
@@nangld because it's very very fast, one artist now can do the same amount of work that it used to take 10 or 20
I'm far more excited about it than I am afraid.@@nangld
its not a brush it makes a whole advanced art in matter of seconds@@nangld
this stopped working. The depth image I get from blender is very white without any depth at all
Really cool. Just out of interest, did you maybe try it the other way around? Meaning export a depth map animation (eg with the camera movement) out of blender and then batch process them in SD? Would be curious to see how consistent this is? Maybe in combination with Animate diff in comfyui.. Thank you
Wow!
You are good, cant wait to learn more. I subbed
Honestly, I think you're brilliant. I love creating stories and I have been looking for a way to start creating my own from scratch. This just opened so many opportunities
Ian Hubert is literally one dude working in blender and he makes entire movies without ai. It’s not that the door was closed, you’re just lazy
you know, millions of people thought the same, you think you'll stand a chance in this market?
@@tright6 you nothing about me clown
Since 2010 i am dreaming about somethinglike this. I got all those images in my mind. I am a genius in 3D Moddeling. But I never got fast enough to bring any of my ideas to paper in good time. BTW for me it is "only" an expensive Hobbie. I come from CAD where my Profession came from. In my special case this brings 14 years of modelling finaly to a conclusion in that case I ever dreamed about. And for those saying "but it is only AI generated!" First those AI Machines run on our own Systems. Second to install a working Image generating KI is a real hard bunch of work with stuff I never was confronted with. Like basics of Coding in 3 different languages, deep reprogramming parts of windows or wrting (it is worth it, when u are done with it) small aplications for automatisation processes. So I was against this stuff cause I wanted to do all alone. Long Story short..... to throw away all those prejudices made my life better in any way. And there is still enough room for handmade 3d art. We only can be WAY more creative now! So take the chance! And thanku again for the Video!
Well I've got a BIG question AND no many time 😭 for the context, i'm in my Last year of a Design degree and I have three weeks for realese a video game background with your tuto. But firt of all, I used Midjourney so I don't know how to use Stable diffusion... well no problem BUT (yes thus Word resum my degree) I create my own graphic style with Midjourney and I would like to know IF I can put a reference image insted of what you selected at 5:20 the "model".
Brilliant video, thanks for sharing your knowledge! :D
I have a question tho : when doing a camera-projection like that, the foreground elements' textures are bleeching on the background elements. The more you move the camera, the more you'll see those texture "errors"
Do you have any trick to fix that? Beside some manual texture rework I can't come with a clever and nice way
Mickmumpits, we appreciate creative and talented citizens like you. Would you be interested in joining or simply learning about the ownerless EQORIA, United Earth, and adding your creation using AI? We like to display your ideas to other citizens so they can reward you for your contribution to Earth.
Hello there - How do you install Stable Diffusion and make it work please? If you have a tutorial on this? :)
You are so good! I’m gonna have to look at your videos. I’ve been trying to find a way to use AI to create 3D images of my drawings to create characters. Can it be done?
hello sir, how much blender knowledge do we need to be doing this? I want to make children's content using your methods and different ai tools. I want to become your patreon member. But do you have content for complete beginners? How much knowledge of blender do you need for this?
ffs, thank you. i was like 'how he's going to use a depth map if he isn't even on img2img tab?' control nets, that's it!
hey man! interested in doing blender too because of you haha would like to ask what is your specs? I'm looking to buy one
How we do get stable diffusion ? It doesn’t really explain it very well what need to do to get to that part to use software stable diffusion . Can you help me out thanks
it does not works. when i select the sky and connect a second texture in the shading section then it's changing me all surrounded area, not only sky. (9:44) what can I do wrong?
I did everything as you have instructed but my Stable diffusion screen is different so I can not enter some of the parameters. It worked and generated an image but can not control it
Just do it for each visual plane instead, then combined at the end to avoid doubling effect and have more camera freedom. Heck projecting, then masking part at another angle, port back to ai, infill the masked part, project the masked area, merge all angles using the mask of each.
By generating the whole scene, you get more stylistic consistency. But you could seperate the foreground and background elements before projecting first. Although trying projection without seperating could end up saving a bunch of time if it works for what you want to do (i.e. very small camera movement)
It's awesome, but don't you stuck with limited camera moves?
@Mickmumpitz Where to download the final file?
add some video projectors to this pipeline and you will get a mind blowing project
Do you also make walking animations in blender and use controlnet to make an ai character walk in the scene?
Hey bro I'd really appreciate it if you make a video on Text to speech Ai voice generators that are good quality like Eleven labs.
I'll look into it!
You genius ! I wish I could make my next music video that way.
Love it - had my head spinning when this was first announced a few months ago but damn dude your video really shows the insane potential of Video > Video AI workflows 👀 Keep it up man, just shared this with my private community 💪
Please ❤ reply sir could i do in my laptop HP PRO-BOOK 450 G9
16 GB RAM WITH ITEL IRES GRAPHICS CARD WITH CORE I 5
PLEASE 🥺 COULD I RENDER AND USED DEPT MAP IN THAT SETUP❤ 7:35
no
WoooooooooooooooooooooooooooooooooooooooooooooooooooooW! So usefull!
Rad! Makes me want to learn blender. Ive just been buying or paying other to make the 3d…
I need to learn how to do this in Maya or maybe the clever thing will be learn Blender
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES? PLS ANSOWER ME
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES? PLS ANSOWER ME
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES? PLS ANSOWER ME
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES? PLS ANSOWER ME
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES? PLS ANSOWER ME
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES? PLS ANSOWER ME
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES? PLS ANSOWER ME
thanks bro. waiting for more detailed tutorial
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES?
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES?
superthanks for sharing your knowledge! looking forward to see this method as a Blender-Addon ...
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES?
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES?
CAN U USE THE REFERENCE IMAGE TO MAKE THE SAME ENVIRONMENT IN DIFFERENT SCENES?
awesome video Mick, i loved watching it 🙂
its a shame stable diffusion generates very shitty images
So clever! awesome video thanks!
Thanks man, that's awesome! Always interesting and informative video! The best!
Have you tried ai generated fractal animations?
Mate this is litteraly mind blowing! Thank you so much for such detailed tutorial!!!
Brilliant Mick! Presented with great positive vibes!💯
Really really cool. I've been playing around with controlnets for characters and ComfyUI. Loving this approach for environments. 👏👏👏
Cool!
Anyone has a Comfyui flow?
Really nice and insperational video, thanks for sharing all this! :)
Is there a way to achieve this with Dall-e ?
Amazing work dude!
Just camera work? No motion?
its really Amazing and helpful
This is exactly how games are going to be down the road. Blocked in proxy models driving AI filters. Realtime will be a bit longer but way sooner than we think and VFX stuff...like shown here...is already a gamechanger.
Thanks for sharing! Been thinking about similar ideas... generative AI & Blender, specially after TripoSR was published just recently. Now there start to be so much tools with AI image making that it is more question of discovering the workflows. I'm myself visual artist working with gen AI.
Hello Mickmumpitz, 1st thank you for this tutorial. I went to Automatic 1111 but there were a bunch of names with folders. I don't want to download a virus. What should I do and how will I do it?
Just awesome
Awesome tutorial ! Thanks
hi mick just follow your tutorial and my results are not really in position or image generation it is not following the depth image accordly... (looks like a little more aleatory) even adjusting CFG scale doesn't help so much. any hints or things to check? let me know cheers and thanks
Man,this is the coolest tutorial I've seen.thanks and blessings.
I feel like we’re about a year away from someone putting this entire workflow into one plugin, complete with random primitive placement, camera placement w animations, scene changes, and character generation.
Then you just use your phone camera to film yourself acting and watch the entire movie come to life! With random prompt presets to help try new layouts and styles.
PEREFCT!! Great tutorial and have filled in so many blanks for me....Thank you
- Great job! Well presented. Very clever, too. And, I love the results
What's your pc specs?
You are insane, more one sub
this is awesome.... but can i use midjourneyAi for generating image? becuase i have some issues with stable diffusion image genertating.
An example of "blending" and "diffusing" the 3D and the AI Worlds together!
how to install depth map
what animations?
Fantastic workflow, I have to try that, time to brush my Blender skills yet again (haven't touched it in years) 😅
how would you start out learning blender? I am pretty good with fusion and Davinci resolve
This is THE tutorial I needed
How to add ai . Tutorial?
Thanks a lot Sir😍
interesting workflow.
Nice Perfect Broh youre Helping so much this community , gracias 🙏🖤💯
Would love to see that done in ComfyUI (sure it's possible but not sure how)
I will cover this in part in my next video (+ lots more amazing techniques for Blender + AI)!
awesome!@@mickmumpitz
you make it look easy
Amazing concept, I'm a layman, I wouldn't have come up with this and I can definitely say that it will come in handy
can you do a character tutorial, like a 3d model character and redesign it with A1111
Amazing! Good job 🇧🇷👍
Remember to pirate anything with AI
😂 or anything with CGI. You techno Amish annoy me.😅 job well done I guess.