Using A.I. for 3D modeling in Blender
HTML-код
- Опубликовано: 14 окт 2024
- How to create 3D environments from AI-generated 2D images.
Links:
Image reference resources: • 5 Reference resources ...
Image generation: chatgpt.com/
Depth map: huggingface.co...
Blender: www.blender.or...
Steps:
1. Search for reference images .
2. Use an AI image generator (e.g., ChatGPT, Gemini, Microsoft designer ) and input a prompt and upload reference images.
3. Select and refine generated images.
4. Create an Ai Depth Map here huggingface.co...
5.Open Blender and add a plane and create a new material.
6. Input the generated image as the base color.
7. Subdivide the plane and add a displacement modifier.
8. Load the depth map as a displacement texture and adjust settings.
9. Shade the object smooth.
10. Repeat the process for additional images.
11. Assemble elements into a 3D environment and render.
![ChatGPT can model FULL 3D SCENES now!? [Free Blender + ChatGPT Workflow]](http://i.ytimg.com/vi/esxvmwHU_ak/mqdefault.jpg)
I was about to build this whole vr blender renderer, to comfy, back to blender, use camera projection.... then I found this video. Thank you, just saved me days of noodling
You deserve an award just for how quick it is.
No give the ai the reward
I came for the Blender part, which was helpful, But just a note about GPT: there's no need to click 'like' or 'dislike' if you don't want to-it won't affect your session personally. Clicking 'simply provides feedback to OpenAI for future training and doesn't influence the outcome of the next response. (A lot of people have assumed/placeboed themselves into thinking otherwise.)
Very good to know!
@@Scarlett_vfx I actually think it effect your personal session Bailey, you can observe it when generating images
Fast explanation and to the point. Great job!! 😊
thanks so much!
this is extremly good technique. As an artist you need to adapt to new tools to survive., that is art too
Your channel is a gem! really great tutorial also you have a nice voice to listen to.
haha thank you friend!
I've never seen Marigold before - absolutely incredible, that by itself is a game changer
I've been experimenting on something similar, but from non-frontal images. Basically turning any generated image or photograph into a bas relief with a decent parallax effect. Didn't think about generating front facing modular buildings for kit bashing. Thanks for sharing this!
i was doing the same thing - just searching google for images - if you want to a better way to search of front facing images check out my other video: ruclips.net/video/q9LbLCUAwCQ/видео.htmlsi=i-IKvp6SRmNMYINU - you can level up your search game with AI too!
Thats crazy. Love seeing these practical workflows start to manifest
🥰🥰thank you!
Impressive! Quick concise explanation . Looking forward to additional videos.
Wow. powerful workflow, explained quickly and clearly 👍
glad you like it! 🥰
Fantastic, thank you so much!
EXCELLENT WORKFLOW. subscribed.
Wow! Super efficient and well explained. Thank you!
Thank you!
😮 I am speechless. Great tutorial thanks.
🥰🥰🥰
Wooow Amazing tut changed my entire modeling process
Love your work❤ this is so helpful and I have learned soo much. Thankyou soo much. Keep it coming!
thank you!
Hi Scarlet, nive video. What about texturing them?
Also I want you to realize that some people who come here, know nothing about Blender (or are just learning), I learned earlier about displacment and subdivision so I was able to catch up on those, but the other things such as "array modifier"' well they are just new to me and I am learning them.
All of this to say, that any other tutorial that starts just AFTER the AI part is done, and explain to newcomers to blender how to create the 3D asset is very welcome.
You are amazing! Thanks for this simple to the point tutorial
Thank you!🤘🙌
Work smart not hard! Awesome tut!
Wow! Thank you so much for this tutorial 😊 Great job!!!!!! 👍👍👍👍
🥰thank you!
Thank nice workflow, this works in Unity too with detphmap shader.
Wo....howd you do the kit bashing? Id love to see a tutorial on that. Looked like you had to cut the figures out
Thank you for sharing! Very smart approach and potentially very helpful
Can't test this out yet, I'm trying to make clothing, but it looks great. Tell me;
Does this work with game engines? Specifically Unreal? This would be great for making specific landscapes and areas in case I don't really feel like going the route of manually creating it in Unreal.
If so, would it just be better to do it in Unreal 5?
Can I make clothing with this?
What about other accessories, even weapons?
Now thats a tutorial. I used AI for my background model. The different is, you made it better😂new subscriber here
One simple word: Brutal. 😁
holy shit, this looks great! At first I thought you were gonna cut out everything (like I currently do)
awesome tutorial. thanks Amelia.
🥰🙌
nice, very interesting. Make more tutorials like this one!
Looks intressting i would assume it would save alot of memory too for lower end builds.
Nice video!!! What shortcut did you use to create the node timeline with Texture coordinate and mapping in combination with the image input?
It’s the node wrangler add-on included with blender! turn it on and then you can just press shift T and it will create a texture node with uv coordinates
does this work with faces and complex sculptures, too?
would be interesting to try this out
Amazing
Is perfect to make trim sheets or to use for a basemesh to model with retopology tools and make your own changes.
this is freakin awesome. Can you use these methods for characters as well?
i tried with a couple characters and the sides still give me trouble - best free ai tool I've found is this demo: huggingface.co/spaces/Wuvin/Unique3D but you'd have to remap the textures manually if you want more detail/roughness
great quick and easy! Thanks you
thats what i like to hear! :)
well that's great but one small issue that to subdivide it soo many times that make it unoptimized
Nah
for sure - you can try adaptive subdivide for larger scenes
@@Scarlett_vfxok thnx
Is there a local install for AI that will create the depth map? Similar to how i can install Stable Diffusion on my PC and avoid uploading to a website.
Also wondering if the multires modifier would be less taxing on a large scene vs the regular subdivisions.
Great video! I subscribed. Luma AI is also cool.
Yes Marigold Depth Estimation can be used locally in ComfyUI. Another benefit of that workflow is that it can output a 32 bit .exr file for the depth map which produces a lot higher quality displacement in the 3d program. A regular image only has 256 shades of grey but a 32 bit image has a huge range of values.
Nice sharing
🙌🙌🙌
This is cool, i definitely wanna try some type of simulation
Could you do a more longer and in depth for beginners? Or send me a link to one please
Nice one. Are there any tools (like that depth-map tool) to remove shadows from the original AI image so the lighting is no baked into the image?
this is amazing!
WOW This is amazing! I cant belive how good you make it look! You are so talented I cant wait to watch more of your channel!! how did you learn this way of working by the way are you self-taught?
Just a graduate of RUclips university 😜
This might be a quicker way of doing things but the amount of geometry needed for displacing the plane is wayy too much compared to modelling the actual geometry
true! i have another video on how to build low poly models from ai images here ruclips.net/video/9nEuOhluxZU/видео.htmlsi=Pbfd20jpDdoQWob8
wow this is brilliant thanks!
awesome stuff!
Thanks for sharing this.
this is insane
Could be good for quick visualization!!
woah that's crazyyy
smart...
What about poly counts values? Retopology?
This is great.
Very nice!! Thank you!
What site are you using for your reference images?
Ignore me - i rewatched and you mentioned another video where you cover that :)
Awesome indeed
Do you have to pay for that version of ChatGPT?
I am using the paid version here but you can now get very good results online here: huggingface.co/spaces/black-forest-labs/FLUX.1-dev or huggingface.co/spaces/black-forest-labs/FLUX.1-schnell you can also search or other free image generators like bing image creator!
Genius thx!
subdividing it makes insanely high poly counts which my laptop cant handle. Is there a way to reduce it like remesh or something to clean extra unnecessary geometry?
Retopologize or model it, you can't run away from modeling.
you can only unsubdivide later or decimate by planar, if you dont want to model by yourself
@@pansitostyle Agree
Model it yourself, very hard but it is what you need to do if you want a real good quality model. Dont expect AI to do those parts of the work. It cuts corners like the people who use it.
you can try an adaptive subdivide or apply the modifiers and decimate the object. if you are looking for a way to make a low ploy model using a A.I. image you can also check out my other tutorial here: ruclips.net/video/9nEuOhluxZU/видео.htmlsi=Pbfd20jpDdoQWob8
how to make that 1:31 base color other banner??
Make sure you have “node wrangler” on in preferences and then press control+t and it will auto populate the texture coordinate
#MadeByHuman and #NotCreatedWithAi will be important # soon. I'm not ready for this. Ai should do the boring stuff.
I was an animation student. Because of all these AI developments, I hated this industry and dropped out of school. I decided to study psychology. Because art is about to die. Everything has turned into a few written words, and after a certain period of time, stupid humanity will not have the ability to even write that and will have it written by artificial intelligence. I wish I were born in 16th century Italy. Not in this freak system where everything turns into profit
I love how it is now, finally I can create entire games myself
I agree with you, everything I see is AI, and people are exploiting AI to make a profit.
And you think that psychologists are safe? Wait more few years...
@@roniricardosystem people need people. The most important service offered by psychologists is not treatment, but reminding or making the other person feel that they are human and valuable. So I'm sure psychologists and prostitutes will be safe (:
@@dilayyilmaz4254 nope. It can be emulated by advanced IA that eliminates the uncanny valley of voice, facial texture, muscular facial expressions etc. Some people are already using it.
"People need people"
This literally happens with art too. Art made by humans for humans. And the same with psychologists.
Does this method also work for Unreal Engine as well???
if it has a displacement node, yes
yes ive been able to pull these into unreal and kitbash with them there!
@@Scarlett_vfx wow maybe there could be a tutorial on that next
@@MythicMasters-m5v great suggestion!
For better results use geometry nodes. :D
❤
When Ai explains how to use Ai
You can do this with any picture, no need for AI
Holy shiet
i just wanted to learn 3d modeling but now😅😅😅😅😅😅 i have changed my mind
Next step, shadow removal
sometimes i add "even lighting" to the prompt to reduce shadows
And now make the 3d character model :> .
if it gets two job done , and efficient,why not
Holy fucking shit I am shocked….
it doesnt work
it does?
This is just image projection modeling. Been around for 25+ years
great, more lifeless slop
Nice but unusable-millions of polygons for a simple scene, not suitable for gaming and interactive use
true i mostly do short animations so it works for me - you can always use an adaptive subdivide for larger scenes. Ive also got another tutorial on how to build out a low poly model from an ai image: ruclips.net/video/9nEuOhluxZU/видео.htmlsi=Pbfd20jpDdoQWob8
It is usable, especially for concept art, this is amazing for that
wwww
Please stop grating your voice at the end of your sentences.
Please just stop using ai it would build your skills actually modelling and sooner or later you will yeild well better results than the mess AI makes. By yourself you can make neat optimised models that you dont have to subdivide an insane ampount of times to look better and that can be game ready, learn how to do things instead of relying on AI. I think the most anyone shoukd use ai for is idea generation but even then that is still not true creativty and doesnt build your skill of being able to come up with ideas on your own.
Ive been building my own models for years and I agree its important to learn the fundamentals first - this was just an interesting workflow I came up with for a project I'm working on for fun :)
Ai is great to use for textures, it would be better to just model it from the photo without all the subd of course but still a great walk through.
@@Chodree check out my video where I do just that! ruclips.net/video/9nEuOhluxZU/видео.htmlsi=0W_5rsJr9WVUM-5c
The video lasting 3 minutes didn't seemingly skip any steps, so in like 10 minutes, it is possible to build a neat-looking diorama with the help of gen-AI. Those who would try to use for more complex applications would run into limitations of this approach, and would see the neccessity of learning Blender properly, but for newcomers, it is a tool which gets their foot into the door of 3D-modeling, and for experienced 3D-artists, it is another tool they can make use of to optimize their workflow.
And yes, this approach doesn't seem to be any good for building game-ready assets, but it can still be used in static renders and videos
I'm sure you would be using stone tools still if you began with them. 😂 Advanced intelligence is here and you throw stones at it smh
Great😡! This kind of insults the people who spend years refining their skills. What's separates the professionals from from the noobs?
I know this is unrelated but give the Quran a read
Could you do a more longer and in depth for beginners? Or send me a link to one please
amazing
Amazing