Shader Fundamentals - Normal Mapping
HTML-код
- Опубликовано: 21 июл 2024
- Support me on Patreon ➜ / danmoran
Follow me on the Twittersphere ➜ / danieljmoran
Get the Assets for this Video here ➜ github.com/Broxxar/NormalMapping
Music:
Donkey Kong Country: Tropical Freeze - Stickerbrush Symphony, 2014
David Wise & Kenji Yamamoto 
Игры
you're making a great difference for beginner shader programmers community... keep up
So not only do your videos show off making stuff look good in video games, but it also shows off making the illustrations in the videos themselves look good. The animations illustrating the concepts you're describing starting at around the 1:18 mark are particularly exquisite.
I'm here to tell you that the time, polish, and effort you put into these videos have not gone unnoticed! Well done.
Aaron Misner
Well said
Totally agreed. In fact im curious how you produced these. Are these Unity scenes as well?
Thank you for starting this series, I have been looking into shader writing for a while now, but it's so hard to find a collection of useful info anywhere, so thanks a ton!
Love to see new videos! Glad you still have a little free time with your new job!
awesome video dude!
the way you make your videos is perfect, don't change anything!
funny and highly educational.
Your videos are a treat to be honest, and your case study videos are eye opening to all the possibilities that can be done through shaders. How does one acquire a deep knowledge and understanding of shaders as yourself? How did you learn this stuff? There's no other channel or resource that is half as good.. and the blogs tend to be introductory, and no one tackles 2D. I hope you could shed some light.
These are high quality teaching videos.
I'm not going to complain about this video because I didn't understand it. The lack of knowledge is mine to own. I felt if I watched it with the pause button looking up what I didn't get and replaying the bits I'd almost got then I'd really understand it. I've watched some terrible tutorials that really are just someone showing off. This is not one of them. Thanks. By the way, I do understand way more than I did before watching it. Big thanks.
I've just recently discovered your channel. I've put shaders off till the end. But I think every math professor would be so jealous of your ability to explain these abstract concepts. Thank you
Also, if you ever do one on linear algebra/matrix multiplication, etc, I'll be one of your biggest fans.
Maaaan, thank you for *finally* describing this in a way I can understand. I could never understand why a "flat" normal map was 0,0,1, but makes total sense now when you say we're multiplying the normal map values with the tangent/bitangent/normal.
As it happens, normal maps are on my to do list for my dissertation! good timing as they're going in in a few weeks :)
the best part of this is . . . most users of 3D creation software don't have to understand one bit of what you said . . . but we are eternally grateful that people like you do.
thank you.
Thanks for the video man, i was always to scared to dive into shaders since i'm clueless about the fundamentals but this video helps out a great deal!
Thank you for that. I've been 3D modeling for years and never really got it till now. Keep it up!
Just watched your entire Shaders videos, thanks! I'm still super lost, but at least you encourage me to learn more about the subject :)
Cool, dense material but cool. I'll need to watch more of your videos.
Great video! Thank you. Adding the github resources is such a nice touch!
please do more! amazing work!
what a brilliant explanation....well done
Thank You, this was very informative to me as 3d artist. Now I see what I have to look for preparing normal maps to be used in Unity.
Amazing video, best tutorial I could find on here that explains normal maps
Great stuff. Thanks for making these.
This was extremely informative, and i'm not even using Unity, so though I filtered and saved for later, a lot of what you said, this helps me finally GET wtf normals are, why they're the colors they are (I was like, is there some standardized gamut everyone is using?) and HOW they work. even though directionality can change by app e.g. in Keyshot vs Blendr, there's plenty of transforms and toggles to fix em. my main confusion was why they were even necessary when you have a bump map, geometry, and in some cases a displacement map. FINALLY i feel a little less dumb today. :) thank you!
Name of the channel absolutely delivers.
Awsome. This is a fantastic video, thanks a lot! Subscribed
Didn't understand 70% of what you just said... feels bad man.
feels bad too
thank god I'm not the only one
they say, "I can explain it to you but I can't understand it for you". The video content is perfectly explained
@@stevejones9044 for some one that alrady knows some data about it, there are many words that people would not know. Still is a good video.
For me the most important take-away from this is the basic explanation of why normal maps are so important and what they do. The light bulb just clicked on, "that explains a lot of things".
I feel like such a nerd understanding and feeling gratitude for this help
finally somebody talks about how to orient the normals relative to texture coordinate
Awesome video! Would you be able to do one that shows off how Heroes of the Storm does their death & waiting-to-respawn screen effects?
I am doing research for my PhD and this is 10 times better than any scientific paper i have read about Mikktspace normals. Thanks a lot
You are an awesome human being. Thanks for sharing knowledge! Respect.
This was excellent.
I'm doing a adv dip including OpenGl, and this is something we've recently covered. Except yours was a much better resource than theirs. ^.^
You should do a shader case study of Super Mario 3D World. This game is FULL of little details that make the game beautiful and some are... Amazing
Omg, this video helped so much. The tutorial wasn't 90% "do this because MAATHHHHH". Thanks! :D
great video !! Please keep uploading new videos
Thank you, this was very helpful.
Very educational! 👏
This shit literally blew my mind... this legit made me realise that the games I play use flattish surfaces and they just have fucking wild normal maps so it lights differently... BLEW MY MIND
such a good explanation!!
love some more GLSL scripting tutes
Awesome video. learned a lot about normal mapping because you just showed it how it is. Best way I learn things :D What is that thing with the top hat? Looks like a state of the US?
Speaking of normals and lighting. I think you should enlighten developers about usage of MatCap shaders and their advantage in mobile development. I've found them extremely useful.
Great stuff. New subscriber!!
Excellent yes I understand everything now thank you
LOL HE IS ACTUALLY ALIVE
waiting more awesome videos for shaders and effects....It is really cool...thanks a lot (Y)
Am I just crazy or are you using Donkey Kong Country Soundtrack as background music (5:41 sounds like stickerbrush symphony)?
Edit: Lol just saw the Video notes and I'm right :-)
Can you Please Make tutorials on "Water Effects like in ori and the blind forest , RayMan" it will be very helpful :)
Really Great!!
Hey! I know this is a bit off topic to your current video, but do you know of any smart way of masking off the world to only render objects that are inside a sphere? I've tried using the stencil buffer but the problem is that if you angle the camera you will continue to see the object despite of it not being physically inside the sphere... I need to achieve a type of snow globe effect, like a little world inside a sphere☺️ Thanks for the awesome videos! Keep them coming👌🏼
Not entirely sure what you're trying to achieve, but a sphere can be defined by just a point and a radius. So if you're writing/editing the shader of the objects that are within the globe, you could pass through world space positions from vertex shader and use clip/discard with the globe's point and radius.
Wonderfully explained them on math. Thank you for this usefull clip.
I Have an Idea what you could analyse next. Prey's Looking Glass technology... it's basically the same as Portals in Portal but still very interesting and a shader break down would be great
I know these might be really easy but maybe could be a quick video that gets good traffic (because of the game). Maybe you could do a quick case study on the enchanted items icons in and the end portal in Minecraft. And whatever other cool shader stuff is in that game...Can't think of any off the top of my head. Love the depth of knowledge you show on your videos ...i only understand some of it but it reveals there is a lot I didn't know i didn't know. Maybe these (what i presume to be) simple shaders or tricks would be something a broad lower level (relatively speaking to yourself) audience might want to implement and can be knocked out relatively quickly. Also maybe you could consider doing a video showing us the best way to interact with shaders via script such as turn them on/off like in the end of the pokemon dive or modify them with gui controls or through user selection, like you did in your web demo of the Spelunky shader..A unity talk on mobile optimization has me paranoid about mobile optimization..if you watch it you will understand why ahah but he talks specifically about shaders at 34:35. ruclips.net/video/j4YAY36xjwE/видео.html. Maybe you could talk some about shaders and running them on mobile. Just some thoughts. Probably the most technical in depth unity information with professional content on youtube I've found . Great work hope to see more soon.
Hey man, any idea on how Hearthstone make those green energy auras around selected cards? Im not sure if it isnt just animated texture/sprites or if theres an actual fancy effect, or maybe a combination of animation + some gloom.
Amazing video! Do you plan on talking about parallax shaders in the future?
EDIT: Also, how about stencil buffer?
Both of these shaders interest me :)
No plans for parallax mapping in the future, but if you have GDC vault access (or you can get access through a friend/work/whatever), part of the talk "Shaders 102" covered a similar technique in Unreal. The talk as a whole is worth checking out.
And stencil buffer ahhh.... I used it in my See through effects video but it's not the best use case for stencil stuff. Compelling reasons to use stencil buffer are pretty few and far between as most ways to use it can be achieved with the depth buffer already. I'll try and think of a cool way to use it for a future video hopefully!
I appreciate the reply :)
Could you make a video on Terrain shaders? One with triplanar for dealing with texture stretching and UV resizing by distance to reduce patterns?( that would be amazing, lol). Anyway, there's hardly any info on terrain shaders for unity in the internet. Most free terrain shaders out there are 4 to 5 years old and don't work anymore. So it doesn't matter if you just want to use them or learn from them, because they just don't work anymore. So I was thinking it would be of great use for many people.
love these
@5:09 could you explain this bit more? How did you get that texture? I’d really like to be find a good way to take 3D animations and bake the, in 2d with normal maps for games.
What about a tutorial about making shaders for vfx, like the Diablo Way with multiple multiplied scrolling textures.
Finally, feeling good about my year of Linear algebra
Just realised that bramble blast from donkey Kong country 2 is playing in the background
Would you consider making a video about writing shaders for text or text mesh in Unity? I've been looking for tutorials and they are non-existent.
I like the intro
Thank you.
How would one create normal data if they don't have the original objects but they do have a texture? Note: This is a technical question, not a "use application " question.
"Tangential explanations" - I see what you did there
Finally understand the dot product.
Which software are you using for those animations? Your Videos always look so polished
Flash for some 2D, and OBS captures from Unity for 3D.
while i also use unity, it would probably be helpful to also highlight where all these precalculated values like the matrices come from
bitmap texture = matrix
hey nice video but is it possible to explain why more about the blueish purple color being that color? eg. when we divide 255/2 = 127.5 = results in 128 for Red and the Green Channel in the mid value but for the blue when we divide 255/1 = 255 we get a (128,128,255) value. SO my question is is 127.5 = 128 or does the dividing the R and G channels should be 256/2 = 128?
thanks
that's so much helpful
Amazing vídeo!
How is the code of the shader that shows the normals of the triangles (at 3:05)?
I have watched all of ur videos but i still dont quite get the distortion uv maps, you some times use the UV color maps, other examples have the normal color map... and finally som e people distorce the uv using a black and white on channel texture.. what is the diference?
I love your work dude. I'm putting a bug in .. for fur/hair shader!
Normal map
This is your daily dose of Recommendation
Makin' Stuff Look Good. I have a "ray" object with a vertex origin and a direction vertex that points off to "infinity". I know how to render this by hand by calculating a point on the "horizon", but have no idea how to model this in the form of shaders. Can you point me in any helpful direction? Thanks, I appreciate any help.
you are a GOD!!!!!!!!!!!!!!!!!!!!! THANK YOU!!!!!!!!!!!!!!!!!!
at 4:50 you show the matrix multiplication. shouldn't you do mul((float3x3)unity_ObjectToWorld, v.normal) instead? You use the inverse matrix which also happens to be the transpose on the right side, matrix multiplications are not commutative so while in this particular case it works and it does transforms from object to world space it might not always be the case. If I'm not mistaken unity objects scale does some weird stuff if you get it wrong, besides, its the correct way to read it.
Yeah I probably shouldn't have moved past that so fast. What you've written here will work but only for uniform scaled transforms. Right side by the inverse will work properly with scaling. It's been a while since I've looked at the proof for that, I'll try and find a good source and make an annotation. Thanks!
really? i thought i was the way around, please do share that information when you find it, I might be doing the wrong way all along without realizing
Can you make realistic rain drops on car windshield?
you explained dot product and I was like "cool I wondered what exaclty dot product was doing" then you said vector to a lightsource from a vertex and it was like the techno wizzardry that is how 3d models are lit became clear.
1:41 i think it should be right hand rule, not left hand rule. or is this different in shaders?
I would love if you went back to the exercises you had in shaders 101, it helps reinforce what you are saying so I am not just listening along. Keep up the awesome videos though!
I'm a bit late, but your definition of the dot product is only true for unit vectors. The dot product of two like vectors is the square of their shared length. That being said, normals will of course be unit vectors, but I mention this for the sake of accuracy.
thx
How do you calculate the normal at a vertex? If a normal is usually found with a cross product, are vertex normals just averages of the normals of the faces around them?
vertex normals come from the input (from the triangle mesh)
You should do more content, i suspect you are sitting on a goldmine! Love your format btw...
Question. Question. Question. At 4:50, shouldn't it be the ObjectToWorld matrix??? And also, shouldn't the matrix be the first parameter? Is the opposite order of the parameters what causes the matrix to be the inverse?? So many questions.....
Very good questions! I don't know why I skipped over this. We are transforming a normal, which is slightly different than just transforming a direction (that's what the math you're suggesting performs). You need to multiply a normal by the Inverse-Transpose of your model matrix to properly account for non-uniform scaling. If you look up why you have to do that you'll come across a stack overflow page with several proofs and different explanations, but the goal is to not squash/stretch your normals if you're scaling non-uniformly.
Then a little trick that Unity actually uses in their cg include files, is to perform the multiplication on the right side. This is the equivalent to multiplying by the transpose from the left, except that mathematically you'd be multiplying a 3x1 matrix instead of a 1x3. But shader compilers don't care, they let you use a float3 as a column or a row contextually.
So the inverse of ObjectToWorld is WorldToObject, and multiplying from the other side accounts for the transpose, which all in all gives us the effect of multiplying by the inverse-transpose.
If you can assume uniform scaling, you can just use ObjectToWorld from the left-hand side as you have suggested and your normals will look just fine :)
Thanks for your response. This actually motivated me to spend 3 hours reading up about the whole matrices things. Thanks for being informative as always. Also I just made a video showing off some of the shaders I wrote. You can check it out on my channel if you want. No pressure tho.
Wow there's some really cool stuff in there! The mystique transition is awesome. How does that look on a more complex model?
Makin' Stuff Look Good I'm glad you like it. It looks pretty cool. It supports tessellation so you can effectively swap out the model by baking 2 different models on the same base mesh. I'll probably make a video highlighting each of them. Again thank you for your feedback :)
is that DK country 2 music playing??
If using forward rendering, why would you want to transform per fragment normals from tangent space into world space?Isn't it better to transform light direction/position from world space to tangent space instead? It would save operations in the fragment shader.
9:06 - yup I mentioned that. It's generally easier to think about and visualize the normals in world space so I explained it this way. As well, there are effects that require world normals anyway so it's good to understand how you would get them out of a normal map.
Sorry i missed that, yeah world space normals are useful too in some situations.
Do you have any plan to use Shader Forge for this kind of stuff?
Definitely not. Shader Forge is not a plugin I would ever endorse. It's a very naive implementation and would need some serious under the hood changes to be able to make production ready shaders in.
I'll be evaluation Amplify Shader Editor soon and if it's a product I think would be valuable to people I'll plan out a pros/cons video without a quick over view on using a node based editor.
which is the difference between directX and OpenGL normal format?
You should clarify that with the dot product you're only talking about unit vectors, for example (2,2) . (2,2) = 8 not 1
[Previous knowledge of texturing terms necessary to understand anything]
hello, good videos. i want to translate this one to russian, and upload on my chanel, any suggestion?
Stickerbrush Symphony?
What a well explained video…….What ?
Just my opinion but it would have been better if you used triangle for 3 point plane, as triangle is a figure which can be drawn only two ways given 3 points (the only difference is which way normal is pointing), is why it's used everywhere instead of something like a quad or hexagon, as other figures don't have the same property.
Also it's not hard to calculate normals yourself, even though it's useless if you're using an engine, since it will always have a way because calculation is simple and works for any valid mesh.
There are only three points, but 4 are visualized. The fourth is actually point A reflected across BC, that's why there's no control handle for it and it moves on it's own.
To visualize a plane, what I really wanted was one that stretched out to infinity like a plane actually should. But that visualization didn't read well so I changed it to a quad.
So, to be clear... the normal map doesn't contain raw normal vectors. It contains what percentage of the normal, tangent, and bitangent go into the final normal, and the normal and tangent will be provided in the geometry data. Is this correct?
Yes, that's a very good way of explaining tangent space normals! Thanks for the comment ^-^
Then I'm confused as to how moving the light to tangent space works. There, it appears the normal in the texture is the real normal. I understand that the full math behind tangent space is beyond the scope of this video, but it would have been helpful to see some sample values in the normal map, and show what the values are for the normals in world for tangent space.
how to make them?
Great video but, wouldn't it be faster and more efficient to use screen space normals instead of world space?
I mention that around 9:00 that you can instead transform the lighting direction into tangent space and then you do a few less ALU's in your fragment code. There's an example of that in the github project.
As for screen space normals, that would be the approach if you we're writing a deferred shader. If you dig into the Unity cg cinclude files they have some good examples of that!
Ah. So your working with a forward render I assume?
Yeah, Unity has some support for Forward and Deferred out-of-box. In this video, we're writing a forward base pass with just one directional light. Things can of course start to get much more complicated as we support more lights/lighting features. But to keep the video from being an hour long, I tried to keep it simple :D
Ah. Are vertex shaders affected by whether or not you use a deferred or forward renderer?
Yes you'd typically write separate vert shaders for forward and deferred because they might need to pass through different data.
The normal vectors at 1:50 are pointing in the wrong direction. ab x ac should be pointing downwards.
To be consistent with the rest of the video, that diagram is of a left handed coordinate, with Z point towards us and Y point up. B and C's x values are actually lower than A's.
Check this: imgur.com/J73qvjn
ab x ac is blue, and ac x ab is red.
Sorry for the confusion!
I see, sorry for the mistake.