Maybe not as visually focused as other topics on the channel, but this came up while I was doing the next installment for differential equations, so I thought it'd be nice to add a quick new chapter to the linear algebra series. I hope a few students out there find this helpful!
Totally agree, this is such a nice way to compute eigenvalues. I hadn't explicitly thought about the connection to factoring quadratics before as you did at the end, very nice:)
I think there's a pretty wide ranging connection there (between matrices and polynomials), which is used all over the place in certain branches of mathematics, but rarely shown early on
Agree - I actually learned this trick through geometry and ellipses (or equivalently any conic section if you throw an i in there). The determinant term is your a^2 + b^2 terms (related to variance if you're dealing with stats) and the trace is the of sum of your major and and minor axes (I'm probably missing factors of 2 and 4 here). I believe the final formula looks directly analogous to the formulas for eccentricity and the semi-latus rectum and the only reason I know this because I was doing some work on physical mechanics and I re-remembered the connection between rotation matrices, orbital mechanics and conic sections.
Your "one sentence reminder" of what an eigenvector is was better than what I was taught at University. A student was shouted at by the professor when he asked if the prof could visualize it. The prof shouted: "We are an elite University! We don´t paint pictures, we abstract!" Yeah thank you - not MF. I´m happy there are people like you on RUclips!
@@Czeckie My dad had a quantum physics professor who thought visualizations only lead to misconceptions. I only know it because my dad says he learned nothing in his class, even though he probably made a decent grade, and always wondered what he was actually doing in that class.
I love your channel. I studied Physics/Mathematics in college before calculators (Took tests with a slide rule, which I learned in elementary school), back in the early 70's. So I learned everything by studying formulas. Watching the newer generation of mathematicians/scientists use computers to visualize math is something we older math geeks could only dream of. It has really opened up the field to people that would otherwise be afraid to tackle the subject. I don't do math much anymore having been retired for almost a decade but I love watching these (and other videos) to see what the field is doing. Thank you so much...you bring smiles to us senior citizens.
Unless the question is 'write down the eigenvalues ' . Yeah, kind of renders it useless for most of us unfortunately 😅 maybe can use it to check your answers
One thing you have to ask yourself is have you understood what eigen values are? Your teacher probably wants you to understand eigen values rather than deriving answers. The creator took 13 minutes and showed each step and work. If you only write the answer there is no way for teacher to know if you understood the fundamentals. Probably your teacher is grading your knowledge
The fact that this video came right before my finals on 17th May is just testament to the fact that this man is omnipresent and knows exactly what his viewers need The best Linear Algebra series on the internet, without a shadow of a doubt
I'll point my students to this, I've tried showing tricks like this before in tutorials, but students often need reminders before it becomes a technique they can incorporate. This, as always, will be a great resource for them! 🙌
The formulas I used are: Let 2x2 Matrix = A λ² - (Trace A)λ + det(A) = 0 Let 3x3 Matrix = B λ³ - (Trace B)λ² + (Adj Trace B)λ - det(B) = 0 Then I just used my basic scientific calculator to solve those adjoint traces and determinants as well as quadratic and cubic functions to obtain all eigenvalues (λ)
This is amazing! Too bad I'm now doing my bachelors thesis - would have helped me a hell of a lot for my first to third semester! Thank you very much for your amazing content!
yeah, also called Viette's formulas, they are taught in the 8th grade alongside the quadratic formula as a completely valid way to solve quadratic equations
Brazilian school teaches us to solve using the sum (mean times two) and product as an alternate method, but the teachers don't actually give us the "p-q-formula"! They tell us that once we get the sum and product, we should just guess until we get the result. Thankfully, they also teach us the normal (Bhaskara) quadratic formula.
As an engineer who had multiple classes that dealt with eigenvalues and eigenvectors, I was always delighted to discover more ingenious ways of calculating them. Mohr's circle has got to be one of my favorite methods.
There is also a variant for Mohr's circle that applies to 3x3 matrices, and using another geometric trick for solving cubic polynomials, I've found it fairly easy to calculate things quickly and efficiently.
I just wanted to say I saw a dog one day and she had blue eyes but one of them had a brown section (¼ of the eye), so I mentioned your youtube channel to the owner and how the dog has a 3blue1brown eye, and the person actually knew about your channel already. It was a great moment :)
I absolutely hate these kinds of math, but since my studies recquire them, all these videos are a godsend. Thanks a lot, and please keep on making more so students like me can bear all these abstract concepts !
I've been following this channel since the Euler's characteristic formula video. I remember when I saw a couple of years ago the first linear algebra series videos when they were being released. I was in high school still. And this channel showed me a first glimpse of what real mathematics is like. It seemed so advanced to me. I had never seen a matrix nor linear transformations, so it was surreal to me. With those videos I for the first time felt I deeply understood something in math. Before that, it was a lot of memorization. And it really changed my perspective and my way of doing things. (Maybe I got a bit too fanatic at that point of trying to understand deeply absolutely everything, and I was a very slow student because of that.) Now, I see these videos and they seem so basic to me. I knew what was gonna happen at pretty much every point in the video, so it was kinda boring. I feel so sad that it is this way. It's also great because it means I learnt a lot. I do feel very nostalgic at hearing this music too though. God, I feel like an old man saying all of this.... Cheers everybody! Math is beautiful and this channel too!
One of the best mathematics related videos I've ever seen. They way you explore the intricacies of the calculations and then relate them to real world problems with insightful visualizations inspires me to learn more math, computer science, and physics. Thank you so much.
I have just found this channel through The essence of calculus series and I want to congratulate you for how good you are making these videos. Thank you.
Was not expecting another entry to the linear algebra series! This series helped me gain so much more intuition and appreciation for linear algebra when I would've been clueless and spiteful towards the subject otherwise. Grant, if you're reading this, a video or even a whole series on complex analysis and complex derivatives/integrals would be awesome. I'll be taking a class like this over the summer and I feel like there is lot of visual intuition to be gained underneath all the equations (like most of math it seems)
Dear Grant Sanderson, Thank you. I am an 33 year old engineer from Brazil. Went to through a pretty good engineering school over here. Actually, no. I hated university. It was aggainst everything I though engineering would be. Good is deliberatedelly misunderstood as hard. And paradoxally, it's easier to make something hard then making it good. Slowly I lost the love for curiosity about these things that people who come here enjoy. I started to see all the problems in function of what benefit, grade, job, recognition they would bring me right away. Whereas being creative towards a better world would be much more thrilling, it never felt like a possibility in my context. This is not a complaint, I am just exposing my reallity so you understand how grateful I am for your work. Recently, while trying to tutor a friend who's learning math, I stumbled across your vídeos. OMG, You are a mastermind of making things simple and beautiful. The level of understanding one must have to explain every subject in such a way that the inferences were so obvious as you make them seem... Thank you for sparkling the love of math in me once again. Thank you for making good into the word. I hope you aways have the privilege to keep up with any project you want to invest your time in. Grant Sanderson, Thank you.
IDK how this is in US, UK and EU but in post USSR countries we learn this trick to get the roots of quadratic equations in school alongside the standard quadratic formula. At least very similar trick which I think is totally equivalent. IIRC it's called Vieta's formulas. (Sorry for bad English)
You're one of my hero's. I actually have returned to Uni for a second degree majoring in math. I am now fluent in the languages of diffusion and waves and so much more. Best decision of my life and you are a definite contributor. Thank you.
That's a great question. The short answer is that there's nothing nearly as nice, because for 3x3 matrices you have to solve a cubic equation, and while there does exist a cubic formula, it's not nearly as compact as the (simplified) quadratic formula. However, you can use this, plus an extra step, as a nice shortcut (well, short-ish) to find the characteristic polynomial. If the characteristic polynomial expands to be x^3 + Px^2 + Qx + R, then it's still the case that the sum of the eigenvalues (the trace of the matrix) is -P, and the product of the eigenvalues (the determinant of the matrix) is -R. But now, there's a new invariant of the matrix we need to account for, that linear term Q. If the eigenvalues are L1, L2, and L3, and you think about expanding (x - L1)(x - L2)(x - L3), you can see that Q = L1*L2 + L1*L3 + L2*L3. This is an invariant, just like the trace and determinant, though to my knowledge it does not have a distinct name. The question is, given a matrix, how can you figure out what this is before you know the eigenvalues? Well, if the coefficients look like this: [[a, b, c], [d, e, f], [g, h, i]] Then by taking the time to expand out the characteristic polynomial (subtract lambda off the diagonal and compute the determinant), you'll see that this new invariant is the following: Q = (ae + ai + ei) - (bd + cg + fh) It's a new computation, somewhere halfway between a trace and a determinant. It has a sort of pleasing visual symmetry to it on the grid of numbers, and if you try it for a few matrices you'll see that it's not too bad to write out, a little easier than the determinant. Combining that with the trace and determinant, you can write out the characteristic polynomial of a 3x3 matrix decently quickly. And from there, maybe you're lucky enough that the polynomial can be factored and solved quickly, but otherwise, you're doomed to use the cubic formula. Or, you know, at this scale just pop over to WolframAlpha and just ask for the eigenvalues :)
@@3blue1brown Thanks for the detailed explanation. It helps me understand more about eigenvalues and eigenvectors, which is important for my project. Thanks once again.
@@3blue1brown Thanks so much! Actually just commented the same question, before reading this. Expanding this to 4x4 etc. would probably keep producing more invariants and make stuff more and more difficult I guess.
@@3blue1brown Q is the sum of the 2x2 minors of the matrix. This generalizes to square matrices of any size. (The trace is the sum of the diagonal 1x1 minors; the determinant is the sum of the one 3x3 minor, etc.)
Dude, you are just so freaking awesome, you have done what my COLLEGE PROFESSOR couldn't do, and in less time, more efficiently, and with a nice little trick to compute something that was kinda complicated and takes too much time, with a nice jingle with it, really, keep going, you are just the best!
Came to the comments to find this! I guess I shouldn't be surprised that a "trick" for solving quadratic equations would apply to finding eigenvalues of a 2x2 matrix! (although I have to hand it to Grant - combining it with the fact about traces and determinants was a beautiful addition)
This technique was known before Po Shen Loh, in fact I learned this technique in middle school several decades ago when math was actually taught at a rigorous level.
This channel is one of the most inspiring math channels Ive found and is largely responsible for how well Ive been doing in my college math classes. Bless 3blue1brown
I love the acappellascience jingle! I honestly wouldn’t mind if you got him on board to sing equations every video, adding that extra sonic dimension would complement your amazing visuals and aid in memorization as well :)
Hey, Grant, I just want to say thank you. I used to be terrified of the idea of taking calculus; however, your essence of calculus series really gave me insight that makes at least the basics make intuitive sense. I’ve since became very interested in maths, and I wouldn’t be there without you
Back in high school I was really good at math. I remember studying my father's university math text books when I was bored, and I did competitions and all that. However, at university I weirdly chose for something that doesn't have anything to do with math. This channel keeps my interest alive, I appreciate it!
I dropped out education after my master's degree. because all that we were doing was based on memorization with out knowing what they really are. now after watching 3 blue 1 brown intuitive lectures I have taken admission for higher studies ( Ph.D in maths)
@@Caleepo From what I was told is that in the US, many people don't do a Masters and go straight into a phd after their bachelors, but the first 2 years of such a phd are like a masters where you still have to take lectures and seminars, and the phd can thus take more than 5 years to finish. Not sure if it counts as if having finished a Masters if you decide to drop out after 2 years, thus I don't really see the point of it. Perhaps it's about getting phd scholarships which pay better and you have a better chance to get than a scholarship for a masters degree and colleges in the US are super expensive.
If learning platforms were as artistic as here, learning would be actually motivating and engaging. I'm highly thankful for this godlike content, though I wish education systems were modern, convenient and not subordinate to perfection.
I'm learning data analysis and a few days ago went over the Principal Component Analysis algorithm. Your videos and also the playlist of Victor Lavrenko were super helpful. I'm glad to see that you still add videos to this playlist!
i recently came back to this channel after recommending a friend check out your "lockdown math" series for a brief but thought-provoking review of some high school math topics. i love that we have a song for the simpler quadratic formula now, especially after hearing you say it was too short for a song. this video made me smile, thanks :)
it only works to some extent. only the calculations for m and p are still correct however you can't actually use the m +- sqrt(m^2 - p) thing e.g. [4 -1 6] [2 1 6] [2 -1 8] eigenvalues = 2, 2, 9 (eigenvalue 2 has algebraic and geometric multiplicity of 2) using the formula, m = 13, p = 36, m + sqrt(m^2 - p) = 9 m - sqrt(m^2 - p) = 4 (= 2 + 2)....eh it kinda works. but in most cases it doesn't work at all e.g. [ 1 3 3] [-3 -5 -3] [ 3 3 1] eigenvalues = 1, -2, -2 (eigenvalue -2 has algebraic and geometric multiplicity of 2 as well) using the formula, m = -1.5, p = 4 but when you do the math.. sqrt(m^2 - p) = sqrt(1.5^2 - 4) = sqrt(-1.75).... whoops.
the computation for 2x2 matrices is actually just computation for roots of a quadratic equation (as seen in another of his vids, search lockdown math episode 1) , because thats the characteristic equation for a 2x2 matrix's eigenvalues. so the computation for 3x3 matrices would be the cubic formula......😪😪
Didn't you have L.A. in your first semester? It's the basics of most math that deals with data and dimensions, ortogonalithy etc. It's a 2x2 matrix o.o Do you have diff. eq before Multivariate Calculus? That looks like a weird syllabus.
@@genericnamethingy Yes, I did take it, I learned the "shortcut" that the eigenvalues of a 2x2 matrix, A, can be found from lambda^2 - tr(A)*lambda+detA=0, but this is quicker. And I took diffeq and multi at the same time
@@hudsonmcgaughey6798 You're subtracting a matrix from a value and then adding a value, are you sure about that formula? The standard one is det(A - I*lambda)=0 with I being the identity matrix, this works for n*n
In linear system theory, we often need to check whether a matrix is Hurwitz (eigenvalues have negative real parts). In this case, we don't actually care about finding the eigenvalues; we just want to know whether they are both negative. For the 2x2 matrix, for both eigenvalues to be negative we require that their sum is negative and their product is positive. Thus, m < 0 and p > 0 tells us the 2x2 matrix is Hurwitz! Very useful trick. Thanks!
That is why it is important to learn the more general technique. As I tell my students: shortcuts in math do not always work on the more complicated problems.
Our professor just mentioned this at a side note but I'm so happy to have this clear, self-evident proof and visualization. These videos are always a blast, I can't ever thank you enough for all your great work. Without your videos I maybe wouldn't study engineering science today :) Greets from Berlin, keep it up!
we actually learn in quantum mechanics to start computing eigenvalues with pauli matrices and from that moment the traditional way is forgotten. so im glad you posted it, this is very useful
It was quite surprising to stumble upon a Grant's video on eigenvalues in recommendations this morning, as only yesterday I was trying to recall the general procedure of calculating eigenvectors and eigenvalues of a matrix. Thank you very much!
Eigenvalues and Eigenvectors cenfused soooooo long time. It is the first time I feel that I finally understand them! Thank you so much for the excellent work
I want to cry a lot, this trick would have saved me hours and hours of absurd calculations of the characteristic polynomial roots, while studying quantum mechanics in college. Better late, than never! Thanks for sharing!
Maybe not as visually focused as other topics on the channel, but this came up while I was doing the next installment for differential equations, so I thought it'd be nice to add a quick new chapter to the linear algebra series. I hope a few students out there find this helpful!
Thank you for everything boss. ❤️
Great work
All the visuals probably take you awhile. I think folks are happy with the short and sweet stuff occasionally. The content is already so high quality.
Once you get the eigen value’s how you find the eigen vectors.
@@aslpuppy1026 haha on Patreon he was debating adding that. I believe it’s coming in another vid.
When the world needed him most, he returned.
He vanished
3Blue1Brown: The Last Number Bender
like in the midst of my IB exams XDXD
@@justinyang21114798 Good Luck,
You got my 666 like. So do you believe in superstitions lol 😁
Totally agree, this is such a nice way to compute eigenvalues. I hadn't explicitly thought about the connection to factoring quadratics before as you did at the end, very nice:)
Prof treffor. What a crossover here,
Both Trefor Bazett and Kyle Broder in the comments section, it must be a good video
I think there's a pretty wide ranging connection there (between matrices and polynomials), which is used all over the place in certain branches of mathematics, but rarely shown early on
Agree - I actually learned this trick through geometry and ellipses (or equivalently any conic section if you throw an i in there). The determinant term is your a^2 + b^2 terms (related to variance if you're dealing with stats) and the trace is the of sum of your major and and minor axes (I'm probably missing factors of 2 and 4 here). I believe the final formula looks directly analogous to the formulas for eccentricity and the semi-latus rectum and the only reason I know this because I was doing some work on physical mechanics and I re-remembered the connection between rotation matrices, orbital mechanics and conic sections.
My two favorite teachers!!!
Your "one sentence reminder" of what an eigenvector is was better than what I was taught at University.
A student was shouted at by the professor when he asked if the prof could visualize it. The prof shouted: "We are an elite University! We don´t paint pictures, we abstract!"
Yeah thank you - not MF. I´m happy there are people like you on RUclips!
Visualization is the art of abstraction.
weird, I've never met a mathematician who doesn't like to draw pictures
@@Czeckie Neither have I
@@Czeckie Yeah indeed.
I often find visual explanations give the best intuition while the alegrabic is best for computation
@@Czeckie My dad had a quantum physics professor who thought visualizations only lead to misconceptions. I only know it because my dad says he learned nothing in his class, even though he probably made a decent grade, and always wondered what he was actually doing in that class.
8:11 for anyone wondering, this is the Stern and Gerlach experiment and it is absolutely fascinating. Look it up
He began the suffering of every physics students
Thanks, I like learning things
The fact that he kept playing the audio really sealed the deal for me
Says a lot about the mechanics of learning!
Especially when we see it at the same time
I love your channel. I studied Physics/Mathematics in college before calculators (Took tests with a slide rule, which I learned in elementary school), back in the early 70's. So I learned everything by studying formulas. Watching the newer generation of mathematicians/scientists use computers to visualize math is something we older math geeks could only dream of. It has really opened up the field to people that would otherwise be afraid to tackle the subject. I don't do math much anymore having been retired for almost a decade but I love watching these (and other videos) to see what the field is doing. Thank you so much...you bring smiles to us senior citizens.
Irony is for most maths in university, a calculator simply doesn't help you
(especially in the super pure fields such as analysis)
One moment of silence for every student that uses this method and doesn't get full marks because the teacher wants them to "show their work".
😂😂😂
Unless the question is 'write down the eigenvalues ' . Yeah, kind of renders it useless for most of us unfortunately 😅 maybe can use it to check your answers
Happened to me 😢
One thing you have to ask yourself is have you understood what eigen values are? Your teacher probably wants you to understand eigen values rather than deriving answers. The creator took 13 minutes and showed each step and work. If you only write the answer there is no way for teacher to know if you understood the fundamentals. Probably your teacher is grading your knowledge
Showing work demonstrates mastery of the material and mathematical maturity.
The jingle is extraordinarily genius. First time I heard it, it caught me off-guard with its brilliance. Thanks to you both!
It was so good. I gave such a vague idea to Tim, and he came back with something hilariously catchy.
@@3blue1brown Props.
@@3blue1brown Do you think you can find a formula like this only for polynomials of degree 3 and 4?
@@3blue1brown the *ping* is what gets me
I'm gonna have that god damn jingle stuck in my head for days now.
11:19 if you want to hear it without moving the cursor
its my new ringtone
m ± √(m² - p)
Ping!
10 hour loop when?
@@damiandeza2761 4:47 is a better timestamp.
The fact that this video came right before my finals on 17th May is just testament to the fact that this man is omnipresent and knows exactly what his viewers need
The best Linear Algebra series on the internet, without a shadow of a doubt
I'll point my students to this, I've tried showing tricks like this before in tutorials, but students often need reminders before it becomes a technique they can incorporate. This, as always, will be a great resource for them! 🙌
Wow! Both Kyle and Trefor in the comments section
maybe capture them and force them to listen to the jingle for a day
@@theblinkingbrownie4654 Whatever it takes 😂
I kept laughing everytime I heard the jingle, and the little 'p' was so funny at 6:08. I'm never forgetting this!
*ding*
Sorry but that "song" was annoying as fk.
Overall good video though, as always.
@@TheRealFFS I highly disagree :D As a piano player, I found it superb and it entertained me a lot :D So catchy melody
Im listening to this at 1.5x which makes it more hilarious
@@TheRealFFS nah
The formulas I used are:
Let 2x2 Matrix = A
λ² - (Trace A)λ + det(A) = 0
Let 3x3 Matrix = B
λ³ - (Trace B)λ² + (Adj Trace B)λ - det(B) = 0
Then I just used my basic scientific calculator to solve those adjoint traces and determinants as well as quadratic and cubic functions to obtain all eigenvalues (λ)
Everytime I see that blue circle in the notifications I genuinely smile and I thank God I get to live in the same times as this amazing teacher
I love how he just comes out casually with a masterpiece every single time
I can’t believe that this particular video comes right along with my LinAlg Final!!
Edit: i survived!
Same. My exam is litteraly in 2 weeks
Uni?
damn this came literally hours after my lin alg exam 😭
@@joseffnic3560 same, linalg exam today xD how did it go for u?
I literally just took mine like 2 hours ago
It's amazing to see what are the different teaching methods from around the world
BitcoinandEthereum investment W=h=a=t=s=A=p=p
*+=1=4=0=4=3=4=1=0=5=5=0*
This is amazing!
Too bad I'm now doing my bachelors thesis - would have helped me a hell of a lot for my first to third semester!
Thank you very much for your amazing content!
I got so proud seeing the "p-q-formula" in the spotlight! It is the way we're taught to solve quadratic equations in Sweden.
yeah, also called Viette's formulas, they are taught in the 8th grade alongside the quadratic formula as a completely valid way to solve quadratic equations
Brazilian school teaches us to solve using the sum (mean times two) and product as an alternate method, but the teachers don't actually give us the "p-q-formula"! They tell us that once we get the sum and product, we should just guess until we get the result. Thankfully, they also teach us the normal (Bhaskara) quadratic formula.
NEW LINEAR ALGEBRA VID DROP LETS GET EM
Germans: Hey, we came up with a nice term for these mathematical objects!
English: lemme just translate the second half
What for Example?
@@spideybot5754 Eigenvalues for example.
@@w3lt3nbr4nd2 Thanks...
"Self vector" has not same feel to it...
@@tetraedri_1834 I would rather translate it as "own vector". "Self vector" sounds more like a translation of "Selbstvektor".
3b1b videos are so good, I give them a like before they even start playing.
As an engineer who had multiple classes that dealt with eigenvalues and eigenvectors, I was always delighted to discover more ingenious ways of calculating them. Mohr's circle has got to be one of my favorite methods.
There is also a variant for Mohr's circle that applies to 3x3 matrices, and using another geometric trick for solving cubic polynomials, I've found it fairly easy to calculate things quickly and efficiently.
Ah thanks, we bigfoots are always finding ourselves needing to calculate eigenvalues out here in the woods
hi
Username checks out
Does your foot get even bigger sometimes ? if yes by what eigenvalue ?
Then you should use matlab bro
I love the calm, classical music accompanying these videos.
I just wanted to say I saw a dog one day and she had blue eyes but one of them had a brown section (¼ of the eye), so I mentioned your youtube channel to the owner and how the dog has a 3blue1brown eye, and the person actually knew about your channel already. It was a great moment :)
I absolutely hate these kinds of math, but since my studies recquire them, all these videos are a godsend.
Thanks a lot, and please keep on making more so students like me can bear all these abstract concepts !
studying a machine learning master and being able to relate to this guy is the best feeling in the world. thank you 3B1B
Your YT channel is a treasure, a feast for mind. Big thank You to share this materials with us.
I've been following this channel since the Euler's characteristic formula video.
I remember when I saw a couple of years ago the first linear algebra series videos when they were being released. I was in high school still. And this channel showed me a first glimpse of what real mathematics is like. It seemed so advanced to me. I had never seen a matrix nor linear transformations, so it was surreal to me. With those videos I for the first time felt I deeply understood something in math. Before that, it was a lot of memorization. And it really changed my perspective and my way of doing things. (Maybe I got a bit too fanatic at that point of trying to understand deeply absolutely everything, and I was a very slow student because of that.)
Now, I see these videos and they seem so basic to me. I knew what was gonna happen at pretty much every point in the video, so it was kinda boring.
I feel so sad that it is this way.
It's also great because it means I learnt a lot.
I do feel very nostalgic at hearing this music too though.
God, I feel like an old man saying all of this....
Cheers everybody!
Math is beautiful and this channel too!
One of the best mathematics related videos I've ever seen. They way you explore the intricacies of the calculations and then relate them to real world problems with insightful visualizations inspires me to learn more math, computer science, and physics. Thank you so much.
MY FAVOURITE SERIES IS STILL GOING?!
I have just found this channel through The essence of calculus series and I want to congratulate you for how good you are making these videos. Thank you.
Was not expecting another entry to the linear algebra series! This series helped me gain so much more intuition and appreciation for linear algebra when I would've been clueless and spiteful towards the subject otherwise. Grant, if you're reading this, a video or even a whole series on complex analysis and complex derivatives/integrals would be awesome. I'll be taking a class like this over the summer and I feel like there is lot of visual intuition to be gained underneath all the equations (like most of math it seems)
Dear Grant Sanderson,
Thank you.
I am an 33 year old engineer from Brazil. Went to through a pretty good engineering school over here.
Actually, no. I hated university. It was aggainst everything I though engineering would be.
Good is deliberatedelly misunderstood as hard.
And paradoxally, it's easier to make something hard then making it good.
Slowly I lost the love for curiosity about these things that people who come here enjoy.
I started to see all the problems in function of what benefit, grade, job, recognition they would bring me right away.
Whereas being creative towards a better world would be much more thrilling, it never felt like a possibility in my context.
This is not a complaint, I am just exposing my reallity so you understand how grateful I am for your work.
Recently, while trying to tutor a friend who's learning math, I stumbled across your vídeos.
OMG, You are a mastermind of making things simple and beautiful.
The level of understanding one must have to explain every subject in such a way that the inferences were so obvious as you make them seem...
Thank you for sparkling the love of math in me once again. Thank you for making good into the word.
I hope you aways have the privilege to keep up with any project you want to invest your time in.
Grant Sanderson,
Thank you.
Awesome that Acapella Science is getting some of the recognition it deserves!
The jingle was absolutely necessary
IDK how this is in US, UK and EU but in post USSR countries we learn this trick to get the roots of quadratic equations in school alongside the standard quadratic formula. At least very similar trick which I think is totally equivalent. IIRC it's called Vieta's formulas. (Sorry for bad English)
Yup, in Vietnamese education system, its called "Vi-et" theorem, probably borrowed from USSR guys
This video should be included in every math class curriculum 👏👏👏
I'm not sure I'll ever have to calculate eigenvalues, but I sure as hell won't be getting that jingle out of my head now.
You're one of my hero's. I actually have returned to Uni for a second degree majoring in math. I am now fluent in the languages of diffusion and waves and so much more. Best decision of my life and you are a definite contributor. Thank you.
Thanks for the tutorial. However, I would like to know if the formula applicable to any 3 x 3 matrices?
That's a great question. The short answer is that there's nothing nearly as nice, because for 3x3 matrices you have to solve a cubic equation, and while there does exist a cubic formula, it's not nearly as compact as the (simplified) quadratic formula.
However, you can use this, plus an extra step, as a nice shortcut (well, short-ish) to find the characteristic polynomial. If the characteristic polynomial expands to be x^3 + Px^2 + Qx + R, then it's still the case that the sum of the eigenvalues (the trace of the matrix) is -P, and the product of the eigenvalues (the determinant of the matrix) is -R. But now, there's a new invariant of the matrix we need to account for, that linear term Q.
If the eigenvalues are L1, L2, and L3, and you think about expanding (x - L1)(x - L2)(x - L3), you can see that Q = L1*L2 + L1*L3 + L2*L3. This is an invariant, just like the trace and determinant, though to my knowledge it does not have a distinct name. The question is, given a matrix, how can you figure out what this is before you know the eigenvalues? Well, if the coefficients look like this:
[[a, b, c],
[d, e, f],
[g, h, i]]
Then by taking the time to expand out the characteristic polynomial (subtract lambda off the diagonal and compute the determinant), you'll see that this new invariant is the following:
Q = (ae + ai + ei) - (bd + cg + fh)
It's a new computation, somewhere halfway between a trace and a determinant. It has a sort of pleasing visual symmetry to it on the grid of numbers, and if you try it for a few matrices you'll see that it's not too bad to write out, a little easier than the determinant. Combining that with the trace and determinant, you can write out the characteristic polynomial of a 3x3 matrix decently quickly. And from there, maybe you're lucky enough that the polynomial can be factored and solved quickly, but otherwise, you're doomed to use the cubic formula.
Or, you know, at this scale just pop over to WolframAlpha and just ask for the eigenvalues :)
@@3blue1brown Thanks for the detailed explanation. It helps me understand more about eigenvalues and eigenvectors, which is important for my project. Thanks once again.
@@3blue1brown Thanks so much! Actually just commented the same question, before reading this. Expanding this to 4x4 etc. would probably keep producing more invariants and make stuff more and more difficult I guess.
@@3blue1brown Q is the sum of the 2x2 minors of the matrix. This generalizes to square matrices of any size. (The trace is the sum of the diagonal 1x1 minors; the determinant is the sum of the one 3x3 minor, etc.)
See my general comment above--it involves one more invariant, the surface area. The cubic formula is nasty, though!
Dude, you are just so freaking awesome, you have done what my COLLEGE PROFESSOR couldn't do, and in less time, more efficiently, and with a nice little trick to compute something that was kinda complicated and takes too much time, with a nice jingle with it, really, keep going, you are just the best!
Coincidentally, I have my linear algebra final tomorrow. Thanks for this, Grant!
Aside from everything explained in an insanely intuitive and reasonable way, i adore the music here :)
Nice application of the trick usually associated to Po-Shen Loh
Came to the comments to find this!
I guess I shouldn't be surprised that a "trick" for solving quadratic equations would apply to finding eigenvalues of a 2x2 matrix!
(although I have to hand it to Grant - combining it with the fact about traces and determinants was a beautiful addition)
Yes. I think Po-Shen Lo should be mentioned and credited!
This technique was known before Po Shen Loh, in fact I learned this technique in middle school several decades ago when math was actually taught at a rigorous level.
You gave me the best explanation I have ever seen in my whole life with your series. You are not good, you are THE BEST ❤.
i passed my linear final bc of u ❤️
The concept of using an eigenbasis to get da diagonalmatrix is so beautiful! For example to eliminate the mixed term xy in quadrik transformations!
I was literally just rewatching your Linear Algebra playlist
This channel is one of the most inspiring math channels Ive found and is largely responsible for how well Ive been doing in my college math classes. Bless 3blue1brown
I love the acappellascience jingle! I honestly wouldn’t mind if you got him on board to sing equations every video, adding that extra sonic dimension would complement your amazing visuals and aid in memorization as well :)
Hey, Grant, I just want to say thank you. I used to be terrified of the idea of taking calculus; however, your essence of calculus series really gave me insight that makes at least the basics make intuitive sense. I’ve since became very interested in maths, and I wouldn’t be there without you
Nooo your eigenvalue video came out the day after my linear algebra final. At least the other videos could help
Well when I studied linear algebra came up in a bunch of later courses, even eigenvalues.
Back in high school I was really good at math. I remember studying my father's university math text books when I was bored, and I did competitions and all that. However, at university I weirdly chose for something that doesn't have anything to do with math. This channel keeps my interest alive, I appreciate it!
I dropped out education after my master's degree. because all that we were doing was based on memorization with out knowing what they really are.
now after watching 3 blue 1 brown intuitive lectures I have taken admission for higher studies ( Ph.D in maths)
Don't do a PhD just because of some RUclips videos, you will burn out
Don’t you have to complete your master’s degree in order to do Ph.D ?
@@Caleepo in most countries, yes, but there are exceptions where one can do their phd with only a bachelor degree (like the UK)
@@LiloudOr oh ok, thats weird
@@Caleepo From what I was told is that in the US, many people don't do a Masters and go straight into a phd after their bachelors, but the first 2 years of such a phd are like a masters where you still have to take lectures and seminars, and the phd can thus take more than 5 years to finish. Not sure if it counts as if having finished a Masters if you decide to drop out after 2 years, thus I don't really see the point of it. Perhaps it's about getting phd scholarships which pay better and you have a better chance to get than a scholarship for a masters degree and colleges in the US are super expensive.
I love how this is the exact same as the quadratic shortcut in the lockdown math video 🧎♀️ tysm
If learning platforms were as artistic as here, learning would be actually motivating and engaging. I'm highly thankful for this godlike content, though I wish education systems were modern, convenient and not subordinate to perfection.
I'm learning data analysis and a few days ago went over the Principal Component Analysis algorithm. Your videos and also the playlist of Victor Lavrenko were super helpful. I'm glad to see that you still add videos to this playlist!
Another video finally
I watched this a week ago, and I use it almost everyday now! Your videos are amazing.
Brilliant! Nit: I think it would be easier to remember if you had used "d" for the determinant instead of "p".
D for product?? What madness is this?
now you will have to remember that p is the product of eigenvalues which is the determinant d
LOL the jingle got me, it's always interesting how you can solve things two different ways.
I find it exceptionally pleasing that the matrix made up of the first four digits of e has integer eigenvalues
.
Never expected to see a new linear algebra upload after 2016. I'm satisfied.
4:50 **aggressively dies of cringe**
It's not cringe, it's cool. And it's catchy so easy to remember
This trick is really cool and I wish or maths professor would have the same enthusiasm explaining maths as you do!
Me: *still waiting for probability 3*
i recently came back to this channel after recommending a friend check out your "lockdown math" series for a brief but thought-provoking review of some high school math topics. i love that we have a song for the simpler quadratic formula now, especially after hearing you say it was too short for a song. this video made me smile, thanks :)
what about the eigenvalue of 3x3-matrices? how to compute them?
it only works to some extent.
only the calculations for m and p are still correct
however you can't actually use the m +- sqrt(m^2 - p) thing
e.g.
[4 -1 6]
[2 1 6]
[2 -1 8]
eigenvalues = 2, 2, 9 (eigenvalue 2 has algebraic and geometric multiplicity of 2)
using the formula, m = 13, p = 36,
m + sqrt(m^2 - p) = 9
m - sqrt(m^2 - p) = 4 (= 2 + 2)....eh it kinda works.
but in most cases it doesn't work at all
e.g.
[ 1 3 3]
[-3 -5 -3]
[ 3 3 1]
eigenvalues = 1, -2, -2 (eigenvalue -2 has algebraic and geometric multiplicity of 2 as well)
using the formula, m = -1.5, p = 4
but when you do the math..
sqrt(m^2 - p) = sqrt(1.5^2 - 4) = sqrt(-1.75)....
whoops.
the computation for 2x2 matrices is actually just computation for roots of a quadratic equation (as seen in another of his vids, search lockdown math episode 1) , because thats the characteristic equation for a 2x2 matrix's eigenvalues.
so the computation for 3x3 matrices would be the cubic formula......😪😪
oh i see. would have been easier if there's a shortcut, but i guess it's fine then😄
and thank you for the help!
So glad I stumbled upon this video before my exam tomorrow! Thank you for sharing!
I feel personally attacked that you waited until the day after I finished my diff eq class to upload this
Didn't you have L.A. in your first semester? It's the basics of most math that deals with data and dimensions, ortogonalithy etc. It's a 2x2 matrix o.o
Do you have diff. eq before Multivariate Calculus? That looks like a weird syllabus.
@@genericnamethingy Yes, I did take it, I learned the "shortcut" that the eigenvalues of a 2x2 matrix, A, can be found from lambda^2 - tr(A)*lambda+detA=0, but this is quicker. And I took diffeq and multi at the same time
@@hudsonmcgaughey6798 You're subtracting a matrix from a value and then adding a value, are you sure about that formula?
The standard one is det(A - I*lambda)=0 with I being the identity matrix, this works for n*n
@@genericnamethingy tr(A) isn't a matrix.
Absolutely beautiful callback to the first live lecture last year
Literally 3 hours too late, I just had my linear algebra final
😂
In linear system theory, we often need to check whether a matrix is Hurwitz (eigenvalues have negative real parts). In this case, we don't actually care about finding the eigenvalues; we just want to know whether they are both negative.
For the 2x2 matrix, for both eigenvalues to be negative we require that their sum is negative and their product is positive. Thus, m < 0 and p > 0 tells us the 2x2 matrix is Hurwitz! Very useful trick. Thanks!
ok im gonna be that guy who always says it:
*I NEVER CLICKED SO FAST!*
I just learned about the characteristic polynomial last week, so this trick is golden! Thank you!
Nice video, but am concern on How to get paid, any help please
Through what kind of job?
Is it online Investment?
@@murraydickson6336 Yes, online investment
I get paid directly to my account
@@murraydickson6336 how please
I'm in college (aerospace engineering), I literally have a test on eigenvalues and eigenvectors TOMORROW, you've saved my life dude
The worst is when they ask you for a 3 by 3….
That is why it is important to learn the more general technique. As I tell my students: shortcuts in math do not always work on the more complicated problems.
@@DoctrinaMathVideos 🤓
Literally in the last few weeks of my intro Linear Algebra course. This could not have come at a better time!
Our professor just mentioned this at a side note but I'm so happy to have this clear, self-evident proof and visualization. These videos are always a blast, I can't ever thank you enough for all your great work. Without your videos I maybe wouldn't study engineering science today :) Greets from Berlin, keep it up!
we actually learn in quantum mechanics to start computing eigenvalues with pauli matrices and from that moment the traditional way is forgotten.
so im glad you posted it, this is very useful
I like that your videos are really expanding on color. I especially like "eigen-teal" and "variating pink"
It was quite surprising to stumble upon a Grant's video on eigenvalues in recommendations this morning, as only yesterday I was trying to recall the general procedure of calculating eigenvectors and eigenvalues of a matrix. Thank you very much!
Just one look at such an ingenious video and you'll share it to the world. Wish he were there in my student days some decades back.
Wow the formula at the end was incredible! Was so fun going through the discovery process with that.
Have a test tmr in differential equations. Thank you blue
Very glad we are learning that short catchy songs are a great way to learn and memorize. Daniel Tiger is a great example.
Nice! I got flashbacks from lockdown math, it was a memorable moment worth revising.
Thank u so much 3b1b.
This channel is really cool. I have learnt how to feel math from here.
ur a hero for this, as we’re about to dive into systems of differential equations in my ODE class
Eigenvalues and Eigenvectors cenfused soooooo long time. It is the first time I feel that I finally understand them! Thank you so much for the excellent work
Got a differential eqs and linear algebra final next week. Perfect timing, Grant!
The little tune is unforgettable and genius!
It was saved to "m" "p" 3.
Perfect timing! I begin teaching a linear algebra course next week. 😊
I want to cry a lot, this trick would have saved me hours and hours of absurd calculations of the characteristic polynomial roots, while studying quantum mechanics in college. Better late, than never! Thanks for sharing!
OMG that jingle is awesome!!!
Of course, that's a nice trick and a whole new way to calculate the eigenvalues, I really appreciated, you rock man