I don't know if anyone else has noticed this, but the gradual shift into abstract concepts is done flawlessly by Professor Strang. In the first few lectures, really up until the lectures on bases, all of the methods Professor Strang uses to teach the subjects were concrete examples; very little was done with abstract definitions and arbitrary matrices. Over the last few lectures, Prof. Strang has made a gradual shift into abstractness which let's the mode of this sort of thinking sink in. Now, in this lecture, nothing is concrete and no numbers are ever used (until the end) and it feels effortless to understand! This man is a genius when it comes to math education. Thanks so much MIT and Prof. Strang for the amazing experience!
The lectures are beyond fantastic no doubt, but I really feel he could have thrown some proofs in between, he mostly "says" things without ever proving them. Yes, we can get the proofs from anywhere else, but I want to hear what would his approach be.
@@tarunkalluri1799 That would make the lectures much longer and means little to the general audience. This is just an introductory course much like entry-level calculus - it is doubtful most students would benefit from being taught real analysis as they are grappling with the idea of derivatives for the first time.
@@ramonmassoni9657 I'm a statistician, but the explanation about why the projection matrix is equal to its square is something I had never thought about. And yes, that property of the projection matrix is absolutely key in multivariate linear regression, which is a very important method in statistics.
The thing I really like about these old timer Professors are the way they teach, he stops and ask questions as if he is also going through the problem he already knows everything but in the moment he is walking through us students and trying to look problems through our eyes, I would say this is the greatest method of teaching.
I just can't thank you enough for showing such a clear picture of these concepts. I was struggling to understand 3D Computer Vision and how the linear algebra involved in it. Your lecture series has connected all the points which I have tried very hard enough to understand but I couldn't until I followed your lecture series. You have shown the whole picture by explaining the logic behind each and everything. You are an awesome professor. Thank You so so much. The way you explain is incredible, brilliant.
I can barely hesitate to say that these lectures are incomparable to the lectures I attend for Linear Algebra at university. It's uncanny how often when watching these videos I think, "I get it now, I get it!" Cudos to you Prof. Strang!
Somethings are so beautiful when comprehended a certain way. Prof. Strang's lecture are as much about the art of transfering such beautiful comprehension one might have experienced as it is about Linear Algebra. Many in youtube have the skill of making a difficult things easy to grasp. But what you also get from Prof. Strang is that sense of euphoria that comprehension of something beautiful invokes.
This is the best explanation of the projection formula that I have ever seen. Prof. Strang not only provides a mathematical basis of the formula by deriving it, but also provides clear intuition and motivation. He also takes the time to go through the simpler case of projecting onto a line first, which allows building up the understanding of the content gradually. What a great lecture!
The great thing about these recorded lectures, is that I can pause the video each time Dr. Strang asks a question, and spend several minutes thinking about it, or working it out on paper on my own, before proceeding. It takes me three times as long to get through the lectures, but I feel like it is time well spent.
These kids rush out every time. They have no idea the blessing they were given. We never know how impressive a good instructor is until we are trying to learn these things on our own later in life. Thank you for making this available to all. (Yes, I rushed as a young college kid too, young people can be stupid.)
This video is just incredible. I've been watching the Khan Academy LA videos and have covered this over there, but seeing this gives me yet another point of view. Coming at it from a slightly different angle is so good at solidifying the concepts. In this lecture I find Professor Strang keeps things high level and really shows the power of thinking at the high "linear algebra" level. Nice to see a video on projection without a cosine in sight :)
Rushikesh Shinde No surprise there. I’ve gone through a few of them, and this one is my favorite by far. Dr. Strang’s lectures are brilliant and intuitive, and he just has such a warm and likable personality. You really feel like he’s actually your professor.
When you start asking questions yourself and find solutions of it hidden inside the teachings, you know how great the lecturer is to give you that sort of understanding. Thank You Mr. Strang for this immortal course.
I asked to my prof " why do we minimize the square of the error in the LSM?" He replied "To reduce the distance" today I understood what does he mean by that after 3 years
This is his first lecture that I watch about a topic that I didn't previously know. Now I can finally see how brilliant he is at explaining because I have never heard any of this stuff before and it still makes sense the first time I hear it. My brain almost exploded at the complex and yet simple beauty of what he's explaining. It's almost like he's doing a magic trick because we know all the laws of math and he can just take them and make something possible that I never would have thought possible.
When i connected dots in my head around 15 minutes when professor was talking about why we do this projection thing, it was one of the most mind fucking blown moments in my mind. I felt like going from top to bottom in the tiny brain - galaxy brain meme in a span of a second. Amazing course
This lecture along with the entire course and you yourself will always remain immortal Prof Strang. Thank you from almost the entire world who have benefitted from these golden amazing insightful flawless transitioned lectures. You are a mathematical genius. Hope you read this comment someday and realise you have the biggest Indian Fan.
I saw this video fours years ago when I was an undergraduate student having linear algebra class, and now I saw it again when I am a graduate student, He is just a legend!, No one teacher I have ever seen can be compared to him.
I always thought econometrics taugh with sums was confusing. I finally found an intuitive way to understand least squares. The minimization of errors proof is cool, but the simplicity of your proof combining the left nullspace,is awesome; thank you once again professor Strang.
Thank you Professor, i am a medicine doctor. I just wanted to learn linear algebra out of curiosity. Even I, who had not dealt with mathematics for a long time, was able to understand the subject. Thank you very much indeed.
I have watched lectures 14, 15, 16 over and over again, and gain new insights each time. Professors, including mine at the university, tend to drop the arrow sign above vectors while writing on the board. This causes great confusion for the uninitiated. For example, in this lecture there is an expression "p=ax" whether the writing "ax" means a (a scalar) times x (a vector) or a (a vector) times x (a scalar) is not that obvious. Admittedly, the confusion stems from my ignorance of the commutative property of scalar multiplication of vectors, which is, in fact, not mentioned explicitly in most textbooks (e.g., Lay et al, ; Larson & Hostetler). In retrospect, this "p=ax" notation is a prelude to the ingenious way of introducing projection matrix, which again, requires pre-knowledge of associative laws. Overall, these are great lectures that stimulate thinking. Thanks a lot.
My mind is about to get blown away. What appeared to be a dry, intangible, and futile branch of mathematics in the first few lectures turned out to answer one of the most gnawing questions, the answer to which was kept as a mystery for my entire life: How did people come up with the method of least squares? Why least squares? Says who? I love this guy!
Finally I understood the origin of the least squares method... (i'm in 2nd year of aeronautics and this teacher is a thousand times better than my university ones. A few could learn how to teach additionally to the algebra lesson)
I have so much difficulty coping with my Linear Models subject. Thank you prof for this! You're a blessing. Continue uploading your lectures. You are a great help to us!
I have no business bing here. Not in a math or engineering field. I never see linear algebra except at night, on long flights, or anytime I want to escape into a world of abstract spaces and subspaces with the immortal Professor Strang as my guide.
As a PhD guy, I can say if you master in this course, actually you master at LOTS of high-level subjects like econometrics, engineering, applied math, chemistry etc. Those "graduate" level courses sometimes just repeat the basic ideas from this course and make them hard to understand.
I just realized multivariable calculus is the prereq of this course. I understand most of the part but there was confusion sometimes. Now I need to take cal 3 so I can continue these awesome lectures from professor Strang.
You missed the whole point of Strang’s gentle wise career which is that calculus before linear algebra is stupid and wrong, actually, linear algebra should precede calculus. We have been unnecessarily tortured and many of us our math careers destroyed, ended, by the unwise reverse decision. LA is much more comprehensible, useful, inspiring, and generally useful than calculus which I’ve never used after a PhD and 30 years more. I really wish my high school had offered linear algebra first. Then so many would have not dropped out, and would have been better served by their effortful learning.
Damn, this is a great lecture.... somehow connect to the least square problem by the interpretation of pure linear algebra without using calculus. what an enlightenment.
How can i just remember every bit of these lectures always? This is education in its true sense, sometimes i feel watching video is a better form of education than personal interaction, if you understand wat i mean
0:15 "...Let's make this lecture immortal"
NOW IS 2019
He did
2020 right now
Yeahhh, i like that i dea
yeaheheahea
after 9 years, it is immortal ,professor, it is immortal
I was thinking the same thing
After 11 years too :)
after 15 years too prof !
After 15 years
@@tino139 after 20 years. The lectures were filmed in 2000
I don't know if anyone else has noticed this, but the gradual shift into abstract concepts is done flawlessly by Professor Strang. In the first few lectures, really up until the lectures on bases, all of the methods Professor Strang uses to teach the subjects were concrete examples; very little was done with abstract definitions and arbitrary matrices. Over the last few lectures, Prof. Strang has made a gradual shift into abstractness which let's the mode of this sort of thinking sink in. Now, in this lecture, nothing is concrete and no numbers are ever used (until the end) and it feels effortless to understand! This man is a genius when it comes to math education. Thanks so much MIT and Prof. Strang for the amazing experience!
The lectures are beyond fantastic no doubt, but I really feel he could have thrown some proofs in between, he mostly "says" things without ever proving them. Yes, we can get the proofs from anywhere else, but I want to hear what would his approach be.
yeah, it's weird yet fantastic!
Lies again? Postal Code
This video clears up my questions and made this topic easy for everyone
@@tarunkalluri1799 That would make the lectures much longer and means little to the general audience. This is just an introductory course much like entry-level calculus - it is doubtful most students would benefit from being taught real analysis as they are grappling with the idea of derivatives for the first time.
For people who deal with statistics, this lecture is probably the most important in the entire series. This is so fucking good.
a bit late but could you develop on that?
@@ramonmassoni9657 he was referring to multivariate linear regression which is a huge topic in statistics.
@@ramonmassoni9657 I'm a statistician, but the explanation about why the projection matrix is equal to its square is something I had never thought about. And yes, that property of the projection matrix is absolutely key in multivariate linear regression, which is a very important method in statistics.
This kinda thread itself also underpins and strengthens this body of knowledge about linear algebra set up by prof. Strang
Strang is a legend. He should get an ovation everytime!
I do, and I believe there’s at least one person who does for each lecture; I guess we collectively give him an ovation. :)
i feel the same, in german unis there is this tradition to knock on the table as a form of applauding. I always feel like strang deserves this, too.
The combination of lecture 14 and 15 are works of art, things of beauty.
Thank you MIT. Thank you professor Strang.
You don't erase the board at MIT! You just raise it! :P
The thing I really like about these old timer Professors are the way they teach, he stops and ask questions as if he is also going through the problem he already knows everything but in the moment he is walking through us students and trying to look problems through our eyes, I would say this is the greatest method of teaching.
This teaching method only works if the instructor has a rock solid understanding of the subject.
I just can't thank you enough for showing such a clear picture of these concepts. I was struggling to understand 3D Computer Vision and how the linear algebra involved in it. Your lecture series has connected all the points which I have tried very hard enough to understand but I couldn't until I followed your lecture series. You have shown the whole picture by explaining the logic behind each and everything. You are an awesome professor. Thank You so so much. The way you explain is incredible, brilliant.
SO DO I !!!
I rewatch this at least once a year and it never fails to amaze me, beautiful work professor
Now I finally understood the linear regression in its matrix form
The Lecture has become immortal, sir! Thank you!
(Ref - first sentence of Prof. Strang in the lecture)
I can barely hesitate to say that these lectures are incomparable to the lectures I attend for Linear Algebra at university. It's uncanny how often when watching these videos I think, "I get it now, I get it!" Cudos to you Prof. Strang!
Good for non mathematics
Somethings are so beautiful when comprehended a certain way.
Prof. Strang's lecture are as much about the art of transfering such beautiful comprehension one might have experienced as it is about Linear Algebra.
Many in youtube have the skill of making a difficult things easy to grasp. But what you also get from Prof. Strang is that sense of euphoria that comprehension of something beautiful invokes.
This is the best explanation of the projection formula that I have ever seen. Prof. Strang not only provides a mathematical basis of the formula by deriving it, but also provides clear intuition and motivation. He also takes the time to go through the simpler case of projecting onto a line first, which allows building up the understanding of the content gradually. What a great lecture!
The great thing about these recorded lectures, is that I can pause the video each time Dr. Strang asks a question, and spend several minutes thinking about it, or working it out on paper on my own, before proceeding. It takes me three times as long to get through the lectures, but I feel like it is time well spent.
These kids rush out every time. They have no idea the blessing they were given. We never know how impressive a good instructor is until we are trying to learn these things on our own later in life. Thank you for making this available to all. (Yes, I rushed as a young college kid too, young people can be stupid.)
This video is just incredible. I've been watching the Khan Academy LA videos and have covered this over there, but seeing this gives me yet another point of view. Coming at it from a slightly different angle is so good at solidifying the concepts. In this lecture I find Professor Strang keeps things high level and really shows the power of thinking at the high "linear algebra" level. Nice to see a video on projection without a cosine in sight :)
One of the crown jewel lectures of MIT OCW.
@@hyungjoonpark83 it is the most visited mit ocw course
Rushikesh Shinde No surprise there. I’ve gone through a few of them, and this one is my favorite by far. Dr. Strang’s lectures are brilliant and intuitive, and he just has such a warm and likable personality. You really feel like he’s actually your professor.
When you start asking questions yourself and find solutions of it hidden inside the teachings, you know how great the lecturer is to give you that sort of understanding. Thank You Mr. Strang for this immortal course.
The subtle but crucial shift from row space to column space using matrices at the end was just phenomenal!
This lecture has made my day
Professor Strang is the BEST! Makes me motivated to enter MIT
Eugene Lee soo.. you entered MIT ?
Did you graduate from MIT now?
Have you started your career using your MIT degree?
@@renney77 Are you an MIT faculty member?
I m in love with how humbly he finishes his lecture.His lecture will be Immortal.
I asked to my prof " why do we minimize the square of the error in the LSM?"
He replied "To reduce the distance"
today I understood what does he mean by that after 3 years
This is his first lecture that I watch about a topic that I didn't previously know. Now I can finally see how brilliant he is at explaining because I have never heard any of this stuff before and it still makes sense the first time I hear it. My brain almost exploded at the complex and yet simple beauty of what he's explaining. It's almost like he's doing a magic trick because we know all the laws of math and he can just take them and make something possible that I never would have thought possible.
Whenever I feel a little off and distracted I go through the comments, get motivated and excited all over again to learn from the legend himself !
Note: Transpose(a)*(b-xa) is the dot product expressed in matrix multiply notation.
Confused me for a moment.
tks ,your reply helps me
@@趙超 second you
When i connected dots in my head around 15 minutes when professor was talking about why we do this projection thing, it was one of the most mind fucking blown moments in my mind. I felt like going from top to bottom in the tiny brain - galaxy brain meme in a span of a second. Amazing course
This professor is a genius :)
2020 now, he did make it immortal
This lecture along with the entire course and you yourself will always remain immortal Prof Strang.
Thank you from almost the entire world who have benefitted from these golden amazing insightful flawless transitioned lectures. You are a mathematical genius. Hope you read this comment someday and realise you have the biggest Indian Fan.
I saw this video fours years ago when I was an undergraduate student having linear algebra class, and now I saw it again when I am a graduate student, He is just a legend!, No one teacher I have ever seen can be compared to him.
I smiled when he casually introduced the concept of linear regression.
Got different view on how this works using matrix.
I hope these mit videos stay the same for 20 more years. I want my kids to watch the same videos
Thank you Professor Strang and MIT. This is fun and great! It boils everything down to the fundamentals. Best you can get!
Hard to appreciate how well presented this is in first go around. The more one learns LA the more one appreciates this style of presentation.
You experience so many Ahha! moments in the lecture!
I always thought econometrics taugh with sums was confusing. I finally found an intuitive way to understand least squares. The minimization of errors proof is cool, but the simplicity of your proof combining the left nullspace,is awesome; thank you once again professor Strang.
This is perhaps "The Best Lecture on Projections" I have ever experienced. Wowwww
This lectures makes the idea of linear regression crystal clear.
Thank you Professor, i am a medicine doctor. I just wanted to learn linear algebra out of curiosity. Even I, who had not dealt with mathematics for a long time, was able to understand the subject. Thank you very much indeed.
I am binge watching this series .....at the end of each one I tell myself that I will watch just one more episode :) !!
"make this lecture immortal"
Professor I am preparing for an entrance exam and your lectures are helping me most. Thank you professor Strang.
In all this time. this is by far the best explanation of least squares I've ever seen. Honestly thank you very much for the video.
I have watched lectures 14, 15, 16 over and over again, and gain new insights each time. Professors, including mine at the university, tend to drop the arrow sign above vectors while writing on the board. This causes great confusion for the uninitiated. For example, in this lecture there is an expression "p=ax" whether the writing "ax" means a (a scalar) times x (a vector) or a (a vector) times x (a scalar) is not that obvious. Admittedly, the confusion stems from my ignorance of the commutative property of scalar multiplication of vectors, which is, in fact, not mentioned explicitly in most textbooks (e.g., Lay et al, ; Larson & Hostetler). In retrospect, this "p=ax" notation is a prelude to the ingenious way of introducing projection matrix, which again, requires pre-knowledge of associative laws. Overall, these are great lectures that stimulate thinking. Thanks a lot.
b-[(a×b/|a|×|b|)×|b|×a/|a|] a×b/|a|×|b| is a additionstheorem cos α cos β × sin α sin β = cos(α-β)
b - (a×b)/|a|^2 × a a×a=|a|^2
Regards from Germany
I am watching in 2020 and I must say it is fresh as mortal. Long Live Prof.
Watching this in 2020, legendary to date!
This lecture is amazing! This is the deepest understanding of linear regression one could get.
Thanks MIT for sharing it with the world ❤️
Thanks to Gilbert Strang and MIT
Dr. Strang this lecture uses some abstract methods which help me understand projections onto subspaces much better.
This is brilliant, go MIT!
wow, this lecture has opened my eyes. Thank you, professor Strang!
My mind is about to get blown away. What appeared to be a dry, intangible, and futile branch of mathematics in the first few lectures turned out to answer one of the most gnawing questions, the answer to which was kept as a mystery for my entire life: How did people come up with the method of least squares? Why least squares? Says who?
I love this guy!
The most beautiful math lecture I have ever seen
This is not a lecture. It's a projection matrix that projects everything in the chapter onto the viewer's brain.
Finally I understood the origin of the least squares method... (i'm in 2nd year of aeronautics and this teacher is a thousand times better than my university ones. A few could learn how to teach additionally to the algebra lesson)
I have so much difficulty coping with my Linear Models subject. Thank you prof for this! You're a blessing. Continue uploading your lectures. You are a great help to us!
How come they did not applaude at the end? OMG you are awesome man!!
Is Gilbert Strang the God of Linear algebra? I loved this lecture :)
I have no business bing here. Not in a math or engineering field. I never see linear algebra except at night, on long flights, or anytime I want to escape into a world of abstract spaces and subspaces with the immortal Professor Strang as my guide.
As a PhD guy, I can say if you master in this course, actually you master at LOTS of high-level subjects like econometrics, engineering, applied math, chemistry etc. Those "graduate" level courses sometimes just repeat the basic ideas from this course and make them hard to understand.
Nobel Prize for teaching linear algebra.
It is immortal at 2019
my mind is blown! not by linear algebra... but by Gilbert Strang's teaching
Gill gets savage on Trig 2:30
e in N(At) is perp. to C(A) just killed me. 30:30
How smooth can someone explain the "big picture" step by step over weeks.
thanks professor Strang, you don't know how helpful this is for many of us!
Just to the point! Clear and Concise! He is my hero!
I just realized multivariable calculus is the prereq of this course. I understand most of the part but there was confusion sometimes. Now I need to take cal 3 so I can continue these awesome lectures from professor Strang.
You missed the whole point of Strang’s gentle wise career which is that calculus before linear algebra is stupid and wrong, actually, linear algebra should precede calculus. We have been unnecessarily tortured and many of us our math careers destroyed, ended, by the unwise reverse decision. LA is much more comprehensible, useful, inspiring, and generally useful than calculus which I’ve never used after a PhD and 30 years more. I really wish my high school had offered linear algebra first. Then so many would have not dropped out, and would have been better served by their effortful learning.
omg.. this is just amazing, thank you MIT thank you professor Strang
With all my endurance I listen to this saga until this lecture just to understand Linear Regression
ML students be going SMH
I am lucky to have the teacher that explained us linear regression THAT VERY WAY! :D
Yeah, it really was that good of a lecture. Professor Strang's Immortal Lecture.
He made some nonintuitive things intuitive with just some simple example, love his videos
This is phenomenal.
If Plato was right about theory of forms I'm pretty sure that this is the IDEAL lecture.
Professor Strang, You are immortal !! 🙏🙏🙏
I got goosebumps the first time I saw this lecture. He is an incredible teacher.
Damn, this is a great lecture.... somehow connect to the least square problem by the interpretation of pure linear algebra without using calculus. what an enlightenment.
This is art ! Thank you Prof. Strang
Is he taken? I’m in love.
you got a great taste honey
My university didn't even teach me projections. After being introduced to PCA (A concept used in machine learning) I came to know this topic. Alas!
OMG!!! Best way to understand least square!!!
I really have to think and imagine a lot in this lecture and I loved it
42:00
Least squares fitting by line
My main man Gilbert "strong" Strang is a BOSS!!! Thank you so much for the lecture!!!
other colleges should be envious that MIT has a great of a professor as Dr. Strang
Txafter
and other countries
Hats on the xs, hats off to Professor Strang!
"Don't take the videotape quite so carefully"... Camera zooms in right after lmao
Legend... Thats one word match their capability :)
intuition behind linear regression is awesome..
now i can feel the art of the linear algebra
Hats off to professor Gilbert strang
This series is making my life so easy
Thanks Prof Strang, MIT!
Definitely perfect final!!
This class is Beautiful.
How can i just remember every bit of these lectures always? This is education in its true sense, sometimes i feel watching video is a better form of education than personal interaction, if you understand wat i mean
Gotta respect Gilbert Strang!