04.03 Ill-Conditioning and Possible Solutions

In this video we discuss a common problem in neural network optimization, that of ill-conditioning. We also present two possible solutions, adding momentum, and pre-conditioning.
You can find the next video of the series here: • 04.04 Challenges in Op...