L11.5 Weight Initialization -- Why Do We Care?

[@haochengzhao7483]

Even if we use BN, is initialization still important?

[@SebastianRaschka]

I think it is far less important then. But it's hard to say exactly because in practice most people use the PyTorch defaults (which is currently He initialization I think)