Knowledge Distillation in Deep Learning - DistilBERT Explained

[@251_satyamrai4]

Clear explanation. Thank you for your work

[@ilhamafounnas8279]

Hey! a very good explanation, waiting for more videos on KD

[@dingusagar]

Thanks 😊. Yes, more videos coming soon.

[@Gokulhraj]

Can you please make a video on what happens during fine tuning of bert? Like whether it will freeze the layers of core engine and train only the head and how weight updation takes place etc for question answering task.

[@dhirajkumarsahu999]

Thank you Dingu

[@sadikaljarif9635]

very good

[@sadikaljarif9635]

could u please share this slide ???

[@dingusagar]

docs.google.com/presentation/d/1IkPeSGOcUSO_qyCwtrP9ZBMx-l2aBzj7FDqwPLK9Ekk/edit?usp=drivesdk

[@sadikaljarif9635]

@@dingusagar thank you so much