Word2Vec Papers Explained From Scratch: Skip-Gram with Negative Sampling

Today we are going to be taking you guys through the 2 Word2Vec papers!
PAPER
Paper 1: Efficient Estimation of Word Representations in Vector Space. arxiv.org/abs/1301.3781
Paper 2: Distributed Representations of Words and Phrases and their Compositionality. arxiv.org/abs/1310.4546
OUTLINE
00:00​ Intro & Overview
00:34​ Word2Vec Paper 1 Abstract
02:32 Feed Forward Neural Network Language Model
04:42 New Proposed Architectures
05:57 Intro to CBOW and Skip-Gram Models
07:21 Word2Vec Paper 2 Abstract
09:15 Skip-Gram Model Objective Function
10:31 Skip-Gram Model with Negative Sampling
11:55 Skip-Gram Model with Subsampling Frequent Words
12:18 Conclusion
RESOURCES
Understanding Neural Network • But what is a neural n...
Hierarchical Binary-Tree Softmax • Neural networks [10.7]...
Demystifying Neural Network in Skip-Gram Modelling: aegis4048.github.io/demystify...

[@harshpoddar2113]

I am really really thankful for such a nice explanation. I would request you to not get demotivated from less views or likes. Keep up the good work.

[@keshavkasat9465]

Crisp! Please keep making more videos!

[@anweshapatra6682]

I love you, for making this video

[@siennahunter9043]

Amazing explanation!!! Thank you!

[@cmfrtblynmb02]

Absolutely amazing work

[@archnamaurya4374]

very detailed and good summary

[@sihatafnan5450]

This channel should make more videos.Excellent stuffs btw

[@onlysparsh]

Best video I saw on SGNS thanks sir !

[@sriyansketavarapu1575]

Guys I absolutely loved the explanation and kudos to all the efforts u put in to understand the subject so thoroughly to put out such beautiful explanations. Do not get demotivated by the number of likes and subscribers, I see a great potential for this channel. All the best.

[@goelnikhils]

Amazing Explanation

[@deeptichamoli]

Nicely explained

[@ankitjaiswal272]

very good, keep doing the good work, dont be disheartened by less views. Very well explained.

[@harshanarayan7363]

This was a great explanation

[@basharmohammad5353]

The best ever. Thanks a million

[@skp6914]

your contents are really good

[@rajivs9287]

Thanks a lot....

[@skp6914]

keep up the good work

[@syfaiz]

Cheers!

[@aizazkhan5439]

Highly underrated channel. Dude you are doing a great job. Thanks for this nice video.

[@petro549]

at 3:32, shouldn't the first term for Q be V X D instead of N X D?

[@andresnamm982]

Can you say what environment you use for cresting these tutorials?

[@WahranRai]

What is the name of your robot (text to voice) ?

[@akshayvalsaraj2047]

damn there is only one video , I wanted to see more videos

[@genericperson8238]

Great video but could you please slow down in your talking speed? It's insanely fast and sometimes it is hard to understand certain words even if I slow down the video