torch.nn.TransformerEncoderLayer - Part 1 - Transformer Embedding and Position Encoding Layer

This video shows the first part of a general transformer encoder layer. This first part is the embedding and the positional encoding.
Positional Encoding video : • Transformer Positional...
torch version - 1.10.0

[@rafaelgp9072]

Very good videos, in my opinion The best i ve ever seen about The math perspective of transformers

[@rounhi]

Excited to see next videos

[@dddaaa931]

What name of embedding method used in bert model?

[@INFJ-A-GOAT]

does torch.nn.TransformerEncoderLayer include position encoding?

[@dddaaa931]

How can find the numbers of vectors for each token???

[@ahmedchaoukichami9345]

very good explaine thanks can you do vit transformers plz

[@brofessorsbooks3352]

keep it uppppp!!!