Implementing the Self-Attention Mechanism from Scratch in PyTorch!

[@marthalanaveen]

Thank you so much for this. You don’t know how badly I needed this right now. Please extend this series to transformers, if possibly any LLM as well.

[@Gowtham25]

It's really good and usefull... Expecting for training an llm from the scratch for the next and interested in KAN-FORMER...

[@jairjuliocc]

Thanks You.Can you explain the entire self attention flow? (from postional encode to final next word prediction). I think it will be an entire series 😅

[@TheMLTechLead]

It is coming! It will take time

[@howardsmith4128]

Awesome work. Thanks so much.