Tiny Transformers

[@MilesBellas]

As Seniors in UK schools, we used LUTs for SIN, COS and LOG, before pocket calculators became ubiquitous!
😅😊

[@MilesBellas]

"AGI?......we're already there........"
Hu-Po

[@sdfrtyhfds]

I mean, all these models also have'nt finished training

[@numannebuni]

Horn @ 2:00

[@sdfrtyhfds]

Maybe you can train the same size of model, just remove most of the softmax.