Low Rank Decompositions of Matrices

[@jimmy21584]

Came here because I’m reading the LoRA LLM paper. Thank you for the clear summary!

[@kadrimufti4295]

I don't understand at 3:45 how and why you're multiplying the columns of matrix T by the rows of matrix W. Isn't matrix multiplication done the other way round, rows of T multiplied by columns of W?

[@hello28572]

It is another alternative way of representing matrix multiplication

[@perioguatexgaming1333]

If you transpose the matrix you get by the above method you will get the same matrix by multiplying rows with columns.