Efficient LLM Inference (vLLM KV Cache, Flash Decoding & Lookahead Decoding)

[@noblesmathews]

If you are interested in this area and would like to explore a bunch of other topics we discussed about in the course please checkout the references and other videos made by my classmates linked at cs.uwaterloo.ca/~wenhuche/teaching/cs886/

[@thepresistence5935]

Can you give the previous lesson, it will be useful to look

[@noblesmathews]

Hi! the previous lecture was given by my classmate you can find it at ruclips.net/video/RfD5tPoMnZY/видео.html

[@SpartanPanda]

Not able to find part 1 of this

[@noblesmathews]

Hi! the previous lecture was given by my classmate you can find it at ruclips.net/video/RfD5tPoMnZY/видео.html