CacheGen: KV Cache Compression and Streaming for Fast Language Model Serving (SIGCOMM'24, Paper1571)
About this video
Editorial review · 85% confidenceWhole-channel inclusion: ACM SIGCOMM (title sample: Nearly all uploads are research paper presentations and technical talks from a top networking conference, genuinely educational primary-source technical content.; 3 of 3 sampled transcripts read as real teaching); this title passed a strict title check.
A 15-minute video from ACM SIGCOMM: “CacheGen: KV Cache Compression and Streaming for Fast Language Model Serving (SIGCOMM'24, Paper1571)”.
Video by ACM SIGCOMM, played through YouTube's embedded player.