Skip to content

KV Cache-Aware Routing and P/D Disaggregation on Kubernetes — Yuchen Fama & Ashish Kamra, Red Hat

AI Engineer1.03M subscribers

5,142 views

About this video

Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video

Explains optimization of KV cache management and compute disaggregation for LLM serving on Kubernetes. Teaches concrete infrastructure tuning and architectural decisions.

Video by AI Engineer, played through YouTube's embedded player.