Skip to content

OSDI '24 - Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve

USENIX42.8K subscribers

2,755 views

Video by USENIX, played through YouTube's embedded player.

Part of OSDI '24