Skip to content

Bay.Area.AI: torch.compile and vLLM, Antoni Viros Martin

FunctionalTV10.9K subscribers

764 views

About this video

Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video

Covers torch.compile and vLLM optimization techniques for improving LLM inference performance. Technical discussion of compiler and runtime optimization.

Video by FunctionalTV, played through YouTube's embedded player.