Bay.Area.AI: torch.compile and vLLM, Antoni Viros Martin
764 views
About this video
Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by videoCovers torch.compile and vLLM optimization techniques for improving LLM inference performance. Technical discussion of compiler and runtime optimization.
Video by FunctionalTV, played through YouTube's embedded player.