SBTB 2023: Nick Hill, Efficiently serving LLMs at scale.
About this video
Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by videoCovers optimization techniques for serving large language models at scale. Teaches inference architecture patterns and performance tuning methods for production LLM systems.
Video by FunctionalTV, played through YouTube's embedded player.
Part of Scale By the Bay 2023