Skip to content

SBTB 2023: Nick Hill, Efficiently serving LLMs at scale.

FunctionalTV10.9K subscribers

About this video

Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video

Covers optimization techniques for serving large language models at scale. Teaches inference architecture patterns and performance tuning methods for production LLM systems.

Video by FunctionalTV, played through YouTube's embedded player.

Part of Scale By the Bay 2023