Distill the LLM, Don't Serve It: Search & Personalization at DoorDash — Raghav Saboo, DoorDash
About this video
Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by videoExplains knowledge distillation and ranking instead of serving full LLMs for search and personalization at DoorDash. Teaches specific inference optimization techniques for production scale.
Video by AI Engineer, played through YouTube's embedded player.