Hacking the Inference Pareto Frontier - Kyle Kranen, NVIDIA
About this video
Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video · 82% confidenceCovers optimization of inference performance and cost tradeoffs at scale. The talk teaches techniques for improving efficiency on the inference Pareto frontier.
A 20-minute video from AI Engineer: “Hacking the Inference Pareto Frontier - Kyle Kranen, NVIDIA”.
Video by AI Engineer, played through YouTube's embedded player.