Skip to content

Demo: Optimizing Gemma inference on NVIDIA GPUs with TensorRT-LLM

5,929 views

About this video

Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video

Shows optimization of Gemma model inference on NVIDIA GPUs using TensorRT-LLM. Teaches performance tuning for LLM deployment.

Video by Google for Developers, played through YouTube's embedded player.

Part of Gemma Developer Day 2024