Skip to content

From model weights to API endpoint with TensorRT LLM: Philip Kiely and Pankaj Gupta

AI Engineer1.03M subscribers

6,388 views

About this video

Advanced · Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video

Walks through deploying models via TensorRT LLM to API endpoints—a complete production workflow. Length and speaker credentials suggest technical depth in inference optimization and serving.

Video by AI Engineer, played through YouTube's embedded player.

Part of Workshop: AIE World's Fair 2024