From model weights to API endpoint with TensorRT LLM: Philip Kiely and Pankaj Gupta
6,388 views
About this video
Advanced · Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by videoWalks through deploying models via TensorRT LLM to API endpoints—a complete production workflow. Length and speaker credentials suggest technical depth in inference optimization and serving.
Video by AI Engineer, played through YouTube's embedded player.
Part of Workshop: AIE World's Fair 2024