Skip to content

[Full Workshop] Llama 3 at 1,000 tok/s on the SambaNova AI Platform

AI Engineer1.03M subscribers

852 views

About this video

Advanced · Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video

Workshop on deploying Llama 3 with high token throughput on SambaNova infrastructure. Practical optimization techniques for inference performance and hardware utilization provide reproducible technical content.

Video by AI Engineer, played through YouTube's embedded player.

Part of Workshop: AIE World's Fair 2024