[Full Workshop] Llama 3 at 1,000 tok/s on the SambaNova AI Platform
852 views
About this video
Advanced · Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by videoWorkshop on deploying Llama 3 with high token throughput on SambaNova infrastructure. Practical optimization techniques for inference performance and hardware utilization provide reproducible technical content.
Video by AI Engineer, played through YouTube's embedded player.
Part of Workshop: AIE World's Fair 2024