Skip to content

HW, SW, Performance and Costs for Llama-2 70b and Mixtral 8x7b LLM Inference with Low...- Ivan Baldo

218 views

About this video

Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video

Details hardware, software, performance, and cost analysis for large language model inference deployment. Teaches practical system design tradeoffs.

Video by The Linux Foundation, played through YouTube's embedded player.

Part of Open AI + Data Forum @ OSS NA 2024, Open Source Summit North America 2024