HW, SW, Performance and Costs for Llama-2 70b and Mixtral 8x7b LLM Inference with Low...- Ivan Baldo
218 views
About this video
Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by videoDetails hardware, software, performance, and cost analysis for large language model inference deployment. Teaches practical system design tradeoffs.
Video by The Linux Foundation, played through YouTube's embedded player.
Part of Open AI + Data Forum @ OSS NA 2024, Open Source Summit North America 2024