Unlocking Local LLMs with Quantization - Marc Sun, Hugging Face

About this video

Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video · 82% confidence

Covers quantization techniques for running large language models locally on consumer hardware. Teaches model compression, numerical reduction, and inference optimization.

A 40-minute video from The Linux Foundation: “Unlocking Local LLMs with Quantization - Marc Sun, Hugging Face”.

Video by The Linux Foundation, played through YouTube's embedded player.

Part of Open Source Summit + AI_dev Japan 2024