Serving 2 Million Models Without Melting: Scaling the Hugging Face Hub — Arek Borucki, Hugging Face
1,558 views
About this video
Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by videoTeaches infrastructure scaling techniques for serving millions of models at Hugging Face Hub. Concrete system design and optimization lessons.
Video by AI Engineer, played through YouTube's embedded player.
Part of Platform Engineering (Sandboxing, Orchestration etc) @ AI Engineer, Open Models @ AI Engineer