Skip to content

ZeRO & Fastest BERT: Increasing the scale and speed of deep learning training in DeepSpeed

About this video

Advanced · Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video

Explains ZeRO and DeepSpeed optimization for scaling deep learning training. Shows techniques to increase training efficiency and model size capacity.

Video by Microsoft Research, played through YouTube's embedded player.

Part of Microsoft Research webinars and tutorials