ZeRO & Fastest BERT: Increasing the scale and speed of deep learning training in DeepSpeed
About this video
Advanced · Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by videoExplains ZeRO and DeepSpeed optimization for scaling deep learning training. Shows techniques to increase training efficiency and model size capacity.
Video by Microsoft Research, played through YouTube's embedded player.