Turing-NLG, DeepSpeed and the ZeRO optimizer

About this video

Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video · 82% confidence

Covers Turing-NLG language model, DeepSpeed optimization framework, and ZeRO optimizer technique. Technical walkthrough of concrete ML systems and optimization methods.

A 21-minute video from Yannic Kilcher: “Turing-NLG, DeepSpeed and the ZeRO optimizer”.

Video by Yannic Kilcher, played through YouTube's embedded player.

Part of Natural Language Processing