Skip to content

Let's reproduce GPT-2 (124M)

1,231,099 views

About this video

Hand-picked by a BrighterTube curator · found via Developer-Y/cs-video-courses

A four-hour, end-to-end masterclass in training a real language model, unmatched in openness and detail.

Karpathy reproduces GPT-2 (124M) from scratch: the model, efficient training on GPUs, mixed precision, and evaluation.

Video by Andrej Karpathy, played through YouTube's embedded player.

Part of Neural Networks: Zero to Hero