Let's reproduce GPT-2 (124M)
1,231,099 views
About this video
Hand-picked by a BrighterTube curator · found via Developer-Y/cs-video-coursesA four-hour, end-to-end masterclass in training a real language model, unmatched in openness and detail.
Karpathy reproduces GPT-2 (124M) from scratch: the model, efficient training on GPUs, mixed precision, and evaluation.
Video by Andrej Karpathy, played through YouTube's embedded player.
Part of Neural Networks: Zero to Hero