BrighterTube

GPT in PyTorch

mildlyoverfitted8.03K subscribers

11,588 views

About this video

Hand-picked by a BrighterTube curator · found via Reddit r/compsci thread: What are your favorite Comp Sci YouTube channels? · 82% confidence

Implements a GPT-style transformer in PyTorch from scratch and checks its outputs against a pretrained reference model, so the build is verified rather than just narrated.

Implements a GPT-style transformer language model in PyTorch, comparing outputs with a pretrained reference.

Programming & CSScience & Math

Video by mildlyoverfitted, played through YouTube's embedded player.

Part of GitHub adventures