Skip to content

Let's build the GPT Tokenizer

1,259,050 views

About this video

Hand-picked by a BrighterTube curator

Fills a gap most tutorials skip; hands-on and precise.

How tokenizers for language models work, by building a byte-pair-encoding tokenizer.

Video by Andrej Karpathy, played through YouTube's embedded player.