Let's build the GPT Tokenizer
1,259,050 views
About this video
Hand-picked by a BrighterTube curatorFills a gap most tutorials skip; hands-on and precise.
How tokenizers for language models work, by building a byte-pair-encoding tokenizer.
Video by Andrej Karpathy, played through YouTube's embedded player.