Vision Transformer in PyTorch

92,305 views

About this video

Hand-picked by a BrighterTube curator · found via Reddit r/compsci thread: What are your favorite Comp Sci YouTube channels? · 82% confidence

Line-by-line implementation that maps each part of the paper to code, checked against a reference model.

Implements the Vision Transformer in PyTorch from the paper: patch embedding, attention blocks and classification head.

Video by mildlyoverfitted, played through YouTube's embedded player.

Part of GitHub adventures