Skip to content

Attention in transformers, step-by-step | Deep Learning Chapter 6

3Blue1Brown8.76M subscribers

4,883,035 views

About this video

Intro · Hand-picked by a BrighterTube curator

Goes deeper than most written tutorials on attention while staying visual and precise.

The attention mechanism in detail: queries, keys, values and how context flows between words.

Video by 3Blue1Brown, played through YouTube's embedded player.