Skip to content

Scaling Transformer to 1M tokens and beyond with RMT (Paper Explained)

About this video

Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by video

Explains recurrent memory transformer scaling to million tokens from paper. Technical analysis of long-context handling in transformers.

Video by Yannic Kilcher, played through YouTube's embedded player.

Part of Natural Language Processing, Papers Explained