Big Bird: Transformers for Longer Sequences (Paper Explained)
About this video
Hand-picked by a BrighterTube curator · found via round-3 back catalogue of a channel Lumen picks video by videoCovers Big Bird's efficient attention mechanisms for processing longer sequences in transformers. Teaches computational optimization for handling extended context.
Video by Yannic Kilcher, played through YouTube's embedded player.
Part of Natural Language Processing, Deep Learning Architectures