16videosSasha Rush
14.3K subscribers on YouTube
Shorts, livestreams, trailers and promos are never listed. Unless a curator approved this channel in full, only individually picked videos appear.
Playlists · 5
Do we need Attention? - Linear RNNs and State Space Models (SSMs) for NLP
35.3K views
Sasha Rush surveys linear RNNs and state space models as alternatives to attention, from first principles.
23:23AI World Models (Keyon Vafa)
6.86K views
A 23-minute video from Sasha Rush's catalogue; the title names its topic.
15:07AIF + DPO: Distilling Zephyr and friends
3.94K views
A 15-minute video from Sasha Rush's catalogue; the title names its topic.
18:50Compute-Constrained Data Selection (Junjie Oscar Yin)
1.51K views
A 19-minute video from Sasha Rush's catalogue; the title names its topic.
20:02Daphne Ippolito (CMU / Google) - No One-Size Fits All Pre-Training Data
953 views
A 20-minute video from Sasha Rush's catalogue; the title names its topic.
43:49Differential Inference: A Criminally Underused Tool
2.63K views
A 44-minute video from Sasha Rush's catalogue; the title names its topic.
33:50Do we need Attention? A Mamba Primer
13.8K views
A 34-minute video from Sasha Rush's catalogue; the title names its topic.
12:50Eugene Cheah - From idea to LLM (RWKV / Recursal)
1.54K views
A 13-minute video from Sasha Rush's catalogue; the title names its topic.
1:16:00GPU Puzzles: Let's Play
13K views
A 76-minute video from Sasha Rush's catalogue; the title names its topic.
19:52Graham Neubig (CMU) - Can we make building with open-source AI as simple as prompting ChatGPT?
874 views
A 20-minute video from Sasha Rush's catalogue; the title names its topic.
11:35Hands on Human-AI Coding
2.7K views
A 12-minute video from Sasha Rush's catalogue; the title names its topic.
26:16Hanna Hajishirzi (AI2) - OLMo: Findings of Training an Open LM
1.57K views
A 26-minute video from Sasha Rush's catalogue; the title names its topic.
22:43Hao Zhang - Chatbot Arena (UCSD / LMSys)
1.53K views
A 23-minute video from Sasha Rush's catalogue; the title names its topic.
49:33How DeepSeek Changes the LLM Story
17.2K views
A 50-minute video from Sasha Rush's catalogue; the title names its topic.
32:04How to write an okay research paper.
10.6K views
A 32-minute video from Sasha Rush's catalogue; the title names its topic.
25:08Inverting Language Models: Raw Text from Vectors and LLM APIs
2.74K views
A 25-minute video from Sasha Rush's catalogue; the title names its topic.
9:30Irina Rish (Mila) - Continual Learning of Foundation Models
703 views
A 10-minute video from Sasha Rush's catalogue; the title names its topic.
58:02Large Language Models in Five Formulas
42.5K views
A 58-minute video from Sasha Rush's catalogue; the title names its topic.
8:40Leshem Chosen - Wiki-models through Natural Feedback
461 views
A 9-minute video from Sasha Rush's catalogue; the title names its topic.
1:27:08Linear Attention and Beyond (Interactive Tutorial with Songlin Yang)
15K views
A 87-minute video from Sasha Rush's catalogue; the title names its topic.
25:45Long-Context LLM Extension
7.5K views
A 26-minute video from Sasha Rush's catalogue; the title names its topic.
7:39Louis Castricato - RLAIF, User Autonomy, and Controllability (Eleuther / Synthlabs)
292 views
A 8-minute video from Sasha Rush's catalogue; the title names its topic.
12:05Luca Soldaini - Curating Pretrain Data (AI2 / Dolma)
1.08K views
A 12-minute video from Sasha Rush's catalogue; the title names its topic.
24:11Ludwig Schmidt - Open source AI for Multimodality
1.05K views
A 24-minute video from Sasha Rush's catalogue; the title names its topic.
16:26MambaByte: Token-Free Language Modeling
7.24K views
A 16-minute video from Sasha Rush's catalogue; the title names its topic.
16:12MiniTorch - Autodifferentiation (1.2)
1.1K views
A 16-minute video from Sasha Rush's catalogue; the title names its topic.
17:47MiniTorch - Backprop (1.3)
1.19K views
A 18-minute video from Sasha Rush's catalogue; the title names its topic.
14:02MiniTorch - Fundamentals (0.1)
8.41K views
A 14-minute video from Sasha Rush's catalogue; the title names its topic.
17:56MiniTorch - Gradients (2.4)
716 views
A 18-minute video from Sasha Rush's catalogue; the title names its topic.
19:54MiniTorch - Learning w/ Derivatives (1.1)
1.04K views
A 20-minute video from Sasha Rush's catalogue; the title names its topic.
15:08MiniTorch - Mini-ML (1.0)
1.35K views
A 15-minute video from Sasha Rush's catalogue; the title names its topic.
13:22MiniTorch - Models and Modules (0.2)
2.33K views
A 13-minute video from Sasha Rush's catalogue; the title names its topic.
11:11MiniTorch - Module 0 Code Walkthrough
2.18K views
A 11-minute video from Sasha Rush's catalogue; the title names its topic.
16:53MiniTorch - Neural Networks (2.0)
847 views
A 17-minute video from Sasha Rush's catalogue; the title names its topic.
11:19MiniTorch - Shapes (2.3)
563 views
A 11-minute video from Sasha Rush's catalogue; the title names its topic.
20:36MiniTorch - Tensor Functions (2.2)
782 views
A 21-minute video from Sasha Rush's catalogue; the title names its topic.