1:16:05Bonus Lecture: CUDA C++ llm.cpp
A 76-minute video from GPU MODE: “Bonus Lecture: CUDA C++ llm.cpp”.
GPU MODE
34.8K subscribers on YouTube
Shorts, livestreams, trailers and promos are never listed. Unless a curator approved this channel in full, only individually picked videos appear.
1:16:05
56:13Lecture 1 How to profile CUDA kernels in PyTorch
A 56-minute video from GPU MODE: “Lecture 1 How to profile CUDA kernels in PyTorch”.
1:12:06Lecture 100: InferenceX Continuous OSS Inference Benchmarking
A 72-minute video from GPU MODE: “Lecture 100: InferenceX Continuous OSS Inference Benchmarking”.
1:11:17Lecture 101: Learning CUTLASS the hard way
A 71-minute video from GPU MODE: “Lecture 101: Learning CUTLASS the hard way”.
2:33:57Lecture 103: Fundamentals of CuTe Layout Algebra and Category-theoretic Interpretation
A 154-minute video from GPU MODE: “Lecture 103: Fundamentals of CuTe Layout Algebra and Category-theoretic Interpretation”.
1:57:57Lecture 104: Gluon and Linear Layouts
A 118-minute video from GPU MODE: “Lecture 104: Gluon and Linear Layouts”.
1:00:18Lecture 105: cuDNN mxfp8 attention
A 60-minute video from GPU MODE: “Lecture 105: cuDNN mxfp8 attention”.
1:28:19Lecture 106: Hugging Face Kernels
A 88-minute video from GPU MODE: “Lecture 106: Hugging Face Kernels”.
1:25:17Lecture 10: Build a Prod Ready CUDA library
A 85-minute video from GPU MODE: “Lecture 10: Build a Prod Ready CUDA library”.
1:01:27Lecture 110: The 4-bitter lesson: Balancing Stability and Performance in NVFP4 RL
A 61-minute video from GPU MODE: “Lecture 110: The 4-bitter lesson: Balancing Stability and Performance in NVFP4 RL”.
1:08:33Lecture 111: Spectral Compute: Compile CUDA everywhere
A 69-minute video from GPU MODE: “Lecture 111: Spectral Compute: Compile CUDA everywhere”.
58:05Lecture 112: Production Megakernels for Real-World Inference
A 58-minute video from GPU MODE: “Lecture 112: Production Megakernels for Real-World Inference”.
52:53Lecture 113: Every Microsecond Matters: Achieving Near Speed-of-Light Latency in GPU Collectives
A 53-minute video from GPU MODE: “Lecture 113: Every Microsecond Matters: Achieving Near Speed-of-Light Latency in GPU Collectives”.
1:44:03Lecture 114: PyCuTe
A 104-minute video from GPU MODE: “Lecture 114: PyCuTe”.
40:07Lecture 115: Proving Kernels Correct Instead of Testing Them
A 40-minute video from GPU MODE: “Lecture 115: Proving Kernels Correct Instead of Testing Them”.
30:35Lecture 116: GPU Kernel Formal Verification
A 31-minute video from GPU MODE: “Lecture 116: GPU Kernel Formal Verification”.
54:01Lecture 117:Building a GPU Compiler from Scratch
A 54-minute video from GPU MODE: “Lecture 117:Building a GPU Compiler from Scratch”.
57:13Lecture 118: GSQ-RCO: Better Non-Uniform GGUF Quantization
A 57-minute video from GPU MODE: “Lecture 118: GSQ-RCO: Better Non-Uniform GGUF Quantization”.
1:08:31Lecture 119: Scan at the speed of light
A 69-minute video from GPU MODE: “Lecture 119: Scan at the speed of light”.
56:43Lecture 11: Sparsity
A 57-minute video from GPU MODE: “Lecture 11: Sparsity”.
53:03Lecture 120: Mercury Multi GPU operator optimization
A 53-minute video from GPU MODE: “Lecture 120: Mercury Multi GPU operator optimization”.
1:12:14Lecture 12: Flash Attention
A 72-minute video from GPU MODE: “Lecture 12: Flash Attention”.
1:15:35Lecture 13: Ring Attention
A 76-minute video from GPU MODE: “Lecture 13: Ring Attention”.
1:21:43Lecture 14: Practitioners Guide to Triton
A 82-minute video from GPU MODE: “Lecture 14: Practitioners Guide to Triton”.
1:34:24Lecture 15: CUTLASS
A 94-minute video from GPU MODE: “Lecture 15: CUTLASS”.
55:41Lecture 16: On Hands Profiling
A 56-minute video from GPU MODE: “Lecture 16: On Hands Profiling”.
59:43Lecture 17: NCCL
A 60-minute video from GPU MODE: “Lecture 17: NCCL”.
1:23:22Lecture 18: Fusing Kernels
A 83-minute video from GPU MODE: “Lecture 18: Fusing Kernels”.
59:09Lecture 19: Data Processing on GPUs
A 59-minute video from GPU MODE: “Lecture 19: Data Processing on GPUs”.
1:02:20Lecture 20: Scan Algorithm
A 62-minute video from GPU MODE: “Lecture 20: Scan Algorithm”.
1:04:41Lecture 21: Scan Algorithm Part 2
A 65-minute video from GPU MODE: “Lecture 21: Scan Algorithm Part 2”.
1:09:25Lecture 22: Hacker's Guide to Speculative Decoding in VLLM
A 69-minute video from GPU MODE: “Lecture 22: Hacker's Guide to Speculative Decoding in VLLM”.
1:47:50Lecture 23: Tensor Cores
A 108-minute video from GPU MODE: “Lecture 23: Tensor Cores”.
1:06:19Lecture 24: Scan at the Speed of Light
A 66-minute video from GPU MODE: “Lecture 24: Scan at the Speed of Light”.
1:30:52Lecture 25: Speaking Composable Kernel (CK)
A 91-minute video from GPU MODE: “Lecture 25: Speaking Composable Kernel (CK)”.
1:18:35Lecture 26: SYCL Mode (Intel GPU)
A 79-minute video from GPU MODE: “Lecture 26: SYCL Mode (Intel GPU)”.