Neural networks & AI
How modern AI works, from a single neuron to building a GPT yourself. Watch them in this order.
- 1
But what is a neural network? | Deep learning chapter 13Blue1Brown
Start here: what a neural network actually is, visually.
- 2
Gradient descent, how neural networks learn | Deep Learning Chapter 23Blue1Brown
Gradient descent: how a network learns from its mistakes.
- 3
Backpropagation, intuitively | Deep Learning Chapter 33Blue1Brown
Backpropagation, the algorithm behind all of deep learning, intuitively.
- 4
7:58Large Language Models explained briefly3Blue1Brown
Large language models in eight minutes: the big picture before the details.
- 5
Attention in transformers, step-by-step | Deep Learning Chapter 63Blue1Brown
Attention, the mechanism that made transformers (and ChatGPT) possible.
- 6
The spelled-out intro to neural networks and backpropagation: building microgradAndrej Karpathy
Hands-on: Andrej Karpathy builds a tiny neural network library from scratch.
- 7
Let's build GPT: from scratch, in code, spelled out.Andrej Karpathy
The capstone: build a small GPT from scratch, in code, step by step.