Let's build GPT: from scratch, in code, spelled out.

Andrej Karpathy1.76M subscribers

8,215,796 views

Why it's on BrighterTube

Hand-picked by a BrighterTube curator · 95% confidence

A two-hour, fully worked coding lecture from a leading practitioner.

What you'll learn

Building a GPT-style language model from scratch in code, following 'Attention Is All You Need'.

Programming & CS Lectures

Video by Andrej Karpathy, played through YouTube's embedded player.

[1hr Talk] Intro to Large Language Models Andrej KarpathyProgramming & CS4.32M views

2:27:41

CS50x 2024 - Lecture 1 - C CS50Programming & CS1.41M views

2:04:55

CS50x 2024 - Lecture 0 - Scratch CS50Programming & CS2.2M views

Raft lecture (Raft user study)Diego OngaroProgramming & CS86.6K views

AT&T Archives: The UNIX Operating System AT&T Tech ChannelLectures2.23M views

1. What is Computation?MIT OpenCourseWareProgramming & CS2.25M views

1:15:51

F2023 #02 - Modern SQL (CMU Intro to Database Systems)CMU Database GroupProgramming & CS35.5K views

4:31:28

Oral History: Ken Thompson on Co-creating Unix, C’s Origins, and the Go Programming Language Computer History MuseumProgramming & CS64.9K views

1:16:14

01 - History of Databases (CMU Advanced Databases / Spring 2023)CMU Database GroupProgramming & CS59.7K views

Lecture 1: Algorithmic Thinking, Peak Finding MIT OpenCourseWareProgramming & CS6.01M views

AlphaGo - The Movie | Full award-winning documentary Google DeepMindLectures38.5M views

Paxos lecture (Raft user study)Diego OngaroProgramming & CS114K views

[1hr Talk] Intro to Large Language Models

Andrej Karpathy4.32M views

An hour-long general-audience talk on what large language models are and how they're trained.

2:27:41

CS50x 2024 - Lecture 1 - C

CS501.41M views

CS50x 2024 lecture 1: an introduction to C — syntax, types, conditionals, loops and compiling.

2:04:55

CS50x 2024 - Lecture 0 - Scratch

CS502.2M views

CS50x 2024 lecture 0: how computers represent information, algorithms, and first programs in Scratch.

Raft lecture (Raft user study)

Diego Ongaro86.6K views

Diego Ongaro's lecture explaining the Raft consensus algorithm: leader election, log replication and safety.

AT&T Archives: The UNIX Operating System

AT&T Tech Channel2.23M views

The 1982 Bell Labs film on the UNIX system, with Ken Thompson, Dennis Ritchie and Brian Kernighan explaining pipes, tools and the shell.

1. What is Computation?

MIT OpenCourseWare2.25M views

MIT 6.0001 lecture 1: what computation is, and a first look at Python.

1:15:51

F2023 #02 - Modern SQL (CMU Intro to Database Systems)

CMU Database Group35.5K views

CMU 15-445 (Fall 2023) lecture 2: modern SQL — aggregates, window functions, CTEs and more.

4:31:28

Oral History: Ken Thompson on Co-creating Unix, C’s Origins, and the Go Programming Language

Computer History Museum64.9K views

An in-depth oral history with Ken Thompson covering his early life, co-creating Unix and C, and his work on Plan 9 and Go.

1:16:14

01 - History of Databases (CMU Advanced Databases / Spring 2023)

CMU Database Group59.7K views

CMU Advanced Databases (Spring 2023) lecture 1: the history of databases and recurring ideas.

Lecture 1: Algorithmic Thinking, Peak Finding

MIT OpenCourseWare6.01M views

MIT 6.006 lecture 1: algorithmic thinking via the peak-finding problem.

AlphaGo - The Movie | Full award-winning documentary

Google DeepMind38.5M views

The full feature documentary on DeepMind's AlphaGo and its 2016 match against Lee Sedol, including how the system was built and tested.

Paxos lecture (Raft user study)

Diego Ongaro114K views

Diego Ongaro's lecture on the Paxos consensus algorithm, recorded for the Raft user study.