9:18L10: Actor-Critic Methods (P1-The simplest Actor-Critic) —Mathematical Foundations of RL
A 9-minute video from WINDY Lab: “L10: Actor-Critic Methods (P1-The simplest Actor-Critic) —Mathematical Foundations of RL”.
WINDY Lab
4.48K subscribers on YouTube
Shorts, livestreams, trailers and promos are never listed. Unless a curator approved this channel in full, only individually picked videos appear.
9:18
12:41L10: Actor-Critic Methods (P2-Advantage Actor-Critic) —Mathematical Foundations of RL
A 13-minute video from WINDY Lab: “L10: Actor-Critic Methods (P2-Advantage Actor-Critic) —Mathematical Foundations of RL”.
16:48L10: Actor-Critic Methods (P3-Importance sampling & off-policy Actor-Critic) —Math Foundations of RL
A 17-minute video from WINDY Lab: “L10: Actor-Critic Methods (P3-Importance sampling & off-policy Actor-Critic) —Math Foundations of RL”.
9:59L10: Actor-Critic Methods (P4-Deterministic Actor-Critic) —Mathematical Foundations of RL
A 10-minute video from WINDY Lab: “L10: Actor-Critic Methods (P4-Deterministic Actor-Critic) —Mathematical Foundations of RL”.
13:29L1: Basic Concepts (P1-State, action, policy, ...)—Mathematical Foundations of RL
Intro
A 13-minute video from WINDY Lab: “L1: Basic Concepts (P1-State, action, policy, ...)—Mathematical Foundations of RL”.
14:33L1: Basic Concepts (P2-Reward,return, Markov decision process)—Mathematical Foundations of RL
Intro
A 15-minute video from WINDY Lab: “L1: Basic Concepts (P2-Reward,return, Markov decision process)—Mathematical Foundations of RL”.
13:29L2: Bellman Equation (P1-Motivating examples)—Mathematical Foundations of RL
A 13-minute video from WINDY Lab: “L2: Bellman Equation (P1-Motivating examples)—Mathematical Foundations of RL”.
5:29L2: Bellman Equation (P2-State value)—Mathematical Foundations of RL
Intro
A 5-minute video from WINDY Lab: “L2: Bellman Equation (P2-State value)—Mathematical Foundations of RL”.
11:40L2: Bellman Equation (P3-Bellman equation-Derivation)—Mathematical Foundations of RL
Intro
A 12-minute video from WINDY Lab: “L2: Bellman Equation (P3-Bellman equation-Derivation)—Mathematical Foundations of RL”.
10:25L2: Bellman Equation (P4-Matrix-vector form and solution)—Mathematical Foundations of RL
Intro
A 10-minute video from WINDY Lab: “L2: Bellman Equation (P4-Matrix-vector form and solution)—Mathematical Foundations of RL”.
7:06L2: Bellman Equation (P5-Action value)—Mathematical Foundations of RL
A 7-minute video from WINDY Lab: “L2: Bellman Equation (P5-Action value)—Mathematical Foundations of RL”.
5:55L3: Bellman Optimality Equation (P1-Motivating example)—Mathematical Foundations of RL
A 6-minute video from WINDY Lab: “L3: Bellman Optimality Equation (P1-Motivating example)—Mathematical Foundations of RL”.
9:07L3: Bellman Optimality Equation (P2-Optimal policy)—Mathematical Foundations of RL
A 9-minute video from WINDY Lab: “L3: Bellman Optimality Equation (P2-Optimal policy)—Mathematical Foundations of RL”.
8:05L3: Bellman Optimality Equation (P3-More)—Mathematical Foundations of RL
Intro
A 8-minute video from WINDY Lab: “L3: Bellman Optimality Equation (P3-More)—Mathematical Foundations of RL”.
11:26L3: Bellman Optimality Equation (P4-Interesting properties)—Mathematical Foundations of RL
A 11-minute video from WINDY Lab: “L3: Bellman Optimality Equation (P4-Interesting properties)—Mathematical Foundations of RL”.
12:14L4: Value Iteration and Policy Iteration (P3-Truncated policy iteration)—Math Foundations of RL
A 12-minute video from WINDY Lab: “L4: Value Iteration and Policy Iteration (P3-Truncated policy iteration)—Math Foundations of RL”.
10:15L4: Value Iteration and Policy Iteration (P1-Value iteration)—Mathematical Foundations of RL
A 10-minute video from WINDY Lab: “L4: Value Iteration and Policy Iteration (P1-Value iteration)—Mathematical Foundations of RL”.
12:25L4: Value Iteration and Policy Iteration (P2-Policy iteration)—Mathematical Foundations of RL
A 12-minute video from WINDY Lab: “L4: Value Iteration and Policy Iteration (P2-Policy iteration)—Mathematical Foundations of RL”.
5:36L5: Monte Carlo Learning (P1-Motivating examples-Monte Carlo)—Mathematical Foundations of RL
A 6-minute video from WINDY Lab: “L5: Monte Carlo Learning (P1-Motivating examples-Monte Carlo)—Mathematical Foundations of RL”.
7:45L5: Monte Carlo Learning (P2-MC Basic-introduction)—Mathematical Foundations of RL
A 8-minute video from WINDY Lab: “L5: Monte Carlo Learning (P2-MC Basic-introduction)—Mathematical Foundations of RL”.
9:34L5: Monte Carlo Learning (P3-MC Basic-examples)—Mathematical Foundations of RL
A 10-minute video from WINDY Lab: “L5: Monte Carlo Learning (P3-MC Basic-examples)—Mathematical Foundations of RL”.
6:21L5: Monte Carlo Learning (P5-MC Epsilon-Greedy-introduction)—Mathematical Foundations of RL
A 6-minute video from WINDY Lab: “L5: Monte Carlo Learning (P5-MC Epsilon-Greedy-introduction)—Mathematical Foundations of RL”.
10:41L5: Monte Carlo Learning (P6-MC Epsilon-Greedy-examples)—Mathematical Foundations of RL
A 11-minute video from WINDY Lab: “L5: Monte Carlo Learning (P6-MC Epsilon-Greedy-examples)—Mathematical Foundations of RL”.
8:57L5: Monte Carlo Learning(P4-MC Exploring Starts)—Mathematical Foundations of RL
A 9-minute video from WINDY Lab: “L5: Monte Carlo Learning(P4-MC Exploring Starts)—Mathematical Foundations of RL”.
8:47L6: Stochastic Approximation and SGD (P1-Motivating example) —Mathematical Foundations of RL
A 9-minute video from WINDY Lab: “L6: Stochastic Approximation and SGD (P1-Motivating example) —Mathematical Foundations of RL”.
8:22L6: Stochastic Approximation and SGD (P2-RM algorithm: introduction) —Mathematical Foundations of RL
A 8-minute video from WINDY Lab: “L6: Stochastic Approximation and SGD (P2-RM algorithm: introduction) —Mathematical Foundations of RL”.
11:14L6: Stochastic Approximation and SGD (P3-RM algorithm: convergence) —Mathematical Foundations of RL
A 11-minute video from WINDY Lab: “L6: Stochastic Approximation and SGD (P3-RM algorithm: convergence) —Mathematical Foundations of RL”.
5:29L6: Stochastic Approximation and SGD (P4-SGD algorithm: introduction) —Math Foundations of RL
A 5-minute video from WINDY Lab: “L6: Stochastic Approximation and SGD (P4-SGD algorithm: introduction) —Math Foundations of RL”.
8:01L6: Stochastic Approximation and SGD (P5-SGD algorithm: examples) —Mathematical Foundations of RL
A 8-minute video from WINDY Lab: “L6: Stochastic Approximation and SGD (P5-SGD algorithm: examples) —Mathematical Foundations of RL”.
9:40L6: Stochastic Approximation and SGD (P6-SGD algorithm: properties) —Mathematical Foundations of RL
A 10-minute video from WINDY Lab: “L6: Stochastic Approximation and SGD (P6-SGD algorithm: properties) —Mathematical Foundations of RL”.
7:59L6: Stochastic Approximation and SGD (P7-SGD algorithm: comparison) —Mathematical Foundations of RL
A 8-minute video from WINDY Lab: “L6: Stochastic Approximation and SGD (P7-SGD algorithm: comparison) —Mathematical Foundations of RL”.
6:51L7: Temporal-Difference Learning (P1-Motivating example) —Mathematical Foundations of RL
A 7-minute video from WINDY Lab: “L7: Temporal-Difference Learning (P1-Motivating example) —Mathematical Foundations of RL”.
10:29L7: Temporal-Difference Learning (P2-TD algorithm: introduction) —Mathematical Foundations of RL
A 10-minute video from WINDY Lab: “L7: Temporal-Difference Learning (P2-TD algorithm: introduction) —Mathematical Foundations of RL”.
12:42L7: Temporal-Difference Learning (P3-TD algorithm: convergence) —Mathematical Foundations of RL
A 13-minute video from WINDY Lab: “L7: Temporal-Difference Learning (P3-TD algorithm: convergence) —Mathematical Foundations of RL”.
11:12L7: Temporal-Difference Learning (P4-Sarsa) —Mathematical Foundations of RL
A 11-minute video from WINDY Lab: “L7: Temporal-Difference Learning (P4-Sarsa) —Mathematical Foundations of RL”.
10:03L7: Temporal-Difference Learning (P5-Expected Sarsa & n-step Sarsa) —Mathematical Foundations of RL
A 10-minute video from WINDY Lab: “L7: Temporal-Difference Learning (P5-Expected Sarsa & n-step Sarsa) —Mathematical Foundations of RL”.