Skip to main content Tentative Topics
Introduction
Exact Solution Methods
- Dynamic programming
- Monte Carlo methods
- TD learning
Approimate Solution Methods
- Value function approximation
- Policy gradient methods
- Actor-critic methods
- Model-based RL and online planning
Advanced Topics
- Successor models
- Hierarchical RL
- Safe RL? Meta-RL?
- Multi-agent RL
Schedule
Week 1 (Introduction)
Week 2 (Exact Solution Methods)
- Tues Jan 24
- LEC 3Dynamic Programming
- Thu Jan 26
- LEC 3Dynamic Programming
Week 3
- Tues Jan 31
- NO CLASS
- Thu Feb 2
- NO CLASS
Week 4
Week 5
- Tues Feb 14
-
- LEC 5Model-free Control
- HW1Exact Methods
- Thu Feb 16
- LEC 5Model-free Control
Week 6 (Approximate Solution Methods)
- Tues Feb 21
- LEC 6Value Function Approx.
- Thu Feb 23
- LEC 6Value Function Approx.
Week 7
- Tues Feb 28
-
- LEC 7Policy Gradient
- PROJAssignment HW1 PR DUE
- Thu Mar 2
- NO CLASS (code review)
- Fri Mar 3
-
- NO CLASS
- HW1 CR DUE
Week 8
- Tues Mar 7
-
- LEC 7Policy Gradient
- HW1 DUE
- LIT 1.1Value Function Approx.
- Thu Mar 9
-
- LEC 8Model-based RL and Online Planning
- PROJProposal Sign-up
- LIT 1.2Value Function Approx.
Week 9
- Tues Mar 14
- NO CLASS (spring break)
- Thu Mar 16
- NO CLASS (spring break)
Week 10 (Advanced Topics)
- Tues Mar 21
-
- LEC 9Successor Models
- HW2DQN
- Thu Mar 23
-
- NO CLASS (project proposal)
- SURVEYSurvey 2
Week 11
- Tues Mar 28
- LEC 10Hierarchical RL
- LIT 2.1Policy Gradient
- Thu Mar 30
-
- LEC 10Hierarchical RL
- HW2 PR DUE
- LIT 2.2Policy Gradient
- Sun Apr 2
-
- NO CLASS
- HW2 CR DUE
Week 12
- Tues Apr 4
-
- LEC 11Hierarchical RL
- HW2 DUE
- LIT 3.1RL Applications
- Thu Apr 6
-
- LEC 12Multi-agent RL
- HW3REINFORCE
- LIT 3.2RL Applications
Week 13
- Tues Apr 11
- LEC 12Multi-agent RL
- LIT 4.1Successor models
- LIT 4.2Successor models
- Thu Apr 13
- LEC 12Multi-agent RL
- LIT 5.1Hierarchical RL
- LIT 5.2Hierarchical RL
Week 14
- Tues Apr 18
-
- LEC 12Multi-agent RL
- HW3 PR DUE
- LIT 6.1MARL
- Wed Apr 19
-
- NO CLASS
- HW3 CR DUE
- Thurs Apr 20
-
- LEC 12Multi-agent RL
- HW3 DUE
- LIT 6.2MARL
Week 15
- Tues Apr 25
-
- PROJProject presentations
- PROJ DUE
- Thurs Apr 27
- PROJProject presentations
Week 16
- Tues May 2
- PROJProject presentations
- Thu May 4
- NO CLASS