The following is a preliminary schedule of the lectures and presentations for CS 4033/5033 Machine Learning for Fall 2017. This specific order of each topic will depend on the class projects and interest. This will be finalized in the first week. The schedule will be updated throughout the semester as we delve deeper into special topics and/or add additional topics of interest. The project deadlines are in red and will not change, even if other parts of the schedule change.
| Date | Topic | Assigned Reading | Assigned today | Due today |
Week 1: Introduction |
||||
| Aug 21 | What is machine learning? What will I learn if I take this class? Types of machine learning. Overview of the course. | Elements of Statistical Learning (ESL), Chapter 1 | Pretest (in class) | |
Aug 23
|
ML Introduction, Project introduction, Machine Learning that matters | ML that Matters paper | Projects | |
Week 2: Reinforcment Learning 1 |
||||
| Aug 28 | Introduction to Reinforcement learning , Exploration & Exploitation | Sutton & Barto: Chapter 1 | HW 1 | |
| Aug 30 | Exploration & Exploitation, The RL Problem | Sutton & Barto: 2.1-2.3, 2.5-2.7 | HW 1 (Sep 1) | |
Week 3: Reinforcment Learning 2 |
||||
| Sep 4 | Labor Day (no class)
|
|||
| Sep 6 | Oral RL project proposals | Oral RL project proposals | ||
Week 4: Reinforcement learning 3 |
||||
| Sep 11 | The RL Problem | Sutton & Barto: Chapter 3 | Written RL project proposals | |
| Sep 13 | The RL Problem |
HW 2 | ||
Week 5: Reinforcment learning 4 |
||||
| Sep 18 | Temporal Difference learning | Sutton & Barto: Chapter 6 |
|
|
| Sep 20 | TD learning, Eligibility Traces, RL with Options, Advanced RL as needed for projects |
Sutton & Barto: Chapter 7 |
HW 2 (Sep 22) | |
Week 6: Introduction to Supervised learning, nearest neighbor methods, regression |
||||
Sep 25 | Introduction to SL, Nearest Neighbor, K-means clustering, |
ESL Chapter 2.1-2.3, ESL Chapter 3.1-3.2 | Short project checkpoint & Long checkpoint 1 |
|
| Sep 27 | Least Squares, Linear Regression, |
|
||
Week 7: Model evaluation and short RL projects |
||||
Oct 2 |
Ridge, Lasso, and Elastic nets Logistic regression Overfitting, Bias-Variance Tradeoff, Model selection, Model evaluation |
Ridge/Lasso/Elastic: ESL Chapter 3.3-3.8 Logistic: Wikipedia and ESL Chapter 4.4 ESL Chapter 7 |
HW 3 | |
Oct 4 |
Oral Short RL project presentations As time allows: Decision trees |
Oral Short RL projects due |
||
Week 8: Tree-based methods and long SL projects |
||||
| Oct 9 | Decision trees |
ESL Chapter 9.2 |
||
| Oct 11 | Oral Long SL project proposals As time allows: Decision trees
|
Oral Long SL project proposals, Written Short RL projects | ||
Week 9: Ensembles and Introduction to Neural Networks |
||||
Oct 16 |
Decision trees, and ensemble methods |
|
Written Long SL project proposals, Long RL checkpoint 2 |
|
| Oct 18 | Boosting, Bagging, Ensemble methods, Random Forests and Gradient Boosted Regression Trees |
ESL Chapter 8.7, ESL Chapter 10, ESL Chapter 15 |
HW 3 (Oct 20) | |
Week 10: Neural Nets |
||||
Oct 23 |
Neural Networks |
ESL Chapter 11 | HW 4 | |
Oct 25 |
Backpropagation |
|
||
Week 11: Neural Nets, Long RL projects, Deep learning |
||||
| Oct 30 | Model evaluation and verification |
|||
Nov 1 |
Oral Long RL project presentations As time allows: Convolutional Neural Nets/Deep learning |
Neural Networks and Deep Learning chapter 6 and see the readings on Canvas | Oral Long RL projects, Long SL checkpoint 1 | |
Week 12: Deep learning and Short SL projects |
||||
| Nov 6 | Convolutional Neural Nets/Deep learning |
Neural Networks and Deep Learning chapter 6 and see the readings on Canvas |
HW 5 | HW 4 |
| Nov 8 | Oral Short SL project proposals As time allows: Convolutional Neural Nets/Deep learning |
Written long RL projects, Oral Short SL project proposals | ||
Week 13: Deep learning |
||||
| Nov 13 | Convolutional Neural Nets/Deep learning |
|
Written SL project proposals | |
| Nov 15 | Convolutional Neural Nets/Deep learning |
|
HW 6 | HW 5 |
Week 14: Deep learning and deep RL |
||||
| Nov 20 | AlphaZero: Deep RL | AlphaZero paper | Short SL checkpoint, Long SL checkpoint 2 | |
| Nov 22 | Thanksgiving vacation |
|||
Week 15: Kernel methods, SVR, SVM |
||||
| Nov 27 | Kernel methods, Support Vector Machines, Kernel trick, SVR, SVMs |
ESL Chapter 11 |
||
| Nov 29 | SVMs continued |
HW 6 | ||
Week 16: Project presentations |
||||
| Dec 4 | All SL project presentations (long ones go first) | Oral SL projects: long projects present first | ||
| Dec 6 | All SL project presentations (short ones and remaining long ones) | Oral SL projects: short projects present second | ||
Week 17: Final |
||||
| Dec 13, 4:30-6:30 | Final project writeup due |
|||