Schedule
Lectures are Tuesday and Thursday, 9:30–10:59 AM in The Gateway Building 1210. Discussion sections meet on Friday. Homework is nominally due on Wednesday at 10:59 PM. Class notes and iPad notes are linked from the schedule as they are posted.
The topic schedule is tentative and will be adjusted during the semester based on student and instructor feedback, as well as developments in the field.
Week 0: Introduction
| Tue, Aug 25 | ||
| Wed, Aug 26 | ||
| Thu, Aug 27 | Lecture 0Intros, Logistics, high-level themes/goals Class notes |
|
| Fri, Aug 28 |
Week 1: Basic Principles and Optimization
| Tue, Sep 01 | Lecture 1Basic Principles Class notes |
|
| Wed, Sep 02 | ||
| Thu, Sep 03 | ||
| Fri, Sep 04 |
Week 2: Optimization and History
| Tue, Sep 08 | ||
| Wed, Sep 09 | ||
| Thu, Sep 10 | Lecture 4History and Retrospective |
|
| Fri, Sep 11 |
Week 3: Misfitting
| Tue, Sep 15 | Lecture 5Misfitting |
|
| Wed, Sep 16 | ||
| Thu, Sep 17 | Lecture 6Guest lecture (Sizhe) Slides |
|
| Fri, Sep 18 |
Week 4: Maximal Update Parameterization (μP)
| Tue, Sep 22 | Lecture 7RMS RMS norm, Maximal update parameterization (μP) iPad notes |
|
| Wed, Sep 23 | ||
| Thu, Sep 24 | Lecture 8MuP iPad notes |
|
| Fri, Sep 25 |
Week 5: Convolutional Neural Networks
| Tue, Sep 29 | Lecture 9Convolutional neural nets |
|
| Wed, Sep 30 | ||
| Thu, Oct 01 | Lecture 10Convolutional neural nets (Continued) |
|
| Fri, Oct 02 |
Week 6: Convolutional and Graph Neural Networks
| Tue, Oct 06 | Lecture 11Convolutional neural nets (Continued) |
|
| Wed, Oct 07 | Homework 5 Due Worksheet |
|
| Thu, Oct 08 | Lecture 12Graph Neural Nets |
|
| Fri, Oct 09 | Discussion 7 |
Week 7
| Wed, Nov 11 | Veterans Day — campus closed
|
Week 8
| Fri, Nov 27 | Thanksgiving holiday — campus closed, no discussion sections
|