Lectures & Deadlines
Slides will be posted after each lecture. For exact milestone due dates and times, check Canvas.
This schedule is tentative, especially the topics of later lectures.
SLP = Speech and Language Processing by Dan Jurafsky and James H. Martin.
| # | Date | Topic | Slides | Resources | Deadlines |
|---|---|---|---|---|---|
| 1 | Sep 2 | Introduction | Christopher D. Manning. 2022. Human Language Understanding and Reasoning. Daedalus 151(2): 134–145 Chris Olah’s Research Taste Exercises Eugene Vinitsky’s Unsolicited Guide Four Categories of Acceptable Papers | - | |
| - | Sep 7 | Labor Day (no class) | - | - | - |
| 2 | Sep 9 | Text Representations | SLP ch 5 | - | |
| 3 | Sep 14 | Language Models and RNNs | SLP ch 3, ch 14 | ||
| 4 | Sep 16 | Transformers | The Annotated Transformer The Illustrated Transformer | - | |
| 5 | Sep 21 | Pre-training | SLP ch 7 | Project Brainstorming due Sept 22 | |
| 6 | Sep 23 | Project Proposal Presentations | - | - | |
| 7 | Sep 28 | Post-training | SLP ch 8, Nathan Lambert’s RLHF Book. | - | |
| 8 | Sep 30 | Prompting & Fine-tuning | Scratchpads, Nye et al. 2021 CoT, Wei et al. 2023 LoRA, Hu et al. 2021 QLoRA, Dettmers et al. 2023 | Brainstorming Peer Feedback due Oct 1 | |
| 9 | Oct 5 | Reasoning | TBD | Project Proposal due Oct 5 | |
| 10 | Oct 7 | In Class Assignment I | - | - | |
| 12 | Oct 12 | Guest Lecture - Rulin Shao | Rulin’s website | - | |
| 13 | Oct 14 | Guest Lecture - Sara Kangaslahti | Sara’s website | - | |
| 14 | Oct 19 | Long Contexts & Experts | TBD | - | |
| 15 | Oct 21 | Evaluation & Benchmarks | TBD | Midterm Presentation Slides due Oct 25 | |
| 16 | Oct 26 | Midterm Project Presentations | - | - | |
| 17 | Oct 28 | Midterm Project Presentations | - | - | |
| 18 | Nov 2 | Multilinguality | TBD | Midterm Peer Feedback due Nov 2 | |
| 19 | Nov 4 | Guest Lecture - Mayee Chen | Mayee’s website | - | |
| 20 | Nov 9 | Guest Lecture - Nishant Balepur | Nishant’s website | - | |
| 21 | Nov 11 | Multimodality | TBD | - | |
| 22 | Nov 16 | Retrieval & RAG | TBD | - | |
| 23 | Nov 18 | Language Agents | TBD | - | |
| 24 | Nov 23 | Interpretability | TBD | - | |
| 25 | Nov 25 | Safety, Societal Impact, & Fairness | TBD | - | |
| 26 | Nov 30 | In-Class Assignment II | - | - | |
| 27 | Dec 2 | Guest Lecture - ???? | - | - | |
| 28 | Dec 7 | Guest Lecture - ???? | - | Final Project Report due Dec 7 | |
| 29 | Dec 9 | Poster Session | - | - | Poster due Dec 9 |