Fall 2023 Course Syllabus: Math 680
Course Title: |
Advanced Statistical Learning |
Textbook: |
The Elements of Statistical Learning: Data Mining, Inference, and Prediction, by Hastie, Tibshirani, and Friedman; Publisher: Springer; 2nd edition, 2009; ISBN: 978-0387848570.
|
Reference
Books: |
An Introduction to Statistical Learning: with Applications in R, by James, Witten, Hastie, and Tibshirani (2021), 2nd edition, Springer.An Introduction to Statistical Learning: with Applications in Python, by James, Witten, Hastie, and Tibshirani (2023), 1st edition, Springer. |
Prerequisites: |
Math 478 or Math 678, or permission by instructor |
Course
Outline |
||||
Date |
Lecture |
Chapter |
Topic |
Assignment |
Week 1 9/5 |
1 |
Chapter 1 |
Overview and Introduction, Application Examples.
|
|
Week 2 9/12 |
2 |
Chapter 2 |
|
|
Week 3 9/19 |
3 |
Chapter 4 |
Binary Classification (I): Basics
Binary Classification (II): Logistic Regression, Discriminant Analysis |
Homework 1 |
Week 4 9/26 |
4 |
Chapter 2 |
Multiclass Classifications |
|
Week 5 10/3 |
5 |
Chapter 4 |
Nonlinear Classification Methods: K-nearest neighbor (KNN) methods |
|
Week 6 10/10 |
6 |
Chapter 4 |
Nonlinear Discriminant Analysis: QDA and RDA |
Homework 2 |
Week 7 10/17 |
7 |
Chapter 14.5 & 3 |
Linear Regression Models |
|
Week 8 10/24 |
|
|
Variable Selection for Linear Regression
Shrinkage Methods by LASSO |
|
Week 9 10/31 |
8 |
Chapter 3 & 7 |
Model Selection and Assessment |
Homework 3 |
Week 10 11/7 |
9 |
Chapter 4.5 & 12
|
Support Vector Machines |
|
Week 11 11/14 |
10 |
Chapter 9 & 8.7 |
Tree-based Methods |
|
Week 12 11/21 |
11 |
|
Tuesday, Nov 21, 2023 (Thursday Classes Meet)
FINAL EXAM: Wednesday, Nov 22, 2023 (Friday Classes Meet) Friday, Nov 24: Thanksgiving Recess |
Homework 4 |
Week 13 11/28 |
12 |
Lecture notes |
Uncertainty Quantification (I): Standard conformal prediction |
|
Week 14 12/5 |
13 |
Lecture notes |
Uncertainty Quantification (II): Conformal prediction under distribution shift
|
|
Week 15 12/12 |
|
|
Students’ Project Presentation
|
|
IMPORTANT
DATES |
|
FIRST DAY OF SEMESTER |
September 5, 2023 |
LAST DAY TO WITHDRAW |
November 13, 2023 |
LAST DAY OF CLASSES |
December 13, 2023 |
FINAL EXAM PERIOD |
December 17 – 23, 2023 |
Grading Policy
Assignment Weighting |
|
Tentative Grading Scale |
||
Homework |
20 % |
|
A |
90 -- 100 |
Project |
40 % |
|
B+ |
85 -- 90 |
Final Exam |
40 % |
|
B |
80 -- 85 |
|
C+ |
75 -- 80 |
||
|
|
|
C |
70 -- 75 |
|
|
|
F |
0 -- 70 |
Important Departmental and University
Policies
Prepared by Prof. Wenge Guo, September 1, 2023