Introduction to Machine Learning (CS 590 and STAT 598A)
CS 59000-030 and STAT 59800 VS1, Spring 2010

Class 9:00 - 10:15am TTh
Location LWSN B134
Instructor S V N Vishwanathan (email: vishy)
Office HAAS 232
Telephone 765 494 0033
Office Hours Tue: 2 - 3pm or by appointment

Course Description

Prerequisites

Topics (Tentative)

Class Notes and Homework

Schedule

Dates Topics HW Handouts and Readings Lab Notes and Code Examples
01/12 Introduction and Motivation  Lecture 1 Slides 
01/14 A Taste of Machine Learning  Chapter 1 
01/19 Bayes Rule and Naive Bayes  Chapter 1 
01/21 Mean Classifier and Nearest Neighbors  Chapter 1 
01/26 Perceptron and K-MeansHW 1 Chapter 1 
01/28 Parametric Density Estimation  Chapter 2 
02/02 Nonparametric Density Estimation  Chapter 2 
02/04 Nonparametric Density Estimation  Chapter 2 
02/09 Exponential Families  Chapter 2 
02/11 Logistic Regression  Chapter 6 
02/16 SamplingHW 2 Chapter 2 
02/18 Sampling  Chapter 2 
02/23 Convex Functions  Chapter 5 
02/25 Gradient Descent  Chapter 5 
03/02 Newton's Algorithm  Chapter 5 
03/04 BFGSHW 3 Chapter 5 
03/09 Conjugate Gradient  Chapter 5 
03/11 Constrained OptimizationProject Guidelines Chapter 5 
03/22 BoostingHW 4 Boosting Slides 
03/25 Boosting  Boosting Slides 
03/29 Mid-term    
04/01 Support Vector Machines  Chapter 8 
04/06 Class Cancelled    
04/08 Support Vector MachinesHW 5 Chapter 8 
04/13 Support Vector Machines  Chapter 8 
04/15 Support Vector Machines  Chapter 8 
04/20 Support Vector Machines  Chapter 8 
04/22 Support Vector Machines  Chapter 8 
04/27 Statistical Learning Theory  Prof. Jian Zhang 
04/29 Statistical Learning Theory  Prof. Jian Zhang 
Updates:
01/13: Slides from Lecture 1 posted.
01/14: Chapter 1 posted.
01/25: HW 1 posted.
02/01: Chapter 2 posted.
02/16: HW 2 posted.
02/28: Chapter 5 posted.
02/28: Chapter 1 bug fixed version posted.
02/28: Chapter 2 bug fixed version posted.
03/05: Chapter 5 substantially revised version posted.
03/05: HW 3 posted.
03/11: Chapter 5 more revisions version posted.
03/11: Project guidelines posted
03/25: Notes for all chapters revised and bugfixed
03/25: Boosting slides updated
03/25: Logistic regression notes posted
04/07: Support vector machine notes posted
04/07: HW5 posted
04/26: Support vector machine notes updated
04/26: Statistical Learning Theory notes posted

Frequently Asked Questions

Grading and other Policies