
Lecture  Topic  Reading/Assignments/Notes  Due Date 
L1  Introduction to Machine Learning 
Read the introductory chapter of [M], [WF], [F] or [A]
See also lecture slides. 
week 1 
Supervised Learning Basics:  
L2  Instance based learning 
[M] Chapter 8 is cloest to class material;
or [RN] 18.8; or [DHS] 4.44.6.
Andrew Moore's tutorial on kdtrees See also lecture slides. 

L23  Decision Trees 
[M] Chapter 3;
or [RN] 18.14; or [F] Chapter 5.
See also lecture slides. 

Optional Reading  T. Dietterich, M. Kearns, and Y. Mansour Decision Tree Learning and Boosting Applying the Weak Learning Framework to Understand and Improve C4.5. International Conference on Machine Learning, 1996.  
Empirical/Programming Assignment 1  Project 1 and corresponding Data  9/17  
Written Assignment 1  Assignment 1  9/22  
L4  Naive Bayes Algorithm 
[M] 6.16.2, and 6.96.10;
[DHS] Section 2.9;
[F] 9.2; [WF] 4.2;
See also
new book chapter from [M]
See also lecture slides. Lecture also provided a basic introduction to probability and working with random variables. 

L5  Linear Threshold Units 
[M] 4.14.4; DHS 5.5;
See also
new book chapter from [M]
See also lecture slides. 

L6  Features (selection, transformation, discretization) 
Wrappers for Feature Subset Selection
Ron Kohavi, George H. John
Artificial Intelligence, 1996.
(Read till section 3.2 inclusive.)
Supervised and unsupervised discretization of continuous features. James Dougherty, Ron Kohavi, and Mehran Sahami. International Conference on Machine Learning, 1995. See also lecture slides. 

L67  Evaluating Machine Learning Outcomes 
[M] Ch 5; [F] Ch 12
See also lecture slides. 

Optional Reading 
Foster Provost, Tom Fawcett, Ron Kohavi
The Case Against Accuracy Estimation for Comparing Induction
Algorithms
Proc. 15th International Conf. on
Machine Learning, 1998.
T. Dietterich, Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms Neural Computation 10(7), 1998. Stephen Salzberg On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach Data Mining and Knowledge Discovery, 1997. 

Written Assignment 2  Assignment 2  10/1  
L8  Clustering 
[DHS] 10.67,10.9; [F] 8.45
See also lecture slides. 

Empirical/Programming Assignment 2  Project 2 and corresponding Data  10/15  
L910  Unsupervised and SemiSupervised Learning with EM 
[M] Section 6.12; [A] 7.4; [F] 9.4; [DHS] 3.9
Text Classification Using Labeled and Unlabeled Documents using EM Nigam et. al, Machine Learning Volume 39, pages 103134, 2000. (The entire paper is relevant; you can skip section 5.3) See also lecture slides . 

Written Assignment 3  Assignment 3  10/20  
L11  Review of math topics from recent lectures.  
L12  Association Rules 
[F] 6.3; [WF] 4.5
Mining Association Rules between Sets of Items in Large Databases Rakesh Agrawal, Tomasz Imielinski, Arun Swami Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, 1993. See also lecture slides. 

Optional Reading 
Real World Performance of Association Rule Algorithms
Zheng et al, KDD 2001.
Mining the Most Interesting Rules Bayardo et all, KDD 1999. Dynamic Itemset Counting and Implication Rules for Market Basket Data Brin et al, SIGMOD 1997. Discovering All Most Specific Sentences Gunopulos et al, TODS, 2003. 

(L14)  Midterm Exam 10/22 
Material for the exam includes everything covered up to October 15
(all the material above this point in the table).
Everything discussed in class is included for the exam.
The reading assignments are supporting materials that should be useful in review and study but I will not hold you responsible for details in the reading that were not discussed in class.
The Exam is closed book; no notes or books are allowed; no calculators or other machines of any sort are allowed. The exam will aim to test whether you have grasped the main concepts, problems, ideas, and algorithms that we have covered, including the intuition behind these. Generally speaking, the exam will not test your technical wizardry with overly long equations or calculations, but, on the other hand, it is sure to include some shorter ones. 

Empirical/Programming Assignment 3  Project 3 and corresponding Data  10/29  
L13,L15  Computational learning theory  [M] 7.1, 7.2, 7.3, 7.5, [RN] 18.5 and (for perceptron) [DHS] 5.5.2 or [CST] 2.1.1 