CSCE 478/878 (Fall 2014) lecture slides

• Lectures 0 and 1: Administrivia and Introduction, Aug 26–28, Chapters 1–2 (pdf6up)
  Also see:
  • Domingos article on machine learning
  • Andrew Ng's Lecture 1 of his course at Stanford
  • Andrew Ng's Lecture 2 of his course at Stanford (discusses autonomous vehicle)


• Homework 0 due Sep 2


• Lecture 2: Supervised Learning, Sep 2–4, Chapter 2 (pdf1up, pdf6up)


• Homework 0.5 due Sep 9


• Lecture 3: Decision Trees, Sep 4–11, Chapter 9 (pdf1up, pdf6up)
  Also see:
  • Manuals/tutorials for C4.5


• Homework 1 due Sep 28


• Homework 1.5 due Sep 18


• Lecture 4: Experimental Design and Analysis Sep 18–25, Chapter 19 and ROC tutorial (pdf1up, pdf6up)
  Also see:
  • Tom Fawcett. An Introduction to ROC Analysis. Pattern Recognition Letters, 27:861-874. 2006.
  • ICML 04 ROC tutorial by Peter Flach
  • Thomas G. Dietterich. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation 10(7):1895–1924.
  • Chris Drummond and Robert C. Holte Cost curves: An improved method for visualizing classifier performance. Machine Learning, 65(1):95–130, 2006.


• Lecture 5: Artificial Neural Networks and Support Vector Machines Sep 30–Oct 9, Chapters 10, 11, and 13 (pdf1up, pdf6up)


• Homework 2 due Thursday, October 23


• Mini-Homework 2.5 due Friday, October 17


• Lecture 6: Bayesian learning, Oct 23–30, Chapter 14 (pdf1up, pdf6up)
  Also see:
  • Nir Friedman and Daphne Koller. Learning Bayesian Networks from Data (NIPS tutorial).
  • Pedro Domingos and Michael Pazzani. Beyond independence: Conditions for the optimality of the simple bayesian classifier. In Proceedings of the 13th International Conference on Machine Learning, 1996.
  • Stuart Russell and Peter Norvig. Artificial Intelligence: A Modern Approach, Third Edition. Prentice Hall, 2009.
  • Richard E. Neapolitan. Learning Bayesian Networks. Prentice Hall, 2004.
  • Neapolitan's KDD lecture on causality
  • Russ Greiner's page of links on Bayes nets
  • Tom Dietterich's course on Probabilistic Relational Models
  • Geiger et al.'s paper on algorithms for d-separation
  • Judea Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Probabilistic Inference. Morgan Kauffmann, 1988.
  • Daphne Koller, Nir Friedman, Lise Getoor, and Ben Taskar. Graphical Models in a Nutshell.


• Homework 3 due Sunday, November 9


• Mini-Homework 3.5 due Friday, November 7


• Lecture 7: Bagging and Boosting, Nov 4, Chapter 17, Breiman paper, Freund & Schapire paper (pdf1up, pdf6up)
  Also see:
  • Leo Breiman. Bagging predictors. Technical Report 421. Dept. of Statistics, University of California-Berkeley. September 1994.
  • Yoav Freund and Robert Schapire. A short introduction to boosting. Journal of Japanese Society for Artificial Intelligence 14(5):771–780, September, 1999. [Other introductory and advanced papers are available at Freund's and Schapire's pages.]
  • Robert Schapire and Yoav Freund. Boosting: Foundations and Algorithms. MIT Press, 2012. ISBN 0-262-01718-0.
  • Nick Littlestone and Manfred K. Warmuth. The weighted majority algorithm.
  Information and Computation 108(2):212–261. February 1994.


• Lecture 8: Clustering, Nov 6–13, Chapter 7 (pdf1up, pdf6up)


• Optional Homework 4 due Tuesday, November 25


• Lecture 9: Hidden Markov Models, Nov 13–25, Chapter 7 (pdf1up, pdf6up)
  Also see:
• Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids, by Richard Durbin, Sean Eddy, Anders Krogh, and Graeme Mitchison. Cambridge University Press, 1998. ISBN 0-521-62971-3.
• Section 9.6 of Pattern Recognition by Sergios Theodoridis and Konstantinos Koutroumbas
• K. Sjölander, K. Karplus, M. Brown, R. Hughey, A. Krogh, I. S. Mian, and D. Haussler. Dirichlet mixtures: A method for improving detection of weak but significant protein sequence homology. Computer Applications in the Biosciences (CABIOS), 12(4):327–345, 1996.


• Lecture 10: How to give a good research talk, Nov 20 (pdf1up, pdf6up)
  Also see:
  • Tips on Presenting Technical Material
  • Guidelines for Presentations by Daniele Radicioni, 2008


• Thanksgiving holiday, Nov 27, no class


• Project presentations, Dec 2–11


• Project reports due Dec 10 15

Last modified 02 December 2014; please report problems to sscott.