CSCE 478/878 (Fall 2004) lecture slides
-
Lectures 0 and 1: Administrivia and Introduction, Aug 23-25, Chapter 1
(ps1up,
pdf1up,
ps4up,
pdf4up)
Also see:
- My slides introducing machine learning to
the Future Problem Solving Program at Central Community College
-
Lecture 2: Concept Learning and the General-to-Specific Ordering,
Aug 25-30, Chapter 2
(ps1up,
pdf1up,
ps4up,
pdf4up)
- Homework 0 due Aug 30
- Prerequisite test due Sep 3
- Labor Day, Sep 6, no class
-
Lecture 3: Decision Trees, overfitting, Occam's razor,
Sep 10-17, Chapter 3
(ps1up,
pdf1up,
ps4up,
pdf4up)
Also see:
-
Lecture 4: Artificial Neural Networks and Support Vector Machines
Sep 19-Oct 4, Chapter 4, Section 7.4.4, Littlestone
paper, handout from Christianini and Shawe-Taylor's book
(pdf1up,
pdf4up)
Topic summary 3 due Wednesday, Oct 13
Also see:
- Manfred K. Warmuth,
who has done much work on EG and Winnow. Many papers available on-line,
including his GD/EG paper:
- Nick Littlestone (creator of Winnow) and some of his papers:
- Avrim Blum and his survey paper
``On-Line Algorithms in Machine Learning''
- Notes from CSCE 970 on nonlinear classifiers [on the intuition behind
using multiple layers to remap the input space]
(pdf4up)
- ANN growing and pruning:
- SVMs:
- Muller, K.-R., Mika, S., Ratsch, G., Tsuda, K., and Scholkopf, B.
An introduction
to kernel-based learning algorithms.
IEEE Transactions on Neural Networks, 12(2):181-201,
2001.
- Christopher Burges.
A
tutorial on support vector machines for pattern recognition
- Nello Cristianini
and John Shawe-Taylor.
An Introduction to Support Vector Machines.
Cambridge University Press, 2000.
- Richard Duda,
Peter Hart, and David Stork.
Pattern Classification, 2nd Edition.
[also see software supplements]
John Wiley, 2001.
(Section 5.11)
- SVM tutorial
- KernelMachines.org
- Sebastian Thrun's links
-
Lecture 5: Evaluating Hypotheses
Oct 13-22, Chapter 5 and ROC tutorial
(pdf1up,
pdf4up)
Topic summary 4 due Friday, Oct 29
Also see:
- Fall break, Oct 18, no class
-
Lecture 6: Combining Classifiers: Weighted Majority, Bagging and
Boosting,
Oct 22-27, Section 7.5.4, Breiman paper, Freund & Schapire paper
(pdf1up,
pdf4up)
Also see:
-
Lecture 7: Bayesian learning,
Nov 1-10, Chapter 6
(pdf1up,
pdf4up)
Also see:
-
Lecture 8: Instance-based learning,
Nov 19-22, Chapter 8
(pdf1up,
pdf4up)
Also see:
- Thanksgiving holiday, Nov 24-26, no class
-
Lecture 8.5: How to give a good research talk,
Nov 29,
(pdf1up,
pdf1up)
Also see:
-
Lecture 9: Reinforcement learning,
Dec 1-3, Chapter 13
(pdf1up,
pdf4up)
Also see:
-
Project presentations, Dec 6-10
(dead week)
- Project reports due Dec 10
Return to the CSCE 478/878 (Fall 2004) Home Page
Last modified 16 August 2011; please report problems to
sscott.