CSCE 478/878 (Fall 2010) lecture slides
-
Lectures 0 and 1: Administrivia and Introduction, Aug 23–25, Chapter 1
(pdf6up)
Also see:
-
Lecture 2: Concept Learning and the General-to-Specific Ordering,
Aug 25–Sep 3, Chapter 2
(pdf6up)
-
Lecture 3: Decision Trees, overfitting, Occam's razor,
Sep 3–15, Chapter 3
(pdf6up)
Also see:
- Labor Day Sep 6; no
class
-
Lecture 4: Artificial Neural Networks and Support Vector Machines
Sep 24–Oct 13, Chapter 4, Section 7.4.4, Littlestone
paper, handout from Christianini and Shawe-Taylor's book
(pdf6up)
Also see:
- Manfred K. Warmuth,
who has done much work on EG and Winnow. Many papers available on-line,
including his GD/EG paper:
- Jyrki Kivinen and
Manfred K. Warmuth.
Exponentiated gradient versus gradient descent for linear predictors.
Information and Computation 132(1):1–64, January 1997.
- Nick Littlestone (creator of Winnow) and some of his papers:
- Avrim Blum and his survey paper
``On-Line Algorithms in Machine Learning''
- Notes from CSCE 970 on nonlinear classifiers [on the intuition behind
using multiple layers to remap the input space]
(pdf4up)
- ANN growing and pruning:
- SVMs:
- Muller, K.-R., Mika, S., Ratsch, G., Tsuda, K., and Scholkopf, B.
An introduction
to kernel-based learning algorithms.
IEEE Transactions on Neural Networks, 12(2):181-201,
2001.
- Nello Cristianini and John Shawe-Taylor.
An Introduction to Support Vector Machines.
Cambridge University Press, 2000.
- Richard Duda,
Peter Hart, and David Stork.
Pattern Classification, 2nd Edition.
John Wiley, 2001.
(Section 5.11)
- SVM tutorial
- KernelMachines.org
- Sebastian Thrun's links
-
Lecture 5: Evaluating Hypotheses
Oct 6–Oct 20, Chapter 5 and ROC tutorial
(pdf6up)
Also see:
- Fall break, Oct 18,
no class
-
Lecture 6: Bayesian learning,
Oct 20–Nov 5, Chapter 6
(pdf6up)
Also see:
-
Lecture 7: Instance-based learning,
Nov 8–15, Chapter 8
(pdf6up)
Also see:
- Case-based reasoning (thanks to Brandon Hauff):
- David Aha, ed. Lazy Learning. Kluwer Academic Publishers, 1997.
- Christopher M. Bishop.
Neural Networks for Pattern Recognition.
Oxford University Press, 1995. [RBF
networks]
-
Sergios Theodoridis and Konstantinos Koutroumbas.
Pattern Recognition.
[distance measures between instances]
-
Lecture 8.5: How to give a good research talk,
Nov 17–19
(pdf6up)
Also see:
Return to the CSCE 478/878 (Fall 2010) Home Page
Last modified 16 August 2011; please report problems to
sscott.