CpSc 881: Machine Learning

Introduction

2

Copy Right Notice

Most slides in this presentation are adopted from slides of text book and various sources. The Copyright belong to the original authors. Thanks!

3

General Information

Class Time: 5:45 PM ~ 8:30PM Monday

Location: 119 McAdams

Instructor: Dr. Feng Luo

Office: 210 McAdams Hall

Phone: 864-656-4793

Email: luofeng@clemson.edu

Office Hours: 4:30PM ~ 5:30PM Monday

Web site:http://www.cs.clemson.edu/~luofeng/course/MachineLearning/

machinelearning.html

4

Prerequisite

Familiarity with basic computer science principles and skills.

Familiarity with the basic mathematics, like probability theory, basic linear algebra.

5

Text Book

Tom Mitchell. Machine Learning, 1997. ISBN 0-07-042807-7, WCB/McGraw-Hill

Reference books:Ethem Alpaydin. Introduction to Machine Learning, 2004. ISBN: 0-262-01211-1, the MIT Press.Nils J. Nilsson Introduction to Machine Learning, (http://robotics.stanford.edu/people/nilsson/mlbook.html)

6

Grading

Grading:Mid-term exam 25 %Final exam 25 %Term project 50 %Curved to A, B, C,D

7

Resources: Datasets

UCI Repository: http://www.ics.uci.edu/~mlearn/MLRepository.html

UCI KDD Archive: http://kdd.ics.uci.edu/summary.data.application.html

Statlib: http://lib.stat.cmu.edu/

Delve: http://www.cs.utoronto.ca/~delve/

8

Tools

Weka (http://www.cs.waikato.ac.nz/ml/weka/)

R (http://www.r-project.org/)

Octave: A free matlab clone (http://www.gnu.org/software/octave/)

Machine Learning Tools in Java (http://sourceforge.net/projects/mldev/)

9

Resources: Journals

Journal of Machine Learning Research www.jmlr.org

Machine Learning

Neural Computation

Neural Networks

IEEE Transactions on Neural Networks

IEEE Transactions on Pattern Analysis and Machine Intelligence

Annals of Statistics

Journal of the American Statistical Association

10

Resources: Conferences

International Conference on Machine Learning (ICML) ICML05: http://icml.ais.fraunhofer.de/

European Conference on Machine Learning (ECML)ECML05: http://ecmlpkdd05.liacc.up.pt/

Neural Information Processing Systems (NIPS)NIPS05: http://nips.cc/

Uncertainty in Artificial Intelligence (UAI)UAI05: http://www.cs.toronto.edu/uai2005/

Computational Learning Theory (COLT)COLT05: http://learningtheory.org/colt2005/

International Joint Conference on Artificial Intelligence (IJCAI)IJCAI05: http://ijcai05.csd.abdn.ac.uk/

International Conference on Neural Networks (Europe)ICANN05: http://www.ibspan.waw.pl/ICANN-2005/

11

What is Machine Learning

Definition – Computing Dictionary:

The ability of a machine to improve its performance based on previous results.

12

Why Machine Learning

Human expertise does not exist (navigating on Mars)

Humans are unable to explain their expertise (speech recognition)

Solution changes in time (routing on a computer network)

Solution needs to be adapted to particular cases (user biometrics)

13

Three niches for machine learning

Data Mining: using historical data to improve decisions

Medical records -> medical knowledge

Software application we can NOT program by hand

Autonomous drivingSpeech recognition

Self customizing programsNews reader that learns user interests

14

Applications of Machine Learning

Information filtering/classification

15

Applications of Machine Learning

Playing games

16

Applications of Machine Learning

Robotics

17

Applications of Machine Learning

fault detection/monitoring technical systems

18

Applications of Machine Learning

bioinformatics

19

Applications of Machine Learning

image classification picture processing

20

Applications of Machine Learning

Text/language processing, classification, visualization, ...

21

Applications of Machine Learning

22

Connections of Machine Learning

MLAI

Neurobiology

ControlStatistics

OptimizationInformation theory

Psychology

Philosophy