introduction to machine learning

1er. Escuela Red ProTIC - Tandil, 18-28 de Abril, 2006

Introduction to Machine Learning

Alejandro Ceccatto

Instituto de Física Rosario CONICET-UNR


Bibliography

Machine Learning, Tom Mitchell (McGraw Hill, 1997)

Principal Component Analysis, Ian Jolliffe (Springer-Verlag, 2002)

An introduction to SVM and other kernel-based learning methods, Cristianini-Shawe Taylor (Cambrige, 2000)

The Elements of Statistical Learning, Hastie-Tibshirani-Friedman (Springer, 2001)


Machine Learning

• The field of Machine Learning is concerned with the question of how to construct computer programs that automatically improve with experience

• The purpose of this course is to present key algorithms and theory that form the core of Machine Learning


Machine Learning

• Interdisciplinary nature of the material:

Statistics, Artificial Intelligence, Information Theory, etc.

• Basic question:

How to program computers to learn?


Machine Learning

Intelligent Data Analysis:

• Intelligent application of data analytic tools (Statistics)

• Application of “intelligent” data analytic tools (Machine Learning)

Modern world: Data-driven world (industrial, commercial, financial, scientific activities)


Why Machine Learning?

• Recent progress in algorithms and theory

• Growing flood of online data

• Computational power available



• Niches for Machine Learning:

– Data Mining: using historical data to improve decisions

Medical records medical knowledge

– Software applications we can’t program by handAutonomous driving

Speech recognition

– Self customizing programsNewsreader that learns user interests



• Data Mining

– Data: Recorded facts– Information: Set of patterns, or expectations, that

underlie the data– Data Mining: Extraction of implicit, previously

unknown, and potentially useful information from data

– Machine Learning: Provides the technical basis of data mining



• Typical Datamining Tasks

– Risk of Emergency Cesarean Section

Given

• 9714 patient records, each describing a pregnancy and birth

• Each patient record contains 215 features

Learn to predict:

• Classes of patients at high risk for emergency cesarean section



One of the learned rules:

IF No previous vaginal delivery, and Abnormal 2nd Trimester

Ultrasound, and Malpresentation at admission

THEN Probability of Emergency C-Section 0.6

Over training data: 16/41=0.63

Over Test Data: 12/20=0.60



– Credit Risk Analysis



– Customer Retention



– Problems Too Difficult to Program by Hand



– Software that Customizes to User


Where is This Headed?

Today: tip of the iceberg

• First-generation algorithms: neural nets, decision trees, regression....

• Applied to well-formated databases

Tomorrow: enormous impact

• Learn across mixed-media data and multiple databases

• Learn by active experimentation

• Learn decisions rather than predictions

• Cumulative, life-long learning


Where is This Headed?

Autonomous entities?

“I'm sorry Dave; I can't let you do that.” –HAL 9000 in 2001: A Space Odyssey, by Arthur Clarke

introduction to machine learning

Documents

escuela red protic tandil

bibliographymachine

datamachine learning

core of machine learning1er

historical data

data miningdata

training data

test data