computer vision and machine learning for archaeology the potential of machine learning and image...

24
Computer vision and Computer vision and machine learning for machine learning for archaeology archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs. L. van der Maaten, Drs. P.J. Boon, Dr. A.G. Lange, Dr. H. Paijmans, Prof.dr. E.O. Postma Paul Boon [email protected] http://www.referentiecollectie.nl/rich Institute for Knowledge and Agent Technology

Upload: wesley-ralph-johnston

Post on 15-Jan-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Computer vision and Computer vision and machine learning for machine learning for

archaeologyarchaeologyThe potential of machine learning and image

analysis techniques for the domain of archaeology

Drs. L. van der Maaten, Drs. P.J. Boon, Dr. A.G. Lange, Dr. H. Paijmans,

Prof.dr. E.O. Postma

Paul [email protected]

http://www.referentiecollectie.nl/rich

Institute for Knowledge and Agent Technology Maastricht University

Page 2: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

OutlineOutline

• Introduction – Why & How– Computer vision and machine learning

• Examples – Historical glass, on-line reference collection– Modern coins

• Conclusion• Future work

Page 3: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Why & HowWhy & How

Need for on-line reference collections

• Making a collection digital is not enough• Create tools for identifying artifacts

– Vision and machine learning for finding ‘alike’ objects– Web technology for presentation and navigation

CollectionArtifact? Library

Page 4: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Computer vision and Computer vision and machine learningmachine learning

186, gl_flu_4

Page 5: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Computer vision and Computer vision and machine learningmachine learning

186, gl_flu_4

1. Object detection

2. Feature extraction

3. Classification

Page 6: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Computer vision and Computer vision and machine learningmachine learning

186, gl_flu_4

Not a Not a replacement, but replacement, but a tool!a tool!

Page 7: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

ExampleExample

Historical glass• Content based image retrieval • Outer shape contours

Page 8: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Object detectionObject detection

Page 9: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Shape contextShape context

θ

r

00 00

00

00

11

22

2233

66 44

Translation, scale and rotation invariant

Histogram construction

Page 10: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

ClassificationClassification

Page 11: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs
Page 12: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs
Page 13: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs
Page 14: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs
Page 15: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs
Page 16: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs
Page 17: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

ExampleExample

Coins• Automatic classification system,

using texture information• Modern coins, but in future early-

medieval coins

Page 18: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

OriginalOriginal

Page 19: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Object detectionObject detection

Page 20: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

FeaturesFeatures

Page 21: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

ConclusionConclusion

You can successfully integrate computer vision and machine learning with an online collection

Page 22: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Future workFuture work

• Improve usefulness– Object detection – Evaluate technology

• Other types of material– Using outer shape and texture

• Partial shapes, from sherds?• Evaluate typologies or device new

ones?

Page 23: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

Shape mapShape map

Page 24: Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs

AcknowledgementsAcknowledgements

We thank the Dutch Royal Coin Cabinet for providing the medieval coin datasetArent Pol – specialist on early-medieval coins

Institute for Knowledge and Agent Technology, Maastricht University

Dutch National Service for Archaeological HeritageJaap Kottman – glass specialist

Netherlands Organization for Scientific Research