computer vision and machine learning for archaeology the potential of machine learning and image...

Computer vision and Computer vision and machine learning for machine learning for

archaeologyarchaeologyThe potential of machine learning and image

analysis techniques for the domain of archaeology

Drs. L. van der Maaten, Drs. P.J. Boon, Dr. A.G. Lange, Dr. H. Paijmans,

Prof.dr. E.O. Postma

Paul Boonp.boon@cs.unimaas.nl

http://www.referentiecollectie.nl/rich

Institute for Knowledge and Agent Technology Maastricht University

OutlineOutline

• Introduction – Why & How– Computer vision and machine learning

• Examples – Historical glass, on-line reference collection– Modern coins

• Conclusion• Future work

Why & HowWhy & How

Need for on-line reference collections

• Making a collection digital is not enough• Create tools for identifying artifacts

– Vision and machine learning for finding ‘alike’ objects– Web technology for presentation and navigation

CollectionArtifact? Library

Computer vision and Computer vision and machine learningmachine learning

186, gl_flu_4

Computer vision and Computer vision and machine learningmachine learning

186, gl_flu_4

1. Object detection

2. Feature extraction

3. Classification

Computer vision and Computer vision and machine learningmachine learning

186, gl_flu_4

Not a Not a replacement, but replacement, but a tool!a tool!

ExampleExample

Historical glass• Content based image retrieval • Outer shape contours

Object detectionObject detection

Shape contextShape context

rθ

θ

r

00 00

00

00

11

22

2233

66 44

Translation, scale and rotation invariant

Histogram construction

ClassificationClassification

ExampleExample

Coins• Automatic classification system,

using texture information• Modern coins, but in future early-

medieval coins

OriginalOriginal

Object detectionObject detection

FeaturesFeatures

ConclusionConclusion

You can successfully integrate computer vision and machine learning with an online collection

Future workFuture work

• Improve usefulness– Object detection – Evaluate technology

• Other types of material– Using outer shape and texture

• Partial shapes, from sherds?• Evaluate typologies or device new

ones?

Shape mapShape map

AcknowledgementsAcknowledgements

We thank the Dutch Royal Coin Cabinet for providing the medieval coin datasetArent Pol – specialist on early-medieval coins

Institute for Knowledge and Agent Technology, Maastricht University

Dutch National Service for Archaeological HeritageJaap Kottman – glass specialist

Netherlands Organization for Scientific Research