computer vision and machine learning for archaeology the potential of machine learning and image...
TRANSCRIPT
Computer vision and Computer vision and machine learning for machine learning for
archaeologyarchaeologyThe potential of machine learning and image
analysis techniques for the domain of archaeology
Drs. L. van der Maaten, Drs. P.J. Boon, Dr. A.G. Lange, Dr. H. Paijmans,
Prof.dr. E.O. Postma
Paul [email protected]
http://www.referentiecollectie.nl/rich
Institute for Knowledge and Agent Technology Maastricht University
OutlineOutline
• Introduction – Why & How– Computer vision and machine learning
• Examples – Historical glass, on-line reference collection– Modern coins
• Conclusion• Future work
Why & HowWhy & How
Need for on-line reference collections
• Making a collection digital is not enough• Create tools for identifying artifacts
– Vision and machine learning for finding ‘alike’ objects– Web technology for presentation and navigation
CollectionArtifact? Library
Computer vision and Computer vision and machine learningmachine learning
186, gl_flu_4
Computer vision and Computer vision and machine learningmachine learning
186, gl_flu_4
1. Object detection
2. Feature extraction
3. Classification
Computer vision and Computer vision and machine learningmachine learning
186, gl_flu_4
Not a Not a replacement, but replacement, but a tool!a tool!
ExampleExample
Historical glass• Content based image retrieval • Outer shape contours
Object detectionObject detection
Shape contextShape context
rθ
θ
r
00 00
00
00
11
22
2233
66 44
Translation, scale and rotation invariant
Histogram construction
ClassificationClassification
ExampleExample
Coins• Automatic classification system,
using texture information• Modern coins, but in future early-
medieval coins
OriginalOriginal
Object detectionObject detection
FeaturesFeatures
ConclusionConclusion
You can successfully integrate computer vision and machine learning with an online collection
Future workFuture work
• Improve usefulness– Object detection – Evaluate technology
• Other types of material– Using outer shape and texture
• Partial shapes, from sherds?• Evaluate typologies or device new
ones?
Shape mapShape map
AcknowledgementsAcknowledgements
We thank the Dutch Royal Coin Cabinet for providing the medieval coin datasetArent Pol – specialist on early-medieval coins
Institute for Knowledge and Agent Technology, Maastricht University
Dutch National Service for Archaeological HeritageJaap Kottman – glass specialist
Netherlands Organization for Scientific Research