metadata matters
DESCRIPTION
Metadata Matters. Ian White September 5, 2013. @urbanmapping. Achtung!. NoSQL is no panacea Big Data isn’t about data Big Data isn’t new Big Data doesn’t present a Boolean quandary With power comes responsibility AWS bills Lady Gaga tweets Innumeracy (correlation v causation). - PowerPoint PPT PresentationTRANSCRIPT
1@urbanmapping
Metadata MattersIan WhiteSeptember 5, 2013
2@urbanmapping
Achtung!NoSQL is no panacea
Big Data isn’t about dataBig Data isn’t newBig Data doesn’t present a Boolean
quandaryWith power comes responsibility- AWS bills- Lady Gaga tweets- Innumeracy (correlation v causation)
3@urbanmapping
One Person’s Metadata is Another Person’s Data
4@urbanmapping
Big v Important
BigHeterogeneousRawDistributedStreaming/real
timeSearch for
meaningTime-sensitivePhilosophical
ImportantWell-defined schemaHigh value (not free)Test-drivenRelationalHistoricalEnterprise-focused
5@urbanmapping
Data Exhaust
Analytics Probes
Social Media Gov2.0
6@urbanmapping
Platforms
Commoditization of compute and storage
7@urbanmapping
A Brief History of Metadata
Callimachus Library of Alexandria, Egypt
8@urbanmapping
A Brief History of Metadata
“Pinakes” (lists)TitleCategoryAuthorAuthor birthplaceFatherWord count
Callimachus
9@urbanmapping
A Brief History of Metadata
Johan van der Does Johan van der Does
Leiden University, 1595Leiden University, 1595
10
@urbanmapping
A Brief History of Metadata
Melville DeweyMelville Dewey
11
@urbanmapping
A Brief History of Metadata
Card catalog room, Library of Congress c. 1920
12
@urbanmapping
A Brief History of Metadata
Dewey Decimal System goes electronic in 1967
13
@urbanmapping
Out with the Old, in with the New
Archiving card catalogs after digitization
14
@urbanmapping
Why Can’t We Be Together?
Metadata Data
15
@urbanmapping
Exponential Growth in Data
Unprecedented rate of data creation, 1995-today
1876
TaxonomyPinakes
300 BC
Database
1970
Catalog
1595 AD
Vo
lum
e o
f D
ata
Ge
ne
rate
d
16
@urbanmapping
Oh, How I’ve Missed You!The reunification of metadata with data
17
@urbanmapping
Together At Last!
18
@urbanmapping
GIS Remains Unevolved
+ =Melville DeweyMelville Dewey
19
@urbanmapping
Enter the Data CuratorPart social scientist, part librarian, part statistician, part RDBMS wiz
20
@urbanmapping
DIKW ModelData
Fact, Signal, Symbol
InformationStructural v FunctionalSymbolic v Subjective
KnowledgeProcessedProcedural
Propositional
21
@urbanmapping
Popularity Contest
Metadata
Big Data
Data ScienceCuration
22
@urbanmapping
c.2013
23
@urbanmapping
One Person’s Metadata is Another’s Data