data management: documentation and metadata for engineering and physical sciences ivey glendon,...
TRANSCRIPT
![Page 1: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/1.jpg)
Data Management:Documentation and Metadata for
Engineering and Physical Sciences
Ivey Glendon, Metadata Librarian
Jeremy Bartczak, Intellectual Access & Metadata Services Librarian
© 2013 by the Rector and Visitors of the University of Virginia.This work is made available under the terms of the Creative Commons Attribution-ShareAlike 4.0International license http://creativecommons.org/licenses/by-sa/4.0/
![Page 2: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/2.jpg)
Documentation & Metadata
Agenda:• Metadata: What is it? Why is it
important?• Capturing and managing metadata:
– Best practices– Tools
• Hands-On Creation of Metadata• Questions
![Page 3: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/3.jpg)
Metadata in Everyday Life
DataONE Education Module: Metadata. DataONE. Retrieved Nov 12, 2012. From http://www.dataone.org/sites/all/documents/L07_Metadata.pptx
CC im
age
by U
SDAg
ov o
n Fl
ickr
CC im
age
by M
skad
u on
Flic
kr
Author(s) Boullosa, Carmen. Title(s) They're cows, we're pigs / by Carmen Boullosa Place New York : Grove Press, 1997. Physical Descr viii, 180 p ; 22 cm. Subject(s) Pirates Caribbean Area Fiction. Format Fiction
Author(s) Boullosa, Carmen. Title(s) They're cows, we're pigs / by Carmen Boullosa Place New York : Grove Press, 1997. Physical Descr viii, 180 p ; 22 cm. Subject(s) Pirates Caribbean Area Fiction. Format Fiction
![Page 4: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/4.jpg)
Metadata
• What is it?– Structured information that describes a
resource
• Why is it important?– Enables a resource or data to be easily
discovered– Good metadata will help others understand
and use your data
![Page 5: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/5.jpg)
Information EntropyDA
TA D
ETAI
LSTime of data development
Specific details about problems with individual items or specific dates are lost relatively rapidly
General details about datasets are lost through time
Accident or technology change may make data unusable
Retirement or career change makes access to “mental storage” difficult or unlikely
Loss of data developer leads to loss of remaining information
TIME (From Michener et al 1997)
![Page 6: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/6.jpg)
Metadata Answers…
• Who created the data?• Who maintains it?• When were the data collected? When were
they published?• Where was it collected (geographic location)?• What is the content of the data? The
structure?• Why were the data created?• How were they produced/analyzed?
![Page 7: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/7.jpg)
Metadata in Research
Project Documentation Dataset Documentation
• Context of data collection• Data collection methods• Structure, organization of data files• Data sources used• Data validation, quality assurance• Transformations of data from the
raw data through analysis• Information on confidentiality,
access and use conditions
• Variable names and descriptions• Explanation of codes and schemas
used• Algorithms used to transform data• File format and software (including
version) used
![Page 8: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/8.jpg)
• When you provide data to someone else, what types of information would you want to include with the data?
• When you receive a dataset from an external source, what types of details do you want to know about the data?
Working with Data
![Page 9: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/9.jpg)
Critical Roles of Metadata• Data Discovery
– To be able to identify important data sets• Data Retrieval
– To know how and where to access data• Data Use
– To know enough details about how the how the data were collected and stored
• Data Archiving– Data can grow more valuable with time, but only if the
critical information required to retrieve and interpret the data remains available
![Page 10: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/10.jpg)
Metadata Formats
• Documentation for understanding & re-use– Readme File– Data Dictionary– Codebook
• Structured documentation in XML format for use in programs
– DDI– FGDC
![Page 11: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/11.jpg)
Unstructured Documentation
• Data Dictionaryhttp://people.virginia.edu/~sah/bsel/DataDefinitions.pdf
• ReadMe Filehttp://libra.lib.virginia.edu/dataset_readme_template
• Dryad Example (lab notebook)http://wiki.datadryad.org/wg/dryad/images/3/3d/DryadLab_example_readme.pdf
• Google Forms
![Page 12: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/12.jpg)
Structured XML
Standard Schemes (XML)– DDI– Data Document Initiative
http://www.ddialliance.org/
– FGDC– Geospatial Metadata Standardhttp://www.fgdc.gov/metadata/geospatial-metadata-standards
![Page 13: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/13.jpg)
Metadata Concept Map by Amanda Tarbet is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.
Metadata Standards
![Page 14: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/14.jpg)
Structured Metadata Tools
Tools– Colectica add-on for Excel (DDI)– Metavist (FGDC)– ArcGIS (ArcCatalog for FGDC)
http://dmconsult.library.virginia.edu/metadata-workshop/
![Page 15: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/15.jpg)
Colectica for Excel
• Excel Addin (DDI)
• Describes data files, variables, and code listings (metadata saved in the excel file)
• Import SPSS (.sav) & Stata (.dta) files into Excel, along with metadata
• Code books can also be customized and generated by the tool with various outputs
http://www.colectica.com/software/colecticaforexcel
![Page 16: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/16.jpg)
Metavist
• Metadata editor for FGDC
• Includes fields for the Biological Data Profile
http://metavist.djames.net/
![Page 17: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/17.jpg)
ArcGIS
• ArcInfo suite includes ArcCatalog, a tool for organizing GIS data and recording metadata
http://its.virginia.edu/research/esri/install/arcinfo91.html
![Page 18: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/18.jpg)
QUESTIONS?
Ivey Glendon, Metadata [email protected]
Jeremy Bartczak, Intellectual Access & Metadata Services Librarian Health Sciences [email protected]
Data Management Consulting Grouphttp://dmconsult.library.virginia.edu
![Page 19: Data Management: Documentation and Metadata for Engineering and Physical Sciences Ivey Glendon, Metadata Librarian Jeremy Bartczak, Intellectual Access](https://reader030.vdocuments.mx/reader030/viewer/2022032708/56649e865503460f94b897d9/html5/thumbnails/19.jpg)
Mailing List Subscription
• You are now on our mailing list and will receive occasional emails to keep up with our services, training, and news.
• Please encourage others to subscribe: http://eepurl.com/CJwYT