digital curation workshop - archivematica...mar 14, 2013 · the digital preservation problem: 7....
TRANSCRIPT
![Page 1: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/1.jpg)
Digital Curation Workshop
March 14, 2013SFU Wosk Centre for Dialogue
Vancouver, BC
Introduction to
![Page 2: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/2.jpg)
What is Archivematica?
● digital preservation/curation system ● designed to maintain standards-based, long-
term access to collections of digital objects● free and open-source (AGPLv3)● supported by Artefactual Systems Inc.
![Page 3: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/3.jpg)
![Page 4: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/4.jpg)
digital preservation consulting open-source sofware for archives and libraries
![Page 5: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/5.jpg)
The Digital Preservation Problem:
1. Rapid technological change drives constant system upgrades,
migrations and retirement of legacy technologies.
2. Incompatible, obsolete, obscure or proprietary systems and file
formats.
3. Loss or damage to bitstreams due the fragility of digital storage
media, system error, or human error.
![Page 6: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/6.jpg)
The Digital Preservation Problem:
4. The overwhelming volume of digital information objects created
daily, each with many possible copies and versions.
5. The lack or loss of adequate metadata describing digital
information objects.
6. Accidental or malicious content alteration.
![Page 7: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/7.jpg)
The Digital Preservation Problem:
7. Doubts about the reliability and integrity of electronic records
and the inability to vouch for their authenticity.
8. The complexity of digital information objects which requires
preservation of their content, structure, context, presentation,
behaviour as intellectual entities as well as bitstreams.
9. The lack of formally recognized organizational responsibility,
resources and enterprise architecture components that facilitate
digital curation, preservation and long-term access.
![Page 8: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/8.jpg)
![Page 9: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/9.jpg)
![Page 10: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/10.jpg)
now future
bitstream
storage media
packaging
storage device
storage driver
file system
error correction operating system
application software user interface
input / output devices
metadata
find
relate / bind
authenticate
contextualize
stored
copied
protected
Accessible?Usable?Authentic?
compression
decryption
file format
character encoding fonts
codec
Responsible?Architecture?Resources?
contentcontext
structurepresentationbehaviour
![Page 11: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/11.jpg)
The Digital Preservation Problem for University Libraries
Digitized collections Born-digital faculty publications and research output
Student E-theses University e-records Born-digital donor collections Born-digital research data sets etc...
![Page 12: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/12.jpg)
The Digital Preservation Problem for University Libraries
ILS Discovery engines / platforms Website CMS Custom departmental / collections websites Dspace Fedora OJS Islandora LOCKSS etc...
![Page 13: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/13.jpg)
Capacity Gap
● No preservation features in key systems
● No digital preservation planning● Format obsolescence
● System & platform incompatibility/obsolesence
● Digital preservation metadata
● External media processing
● Dedicated storage and geo-remote backup
● No Trusted Digital Repository (TDR)
● No obvious next steps to improve capacity
![Page 14: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/14.jpg)
TRAC: Trustworthy Digital Repositories
![Page 15: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/15.jpg)
ISO 16363:2012
![Page 16: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/16.jpg)
Data Management
Preservation Planning
Archival Storage
Ingest
Administration
SIP
MANAGEMENT
AIP Access DIP
PRODUCER
CONSUMER
Open Archival Information System (OAIS) reference model (ISO-STD 14721)
![Page 17: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/17.jpg)
What is Archivematica?
● Allows users to process digital objects from ingest to access in conformance with the ISO-OAIS functional model
● Archivematica creates high-quality, standards-compliant Archival Information Packages (AIP)
● Archivematica provides an architecture for implementing preservation strategies
● Archivematica provides a framework for evaluating and implementing format policies
![Page 18: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/18.jpg)
![Page 19: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/19.jpg)
`
web-based dashboard
monitor and control
web server
MCP server
micro-service processing clients
watched directory
success
error
fileshare
successdigital curationmicro-services
pythonscripts
FOSStools
AIP
DIP
SIP or
transfer of digital objects
& metadata
![Page 20: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/20.jpg)
![Page 21: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/21.jpg)
The METS file<dmdSec> (descriptive metadata) Dublin Core XML EAD XML MODS XML [whatever] XML<amdSec> (administrative metadata) <techMD> PREMIS: object <digiProvMD> PREMIS: events PREMIS: agents <rightsMD> PREMIS: rights<fileSec> (a list of the files and their roles and relationships)<structMap> (a representation of the physical structure of the AIP)
![Page 22: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/22.jpg)
Preservation planning
● A two-pronged approach:– Normalization on ingest
– Preservation of the original file to support future strategies such as migration and emulation
● Normalization relies on format policies based on an analysis of the significant characteristics of file formats
● A format policy indicates the actions, tools and settings to apply to a file of a particular file format (e.g. normalization to preservation and/or access format)
![Page 23: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/23.jpg)
https://www.archivematica.org/preservation
![Page 24: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/24.jpg)
Archivematica format policies
● Criteria for selecting default formats:● Non-proprietary● Freely available specifications● Widely used/endorsed by major repositories● No compression/lossless compression● Tools available to write and render the format
● Format policies will change as community standards, practices and tools evolve.
![Page 25: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/25.jpg)
PRONOM
UDFR
Format Policy Registry (FPR)
?
API GUI
![Page 26: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/26.jpg)
![Page 27: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/27.jpg)
Systems Integration
● Application Programming Interfaces (API)– Storage
– Ingest
– Access
● Dspace● ContentDM● ICA-AtoM● Archivist Toolkit● LOCKSS● Islandora● Fedora● Dataverse
![Page 28: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/28.jpg)
Archivematica Clients / Partners
● 30 – 50 users worldwide● Active discussion list, twitter feed, website● Courses, community participation● Current Artefactual clients:
– UBC Library
– UofA Library
– SFU Library
– SFU Archives
– City of Vancouver Archives
– Rockefeller Archive Center
– International Monetary Fund Archives
– Columbia University Library
– Museum of Modern Art (MoMA)
– Yale University Library
![Page 29: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/29.jpg)
Foundation orSteering Committee
Governance
Coordination
Funding
Promotion
Users
Lead institutions Funding DevelopmentAll users Bug reports Enhancement requests Code patches Documentation Promotion Open Source Software
Code
Knowledge
Community
Service Providers
Development
Technical Support
Hosting
Training
Promotion
CodeTime
MoneyKnowledge
CodeTimeMoneyKnowledge
TimeMoney
Knowledge
![Page 30: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/30.jpg)
Free Beer!
![Page 31: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/31.jpg)
“They’ll never take our freedom”
© 1995 Paramount Pictures & 20th Century FoxSee fair use rationale: http://en.wikipedia.org/wiki/File:Brave_mel.jpg
![Page 32: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/32.jpg)
![Page 33: Digital Curation Workshop - Archivematica...Mar 14, 2013 · The Digital Preservation Problem: 7. Doubts about the reliability and integrity of electronic records and the inability](https://reader033.vdocuments.mx/reader033/viewer/2022052012/6028f7aed2572347c3458c8c/html5/thumbnails/33.jpg)
http://archivematica.org