the case for yet another digital preservation evaluation tool

THE CASE FOR YET

ANOTHER DIGITAL

PRESERVATION

EVALUATION TOOL

Robert Gillesse (DEN)

Henk Vanstappen (PACKED)

IS&T Archiving 2014

DEN & PACKED

Dutch and Flemish centers of expertise

supporting cultural heritage institutions in

creating, preserving and publicizing digital

heritage

Digital preservation important part of message

Score mo joint effort

Foto: THE Holy Hand Grenade! CC BY-SA 2.0

Foto: Wief70 CC BY-NC 2.0

Foto: portfolium CC BY-NC 2.0

DIGITAL PRESERVATION IS…

Organizational structure

People and resources

Storage

Standards

File identification and validation

Checksums

Archival file formats

Migration, normalization, emulation

Preservation metadata

Structural metadata

Technology watch

….

STANDARDS & CHECKLISTS

DRAMBORA Digital Repository Audit Method

Based on Risk Assessment

By DCC and DPE

221 pages (draft)

STANDARDS & CHECKLISTS

ED3 Eisen Duurzaam Digitaal Depot

V.2 publicated 2012

28 p.

Bases on TRAC and TDR

STANDARDS & CHECKLISTS

NESTOR CHECKLIST Kriterienkatalog vertrauenswurdige

digitale Langzeitarchive

Nestor-Arbeitsgruppe Vertrauens-

wurdige Archive – Zertifizierung

STANDARDS & CHECKLISTS

DATASEAL OF APPROVAL

Trustworthy preservation of research

data

Five principles translated into 17

guidelines

Broad community

Self-assessment followed by peer

review

Created by Data Archiving and

Networked Services (DANS) now

managed by an international board

Based on TRAC, DRAMBORA, etc

STANDARDS & CHECKLISTS

CHARLES M. DOLLAR Digital Preservation Readiness Capability Maturity Model

STANDARDS & CHECKLISTS

TRUSTED DIGITAL

REPOSITORY (TDR)

CHECKLIST

Largely based on TRAC

checklist

ISO 16363:2012

77 pages

Based on the OAIS

reference model

Recommendation for Space Data System Practices

MAGENTA BOOK

AUDIT AND CERTIFICATION OF

TRUSTWORTHY DIGITAL REPOSITORIES

RECOMMENDED PRACTICE

CCSDS 652.0-M-1

September 2011

STANDARDS & CHECKLISTS

OAIS BLUE BOOK Developed by NASA

ISO 14721:2003

148 pages

Content Information: The set of information that is the

original target of preservation. It is an Information

Object comprised of its Content Data Object and its

Representation Information. An example of Content

Information could be a single table of numbers

representing, and understandable as, temperatures,

but excluding the documentation that would explain its

history and origin, how it relates to other observations,

etc.

RECOMMENDATION FOR SPACE

DATA SYSTEM STANDARDS

Reference Model for an

Open Archival Information

System (OAIS)

CCSDS 650.0-B-1

BLUE BOOK

January 2002

MOTIVATION AND AIM

Existing DP evaluation tools are complex and

need expertise to use

Unwanted effect of this complexity:

organizations might be overwhelmed and

ignore the urgency and risks concerning their

digital collections

AIM

Create a self-evaluation tool that smaller or

less technically orientated institutions can use

Easy to use and to manage -> web tool

Risk analysis

Problem solving

Dutch & English version

RELATION TO OTHER EVALUATION

TOOLS

Based on different DP evaluation tools

TDR

DRAMBORA

NESTOR

Dataseal of approval

ED3

Inspired by the Digital Preservation Capability

Maturity Model

COMPLEMENTARY

Complementary to the existing audit tools

First step towards TDR audit

CHALLENGES

Translate complicated interlinked OAIS

terminology into non-simplistic, jargon free

criteria

Keep amount of criteria as low as possible

without being too concise

Building a user- and management-friendly

web tool

USER RESULTS

Results are private

Model can be used anonymously

Registered users:

Can return to earlier made reports

Can fill in the model in different sessions

62 CRITERIA

Context

Risks

Examples

Solutions

THREE RISK LEVELS

No flasher

No lights

No brakes

A MATURITY MODEL FOR REPOSITORIES

THREE LEVELS

A MATURITY MODEL FOR REPOSITORIES

THREE LEVELS

A MATURITY MODEL FOR REPOSITORIES

THREE LEVELS

SEVEN DOMAINS

Policy

Strategy

Expertise & organization

Storage management

Ingest

Planning & control

Access

SCORES

For each domain maximum of 100 points

Three risk levels have different weights

The high risk criteria have to be fulfilled

before the criteria of lower risk will even

count

Idea: which things have to be done first

FINAL REPORT & ACTION PLAN

After filling in all criteria the user gets:

Final report (PDF)

Action plan: all failed criteria listed

RADAR CHART

DEMO

DEMO

DEMO

FUTURE PLANS & CHALLENGES

Improving texts

Better connection to TDR checklist

Version management

Privacy vs interesting statistical material

Possibility of adapting risk levels

User research

BROADER IMPLICATIONS

DP has broad implications for an cultural heritage

organization:

Policy, organization, budget, ICT household and

workflows, etc.

Risk of being overwhelmed and let other

priorities win over

Score model might help pointing out the biggest

problems and prioritize

Unspoken possible implications of using the model:

Outsourcing

Cooperation

CONCLUSIONS

Score model is used by a diverse group of

cultural heritage institutions

Mainly from Netherlands, Belgium and the US

Also used for educational purposes

Case has been proved for a easy accessible

and easy to use tool which gives a first

overview of what DP is all about

BROADER IMPLICATIONS

DP has broad implications for an cultural heritage organization:

Policy, organization, budget, ICT household and workflows,

etc.

Risk of being overwhelmed and let other priorities win over

Score model might help pointing out the biggest problems and

first steps taken

Unspoken possible implications of using the model:

Outsourcing

Cooperation

http://upload.wikimedia.org/wikipedia/commons/f/f0/Fragen,_Wegweiser.JPG

www.scoremodel.org

robert.gillesse@den.nl

henk.vanstappen@packed.be