digital preservation
DESCRIPTION
Digital Preservation. ICDL-Contentra Workshop 29 th November 2013 [email protected]. What Can You expect in this Presentation. An overview of Issues in long-term preservation of access to Digital Content Preserving Trust, Authenticity, Intelligibility, and Usability - PowerPoint PPT PresentationTRANSCRIPT
Contentra Technologies Confidential (RajuB)
1
Digital Preservation
ICDL-Contentra Workshop
29th November [email protected]
29/11/2013
Contentra Technologies Confidential (RajuB)
2
What Can You expect in this PresentationAn overview of
Issues in long-term preservation of access to Digital Content
Preserving Trust, Authenticity, Intelligibility, and Usability
Standards Bit Preservation Format Preservation Metadata Preservation
Planning for Digital Preservation ProgrammeQ&A
29/11/2013
Contentra Technologies Confidential (RajuB)
3
Fragility of Digital ContentOverly dependent on the Environment
Media or CarrierEncoding or FormatDescriptive Information or MetadataRendering EnvironmentKnowledge Base of Designated Communities
29/11/2013
Contentra Technologies Confidential (RajuB)
4
Issues in Preserving Long-term accessPlanning Horizon is between 100 to 400
yearsTechnical and Non-technical issues
Technical Issues Bit Preservation or Media Preservation Encoding Preservation or Format Preservation Metadata Preservation or Meaning & Context
preservation Rendering Environment or Viewing Environment Characterizing the Designated Communities
Non-Technical Issues
29/11/2013
Contentra Technologies Confidential (RajuB)
5
Non-Technical Issues in Preservation
Source: Mike Kastellec “Practical limits to Scope of Digital Preservation”29/11/2013
Contentra Technologies Confidential (RajuB)
6
Technical IssuesBit Preservation or Media Preservation
Risks Assessment Media Obsolescence Bit Rot
Loss-less migrationEncoding Preservation or Format
PreservationContainers & ContentObject Preservation & Set Preservation (Data
sets/Fonds)
29/11/2013
Contentra Technologies Confidential (RajuB)
7
Metadata PreservationStructural MetadataAdministrative Metadata
Provenance MetadataRights Metadata..
Descriptive MetadataPreservation Metadata
29/11/2013
Contentra Technologies Confidential (RajuB)
8
OAIS Reference Model
29/11/2013
Contentra Technologies Confidential (RajuB)
9
Establishing TrustIngest trustworthy informationIs through a clear transparent
communication channel to the future societyProvenance, Respect du fonds, Chain of
custody, IntegrityThe channel should preserve itselfRealized through a set of:
Policies & ProceduresAuditable Systems & Services
29/11/2013
Contentra Technologies Confidential (RajuB)
10
Attributes of TDRCompliance to International Standards (such
as OAIS-RM)Administrative ResponsibilitiesOrganizational ViabilityFinancial SustainabilityTechnological and Procedural SuitabilityProcedural Accountability
29/11/2013
Contentra Technologies Confidential (RajuB)
11
Responsibilities of a TDRCurational ResponsibilityOperational Responsibilities
Ingestion of Resource & MetadataObtaining control over the information for lifecycle
management Rights, Validation of Metadata and Preservation Metadata,
Unique Identification, Binding Metadata with resource, failsafe archival storage.
Access Provisioning Compliance to policies
Discovery and Access service provisioningManaging Producer/TDR and TDR/Designated
community relationships 29/11/2013
Contentra Technologies Confidential (RajuB)
12
Recommended Policies for TDRsCollection Development PoliciesDigital Rights and Digital Authorization
PoliciesPolicies for storageService Provisioning PoliciesSystem Change/Update control policies
29/11/2013
Contentra Technologies Confidential (RajuB)
13
Types of ContentDigitized ContentBorn Digital ContentWebSocial Network FeedsResearch Data
Survey Data SetsExperimental/Empirical DataThesis and Dissertations
29/11/2013
Contentra Technologies Confidential (RajuB)
1729/11/2013Source: http://www.dlib.indiana.edu/~jenlrile/metadatamap/seeingstandards.pdf
Standards1
Contentra Technologies Confidential (RajuB)
1829/11/2013
Source: http://www.dlib.indiana.edu/~jenlrile/metadatamap/seeingstandards.pdf
Standards2
Contentra Technologies Confidential (RajuB)
19
Preservation Planning
29/11/2013
What might organisations need in terms of preservation services?
Contentra Technologies Confidential (RajuB)
21
Six step process for digital curation
Step 1: Develop Collection Development Policy and Repository services policyTarget user groupsInformation use patterns
Step 2: Define the Service experience goalsInformation Discovery ServicesRendering environment and ReadabilityInformation Quality
(integrity/comprehensive/reliable/fit-for-use)
29/11/2013
Contentra Technologies Confidential (RajuB)
22
Six step process for digital curation (2)
Step 3: Identify information acquisition/curation processesInformation sources identificationSelection criteria and ingest mechanisms
Step 4: Discovery and Access mechanismsMetadata & Navigational support for users to
discover informationAccess and Rendering environments
29/11/2013
Contentra Technologies Confidential (RajuB)
23
Six step process for digital curation (3)
Step 5: Instrumentation for usage dataStep 6: Sustainability over a period of time
Resources & FundingMaintenance of currency and value
29/11/2013
Contentra Technologies Confidential (RajuB)
24
Levels of Digital Preservation (NDSA)
29/11/2013
Level 1(Protect your data)
Level 2(Know your data)
Level 3(Mirror your data)
Level 4(Repair your data)
Storage and Location
Two copies &Ingested
Three copies, a copy in different location, document storage system and media and what you need to use them
At least one copy in a different location with different disaster threat
Obsolescence monitoring process for storage systems and media
At least 3 copies in locations with different disaster threats
Comprehensive plan in place to keep files and metadata on currently accessible media
Contentra Technologies Confidential (RajuB)
25
Levels of Digital Preservation2 (NDSA)
29/11/2013
Level 1(Protect your data)
Level 2(Know your data)
Level 3(Mirror your data)
Level 4(Repair your data)
File Fixity and Data Integrity
Check file fixity on ingest if it is provided otherwise create fixity info
Check file fixity on all ingests
Virus and Integrity Checks on high risk content
Check fixity of content at fixed intervals
Maintain logs of fixity info
Ability to detect corrupt data
Virus and integrity check on all content
At least 3 copies in locations with different disaster threats
Check fixity on all content in response to events
Ability to repair/replace corrupt data
No one person has write access to all copies
Contentra Technologies Confidential (RajuB)
26
Levels of Digital Preservation3 (NDSA)
29/11/2013
Level 1(Protect your data)
Level 2(Know your data)
Level 3(Mirror your data)
Level 4(Repair your data)
Information Security
Identify who has read, move and delete authorization to individual files
Restrict who has authorization to individual files
Document access restrictions for content
Maintain logs of all actions on the files inclusive of preservation actions
Perform Audit of all logs
Metadata Inventory of content and its storage location
Document all non-colocation of inventory
Store Administrative metadata
Store transformative metadata and log
Store technical and descriptive metadata
Store preservation metadata
Contentra Technologies Confidential (RajuB)
27
Levels of Digital Preservation4 (NDSA)
29/11/2013
Level 1(Protect your data)
Level 2(Know your data)
Level 3(Mirror your data)
Level 4(Repair your data)
File Formats Encourage the use of a limited set of known open file formats and codecs
Inventory of file formats in use
Monitor file format obsolescence issues
Perform format migration, emulation and similar activities as needed
Contentra Technologies Confidential (RajuB)
28
Advanced Considerations of Digital PreservationMigration VS EmulationsIntelligibility Preservation
Modules and DependenciesDesignated Community Profiles
UsabilityRe-use by Communities other than planned
designated communities Sustainability
29/11/2013
Contentra Technologies Confidential (RajuB)
30
Questions
29/11/2013