Preserving Digital Preserving Digital Collections for Collections for

Future ScholarshipFuture Scholarship

Oya Y. RiegerOya Y. Rieger

Cornell UniversityCornell University

oyr1@cornell.eduoyr1@cornell.edu

Part 1: Cornell Case Study

CUL Special Funds: 15,000 booksMicrosoft Live Book, 100,000 booksGoogle Book Search, 500,000 books

Part 2: Preservation

Why preserve?Why preserve?

Long-term returns on our investment Long-term returns on our investment in print collectionsin print collections

Users want content in digital formatUsers want content in digital format

Significant costs – likelihood of a 2Significant costs – likelihood of a 2ndnd round?round?

If not libraries, who will assume the If not libraries, who will assume the stewardship role? stewardship role?

Digital PreservationDigital Preservation

Managed activities to support the Managed activities to support the long-term maintenance of long-term maintenance of bitstreamsbitstreams to make sure that digital objects are to make sure that digital objects are usableusable

Digital PreservationDigital Preservation

Managed activities to support the long-Managed activities to support the long-term maintenance of term maintenance of bitstreamsbitstreams to make to make sure that digital objects are usablesure that digital objects are usable

Ensuring the Ensuring the usabilityusability of a digital of a digital resource by retaining all quantities of resource by retaining all quantities of authenticity, accuracy, and functionalityauthenticity, accuracy, and functionality

Digital PreservationDigital Preservation Managed activities to support the long-Managed activities to support the long-

term maintenance of term maintenance of bitstreamsbitstreams to make to make sure that digital objects are usablesure that digital objects are usable

Ensuring the Ensuring the usabilityusability of a digital resource of a digital resource by retaining all quantities of authenticity, by retaining all quantities of authenticity, accuracy, and functionalityaccuracy, and functionality

Envisioning & enabling new ways of Envisioning & enabling new ways of scholarshipscholarship based on digital content based on digital content

Digital Preservation Digital Preservation ProgramProgram

Organizational Organizational InfrastructureInfrastructure

Technical Technical ArchitectureArchitecture

Resources Resources FrameworkFramework

Digital Preservation Digital Preservation ProgramProgram

Organizational Organizational InfrastructureInfrastructure

Technical ArchitectureTechnical Architecture Resources FrameworkResources Framework Access VisionAccess Vision

technology

resources

organizationaccess

Organizational Organizational InfrastructureInfrastructure

Preservation mandate Preservation mandate & priorities& priorities

Policies for selecting, Policies for selecting, reselecting, and reselecting, and deselectingdeselecting

Technical Technical requirements and best requirements and best practicespractices

Training and Training and professional professional development development

Provenance, Provenance, authenticity, and authenticity, and integrity integrity

Intellectual property Intellectual property rights rights

CollaborationCollaboration Risk assessment Risk assessment Documentation Documentation

Technical ArchitectureTechnical Architecture

Repository to ingest, Repository to ingest, monitor, manage, monitor, manage, and archive and archive

Storage Storage architecturearchitecture

Ingest workflow and Ingest workflow and quality control quality control

Preservation Preservation metadatametadata

Interoperability Interoperability

Monitoring and Monitoring and managementmanagement

Preservation Preservation strategies strategies

Disaster-prevention & Disaster-prevention & recoveryrecovery

Security measuresSecurity measures Technical auditsTechnical audits Technology Technology

forecastingforecasting

Resources FrameworkResources Framework

Storage Storage architecturearchitecture PrimaryPrimary SecondarySecondary

Programming & Programming & systems staffsystems staff

Preservation policy Preservation policy staffstaff

Network chargesNetwork charges SustainabilitySustainability Cost recoveryCost recovery

PoDPoD DoD DoD

Access VisionAccess Vision

Redundancy Redundancy arrangements for arrangements for accessaccess

Search enginesSearch engines Access to materials:Access to materials:

Public domainPublic domain CopyrightCopyright

New forms of New forms of scholarshipscholarship Text miningText mining VisualizationVisualization Clustering Clustering New forms of New forms of

publishingpublishing Social networkingSocial networking

Part 3: Recommendations

Reassess Digitization Reassess Digitization Requirements: Create a New Requirements: Create a New

MetricsMetrics Contemporary digitization technologies and Contemporary digitization technologies and

image-processing toolsimage-processing tools

New archival file formats, such as JPEG2000 New archival file formats, such as JPEG2000 and PDF/A and PDF/A

Evolving access formats for sophisticated Evolving access formats for sophisticated retrieval and use of content such as text mining retrieval and use of content such as text mining

The correlation between image quality and The correlation between image quality and OCR accuracy OCR accuracy

Enhance Access to Digitized Enhance Access to Digitized ContentContent

Enduring access by enabling online discovery Enduring access by enabling online discovery Print preservation for materials in copyrightPrint preservation for materials in copyright

Collaboration for aggregated or federated Collaboration for aggregated or federated accessaccess

Understand the impact of contractual Understand the impact of contractual restrictions on preservation responsibilitiesrestrictions on preservation responsibilities

Support new e-scholarship formats & Support new e-scholarship formats & applicationsapplications

Outline an Archiving Action Outline an Archiving Action AgendaAgenda

Defining minimum requirements necessary to Defining minimum requirements necessary to facilitate shared storage and registry initiatives facilitate shared storage and registry initiatives

Making geographic data-redundancy arrangementsMaking geographic data-redundancy arrangements

Implementing distributed and collaborative Implementing distributed and collaborative strategies (LOCKSS and Portico)strategies (LOCKSS and Portico)

Sharing open-source preservation servicesSharing open-source preservation services

Exploring how usage statistics can inform Exploring how usage statistics can inform preservation decisionspreservation decisions

Understand Costs Involved in Understand Costs Involved in

Digital Preservation EffortsDigital Preservation Efforts Significant local expenses by Significant local expenses by

participating librariesparticipating libraries

Building and managing a digital Building and managing a digital preservation infrastructure is neither preservation infrastructure is neither easy nor cheap easy nor cheap

Share cost information – understand Share cost information – understand long-term implicationslong-term implications

Developing a Joint AgendaDeveloping a Joint Agenda

Institutional differences in opinion, funding Institutional differences in opinion, funding models, digital library infrastructures, and models, digital library infrastructures, and strategic goalsstrategic goals

Cooperative efforts should not slow the Cooperative efforts should not slow the community’s efforts, but rather complement community’s efforts, but rather complement the ongoing institutional programsthe ongoing institutional programs

Join forces among cultural institutions & Join forces among cultural institutions & corporate partners to leverage resources, corporate partners to leverage resources, strengthen causes, control risks, and expand strengthen causes, control risks, and expand alternative strategiesalternative strategies