implementing an integrated digital asset management system: fedora and oais in context

Implementing an Implementing an Integrated Digital Asset Integrated Digital Asset

Management System: Management System: FEDORA and OAIS in FEDORA and OAIS in

ContextContextPaul BevanPaul Bevan

DAMS Implementation Manager DAMS Implementation Manager

paul.bevan@llgc.org.ukpaul.bevan@llgc.org.uk

StructureStructure Background and overviewBackground and overview OAIS ModelOAIS Model

Why OAIS?Why OAIS? OverviewOverview IngestIngest Archival StorageArchival Storage AccessAccess (Administration, Data Management)(Administration, Data Management)

METSMETS Integration as a project (Issues and Tasks)Integration as a project (Issues and Tasks)

Institutional ContextInstitutional Context

The LLGC DAMS is safekeeping for The LLGC DAMS is safekeeping for Wales’ digital assets but, it is an Wales’ digital assets but, it is an element within a wider Digital Asset element within a wider Digital Asset Management Solution, which is an Management Solution, which is an element within the library’s element within the library’s integrated systems, which come integrated systems, which come together to:together to:… preserve and give access to all kinds and forms of recorded knowledge, especially relating to Wales and the Welsh and other Celtic peoples, for the benefit of the public including those engaged in research and learning.

Institutional ContextInstitutional Context IMS Procurement high level IMS Procurement high level

deliverables:deliverables: Improves efficiency and substantially simplifies the Library’s Improves efficiency and substantially simplifies the Library’s

technical architecture and infrastructure.technical architecture and infrastructure. Interfaces seamlessly across different parts of the Library Interfaces seamlessly across different parts of the Library

with links to, for example, remote document delivery with links to, for example, remote document delivery systems.systems.

Conforms to and interfaces with international standards Conforms to and interfaces with international standards and related activities based on an open architecture.and related activities based on an open architecture.

Is open and hospitable to external user systems, e.g. for Is open and hospitable to external user systems, e.g. for document requesting, resource discovery and inter-library loans.document requesting, resource discovery and inter-library loans.

Is operational with successfully migrated legacy data and data Is operational with successfully migrated legacy data and data from external sources.from external sources.

Accommodates the functions of the National Screen and Sound Accommodates the functions of the National Screen and Sound Archive of Wales.Archive of Wales.

Is open and hospitable to the information community in Is open and hospitable to the information community in Wales e.g. for data exchange, maintenance and storage, and Wales e.g. for data exchange, maintenance and storage, and for the ingest of electronic resources.for the ingest of electronic resources.

Institutional Context: Institutional Context: Development AimsDevelopment Aims

History of development with FedoraHistory of development with Fedora

Key Aims:Key Aims:

Add functionality to VITALAdd functionality to VITAL Developments in line with communities (Fedora, Vital and Developments in line with communities (Fedora, Vital and

other DAMS)other DAMS) Skills and ResourcesSkills and Resources

Cataloguers experienceCataloguers experience Re-use skillsRe-use skills

Single SearchSingle Search Solution to adhere to Standards; METS, PREMIS, OAIS, Solution to adhere to Standards; METS, PREMIS, OAIS,

TDR etc etcTDR etc etc

OAIS OverviewOAIS Overview

Why OAIS?Why OAIS? Useful OverviewUseful Overview Standard and ‘tested’Standard and ‘tested’ Overlaps with TDR (medium-term goal)Overlaps with TDR (medium-term goal) GranularityGranularity

But...But...

Not overly restrictive (Not overly restrictive (interpretation?interpretation?).). Complex & inaccessibleComplex & inaccessible

Rights Management

Object Storage Servers

Dissemination Layer

FEDORA

Preservation Check

(eg. DROID)

Virus Check

Error Check

(Checksum)

Preservation Tasks

(eg. Migration)

Object

Electronic Deposit

Off-AirRecording

DigitalArchives

Digitisation

Ing

est M

ech

an

isms

…

FEDORA

iPortal

Storage Solution(s)

VITALClient

UserStaff

Layered Layered DisseminaDisseminator tor StructureStructure

Direct Route

(eg. Google, URL)

ExternalDepositor

Ingest Process

Web Deposit Interface

VITAL Access Portal

Rights?

Modelling: IngestModelling: Ingest

Rules for being an AIPRules for being an AIP Every object will have a MARC record (at Every object will have a MARC record (at

some level) within the IMSsome level) within the IMS Every object in the repository will have a Every object in the repository will have a

METS documentMETS document Every object will have DC for OAI-PMHEvery object will have DC for OAI-PMH METS will be our SIP, AIP and DIPMETS will be our SIP, AIP and DIP METS will be the policy, FEDORA services METS will be the policy, FEDORA services

will enact the policy.will enact the policy. eg. DC Section in METS populates the DC eg. DC Section in METS populates the DC

datastreamdatastream eg. Structural Map held in METS, structure in eg. Structural Map held in METS, structure in

RELS-EXT datastreamRELS-EXT datastream

METS Creation METS Creation

Existing METS Document

(if applicable) MARC XML

Default METSDocument

METS SIP

JHoveDC

ModsPREMIS

Technical – MIXBehaviour

METS:RightsMETS:StructuralMap

etc.

Ingest RevisitedIngest Revisited

Checksum, Error Checking etc

Ingest Processes (IMS, MARCXML etc)

Update IMS with 856 link to Handle

Modelling: Archival Modelling: Archival StorageStorage

Object (PID/Handle)

DS: METS

DS: DC (OAI-PMH)

DS: Relationships

DS: Object (eg. TIFF File)

DS: Object (eg. JPEG File)

DS: Object (eg. Thumbnail File)

DS: Object (eg. Zoomify File)

Referenced

Referenced

Referenced

Near-LineTape Store

Fast Image Server

Server

Object Model (AIP): Still Object Model (AIP): Still ImageImage

Metadata Types & Metadata Types & LocationsLocations

Asset

Virtua VITAL

MARC21 METS

DC

Archival Storage Archival Storage RevisitedRevisited

FEDORA/VITAL

Developments Existing/Storage Processes

Modelling: AccessModelling: Access

Access RevisitedAccess Revisited

FEDORA/VITALIMS/Virtua

Briefly: Administration?Briefly: Administration?

Briefly: Data Briefly: Data Management?Management?

METSMETS

METS as SIP, AIP and DIPMETS as SIP, AIP and DIP Contains Metadata from:Contains Metadata from:

JHOVE/Automatically ExtractedJHOVE/Automatically Extracted RightsMD RightsMD DescriptiveMD (minimum required for DescriptiveMD (minimum required for

locating)locating) PreservationMDPreservationMD

METS functions as the METS functions as the rulesrules not the not the enforcement mechanismenforcement mechanism

Key Issues for IntegrationKey Issues for Integration

Seamless Transition IMS to DAMSSeamless Transition IMS to DAMS Skin Skin Language choice Language choice

Persistent SessionPersistent Session Search historySearch history CartCart

Shared Rights Shared Rights LDAPLDAP

Single Sign onSingle Sign on

IMS Linking IMS Linking (Developments)(Developments)

Updating of MARC Records in IMSUpdating of MARC Records in IMS Ingest of descriptive metadata from Ingest of descriptive metadata from

IMSIMS Single Search & Sign OnSingle Search & Sign On Transparent Dissemination Transparent Dissemination

ExperienceExperience Rights ManagementRights Management

Managing the Managing the ImplementationImplementation

Implementation Group comprising mix Implementation Group comprising mix of standards, IMS project management, of standards, IMS project management, technical, and digitisation staff. technical, and digitisation staff. Carried Carried over from pilot.over from pilot.

2 DAMS Implementation Managers 2 DAMS Implementation Managers (Systems & Technical)(Systems & Technical)

Key interactions with other personnel Key interactions with other personnel as required.as required.

Managing the Managing the ImplementationImplementation

Milestones:Milestones: Migration of existing Digitised MaterialMigration of existing Digitised Material Switch over to VITAL for delivery of Switch over to VITAL for delivery of

assetsassets Ingest of other existing formats (eg. Ingest of other existing formats (eg.

VDEP, Websites, A/V)VDEP, Websites, A/V) Implementation of further Implementation of further

disseminators required for access.disseminators required for access.

Questions?Questions?

paul.bevan@llgc.org.ukpaul.bevan@llgc.org.uk