europeana cloud - ingestion and aggregation workshop
DESCRIPTION
Europeana Cloud Kick-Off Meeting, 5 March 2013, The Hague, The Netherlands. By Chiaro LatronicoTRANSCRIPT
europeana cloud
Ingestion and Aggregation Workshop
Chiara LatronicoOperations Officer The European Library
Europeana Cloud Kick-Off Meeting, Den Haag, 04-05 March 2013
Agenda
The European Library Datasets life-cycle and workflows Content ingestion questionnaire Ingestions tools Aggregation and delivery to Europeana Europeana Data Model (EDM) Full-text index Questions
48 National Libraries ~ 40 Research and University Libraries ~ 115 Million Bibliographic Records > 16 Million Digital Objects > 25 Million Pages of Full-text
The European Library
The European Library
Data access point for researchers Combination of bibliographic records and
metadata for digital objects
Aggregator for Europeana Cloud
The European LibraryAggregation into Europeana
The European LibraryIngestion Workflow Content ingestion questionnaire Scheduling of ingestion Datasets ready for harvesting Create case in CRM: case # to provider Harvesting metadata Enhance metadata (VIAF, Geonames, MACS,...) Indexing in acceptance portal E-mail to provider to accept dataset Live index = live portal Delivery to Europeana Enhancing and publishing in Europeana
Content Ingestion Questionnaire Web-form Personal Information
(about the person filling the web-form) Name & surname Job title E-mail address Skype address
Information about Organization Organization name Country Website Type of institution
Content Ingestion QuestionnaireHarvesting Details Which protocol will be used to transfer data?
OAI-PMH File Z39,50 FTP HTTP
Harvesting time and dates preferences
How often dataset(s) will need to be updated? Weekly Monthly Quarterly Annually On demand
Content Ingestion QuestionnaireInformation about dataset(s)
Number of dataset(s) to be ingested
Number of records to be expected
Number of digital objects to be expected
Contact person(s) per dataset(s) Editorial: for collection description Technical: for collection ingestion
Content Ingestion QuestionnaireInformation about Metadata
Metadata standard(s) available to describe objects Marc21 MarcXchange Unimarc ESE EDM METS MODS OAI_DC TEI
Number of formats available per dataset
Content Ingestion QuestionnaireInformation about Metadata
Are the metadata ready? If yes, for which dataset(s) If not, when will they be ready?
Type of digital objects per dataset(s) TEXT IMAGE AUDIO VIDEO
Content Ingestion QuestionnaireInformation about Content
Will content be delivered in addition to metadata?
If yes, for which dataset(s)? If yes, in which format(s)?
Has the content been digitized? If yes, for which dataset(s)? If not, when will the content be available?
Content Ingestion QuestionnaireInformation about Authority
Will authority files be delivered? If yes, for which dataset(s)? If yes, in which format(s)?
Are controlled vocabularies utilized? If yes, which kind?
• Classification• Thesauri• Subject Headings• Other
If yes, for which dataset(s)?
Will full-text be delivered? If yes, for which dataset(s)? If yes, in which format(s)?
SugarCRM aggregation tasks management
SugarCRM Customer Relation Management tool
SugarCRM generation automated reports
SugarCRM Customer Relation Management tool
In SugarCRM Organizations, contacts, datasets, project and more
SugarCRM is utilized for Collections control Ingestion plans Automated reports Cases per specific datasets
SugarCRM Customer Relation Management tool
The European LibrarySystem architecture
UIM Unique Ingestion Management
Dataset in Acceptance Portal
Acceptance Portal Test environment Providers to validate data
Reports via UIM workflows Link Validation Field Validation
Dataset in Acceptance Portal
When Dataset in Acceptance Portal
Create an account onhttp://www.theeuropeanlibrary.org/
Use credential to log-in in acceptancehttp://www.tel.ulcc.ac.uk/acceptance/
Validate data using tabs for Default XML
Dataset in Acceptance Portal
Dataset(s) in Live Index and Portal
When a provider accepts dataset(s) E-mail Dataset(s) ready for live index Dataset(s) ready for Europeana
Dataset(s) indexed into the live portal It takes ~ 24 hrs for dataset(s) to be
searchable into the live portal
Dataset(s) Live in Europeana
When a provider accepts dataset(s)
Dataset(s) delivered to Europeana Europeana publishes live once a month Delivery deadline ~ 21 of each month Dataset(s) searchable in Europeana by
following month
Dataset(s) published live in Europeana E-mail to provider with link to dataset(s)
into Europeana portal
EDM – Europeana Data Model
Europeana Libraries project EDM for library data
Europeana Cloud Project EDM for museum and archive metadata &
content
Delivery in EDM to Europeana
EDM – Europeana Data Model
Europeana Preview
Europeana Preview
Full-Text (OCR)
Continue Full-text indexing
Full-Text (OCR)
Full-text & OCR
URLs to OCR texts into metadata Extraction of Full-text Full-text indexing
Full-Text (OCR)
Continue the work about Full-text Europeana Newspapers Europeana Cloud
Summary
What we would like to have from you Richest possible metadata Content Full-text Authority files or ontologies
www.theeuropeanlibrary.org