cloud transforms culture, europeana tech 2014

12
Culture transformed by the Cloud Pavel Kats (Europeana Foundation) Marcin Werla (PSNC)

Upload: pavelkats

Post on 06-Aug-2015

66 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Cloud Transforms Culture, Europeana Tech 2014

Culture transformed by the Cloud

Pavel Kats (Europeana Foundation)Marcin Werla (PSNC)

Page 3: Cloud Transforms Culture, Europeana Tech 2014

Data Storage: Records and Datasets

● Scaleable object storage cluster with support for basic technical metadata● Storing content of all types - as parts of data records● Allows to organize data records in datasets● Generic data model to support metadata and content aggregation

workflows

Record → Representation → Version

Technology: OpenStack Swift + Apache Cassandra

Project: Europeana Cloud

Page 4: Cloud Transforms Culture, Europeana Tech 2014

Persistent Identifiers

● Allocates unique and persistent identifiers to records

● Maintains a built-in mapping between these identifiers and local identifiers used by providers (several local identifiers can be mapped to one global)

● Will be compliant with standards like URN and PURL in the future

● As an additional service for the cultural sector, can be backed by a connection to an available identifier system (e.g. DOI)

Technology: Apache CassandraProject: Europeana Cloud

Marcin Werla
First bullet - TBC
Page 5: Cloud Transforms Culture, Europeana Tech 2014

Annotations

● Separation between core data (digital objects+metadata) and complementary data layers required for research, provenance or other application-specific needs

● Complementary data can be structured in many ways and it is usually stored separately from the core one

Technology: Graph databases (probably, e.g. Neo4j)Project: Europeana Cloud

Page 6: Cloud Transforms Culture, Europeana Tech 2014

Long Term Archival Storage

● Several public data archiving services exist in Europe on national and pan-Europeana levelso EU-DAT (European level,

see http://www.eudat.eu/partners) o DANS (the Netherlands)o PLATON Archiving Service (Poland)

● Europeana DSI can be partnering with such trusted bodies to provide digital preservation services

Marcin Werla
In this case - not by building it but by associating national or european level providers with Europeana community.
Pavel Kats
Good idea, I do not know much about these project. Can you add a couple of sentences in the notes?
Page 7: Cloud Transforms Culture, Europeana Tech 2014

Content-Specific Access

Technology: IIIF-compliant streaming of images Project: Europeana Cloud+Europeana Newspapers+Europeana Creative

● Streaming functionality for specific popular content formats

● For images (the most popular content type) provide a streaming service compatible with the IIIF standard, increasingly adopted by the cultural heritage sector

● HTTP-based streaming of audio and video content will be considered

Marcin Werla
Image to be updated probably
Page 8: Cloud Transforms Culture, Europeana Tech 2014

Metadata and Content Indexing

● Out-of-the-box search service for a controlled set of formats which are well known, e.g.:

o EDM, LIDO, ...

o Full text search (where full text is provided)

Technology: SolrProject: Europeana Cloud / Europeana v3

Page 9: Cloud Transforms Culture, Europeana Tech 2014

A scaleable distributed computing system for massive resource-intensive computations, such as

● Metadata transformations according to predefined mappings

● Metadata enrichment

● Content analysis● Content conversions

between formats● Thumbnail generation

Metadata and Content Processing

Technology: Apache Storm, AkkaProject: Europeana Cloud / Europeana Creative

Page 10: Cloud Transforms Culture, Europeana Tech 2014

Application Hosting

● Cloud-based application hosting services

● PaaS as a service offered by the DSI to projects and developers

Page 11: Cloud Transforms Culture, Europeana Tech 2014
Marcin Werla
Image to be updated
Page 12: Cloud Transforms Culture, Europeana Tech 2014

Thank you for your attention!

Pavel Kats <[email protected]>Marcin Werla <[email protected]>