microservices in locloud

Download Microservices in LoCloud

Post on 14-Jan-2017

273 views

Category:

Internet

0 download

Embed Size (px)

TRANSCRIPT

  • LoCloud Conference - Sharing local cultural heritage online with LoCloud servicesMicroservices in LoCloudWalter Koch (kochw@ait.co.at)Gerda Koch (kochg@ait.co.at)AIT- Angewandte InformationstechnikForschungs-GmbH, Graz - AustriaLoCloud is funded by the European Commission's ICT Policy Support Programme

    *

  • G.&W.Koch: Microservices in LoCloud*Content

    Project ContextLoCloud MicroservicesVocabulary Microservices

    Technical Insights (examples)Microservices and Modern System Architectures

    DeploymentMarketplaceAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

    *

  • G.&W.Koch: Microservices in LoCloud*Project Context

    LoCloud is a Best Practice Network co-funded under the CIP ICT-PSP programme of the European Commission. LoCloud is supporting small and medium-sized institutions in making their content and metadataavailable to Europeana.Acloud-based technology infrastructure will enablethe aggregation oflocal content, anda number of microserviceswill help to reduce technical, semantic and skills barriers and to renderthe content more discoverable and interoperable. Amersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*Project Context

    Six development teams: AIT, Athena RC, AVINET, IPCHS, UPV/EHU, VUKFC

    All the services are implemented on virtual machines in a cloud testlab (using the OpenNebula cloud computing platform)

    API documentation is available for each service

    End-user interfaces are provided for three microservicesEach service has been integrated in MOReAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*LoCloud Microservices

    http://support.locloud.eu/ Cloud-based microservices for metadata enrichment and capture: Geo-location APIVocabulary serviceHistoric Place Names serviceGeo-coding application

    Vocabulary matching service Background linking serviceWikimedia applicationAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*LoCloud MicroservicesLoGeo API

    Uses NER-Name Entity RecognitionRecognizes and returns one or more place names candidates accompanied by geographical coordinates.GPLIPCHSAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*LoCloud MicroservicesVocabulary service

    Based on TemaTresIncorporates 29 standard thesauri allows users to add and create vocabularies, and add terms or translationsadd thesauri terms to all items of a metadata packageIntegrated in MOREExploited by the LoCloud vocabulary matching microservice via its APIGPLAITAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*LoCloud MicroservicesHistoric Place Names service

    A semi-automatic historical geo-information management function and web service. Enables local cultural institutions to collaborate in developing the Thesaurus of HPN and enriching ingested metadata.Enables export of selected LoCloud HPN Thesaurus data sets.

    GPLVUKFAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*LoCloud MicroservicesGeo-coding application

    End-user oriented applicationallows institutions to add geographical locations to existing content in a controlled crowd-sourcing environment and then load the augmented data back into their original production databases.

    GPLAVINETAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*LoCloud MicroservicesVocabulary matching service

    Builds on work in the PATHS project (FP7)Automatically assigns relevant concepts and terms to item records Retrieves terms from the Vocabulary serviceUPV/EHUApache License 2.0Amersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*LoCloud MicroservicesBackground linking service

    Based on work in PATHSFollows the Named Entity Disambiguation approachEnriches items with links to external contextual information in DBpedia and Wikipedia

    Apache License 2.0UPV/EHUAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*LoCloud MicroservicesWikimedia application

    A web service that uses a REST interface to communicate with Wikimedia commons The main functionalities are harvesting content form Wikimedia, parsing the harvested content, and identifying useful entities that can be mapped to the ESE or EDM metadata schemas. The mapped ESE / EDM records are then sent to MORe to be delivered to Europeana.

    Wikimedia Commons LicensingAthena RCAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • Vocabulary MicroservicesG.&W.Koch: Microservices in LoCloud*Amersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*http://vocabulary.locloud.eu/

    Vocabulary Microservices

    LoCloud uses a variety of standard vocabularies during the metadata enrichment process.These vocabularies have been established with the TemaTres tool and are available in the LoCloud testlab.In addition, you can add your own vocabularies, establish new vocabularies or add languages to existing vocabularies.

    Amersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

  • Technical InsightsVocabulary WebService; 20+ Functions, REST-APIhttp://test113.ait.co.at/tematres/vocab/services.php REST-API-Example: Search; UNESCO-Thesaurushttp://test113.ait.co.at/tematres/unesco/services.php?task=search&arg=peace SPARQL-Example; DISMARC-Genreshttp://test113.ait.co.at/tematres/vocab/sparql.php (SPARQL Endpoint)Service Call (fetchTopTerms); embedded in a test application ( Vocabulary Microservice)Test Application Development; Designer ViewThe Test Application; Part of Data Entryhttp://dmdap.ait.co.at/index.php/vocabulary-test/

    Amersfoort, 2016-02-05G.&W.Koch: Microservices in LoCloud*SELECT ?term WHERE { ?concept skos:prefLabel "Acid Jazz" .?concept skos:broader ?broader . ?broader skos:prefLabel ?term . }

    G.&W.Koch: Microservices in LoCloud

  • G.&W.Koch: Microservices in LoCloud*Vocabulary WebService20+ Functions, REST-APIParametersExampleAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

    3419.bin

  • G.&W.Koch: Microservices in LoCloud*REST-API-Example: SearchUNESCO-Thesaurushttp://test113.ait.co.at/tematres/unesco/services.php?task=search&arg=peace Amersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

    3423.bin

  • G.&W.Koch: Microservices in LoCloud*SPARQL-ExampleDISMARC-GenresQuery: "Find all Broader Terms for Acid Jazz SPARQL End Point: http://test113.ait.co.at/tematres/vocab/sparql.php

    QueryResultArt

    ThesaurusEntry

    Amersfoort, 2016-02-05PREFIX skos: SELECT ?term WHERE { ?concept skos:prefLabel "Acid Jazz" .?concept skos:broader ?broader . ?broader skos:prefLabel ?term . }Query

    G.&W.Koch: Microservices in LoCloud

    3433.bin

    3434.bin

    3435.bin

    *

  • G.&W.Koch: Microservices in LoCloud*Service Call (fetchTopTerms)embedded in a test applicationMicro- ServiceVocabulary Web ServiceAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

    3436.bin

  • G.&W.Koch: Microservices in LoCloud*Test Application DevelopmentDesigner ViewDevelopment of a Drop Down ListDevelopment of a Drop Down ListAmersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

    3437.bin

  • G.&W.Koch: Microservices in LoCloud*The Test ApplicationPart of Data EntryPath to the Thesaurus ItemCandidate Term Crowdsourcing activity (Vocabulary Management)Amersfoort, 2016-02-05http://dmdap.ait.co.at/index.php/vocabulary-test/

    G.&W.Koch: Microservices in LoCloud

    3441.bin

  • Microservices and Modern System ArchitecturesG.&W.Koch: Microservices in LoCloud*Amersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

    *

  • G.&W.Koch: Microservices in LoCloud*The LoCloudAggregation Structure

    EnrichmentServicesEuropeana Cloud

    TestlabAmersfoort, 2016-02-05Object Storage

    G.&W.Koch: Microservices in LoCloud

    3447.bin

  • G.&W.Koch: Microservices in LoCloud*About: MicroserviceWikipedia: https://en.wikipedia.org/wiki/Microservices (2016-02-01)[...] microservices is a software architecture style in which complex applications are composed of small, independent processes communicating with each other using language-agnostic APIs. These services are small, highly decoupled and focus on doing a small task,facilitating a modular approach to system-building.

    Amersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

    3452.bin

  • G.&W.Koch: Microservices in LoCloud*Evolution of Architecturespwc: Technology Forecast: Rethinking Integration, Issue 1, 2014, page 3

    Amersfoort, 2016-02-05

    G.&W.Koch: Microservices in LoCloud

    3453.bin

    *

  • G.&W.Koch: Microservices in LoCloud*Deployment of MicroservicesLocloud:Each LoCloud microservice is contained in a virtual engine (IaaS)

    Post LoCloud (AIT):Packaging (some) microservices 1)inside docker-containers (PaaS)Microservices are available via a private Docker HubManagement of microservices using Docker Swarm or KubernetesApplications: OpenStack Swift for object storage

    Amersfoort, 2016-02-05

    1) dotCloud, Inc. -http://www.docker.io/static/img/docker-top-logo.png, Apache License