LoCloud - D3.4: Vocabulary services

Download LoCloud - D3.4: Vocabulary services

Post on 11-Jun-2015

198 views

Category:

Technology

2 download

DESCRIPTION

This is one of 7 reports provided in work package 3: Micro services for small and medium institutions. Authors: Odo Benda, Astrid Hller and Gerda Koch AIT Angewandte Informationstechnik Forschungsgesellschaft mbH

TRANSCRIPT

1. Local content in a Europeana cloudD3.4: Vocabulary servicesAuthors:Odo Benda, Astrid Hller and Gerda KochAIT Angewandte Informationstechnik Forschungsgesellschaft mbHLoCloud is funded by the European CommissionsICT Policy Support ProgrammeVersion: 1.0 2. RevisionHistoryRevisionDateAuthorOrganisationDescriptionV0.12014-06-23A.HllerAITDraftofdocumentV0.22014-07-04O.BendaAITRevisionDraftV0.22014-07-07A.HllerAITRevisionDraftV0.22014-08-20G.KochAITRevisionAPIReferenceV0.32014-08-25A.HllerAITTable1,UNESCOThesaurusexamplesV0.32014-08-26A.HllerAITAPIsV0.32014-08-27A.HllerAITFAQsectionV0.32014-08-28O.BendaAITInstallation,APIsV0.32014-08-28W.KochAITReviewV0.42014-08-28G.KochAITEditingwholedocumentV1.02014-09-02O.Benda,A.Hller,G.KochAITVersion1WView the LoCloud project deliverablesChangeLogJuly2014:LoCloudexperimentalvocabularyapplicationeva,Version1August2014:LoCloudexperimentalvocabularyapplicationeva,Version2Statementoforiginality:Thisdeliverablecontainsoriginalunpublishedworkexceptwhereclearlyindicatedotherwise.Acknowledgementofpreviouslypublishedmaterialandoftheworkofothershasbeenmadethroughappropriatecitation,quotationorboth.LoCloudD3.4VocabularyServices2 3. ContentsExecutivesummary.......................................................................................................................41.Introduction............................................................................................................................5Overviewofthemicroservice..................................................................................................................5Overviewofthedevelopmentmethodology...........................................................................................72.Gettingstarted.....................................................................................................................12Termsofuse.........................................................................................................................................12Authentication......................................................................................................................................12BaseURL...............................................................................................................................................12UsingtheLoCloudVocabularyManagementSystembasedonTemaTres..............................................123.APIReference.......................................................................................................................134.Howtoinstallthemicroservice............................................................................................375.HowthemicroserviceisinstalledinLoCloud........................................................................386.Troubleshooting/FAQ..........................................................................................................397.References............................................................................................................................428.Glossary................................................................................................................................439.Conclusions...........................................................................................................................45Annex1-UsingtheLoCloudexperimentalvocabularyapplicationbasedonTemaTres................46Creatinganewvocabulary........................................................................................................................................50Administration..........................................................................................................................................................53Vocabularyconfiguration.....................................................................................................................................53Users.....................................................................................................................................................................54Export...................................................................................................................................................................55Maintenancedatabase.........................................................................................................................................56Deletedatamassively......................................................................................................................................60TermManagement...................................................................................................................................................61Notes.........................................................................................................................................................................68Reports......................................................................................................................................................................70Vocabularyreference................................................................................................................................................71Importingamultilingualvocabulary.........................................................................................................................78Abbreviatons........................................................................................................................................81LoCloudD3.4VocabularyServices3 4. ExecutivesummaryTheaimoftheworkwithinTask3.4istodevelopanexperimentalapplicationforenablinglocalculturalinstitutionstocollaborateinthedevelopmentofmultilingualvocabulariesforlocalhistoryandarchaeologyandallowtheretrievaloftermstobeintegratedduringsemanticenrichmentintheLoCloudaggregationprocess.Furthermore,thisapplicationshouldbemadeavailableforthelocalusersasacloud-basedservice.Culturalheritagedomainvocabulariescanvarytoahugeextendfromcountrytocountry.Termsexistinginonelanguagemightnotbeknowninanotherlanguage,orthehierarchiesofthevocabulariesinthevariouslanguagescouldvary.Hence,themainissuesformultilingualvoabulariesare: Structuralproblems:Theconceptualsystemscandifferinthevariouslanguages Equivalenceproblems:o Thelexicalizationofconceptscandifferindifferentlanguages(eg.bonefishbone(en);KnochenGrten(de))1o Thetranslationofathesaurusfromonelanguagetoanotherdoesnotmakeitathesaurusfortheotherlanguage(intraandinter-languageequivalenceproblems,termsmightdifferinmeaningetc.)Agoodwaytotackletheseproblemsistochooseafederatedmodelforthesauruscreation.Withthefederatedmodelitispossibletohaveindepentvocabulariesforthevariouslanguagesinthesamedomain.Thealignmentofthevariousvocabulariesinthedifferentlanguagesisdoneviaconceptidentifiers.Thelinkingofvocabularyconceptsmakesitpossiblefortheend-usertosearchinalllinkedindexingvocabulariesusinganyoneofthelinkedthesauriorsubjectheadinglists.Thus,theLoCloudexperimentalvocabularyapplicationisbasedonthefederatedmodelandawell-establishedplatform,TemaTres2,hasbeenchosenasbaselinefordevelopment.ThetoolhasbeenintegratedintheLoCloudtestlabwhereitcanbeaccessedviahttp://test113.ait.co.at/tematres/unesco/index.phporviathetestplatformofthemicroservicesathttp://lc004.ait.co.at:8080/portal/site/wp3.Itsupportstheimportofvocabulariesandtheonlinecollaborationinthecreationandupdatingofvocabularies.ForthesepurposestheTemaTressoftwarehadtobeextended.ArewrittenSKOSimporterwasaddedandtwonewwebservicecallsweredevelopedtoallowimportingdataintoaremotethesaurus.ThisdocumentdescribestheexperimentalvocabularyapplicationVersion2(eva2)thathasbeensetuptoAugust2014.ThetestphaseofthemicroservicesisastagedtestingprocesstoNovember2014.Futuretestresultsorrecommendationsmayleadtotheupdatingofthetool.1http://www.dsoergel.com/cv/B67.pdf20thAugust,20142http://www.vocabularyserver.com/31thAugust,2014LoCloudD3.4VocabularyServices4 5. 1. IntroductionOverview of the microserviceThevocabularyservicesareused:a)inthevariousenrichmentworkflowsautomaticallythroughthegenericenrichmentserviceandb)throughtheAggregatorUI.Regardingthefirstcase,thegenericenrichmentserviceofLoCloudallowstoorchestratevariousRESTmicro-servicesintocomplexenrichmentworkflows.Theusercancreateaworkflowbyselectingandcombiningthemicro-serviceshewants.Morespecificallyforthevocabularyservicetheuserisabletoselecttermstoattachtoaharvestedpackage.Regardingthelatter,theuserispresentedwiththevariousthesauriandiscapableofsearchingandnavigatingthroughtheconcepts.Inordertominimizetheeffortforthedevelopmentoftheexperimentalvocabularyapplicationvariousvocabularytoolsthatarecurrentlyavailableandopensourcehavebeenevaluated.ResearchshowedthattheimplementationandadaptationoftheTemaTrestool,anopensourcevocabularyserverandwebapplicationtomanageandexploitvocabularies,thesauri,taxonomiesandformalrepresentationsofknowledgewouldbeaveryappropriatestartingpointforthedevelopment,http://www.vocabularyserver.com/.ThereforeitwasdecidedtouseTemaTresasstartingapplicationforshapinganexperimentalcollaborativevocabularytoolforLoCloudpurposes.TemaTressupportsthehandlingofvocabulariesinaccordancewithstandardthesaurusnorms.Itallowsforimport/exportofdataassimpletextfilesorinSKOS3format.TemaTresisawebapplicationformanagingformalrepresentationsofknowledge,thesauri,taxonomiesandmultilingualvocabularies.4Itsmainfeaturesare: SPARQLendpoint(SPARQLProtocolandRDFQueryLanguage) Meta-terms:definefacets,collectionsorarraysofterms Supportformultilingualthesaurus Exposevocabularieswithpowerfulwebservices Searchtermssuggestion(didyoumean...?) Displaytermsinmultipledeeplevelsinthesamescreen Searchexpansion Vocabularyharmonizationfeatures:equivalent,noequivalentandpartialtermswithothervocabularies3http://www.w3.org/2004/02/skos/20thAugust,20144http://sourceforge.net/projects/tematres/25thJune,2014LoCloudD3.4VocabularyServices5 6. Relationshipbetweenterms(BT/NT,USE/UF,RT) Nolimitstonumberofterms,alternativelabels,levelsofhierarchy,etc Systematicoralphabeticnavigation Search CompleteexportinXMLformat(Zthes,TopicMaps,MADS,DublinCore,VDEX,BS8723,SiteMap,SQL) CompleteexportinRDFformat(Skos-Core) Completeexportintxt Scopenotes,HistoricalandBibliographicalnotes Usermanagement Termsandusersupervision Duplicatestermscontrol Freetermscontrol Qualityassurancefunctions(Duplicatesandfreeterms,ilegalrelations) Multilingualinterface EasyInstall Utilitytoimportthesaurifromtabulatedtextfiles Uniquecodeforeachterm "Editinplace"featuresfortermsandcodes. Terminologymapping multilingualterminologymapping Termreportsforeditors Workflow:candidate,acceptedandrejectedterms Allowsuser-definedrelationshipstobecreated Relationshipsbetweentermsandwebentities Allowspublishedandhiddenlabelstobedefined ExporttoWXP(WordPressXML) ImportandexportdatainSkos-coreTemaTrescansupportdistributedmanagementmodels,ensuringconsistencyandintegrityofdataandrelationshipsbetweenterms.Ithasfeaturesspeciallydesignedtoprovidedatatraceabilityandqualitycontrolinthecontextofacontrolledvocabulary.FurthermoreTemaTressupportstheanalysisandcategorisationoftermsforsearch.Itenablesvocabulariestoberepresentedinawiderangeofmetadatastandardsrelevanttoknowledgemanagement.InAugust2014thetoolwasagainupdated:Editorsnowcangetterminologicalandconceptualsuggestionsfromanytematresvocabulary(morethan300..).Youcancreatetermsorgetrecommendationsprovidedbyothervocabulariesviawebservices.TheRussianlanguagewasaddedandaContactmailwasaddedtoexposedmetadataabouteachvocabulary.Thesimilartermsearchwasimprovedandthestepstouseandreusevocabulariesviawebserviceshavebeendescribed.LoCloudD3.4VocabularyServices6 7. Overview of the development methodologyAthttp://test113.ait.co.at/tematres/unesco/index.phpatestinstallationwithamultilingualthesauruswassetupfortheLoCloudstagedtestingphaseinspring2014.FurthermorethetestvocabulariesshowninTable1havebeenestablishedwithTemaTres.ThesevocabulariesareusedbytheenrichmentservicesdevelopedintaskT3.3ofLoCloud.Table 1 Test vocabularies created with TemaTresAuthorNameofvocabularyURLSubjectLanguageUniversityofCalifornia,SantaBarbaraAlexandriaDigitalLibraryFeatureTypeThesaurushttp://test113.ait.co.at/tematres/adl/index.phpScience&Technology:places,geographicaEnglishRoyalCommissionontheAncientandHistoricalMonumentsofScotland(RCAHMS)ArcheologicalObjectsThesaurusScotlandhttp://test113.ait.co.at/tematres/Archeological_ObjectsObjectsmadebyhumanactivityEnglishEnglishHeritageArcheologicalSciencesThesaurushttp://test113.ait.co.at/tematres/arch_scTechniques,recoverymethodsandmaterialsassociatedwitharchaeologicalsciencesEnglishEnglishHeritageBuildingMaterialsThesaurushttp://test113.ait.co.at/tematres/building_materialsMainconstructionalmaterialtypes(eg.thewalls)forindexingofmonumentsEnglishEnglishHeritageComponentsThesaurushttp://test113.ait.co.at/tematres/componentsTerminologycoveringdivisionsandstructuralelementsofabuildingormonumentEnglishAmericanFolkloreSocietyEthnographicThesaurushttp://test113.ait.co.at/tematres/ethnographicSocialsciences:ethnographic,folklore,unitedstates,etnomusicologyEnglishEnglishHeritageEventTypeThesaurushttp://test113.ait.co.at/tematres/event_typeTerminologyusedforrecordingarchaeologicalandarchitecturalEnglishLoCloudD3.4VocabularyServices7 8. AuthorNameofvocabularyURLSubjectLanguageinvestigative,datacollectionexercises;fromintrusiveinterventionstonondamagingsurveysEnglishHeritageEvidenceThesaurushttp://test113.ait.co.at/tematres/evidenceTerminologycoveringtheexistingphysicalremainsofamonument,orthemeansbywhichamonumenthasbeenidentifiedwherenophysicalremainsexistEnglishEnglishHeritageFISHArcheologicalObjectsThesaurushttp://test113.ait.co.at/tematres/FISH_arcobjectsRecordingofarchaeologicalobjectsinBritainandIrelandcoveringallhistoricalperiodsEnglishEionetEuropeanEnvironmentInformationandObservationNetworkGeneralMultilingualEnvironmentalThesaurusGEMEThttp://test113.ait.co.at/tematres/Gemet/index.phpenvironment,policiesDutch,English,French,German,Italian,Portuguese,SpanishFederationInternationaledesArchivesduFilm(FIAF)GeneralSubjectheadingsforFilmArchiveshttp://test113.ait.co.at/tematres/fiaf/index.phpArts&Humanities:films,filmsarchives,cinemaEnglishTheDiscoveryProgrammeIrishMonumentshttp://test113.ait.co.at/tematres/Irish_MonumentsIrishmonumentsEnglishTheDiscoveryProgrammeIrishPeriodshttp://test113.ait.co.at/tematres/Irish_PeriodsIrishperiodsEnglishRoyalCommissionontheAncientandHistoricalMonumentsofScotland(RCAHMS)MaritimeCraftThesaurusScotlandhttp://test113.ait.co.at/tematres/Maritime_CraftTypesofcraftthatsurviveaswrecks,oraredocumentedaslosses,inScottishmaritimewatersEnglishEnglishHeritageMaritimeCraftTypehttp://test113.ait.c CrafttypeswhichEnglishLoCloudD3.4VocabularyServices8 9. AuthorNameofvocabularyURLSubjectLanguageThesauruso.at/tematres/maritime_craft_typesurviveaswrecksinEnglishHeritagesmaritimerecordEnglishHeritageandRoyalCommissionontheHistoricalMonumentsofEnglandMDAArchaeologicalObjectsThesaurushttp://test113.ait.co.at/tematres/arcobjects/index.phpSocialsciences:archaeologicalobjects;museums;vocabularyEnglishRoyalCommissionontheAncientandHistoricalMonumentsofWales(RCAHMW)MonumentThesaurusWaleshttp://test113.ait.co.at/tematres/Monument_Thesaurus_WalesClassificationofmonumenttypesinWalesbyfunctionEnglishRoyalCommissionontheAncientandHistoricalMonumentsofScotland(RCAHMS)MonumentTypeThesaurushttp://test113.ait.co.at/tematres/mon_typeMonumenttypesrelatingtothearchaeologicalandbuiltheritageofScotlandEnglish,ScottishGaelicforsometermsEnglishHeritagePeriodThesaurushttp://test113.ait.co.at/tematres/periodEnglishHeritagePeriodsListEnglishRoyalCommissionontheAncientandHistoricalMonumentsofWales(RCAHMW)PeriodThesaurusWaleshttp://test113.ait.co.at/tematres/Period_WalesAlistofperiodsforuseinWalesEnglishBibliographicStandardsCommitteeoftheRareBooksandManuscriptsSection(ACRL/ALA)RelatorTermsforUseinRareBookandSpecialCollectionsCataloguinghttp://test113.ait.co.at/tematres/rbms/index.phpArts&Humanities:RareBook;SpecialCollectionEnglishUniversidaddeLenTesaurodeCienciasdelaDocumentacinhttp://test113.ait.co.at/tematres/docutes/index.phpSocialsciences:librarysciences,informationsciences,documentation,librarianshipSpanishLibraryofCongress.PrintsandPhotographsThesaurusforGraphicMaterials1:SubjectTermshttp://test113.ait.co.at/tematres/tgm1/index.phpArts&Humanities:graphicmaterials,subjecttermsEnglishLoCloudD3.4VocabularyServices9 10. AuthorNameofvocabularyURLSubjectLanguageDivisionLibraryofCongress.PrintsandPhotographsDivisionThesaurusforGraphicMaterials2:GenreandPhysicalCharacteristicTermshttp://test113.ait.co.at/tematres/tgm2/index.phpArts&Humanities:graphicmaterialsEnglishMinisteroperiBenieleAttivitCulturaliThesaurusPICO4.1http://test113.ait.co.at/tematres/pico/index.phpArts&Humanities:italianculture,heritageEnglish,ItalienUKATUKArchivalThesaurus(UKAT)http://test113.ait.co.at/tematres/ukat/index.phpGeneralreference:archives,ukat,unitedkingdomEnglishUNESCOUNESCOthesaurushttp://test113.ait.co.at/tematres/unesco/index.phpGeneralreference:education,culture,socialandhumansciences,informationandcommunication,politics,law,economicscienceEnglish,SpanishForLoCloudpurposesanextensiontothecoreSKOSformatisrequiredthatallowsthestorageofgeo-coordinatesandtimeperiods.AITdevelopedanextensionforTemaTresthatallowsmetadatathatexceedsSKOS-coretobestoredinthevocabulary.Thismadeitpossibletoimplementthewebservicesneededforthedataenrichment.AnotherLoCloudextensiontothetoolwasthedevelopmentofanimporterformultilingualvocabulariesinskosandplaintextformat.Forsimplifyingtheimportprocessofmultilingualvocabulariesanewidentifierforconceptswasintroduced.Thevocabularywebservicesofthetoolcanbeusedfortheintegrationofthevocabulariesintoremotelocalsystems.Andviceversaitispossibletointegrateexistingconceptsfromremotevocabulariesviathewebservicesintothecloudbasedvocabularytool.ThereforethewebservicecallsimportandlinkTermwereaddedtoTemaTres(seewebservicecalldocumentationinchapter3.APIReference).Twoscenarioshavebeendevelopedfortestingpurposes:1. ThetoolwasputonavirtualmachineintheLoCloudtestlabandisbeingtestedthere.2. ThecollaborativevocabulariesavailableviathetoolaremadeavailabletothemetadataenrichmentprocessandtheintegrationofthevocabulariesviaWebservicescanbetestedthisway.ThefirsttestphasewithselectedendusersfromtheLoCloudconsortiumstartedinJuly2014.Thetestsfocussedonthefunctionaltestingoftheexperimentalvocabularyapplication.ThesecondtestLoCloudD3.4VocabularyServices10 11. phasewillstartendofAugustandwillconcerntheLoCloudspecificadaptationsofthetool(multilingualityextensions,geolocationinformation,import).Inparallel,theresultsofthefirsttestphasearebeingevaluatedandthetoolwillbeconstantlyenhancedandupdatedtilNovember2014.LoCloudD3.4VocabularyServices11 12. 2. GettingstartedTerms of useTheexperimentalvocabularyapplication(eva)isfreelyavailableunderGNUGeneralPublicLicenseversion2.0(GPLv2).ThisisthesamelicenceasforthestandardTemaTrestool.OncetheLoClouddevelopmentshavebeenfinalizedandfine-tuneditisenvisagedtocontributethemtotheTemaTresrepository(http://sourceforge.net/projects/tematres/).AuthenticationAuthenticationforthetestplatformtoaccessthevocabularyapplicationis:test@ait.co.at/test(useraccount/password)Base URLPleasegotohttp://test113.ait.co.at/tematres/unesco/index.phpinyourbrowserorenterthetestplatformforthemicroservicesat:http://lc004.ait.co.at:8080/portal/site/wp3,useraccount/password:test/test,gototheworkspace>microservicesandselectVocabularyTool.Using the LoCloud Vocabulary Management System based on TemaTresThedetaileduserguidelinesfortheLoCloudexperimentalvocabularyapplicationcanbefoundinAnnex1.LoCloudD3.4VocabularyServices12 13. 3. APIReferenceInthefollowingsectioneachTemaTresAPIrequestanditsresponseisdescribed.PLEASENOTE:TheAPIsimportandlinkTermhavebeendevelopedbyAITforLoCloudpurposes.fetchSearchandretrievetermsusingexactmatching.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetch&arg=cultureParameterDatatypeDescriptionargstringexactmatchingtermsLoCloudD3.4VocabularyServices13 14. ResponseStatusResponse200Theresponseshowstheexactmatchingterm.Exampleresponse:LoCloudD3.4VocabularyServices14 15. fetchAltThealternativeornon-preferredtermsforonevocabularytermIDarerequested.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchAlt&arg=2575ParameterDatatypeDescriptionargintegerTermIDResponseStatusResponse200Theresponseshowsthealternativeornon-preferredtermsforoneID.Exampleresponse:200Theresponseshowssimpletermdateretrievedbycode.Exampleresponse:LoCloudD3.4VocabularyServices15 16. fetchDirectTermsThealternative,relatedordirecthierarchicaltermsforavocabularytermIDarerequested.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchDirectTerms&arg=155ParameterDatatypeDescriptionargintegerTermIDResponseStatusResponse200Theresponseshowsthealternative,relatedordirecthierarchicaltermsonetermID.Exampleresponse:LoCloudD3.4VocabularyServices16 17. fetchDownMorespecifictermsforonevocabularytermIDarerequested.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchDown&arg=142ParameterDatatypeDescriptionargintegerTermIDResponseStatusResponse200TheresponseshowsthemorespecifictermsforoneID.Exampleresponse:LoCloudD3.4VocabularyServices17 18. fetchLastRetrieverecenttermscreated.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchLastResponseStatusResponse200Theresponseshowsthelastesttermscreated.Exampleresponse:LoCloudD3.4VocabularyServices18 19. fetchNotesRetrievenotesforoneterm.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchNotes&arg=2575ParameterDatatypeDescriptionargintegerTermIDResponseStatusResponse200Theresponseshowsthenotesforaterm.Exampleresponse:LoCloudD3.4VocabularyServices19 20. fetchRelatedTherelatedtermsforavocabularytermIDarerequested.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchRelated&arg=3173ParameterDatatypeDescriptionargintegerTermIDResponseStatusResponse200TheresponseshowstherelatedtermsforoneID.Exampleresponse:LoCloudD3.4VocabularyServices20 21. fetchRelatedTermsTherelatedtermsforseveralvocabularytermsarerequested.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchRelatedTerms&arg=3173,3248ParameterDatatypeDescriptionarglistofintegersTermID,separatedbycommaResponseStatusResponse200TheresponseshowstherelatedtermsformorethanoneID.Exampleresponse:LoCloudD3.4VocabularyServices21 22. fetchSimilarSearchandretrievesimilartermforstringsearchexpression.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchSimilar&arg=kultuParameterDatatypeDescriptionargstringsimilarexpressionResponseStatusResponse200TheresponseshowsthesimilartermforastringsearchexpressionExampleresponse:LoCloudD3.4VocabularyServices22 23. fetchSourceTermsSearchandretrievetermsmappedintargetvocabularyforagiventerm.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchSourceTerms&arg=culturaParameterDatatypeDescriptionargstringtermResponseStatusResponse200Theresponseshowsthetermsmappedinatargetvocabularyforagiventerm.Exampleresponse:LoCloudD3.4VocabularyServices23 24. fetchTargetTermsSearchandretrievedataabouttargettermsmappedviawebservicesforoneTermID.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchTargetTerms&arg=142ParameterDatatypeDescriptionargintegerTermIDResponseStatusResponse200TheresponseshowsdataabouttargettermsmappedviawebservicesforoneTermID.Exampleresponse:LoCloudD3.4VocabularyServices24 25. fetchTermThedataforavocabularytermisrequested.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchTerm&arg=142ParameterDatatypeDescriptionargintegerTermIDResponseStatusResponse200Theresponseshowsthesimpletermdata.Exampleresponse:LoCloudD3.4VocabularyServices25 26. fetchTermsThedataforseveralvocabularytermsisrequested.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchTerms&arg=142,458ParameterDatatypeDescriptionarglistofintegersTermID,separatedbycommaResponseStatusResponse200Theresponseshowssimpletermdataformorethanoneterm.Exampleresponse:LoCloudD3.4VocabularyServices26 27. fetchTopTermsThetoptermsofavocabularyarerequested.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchTopTermsResponseStatusResponse200Theresponseshowsthetoptermsofthecompletevocabulary.Exampleresponse:LoCloudD3.4VocabularyServices27 28. fetchUpRequestthehierarchicalstructureforoneID.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchUp&arg=163ParameterDatatypeDescriptionargintegertermIDResponseStatusResponse200TheresponseshowsthehierarchicalstructureforonetermID.Exampleresponse:LoCloudD3.4VocabularyServices28 29. fetchVocabularyDataRequestthedataaboutavocabulary.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=fetchVocabularyDataResponseStatusResponse200Theresponseshowsthedataaboutthevocabulary.Exampleresponse:LoCloudD3.4VocabularyServices29 30. importImporttermsintothethesaurus.CurrentlythisroutinesupportsthedataformatSKOS.ThisAPIcallisusedbytheSKOSimporterwhenimportingmultilingualconcepts.RequestMethodURLPOSThttp://test113.ait.co.at/tematres/unesco/services.php?task=imultipart/form-datamport&arg=skosURL-ParameterDatatypeDescriptionargstringFixedtoskosPOST-ParameterDatatypeDescriptionid_correo_electronicostringAdminuseraccount(email)id_passwordstringAdminuserpasswordfilexml-skos-fileTheimportfile.ThisXMLfilehastocontaintheskos:Conceptsthatwillbeaddedtothethesaurus.ResponseStatusResponse200Theresponseshowsalistoftheimportedtermsandimportproblemsifapplicable.LoCloudD3.4VocabularyServices30 31. letterRequesttermsbytheinitialletter.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=letter&arg=dParameterDatatypeDescriptionargcharacterinitialletterResponseStatusResponse200Withthistasktermswithacertaininitiallettercanbesearchedandretrieved.Exampleresponse:LoCloudD3.4VocabularyServices31 32. linkTermLinkoneormoretermsoftworemotevocabularies.Allresultinglinkswithtermequivalences(EQ).IfyouhaveforexampleanEnglishandaSpanishvocabularyyoucanusethiscalltosendtheEnglishvocabularytheequivalenttermsinSpanishandviceversa.ThisAPIcallisusedbytheSKOSimporterwhenimportingmultilingualconcepts.RequestMethodURLPOSThttp://test113.ait.co.at/tematres/unesco/services.php?task=lmultipart/form-datainkTermPOST-ParameterDatatypeDescriptionid_correo_electronicostringAdminuseraccount(email)id_passwordstringAdminuserpasswordvocab_url[]string[]TheremotevocabularybaseURL.Thismustalreadyexistsasaremotetargetvocabulary.YouhavetousethesameURLprovidedinremotetargetvocabularyconfigurationterm[]string[]Theremotetermlabel.remote_term_id[]string[]Theidentifierofthetermintheremotevocabulary.local_term_id[]string[]Theidentifierofthetermyouwanttoconnecttotheremoteterm.ResponseStatusResponse200Theresponseshowsalistoftheconnectedtermsorproblemsifapplicable.LoCloudD3.4VocabularyServices32 33. searchSearchandretrieveterms.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=search&arg=cultureParameterDatatypeDescriptionargstringsearchterm(automaticallytruncatedonbothends)ResponseStatusResponse200TheresponseshowsthesearchedtermsExampleresponse:LoCloudD3.4VocabularyServices33 34. searchNotesRetrievetermssearchinginnotes.RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=searchNotes&arg=cultureParameterDatatypeDescriptionargstringsearchtermResponseStatusResponse200Theresponseshowstermssearchinginnotes.Exampleresponse:LoCloudD3.4VocabularyServices34 35. suggestSimplesearchandretrievetermswhostartwithstring(onlystring).RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=suggest&arg=cultureParameterDatatypeDescriptionargstringsearchtermResponseStatusResponse200Theresponseshowstermsstartingwithstring.Exampleresponse:LoCloudD3.4VocabularyServices35 36. suggestDetailsSearchandretrievetermswhostartwithstring(termID,term,andmoredata).RequestMethodURLGEThttp://test113.ait.co.at/tematres/unesco/services.php?task=suggestDetails&arg=culParameterDatatypeDescriptionargstringsearchtermResponseStatusResponse200Theresponseshowstermsstartingwithstring.Exampleresponse:LoCloudD3.4VocabularyServices36 37. 4. HowtoinstallthemicroserviceTheLoCloudversionoftematrescanbedownloadedfromhere:http://lc004.ait.co.at:8080/access/content/group/wp3/Vocabulary/tematres-1.7.2-ait1.zipTheinstallationprocessisthesameasthedefaulttematresinstallation,seefurtherdescriptionsat.http://vocabularyserver.com/wiki/index.php?title=Install_TemaTresYouwillneedthecommonapache+php+mysqlserverstack.LoCloudD3.4VocabularyServices37 38. 5. HowthemicroserviceisinstalledinLoCloudAninstanceoftematresisinstalledinthecloudtestinglabathttp://test113.ait.co.at/tematres/.Togetalistofavailablevocabulariesbrowsetohttp://test113.ait.co.at/tematres/locloud-vocabularies/andyoucandownloadaCSVfilewiththevocabularyURLsandnames.ThetechnicalinfrastructureforrunningtheserviceisanUbuntu12.04LTSservermachinewithapache2.2,php5.3andmysql5.5whichrunasaKVMguestintheOpenNebulacloud.ThevocabularyservicesareusedinLoCloud:a)inthevariousenrichmentworkflowsautomaticallythroughthegenericenrichmentserviceandb)throughtheAggregatorUI.Regardingthefirstcase,thegenericenrichmentserviceofLoCloudallowstoorchestratevariousRESTmicro-servicesintocomplexenrichmentworkflows.Theusercancreateaworkflowbyselectingandcombiningthemicro-serviceshewants.Morespecificallyforthevocabularyservicetheuserisabletoselecttermstoattachtoaharvestedpackage.Regardingthelatter,theuserispresentedwiththevariousthesauriandiscapableofsearchingandnavigatingthroughtheconcepts.LoCloudD3.4VocabularyServices38 39. 6. Troubleshooting/FAQWhydoesthesubordinationofanexistingtermnotwork?Itispossiblethatthetermhasalreadyabroadertermandonlyapolyhierarchicalvocabularycanhavetermswithmorethanonebroaderterm.TomakethevocabularypolyhierarchicalgotoLoCloudD3.4VocabularyServices39Menu->Administration->Vocabularyconfiguration,clickonthenameofthevocabularyandselectYESwiththedrop-down-menutoPolihierarchical(compareFigure22).WherecanIfindthecurrentlyusedversionoftheTemaTressoftware?WhenclickingonAboutatthetopofthepageanoverviewofthevocabularyisshown.Atthebottomtheusedversionofthesoftwarecanbefound(seeFigure1).Figure 1 Version of TemaTresWhydoestheSPARQLendpointnotwork?WhenclickingonSPARQLendpointatthebottomoftheHomescreenitispossiblethatthefollowingmessageappears(seeFigure2):Figure 2 Missing configuration of SPARQL endpointTheSPARQLendpointneedstobeupdatedbygoingtoMenu->Administration->Maintenancedatabase->UpdateSPARQLendpointandclickingonSubmit(compareFigure31).Thisproceduremaytakeseveralminutes.WhenfinishedtheSPARQLendpointisopened(seeFigure3). 40. Figure 3 The SPARQL endpoint of the UNESCO ThesaurusCanIchangethename,authoretc.ofthevocabularywhenithasalreadybeenestablished?Yes,itispossibletochangethevocabularydataafterwardsbygoingtoMenu->Administration->Vocabularyconfigurationandclickingonthenameofthevocabularythatneedstobechanged.Thenname,author,language,creationdateetc.canbechanged.WhenfinishedclickonSave(compareFigure22).WhatexactlyareAPIsandwherecanIfindfurtherinformation?Incomputerprogramming,anapplicationprogramminginterface(API)specifiesasoftwarecomponentintermsofitsoperations,theirinputsandoutputsandunderliningtypes.Itsmainpurposeistodefineasetoffunctionalitiesthatareindependentoftheirrespectiveimplementation,allowingbothdefinitionandimplementationtovarywithoutcompromisingeachother.5APIsareawaytogetdatafromtheinternetforyourlocalapplicationsandprojects.WiththeAPIcalls(URLs)youcanreceiveavarietyofformatsdependingontheservice.Whenenteringhttp://test113.ait.co.at/tematres/unesco/services.phpinyourbrowserallTemaTresAPIsarelistedwithdescriptionandexample.Whycanausernotimportavocabulary?Theimportofavocabularyisonlypossibleifanewlyaddeduserisdefinedasadmin(compareFigure25).TodothisgotoMenu->Administration->Usersandclickonthenameoftheuserthatneedstobechangedoraddanewone.ThecheckboxbesidedIsadminneedstobeselectedbeforeclickingonSubmit.Otherwiseonlytermscanbeadded.5http://en.wikipedia.org/wiki/Application_programming_interface27thAugust,2014LoCloudD3.4VocabularyServices40 41. WhatareMeta-termsandhowcantheybecreated?AMeta-termisatermthatcannotbeusedintheindexingprocess.Itisatermtodescribeotherterms,forexampleguideterms,facets,categories,etc.WhenaddinganewtermitcanbemadeaMeta-termbytickingthecheckboxbesidesMeta-term(compareFigure41).WhengoingtoMenu->Administration->VocabularyconfigurationandclickingonthenameofthevocabularytheoptionCFG_SEARCH_METATERMcanbefound.TomakeMeta-termssearchableselectYESfromthedrop-downmenu(seeFigure4).Figure 4 Option for making Meta-terms searchableCanIaddmultipletermsatonce?Yes,itispossibletoaddmultipletermsbyputtingonetermperline(compareFigure41).WhyaretherenotoptermsattheHomescreen?ItispossibletoconfiguretheappearancebygoingtoMenu->Administration->Vocabularyconfigurationandclickingonthenameofthevocabulary.Theretheoption_SHOW_TREEcanbefound.WhenNOisselectedinthedrop-downmenunotoptermsareshownattheHomescreen.SelectYESandclickonSavetochangethat(seeFigure5).Figure 5 The option _SHOW_TREE in the configurationLoCloudD3.4VocabularyServices41 42. 7. ReferencesBgin,LaurentanddeSmedt,John.SKOSExtensionsfortheEUROVOCThesaurus.MondecaWorkshopParis,June2010GuidelinesforMultilingualThesauri.CompiledbyaWorkingGrouponGuidelinesforMultilingualThesauriofIFLAClassificationandIndexingSectionchairedby:GerhardJ.A.RiesthuisandPatriceLandryTheHague,IFLAHeadquarters,2009.-30p.30cm.(IFLAProfessionalReports:115)ISBN978-90-77897-35-5.ISSN0168-1931INTERNATIONALSTANDARDISO25964-1Firstedition2011-08-15,InformationanddocumentationThesauriandinteroperabilitywithothervocabulariesPart1:Thesauriforinformationretrieval,ReferencenumberISO25964-1:2011(E)INTERNATIONALSTANDARDISO25964-2Firstedition2013-03-15,InformationanddocumentationThesauriandinteroperabilitywithothervocabulariesPart2:Interoperabilitywithothervocabularies,ReferencenumberISO25964-2:2013(E)Mitre,Mara.TESQUAL:Amicro-thesaurusforuseinqualitymanagementinEuropeanHigherEducation.RevistaEspaoladeDocumentacinCientfica,2009;32(2),pages66-82LoCloudD3.4VocabularyServices42 43. 8. GlossaryTermDescriptionAPIApplicationProgrammingInterface6broadertermpreferredtermrepresentingaconceptthatisbroaderthantheoneinquestionBTabbreviationforbroadertermconceptunitofthoughtinstancerelationshiplinksageneralconcept,suchasaclassofthingsorevents,andanindividualinstanceofthatclass,whichisoftenrepresentedbyapropernamemeta-termatermthatcannotbeusedintheindexingprocess;itisatermtodescribeotherterms,forexampleguideterms,facets,categories,etc.narrowertermpreferredtermrepresentingaconceptthatisnarrowerthantheoneinquestionnon-preferredtermnon-descriptortermthatisnotassignedtodocumentsbutisprovidedasanentrypointinathesaurusorindexNTabbreviationfornarrowertermpartitiverelationshipArelationbetweentwoconceptswhereoneoftheconceptsconstitutesthewholeandtheotherconceptapartofthatwhole7polyhierarchicalstructurehierarchicalarrangementofconcepts,inathesaurusorclassificationscheme,inwhicheachconceptcanhavemorethanonebroaderconceptpreferredtermdescriptortermusedtorepresentaconceptwhenindexingRDFafamilyofWorldWideWebConsortium(W3C)specificationsoriginallydesignedasametadatadatamodel;Ithascometobeusedasageneralmethodforconceptualdescriptionormodelingofinformationthatisimplementedinwebresources,usingavarietyofsyntaxnotationsanddataserializationformats86http://en.wikipedia.org/wiki/Application_programming_interface1stSeptember,20147http://www.iva.dk/bh/lifeboat_ko/concepts/partitive_relation.htm25thJune,20148http://en.wikipedia.org/wiki/Resource_Description_Framework25thJune,2014LoCloudD3.4VocabularyServices43 44. relatedtermcoversassociationsbetweenpairsofconceptsthatarenotrelatedhierarchically,butaresemanticallyorconceptuallyassociatedtosuchanextentthatthelinkbetweenthemneedstobemadeexplicitinthethesaurus,onthegroundsthatitmaysuggestadditionaloralternativetermsforuseinindexingorretrievalRESTRepresentationalStateTransfer9RTabbreviationforrelatedtermSkosSimpleKnowledgeOrganizationSystem:commondatamodelforsharingandlinkingknowledgeorganizationsystemsviatheWeb10SPARQLSPARQLProtocolandRDFQueryLanguage:anRDFquerylanguage,thatis,aquerylanguagefordatabases,abletoretrieveandmanipulatedatastoredinResourceDescriptionFrameworkformat11targetvocabularynameTemaTresusesforareferencevocabularytaxonomythepracticeandscience(study)ofclassificationofthingsorconcepts,includingtheprinciplesthatunderliesuchclassification12termwordorphraseusedtolabelaconceptthesauruscontrolledandstructuredvocabularyinwhichconceptsarerepresentedbyterms,organizedsothatrelationshipsbetweenconceptsaremadeexplicit,andpreferredtermsareaccompaniedbylead-inentriesforsynonymsorquasi-synonymstoptermPreferredtermrepresentingaconceptthathasnobroaderconceptinthethesaurusUIUserinterfaceuseforthetermthatfollowsthetagisanon-preferredtermforwhichthepreferredtermprecedingthetagshouldbeusedinsteadUSE/UFabbreviationforusedoruseforThesaurus/VocabularyrelatedtermsoftheglossaryarebasedontheISO25964-2:2013definitions.9http://en.wikipedia.org/wiki/Representational_state_transfer1stSeptember,201410http://www.w3.org/2001/sw/wiki/SKOS25thJune,201411http://en.wikipedia.org/wiki/SPARQL25thJune,201412http://en.wikipedia.org/wiki/Taxonomy25thJune,2014LoCloudD3.4VocabularyServices44 45. 9. ConclusionsThisdeliverabledescribestheapproachesthatweretakeninordertoachievetwoaimsforLoCloud:1. ToprovideaplatformformultilingualvocabulariesfromwhichtheycanberetrievedandusedbytheLoCloudmetadataenrichentservices.2. Toprovideforlocalcontentprovidersacloud-basedexperimentalvocabularyapplicationthatsupportscollaborativeworkandcrowdsourcingeffortswhencreatingmultilingualvocabularies.InitialresearchshowedthattheopensourcesoftwareTemaTreswouldprovidethemostefficientstartingpointforthedevelopment.ThissoftwaresupportsthenecessaryfederalmodelformultilingualvocabulariesandhasthenbeextendedwithaLoCloudSKOSimporterandtwonewwebservicescallstoallowimportofdataintoaremotevocabulary.Inaddition,partoftheapplicationwasextendedinordertotestthestorageofgeo-coordinatesandtimeperiods.AtthewritingofthisdeliverableatestinstallationwithamultilingualvocabularyisaccessibleatthevirtualmachineintheLoCloudtestlab(http://test113.ait.co.at/tematres/unesco/index.php)andstillbeingusedforthestagedtestingphaseandfine-tuningwhichwilllasttilNovember2014.AlargenumberofvocabularieshasbeenestablishedwithTemaTresandmadeavailabeatthecloudtestlabforthemetadataenrichmentservices.LoCloudD3.4VocabularyServices45 46. Annex 1 - Using the LoCloud experimental vocabularyapplication based on TemaTresFigure6showsthegeneralfunctionaloptionswhenopeningTemaTres.132.Generaldataofthevocabulary4.advancedsearch5.alphabeticalnavigation6.systematicnavigationFigure 6 General functional options1.useTemaTresasregistereduser3.search7.changeinterfacelanguage1. Afterloggingin(seeFigure7)aregistereduserhasdifferentoptions(seeFigure8)likeaddinganewtermforexample.1313http://r020.com.ar/tematres/manual/gestin_de_trminos.html25thJune,2014LoCloudD3.4VocabularyServices46 47. Figure 7 Logging inFigure 8 Menu as registered user2. WhenclickingonAboutthefollowingscreencanbeseen(seeFigure9).Itgivesinformationonthecreatedvocabulary,liketheURIandthenumberofterms.LoCloudD3.4VocabularyServices47 48. Figure 9 About the created vocabulary3. Withthesearchoptiontermscanbesearched.AscanbeseeninFigure10searchtermsaresuggestedwhiletyping.Whenclickingonsearchtheresultsareshown(seeFigure11).Figure 10 Searching for EducationLoCloudD3.4VocabularyServices48 49. Figure 11 Search results for Education2. WiththeAdvancedsearchdifferenttypesofterms,exactphrases,notetypesetc.canbesearched(seeFigure12).Figure 12 Advanced search3. Withthealphabeticalnavigationtermsinitiatingwithaspecificlettercanbesearched(seeFigure13).AscanbeseenthetotalnumberoftermsstartingwithMisgiven.Figure 13 Part of all terms starting with MLoCloudD3.4VocabularyServices49 50. 4. Withthesystematicnavigationtermsareshownfromtoptonarrowerterms(seeFigure14andFigure15).Figure 14 Systematic navigation showing the top termsFigure 15 Narrower terms of EDUCATION5. Theinterfacelanguagecanbechangedwiththedropdownbuttonattherightbottomofthepage(seeFigure16,compareFigure6).Figure 16 Changing the interface languageCreating a new vocabularyToestablishacompletelynewvocabularyintheLoCloudcloudenvironmentyouhavetocreatethevocabularyconfigurationfolderontheserver.Todothisopentheserverfoldersftp://tm@test113.ait.co.at:4113/var/www/tematresandcopythedefaultconfigurationfolderLoCloudD3.4VocabularyServices50 51. vocabtoyournewvocabularyconfiguration(f.i.unesco).Youcantothisusingtheprogramfilezilla.14Thenthefiledb.tematres.phpneedstoopenedinthefolderunesco.Theretheprefixforthetablesneedstobechangedtounesco(seeFigure17).Figure 17 Changing the prefix for the tables to unescoWhennowenteringtheURLtest113.ait.co.at/tematres/unesco/index.phpanewthesauruscanbeestablishedandtheUNESCOthesauruscanbeimported(comparethechapterImport).PLEASENOTE:ThenameintheURLreferstothenameofthefolder(inthisexamplethefolderisnamedunescoandtheURLcontainsunesco).WhennowenteringthebaseURLtest113.ati.co.at/tematres/followedbythenameofthenewlycreatedfolder(test113.ait.co.at/tematres/unesco/index.php)theTemaTressetuppageappearsinSpanish.AtthetopofthepagethelanguageneedstobechangedtoEnglish(seeFigure18).14https://filezilla-project.org/1stSeptember,2014LoCloudD3.4VocabularyServices51 52. Figure 18 TemaTres setup pageTitle,Author,LanguageandUserneedtobefilledin.ThenclickonSubmit.ThewindowshowninFigure19opens.ClickonEnjoyyourVocabularyServertofinishthesetup.LoCloudD3.4VocabularyServices52 53. Figure 19 Enjoy your Vocabulary ServerAdministrationVocabularyconfigurationThissectiondescribeshowtoconfiguretheUNESCOvocabulary.Beforetermsareaddedthevocabularyissettobepolyhierarchical.ToachievethisgotoMenu->Administration->Vocabularyconfiguration(seeFigure20).Figure 20 Going to Vocabulary configurationWhenclickingonthenameofthevocabulary(UNESCOThesaurus)(seeFigure21)itcanbeconfigured.Withthedrop-down-menutoPolihierarchicalYESneedstobechosen(seeFigure22).Figure 21 Clicking on UNESCO ThesaurusLoCloudD3.4VocabularyServices53 54. Figure 22 Configuring the vocabularyUsersWhengoingtoMenu->Administration->Users(seeFigure23)theuserscanbeadministered.AscanbeseeninFigure24thename,organisationanddateofcreationofeachuserisgiven.Furthermorethenumberoftermscreatedbytheuserisshown.Figure 23 Going to user administrationLoCloudD3.4VocabularyServices54 55. Figure 24 User managementWhenclickingonNewuseranewusercanbecreated(seeFigure25).Figure 25 Creating a new userExportWhengoingtoMenu>Administration>Exportthevocabularycanbeexported(seeFigure26).Figure 26 Going to ExportFigure27showsthepossibilitiesforexportingthevocabularies.WhenoneXMLschemahasbeenchosenwiththedrop-downmenuclickonSave.LoCloudD3.4VocabularyServices55 56. Figure 27 Exporting the vocabularyAnexampleforahierarchicallist(txt)canbeseeninFigure28.Figure 28 Exporting a hierarchical list (txt)InthelisttheXMLschemeBS8723canbeseen.ItisthepredecessorofthecurrentISO25964.15MaintenancedatabaseWhengoingtoMenu->Administration->Maintenancedatabasedifferentoptionsareshown(seeFigure29).15http://en.wikipedia.org/wiki/ISO_2596427thAugust,2014LoCloudD3.4VocabularyServices56 57. Figure 29 Maintenance database optionsRecreateindexesWhenclickingonRecreateindexesthecompletenumberofrecordsisshown(seeFigure30).Figure 30 After recreating the indexUpdateSPARQLendpointWithUpdateSPARQLendpointtheSPARQLendpointcanbeactualised(seeFigure31).Thiscantakeseveralminutes.Formultilingualthesaurithisstephastoberepeatedforeverythesaurus.Figure 31 Updating the SPARQL endpointImportWiththeImportoptionathesauruscanbeimportedfromafile(seeFigure32).LoCloudD3.4VocabularyServices57 58. Figure 32 Importing a thesaurus from a fileAscanbeseentheusercanchoosebetweentabulatedtext,taggedtextorSkos-core(examplesaregivenatthebottomofFigure32).Thenafilecanbechosen.Figure33showsanexampleimportoftheUNESCOthesaurusinSkos-core.Figure 33 Importing the UNESCO thesaurusAfterclickingonOKasecondstepduringtheImportprocessmakesitpossibletoselectthelanguageterms(seeFigure35).Thenumberoftermsisgiveninbrackets.SelectAllinthedrop-downmenuofChooseconceptschemeandclickonImport.PLEASENOTE:Thiscantakeseveralminutes.LoCloudD3.4VocabularyServices58 59. Figure 34 Second step during ImportAftertheImportisfinishedfeedbackontheprocessisgiven(seeFigure35).Theerrormessagesaremergedingroupsthatcanbescrollediftherearemore.Atthebottomofthepagethenumberoftheconceptsstoredisgivenandamessagethatsaysthattheimporttaskisfinished.Figure 35 Import task finishedWhennowgoingtotheHomescreenthetoptermsofthenewlyimportedthesauruscanbeseen(seeFigure36LoCloudD3.4VocabularyServices59 60. Figure 36 Top terms of UNESCO thesaurusDeletedatamassivelyWithDeletedatamassivelydifferentdatatypescanbedeletedatonce(seeFigure37).ToachievethistheappropriatecheckboxneedstobeselectedbeforeclickingonSubmit.PLEASENOTE:Thessactionsareirreversible!Figure 37 Deleting data massivelyOptimizetablesWhenclickingonOptimizetablesanoverviewofallthetablesisgivenwithstatusmessages(seeFigure38).Figure 38 Optimizing tablesLoCloudD3.4VocabularyServices60 61. UpdateFinallydifferentupdateoptionsaregiven(seeFigure39).Figure 39 Updating TemaTres versionsTerm ManagementWhenthevocabularyisconfiguredcorrectlydifferenttermscanbeadded.AddingorcreatingatermWhengoingtoMenu>AddTermoneormoresearchtermscanbecreated(seeFigure40).Ifmorethanonetermisaddedonetermperlinemustbeentered.Thetermcanalsobecreatedascandidatetermormeta-termbytickingtheappropriatebox(seeFigure41).Figure 40 Adding a new termFigure 41 Adding the term EconomyWhenthetermisadded(afterclickingonSubmit)therearedifferentoptions(seeFigure42).LoCloudD3.4VocabularyServices61 62. OptionsforthenewtermviewdifferentXMLschemesexternalsearchoptionsforthetermFigure 42 Options for the newly added termFigure43showstheSKOS-Core16schemeafterclickingonSKOS-Coredatesassociatedwiththetermatthebottom(compareFigure42).Figure 43 SKOS-Core scheme of EconomyWhenclickingontheWikipediaiconontherightbottomofEconomyWikipediasearchresultsforEconomyareshown(seeFigure44).16http://www.w3.org/TR/swbp-skos-core-guide/13thJanuary,2014LoCloudD3.4VocabularyServices62 63. Figure 44 Wikipedia search results for EconomyCreatingspecifictermsFromtheoptionsmenuofthetermAdd>SubordinatedTerm>AddTermneedstobeselected(seeFigure45).Figure 45 Adding a subordinated termThenthetermscanbeaddedasdonebefore(seeFigure46).Additionallytherelationtypecanbeselected(partitiveorinstancerelationship).LoCloudD3.4VocabularyServices63 64. Figure 46 Adding a subordinated term to EconomyConvertingafreeterminaspecifictermFromtheoptionsmenuofthetermAdd>SubordinatedTerm>SubordinateAnExistingTermneedstobeselected(seeFigure47).Figure 47 Subordinate an existing termThenthetermthatneedstobesubordinatedissearched(seeFigure48).Onlyfreetermstermswithnorelationshipcanbeused.Figure 48 Searching the term to be subordinatedFinallyselectthetermtobesubordinated(seeFigure49).LoCloudD3.4VocabularyServices64 65. Figure 49 Saving the subordinated term World economyCreatinganon-preferredtermFromtheoptionsmenuofthetermAdd>NonpreferredTerm>AddTermneedstobeselected(seeFigure50).Figure 50 Adding a non-preferred termNowoneormorenon-preferredtermscanbeaddedasdonebefore.SimilartoFigure47anexistingfreetermcanbecomeanon-preferredtermbyselectingAssociateAnExistingNon-PreferredTerm(compareFigure50).LoCloudD3.4VocabularyServices65 66. CreatingatermassociatedorrelatedThisactionallowsyoutocreatenewtermsthatwillbeautomaticallylinkedviaanassociativerelationship.FirstfromtheoptionsmenuofthetermAdd>RelatedTerm>AddTermneedstobeselected(seeFigure51).Figure 51 Adding a related termThenoneoremorerelatedtermscanbecreated.Asbeforeanexistingtermcanbecomearelatedtermtoo.SubordinatinganexistingtermFromtheoptionsmenuofthetermselectAdd->SubordinatetheTerm(seeFigure52).ThenthebroadertermforthetermthatneedstobesubordinatedissearchedinthiscasePOLITICS,LAWANDECONOMICS(seeFigure53).WhenclickingonPOLITICS,LAWANDECONOMICSLoCloudD3.4VocabularyServices66thetermEconomyissubordinated(seeFigure54).Becausethevocabularyispolyhierarchicalatermcanhavemorethanonebroaderterm.Theabove-mentionedprocedurecanberepeatedasoftenasneeded(seeFigure55).Figure 52 Subordinating a term 67. Figure 53 Searching for the broader term POLITICS, LAW AND ECONOMICSFigure 54 Economy subordinated to POLITICS, LAW AND ECONOMICS Figure 55 Economy subordinated to more than one termDeletingarelationshipWhendeletingatermorconvertingittoarejectedorcandidateterm,thetermSHOULDNOTHAVERELATIONS(TE/TG,UP/USE,TR).Toremovetherelationsofaterm,selecttheXlocatedattheleftofeachterm(seeFigure56).Figure 56 Deleting a relationshipLoCloudD3.4VocabularyServices67 68. Thisactiondoesnotdeletetheterm.Itonlyremovestherelationship.DeletingatermTodeleteatermgotoDeletetermintheoptionsmenu(seeFigure57).Figure 57 Deleting a termNotesTemaTresallowsassociatingatermtoanunlimitednumberofnotes.Thekindofnotesincludedare: Scopenote:providesinformationabouttheconceptualscopeoftheterm. HistoricalNote:providesinformationaboutprevioususesormeaningsofatermorothertermsthathavebeenusedbeforereplacingit. BibliographicalNote:providesinformationonthereferencesourcesusedfortheselectionandwordingoftheterm. Cataloguersnote:providesrecommendationsontheapplicationcontextoftermindexingprocesses,orargumentsabouthowthetermwaswritten. PrivateNote:allowsausertoenternotesvisibleonlyforregisteredusers(publishersoradministrators)ofthecontrolledvocabulary.Itisalsopossibletowritenotesindifferentlanguages.Whenthenotesarewritteninalanguageotherthanthevocabularylanguage,itismentionedalongsidethedenominationtypenote.ManagingnotesFirsttheNotesEditorfromtheoptionsmenuofatermneedstobeselected(seeFigure58).LoCloudD3.4VocabularyServices68 69. Figure 58 Opening the Notes EditorFigure59showstheNotesEditorwithitsdifferentfunctions.backtotermselectnotetypeinsertlinksFigure 59 The Notes EditorselectnotelanguageformattingtoolsremoveformattinginsertpicturesLoCloudD3.4VocabularyServices69 70. ReportsWhengoingtoMenu->reportsreportscanbecreated(seeFigure60).Figure 60 Selecting reportsTemaTresdifferentiatesbetweenreportsandadvancedreports(seeFigure61).Figure 61 Creating a reportAscanbeseendifferenttermtypesforreportscanbeselected:freeterms,duplicateterms,termswithmorethanonebroaderterm,narrowertermsxterm,numberofwordsxterm,meta-terms,relatedterms,non-preferredterms,candidatetermsandrejectedterms.LoCloudD3.4VocabularyServices70 71. Intheadvancedreportssectionreportscanbecreatedaccordingtotop-terms,notetypes,creationdate,terminologicalmapping,targetvocabularies,usersandwordsincluded(compareFigure61).Vocabulary reference17TherearetwopossiblemodelstoimplementmultilingualvocabulariesinTemaTres:181) ModelwithcentralvocabularyThismodelcontainsinthesamevocabularythetermsfromsourcevocabularyandtheequivalencetothetermsintargetvocabularies.Allvocabularies(sourceandtargetvocabularyvocabulary)aremanagedbythesameinstanceofTemaTres.Thisoptionisusefulifthetargetvocabularydoesnotexistortheterminologyservicesarenotavailableorthereareincompleteterminologicalcorrespondences.Advantages: Registersandestablishesnominalreferencemappingofvocabulariesalthoughtheydonotexistorareunavailable. Thetermmappingscanberecoveredinsearchoperationsandalphabeticalnavigation. Theuserhasfullcontroloverthetermmanagementofthereferencevocabulary. Forthemappingthefollowingrelationsareallowed:normalized,completeequivalence,partialornon-equivalence.Disadvantages: Establishingnominalmappingsontheresultingiscomplexandcanleadtoinferencesonadvancedprocesses. Whenmanyvocabulariesareregistered,irrelevantandinaccurateresultscanbegenerated,becausetheresultofallreferencevocabulariesisincluded. Ifchangesintheactualreferencevocabularyoccurtherearenoautomaticalertorupdatemechanisms.2) FederatedModelThismodelallowstoestablishindependentrelationshipsbetweendifferentvocabulariesorlanguages,whetherequivalencerelationsbetweenlanguagesorotherpossiblerelationshipsbetweentermsandconcepts.Eachofthevocabulariesofdestination(targetvocabulary)shouldbeabletoofferwebservicesaccordingtotheTemaTrespatternterminologyservices.Throughtheseservices,thesourcevocabularycansearchtermsinthetargetvocabulariesandestablishrelationshipsbetweenterms.Thisoptioncanbeusefulformediumandlargeprojectsmanagedbymultilingualterminologistteam.Advantages: Permitstheestablishmentofcompleteterminologicalmappingsandprovidesfunctional,logicalandnominalcapabilities.EachofthesemappingshasauniqueURIinordertodescribetherelationshipsintermsofinteroperabilityconsistentwiththemodelLinkeddata. Anunlimitednumberofreferencevocabulariescanbeenteredwithoutinfluencingthefunctionalityandperformanceofeachvocabulary. Becauseitisafederatedmodel,ithasaschemeofindependentusersforeachvocabulary,beingabletoarticulateterminologistsaccordingtolanguageordomainequipment. It offers17http://www.r020.com.ar/tematres/manual/vocabularios_de_referencia.html25thJune,201418http://vocabularyserver.com/wiki/index.php?title=Multilingual_vocabularies25thJune,2014LoCloudD3.4VocabularyServices71 72. automated mechanisms for updating federated terms. When a term is modified oreliminated in the reference vocabulary, it is notified in the source vocabulary. Themappingrelationshipsarenotstandardized,thereforeitispossibletoestablishrelationshipsofallkindsamongvocabularies,translations,extensionsetc.Disadvantages: RequiringWebservicesterminology,isonlypossiblewithvocabulariesthatexposethesameWebservicesterminology. Allowingdenormalizedrelationshipsisatthediscretionofvocabularyadministratorsforacohesiveandcoherentdevelopmentofterminologymapping.TheLoCloudvocabularyapplicationshouldsupportthecollaborationonmultilingualvocabularymanagementandisthereforebasedonthefederatedmodel.Especiallyintheculturalheritagedomainvocabulariescanvarytoahugeextendfromcountrytocountry.Termsexistinginonelanguagemightnotbeknowninanotherlanguage,orthehierarchiesofthevocabulariesinthevariouslanguagescouldvary.Themainissuesformultilingualthesauriare: Structuralproblems:Theconceptualsystemscandifferindifferentlanguages Equivalenceproblems:o Thelexicalizationofconceptscandifferindifferentlanguages(eg.bonefishbone(en);KnochenGrten(de))19o Thetranslationofathesaurusfromonelanguagetoanotherdoesnotmakeitathesaurusfortheotherlanguage(intraandinter-languageequivalenceproblems,termsmightdifferinmeaningetc.)Withthefederatedmodelitispossibletohaveindepentvocabulariesforthevariouslanguagesinthesamedomain.Thealignmentofthevariousvocabulariesinthedifferentlanguagesisdoneviaconceptidentifiers.Thelinkingofvocabularyconceptsmakesitpossiblefortheend-usertosearchinalllinkedindexingvocabulariesusinganyoneofthelinkedthesauriorsubjectheadinglists.Inthefollowingsectiontheimplementationofthefederatedapproachisdemonstrated.AddingatargetvocabularyWhengoingtoMenu->Administration->Vocabularyconfiguration(seeFigure62)anewtargetvocabularycanbeadded(seeFigure63)Figure 62 Going to Vocabulary configuration19http://www.dsoergel.com/cv/B67.pdf20thAugust,2014LoCloudD3.4VocabularyServices72 73. Figure 63 Adding a target vocabularyNowthetargetvocabularycanbeconfigured(seeFigure64).InthisexampletheUNESCOThesaurusisaddedinGerman.AscanbeseenTitle,Author,Language,DateofcreationandURIarefilledin.AfterthisclickonSaveatthebottom.Figure 64 Adding the German thesaurus UNESCO Thesaurus_DENowtherearetwovocabulariesintheoverviewoftheconfiguration(seeFigure65).LoCloudD3.4VocabularyServices73 74. Figure 65 Two vocabularies in the overviewWhennowclickingononeterm(inthisexampleEconomy)arelationtotheGermanvocabularycanbecreatedbyselectingOptions->Add->Relationsbetweenvocabularies->Targetvocabulary(seeFigure66).Figure 66 Adding a relation to the target vocabularyNowanequivalencerelationshipbetweenthetwovocabulariescanbeestablishedbyfillingintheGermanterm(seeFigure67).LoCloudD3.4VocabularyServices74 75. Figure 67 Adding the equivalent term WirtschaftInthetermoverviewtheequivalenttermcanbeseen(seeFigure68).Figure 68 Equivalent relationship of termsAddingaremotetargetvocabulary(viaWebservice)WhengoingtoMenu->Administration->Vocabularyconfigurationaremotetargetvocabularycanbeadded(seeFigure69).Figure 69 Adding a remote target vocabulary (web services)Thenthefollowinginformationneedstoberecorded(seeFigure70foranexample):LoCloudD3.4VocabularyServices75 76. - Referencelabel:thelabelwillbedisplayednexttoeachterm- Referencetag:adescriptivetypeofrelationshipterminology(egEQforequivalent,EQPforpartialequivalent)- Language:languagecodeofthevocabularyreference(targetvocabulary)- URLforthewebservicesreference:URLfromwhichthereferencevocabularyprovideswebservicesterminology.Theservicemustbeenabledonthetargetvocabulary.Figure 70 Information on remote target vocabularyWheneverythinghasbeenfilledincorrectlyclickSubmit.Nowtheremotetargetvocabularycanbeseenintheconfigurationoverview(seeFigure71).Figure 71 Configuration overview with remote target vocabularyWhennowclickingononeterm(inthisexampleCULTURE)arelationtotheremotevocabularycanbecreatedbyselectingOptions->Add->Relationsbetweenvocabularies->Remotetargetvocabulary(webservices)(seeFigure72).LoCloudD3.4VocabularyServices76 77. Figure 72 Establishing a relation to a remote target vocabularyNowthetargetvocabularyandtheterminologicalmappingmethodareselectedbeforeclickingonSearch.Theresultisshownatthebottom(seeFigure73).Figure 73 Searching for Cultura in remote vocabularyWhenselectingoneoftheresulttermsitappearsintheoverviewoftheterm(seeFigure74).LoCloudD3.4VocabularyServices77 78. Figure 74 Link to remote target vocabularyWhenclickingonthetermoftheremotetargetvocabularythetermintheoriginalvocabularycanbeseen(seeFigure75).Figure 75 Term cultura in Tesauro Europeo de la EducacinImporting a multilingual vocabularyWhencreatingamultilingualvocabularyliketheUNESCOThesauruswhichisavailableinEnglish,SpanishandFrenchfirstathesaurusforeachlanguageneedstobeestablishedasdescribedinthechapterCreatinganewvocabulary.InourexampletheEnglishandSpanishUNESCOThesaurushavebeencreated.PLEASENOTE:Itisimportanttocreateallvocabularieswiththesameuseraccount.Otherwiseswitchingbetweenthevocabularieswillnotwork.Noweachvocabularyisdefinedastheremotetargetvocabularyoftheotherone(comparethechapterAddingaremotetargetvocabulary(viaWebservice),seeFigure76).LoCloudD3.4VocabularyServices78 79. Figure 76 English UNESCO Thesaurus as target vocabulary for Spanish UNESCO thesaurusFinally,theUNESCOSkosfileisimportedintheEnglishUNESCOThesaurusasdescribedinthechapterImport.AsecondstepduringtheImportprocessmakesitpossibletoselectthelanguageterms(seeFigure77).Thenumberoftermsisgiveninbrackets.SelectAllinthedrop-downmenuofChooseconceptschemeandclickonImport.PLEASENOTE:Thiscantakeseveralminutes.Figure 77 Second step during ImportWhentheImportisfinishedamessageappears(compareFigure35).Whennowclickingononetermofthethesaurusthereisalinktothetermintheotherlanguage(seeFigure78).Figure 78 Link to Spanish UNESCO ThesaurusWhenclickingontheSpanishtermtheSpanishUNESCOThesaurusisopened(seeFigure79).ByclickingontheEnglishtermitcanbeswitchedbacktotheEnglishversionofthethesaurus.LoCloudD3.4VocabularyServices79 80. AtthebottomanIdentifierhasbeenaddedthatistakenfromtheSkosfilethathasbeenimported.Figure 79 The Spanish UNESCO ThesaurusLoCloudD3.4VocabularyServices80 81. AbbreviatonsThefollowingtableshowstheabbreviationsoftagsusedinTemaTrestodisplayhierarchicalrelationsbetweenterms.Table 2 Relationship indicators in TemaTres20BasqueCatalanDutchEnglishFrenchGalicianGermanItalienPolishPortugueseSpanishMeaningTGTGBTBTTGTGOberbegriffBTBTTGTGbroaderLoCloudD3.4VocabularyServices81termTETENTNTTSTEUnterbegriffNTNTTETEnarrowertermTRTRRTRTTATRVerwandterBegriffRTRTTRTRrelatedtermIrismennabariduNotad'abastScopenotitieScopeNoteNoted'applicationNotadealcanceDefinitionNotadiambito(SN)NotaozakresieNotadeescopoNotadealcanceScopeNoteUSEUSEUGEBRUIKUSEUSEUSEsieheUSEUyjUSEUSEuse20comparehttp://databases.unesco.org/thesaurus/help.html27thAugust,2014