locloud mint metadata mapping tool, nikolaos simou, eleni iskou, national technical uuniversity of...
TRANSCRIPT
MINT MAPPING TOOL Nikolaos Simou, Eleni Iskou
NTUA
Overview • MINT Mapping Tool – User Administra>on – Metadata Import – Mappings – Transforma>on – Reports
Basic Concepts
3
Metadata • The term metadata refers to "data about data". The term is ambiguous, as it is used for two fundamentally different concepts (types). • Structural metadata is about the design and specifica>on of data structures and is more properly called "data about the containers of data";
• Descrip>ve metadata, on the other hand, is about individual instances of applica>on data, the data content. In this case, a useful descrip>on would be "data about data content" or "content about content" thus metacontent.
User AdministraCon
5
USER & ORGANIZATION REGISTRATION • User Registra>on • Self-‐registra>on from MINT Mapping Tool • User registra>on without an organiza>on • User registra>on under an exis>ng organiza>on • User management (& User crea>on under an organiza>on by his administrator)
• Organiza>on Registra>on & Management
MINT – Instance for Locloud ¨ hVp://mint-‐projects.image.ntua.gr/locloud/ ¨ Click on “I want to register”
User Registra>on
• Fill in the form and click on “Submit”
8
Create new organiza>on
Create new organiza>on (Cont.) • Fill in the form and click on “Submit”
Create children organiza>ons • Create a new organiza>on and this >me set the parent organisa>on
Create new user for Parent organiza>on
Create new user • Fill in the form and click on “Submit”
13
User registra>on under organiza>on (children organiza>on) • hVp://mint-‐projects.image.ntua.gr/Locloud/ • Click on “I want to register”
14
User registra>on under organiza>on (Cont.)
• Fill in the form • Select organiza>on • Click on “Submit”
Rights assignment to user • The administrator has to assign rights to user
User roles
• Administrator: This user can create/update/delete users and children organiza>ons for the organiza>on he is administering.
• Annotator & Publisher: This user has all the rights of an annotator as well as rights to perform final publishing of data.
• Annotator: This user can upload data for his/her organiza>on (and any children organiza>ons) and perform all available data handling func>ons (view items, delete items, mappings etc) provided by the system, apart from final publishing of data.
• Data Viewer: This user only has viewing rights for his organiza>on
• No role: A user that has registered for an organiza>on but has not yet been assigned any rights.
User roles
Administrator
Annotator & Publisher
Annotator
Data Viewer
No role
18
Metadata Import
19
Import metadata • Formats
– CSV • UTF-‐8 Encoding
– XML file containing metadata for one or many records – ZIP files containing an XML file per cultural heritage object
• Import Recommenda>ons – ZIP files containing no more than 30.000 files
Import metadata
Import metadata (Cont.)
q Import the file containing your data either via local upload, or via Remote FTP/ΗTTP , OAI URL and click “Submit” (Different upload protocols are supported)
Import metadata (Cont.)
Import metadata • By selec>ng on the uploaded file from “My workspace” view,
the “Dataset Op>ons” appear • Aher impor>ng a file to MINT Inges>on plaiorm it can be
viewed in “My Workspace menu” either with a green >ck that indicates that the import was successful or with a red that indicates a problem during upload
Define Items • Set – The item level of your import (root item) – The item label of your import (>tle) – The iden>fier of your import by dragging and dropping the appropriate elements to the appropriate textboxes.
Define Items (Cont.)
Define Items (Cont.)
Dataset Sta>s>cs
Show all items
Show all items (Cont.) • Select a mapping (not applicable at this point) • Select the previews you like • Click on an item from the list
Create New Mapping
31
Create new mapping • Select the schema to which you want to map your metadata
Mapping editor
Input Schema Area
Mapping Area
Navigation Area
Input Schema Area
• The tree represents the snapshot of the XML schema that is used as input for the mapping process. The u s e r i s a b l e t o navigate and access element sta>s>cs and also to search the tree by using the text field on the top.
Mapping Area
Naviga>on Area • Shortcuts to the EDM classes
Naviga>on Area (Cont.) • Bookmarks – A user can set/unset a bookmark to an element by clicking on the star ( ) on its right
Naviga>on Area (Cont.) • Mandatory elements that are not mapped
Naviga>on Area (Cont.) • Search the target schema
Mapping editor nota>on On the top of each element in the mapping area – the schema prefix and the element name are shown – (eg. edm: ProvidedCHO) there are some indicators described in the following table:
Mapping editor nota>on (Cont.) Icon Description
Appears on the left of the mapping to indicate that no conditional mapping is used. By clicking on it conditional mapping is activated.
Appears on the left of the mapping to indicate that a conditional mapping is used. By clicking on it the conditional mapping is de-activated.
Appears on the left of the mapping to indicate that no functional mapping is used. By clicking on it the functional mapping is activated.
Appears on the left of the mapping to indicate that a functional mapping is used. By clicking on it the functional mapping is de-activated.
Appears on the left of the mapping to indicate that no value mapping is used. By clicking on it the value mapping is activated.
Appears on the left of the mapping to indicate that a value mapping is used. By clicking on it the value mapping is de-activated.
Appears on the top left of a mapping. By clicking on it concatenate mapping is activated.
Appears on the top left of a mapping. By clicking on it you remove the mapping.
Mappings
Mapping
Xpath
Constant
Concatenate
Value
Func>onal
Condi>onal
Structural
Thesaurus
Mappings – Xpath mapping • Xpath mapping is performed simply by dragging the xpath
from the input tree and dropping it to the desired element of the mapping area.
Mappings – Enumerated Mapping
• Double click on an element that takes values from an enumerated list.
Mappings – Constant Mapping
• By double clicking on the unmapped area you can type a constant value that will be applied to all items.
Mappings – Concatenate mapping • By clicking on the icon you can perform a concatenate
mapping i.e. to combine more than one mappings for producing a new mapping
Mappings – Func>onal Mappings • By clicking on the buVon you can perform a func>onal mapping i.e. to modify the value of an input xpath by applying a string manipula>on func>on to it.
Func>onal Mappings – Substring – You set the start and the end index. – Substring aIer – You set the substring of the original string aher which the
value is taken. – Substring before – You set the substring of the original string before which
the value is taken. – Substring between – You set the substrings of the original string aher and
before which the value is taken. – Split – You set the delimiter for tokeniza>on and the start index of the
original string. – Replace string -‐ You set a string to be replaced with the replacement – Trim –Trims spaces – Replace with regex -‐ Replace all occurrences matching the regular expression
(first argument) with the second argument (string) – Split-‐ You set the delimiter for the tokeniza>on and the start index of the
original string – Tokenize content and generate an element per content – You set the
delimiter for tokeniza>on. – Custom funcCon – You can set a custom XSLT func>on
Mappings – Func>onal Mappings
Mappings – Condi>onal Mapping • By clicking on the buVon you can perform a condi>onal mapping i.e. to
transform the value from an input xpath by using condi>ons. On the leh the drop down menu with the type of condi>on appears that can be AND or OR. A condi>on is set using one of the following func>ons. – Is equal to – sets a condi>on that is sa>sfied when the given xpath is equal to
the given value. – Is not equal to – sets a condi>on that is sa>sfied when the given xpath is not
equal to the given value. – Exists – sets a condi>on that is sa>sfied if the given xpath exists. It is
important to note at this point that the fact the xpath of an element exists in the input tree does not mean that it exists for all the data in the imported collec>on. (In other words the input tree shown on the leh aggregates all the possible xpaths found in the input data).
– Does not exist – sets a condi>on that is sa>sfied if the given xpath does not exist. It is important to note at this point that the fact the xpath of an element exists in the input tree does not mean that it exists for all the data in the imported collec>on. (In other words the input tree shown on the leh aggregates all the possible xpaths found in the input data).
Mappings – Condi>onal Mapping – Contains – sets a condi>on that is sa>sfied if the given xpath contains the given value.
– Does not contain – sets a condi>on that is sa>sfied if the given xpath does not contain the given value.
– Starts with – sets a condi>on that is sa>sfied if the given xpath starts with the given value.
– Does not start with – sets a condi>on that is sa>sfied if the given xpath does not start with the given value.
– Ends with – sets a condi>on that is sa>sfied if the given xpath ends with the given value.
– Does not end with – sets a condi>on that is sa>sfied if the given xpath does not end with the given value.
Mappings – Condi>onal Mapping • If the value of xpath tns:Descrip>on contains “southwest”
then the value of the xpath tns:Descrip>on will be mapped to the xpath edm:ProvidedCHO/dc:descrip>on of the target schema.
Mappings – Structural Mapping • Structural mappings form a special category of mapping.
As you may have no>ced in the complex types of the target schema illustrated in the mapping area text “structural” appears instead of “unmapped”. At this area you can map complex elements of your input metadata.
• Let’s assume you have a complex element named “B” in your metadata – having “C” as a child – and B appears 3 >mes in only one record. Also assume complex element “BTarget” – having “CTarget” as a child – in the target schema. If you make a structural mapping of B (by dragging it and dropping it) to “BTarget” and then you map “C” to “CTarget” 3 “BTarget” complex elements will appear in the output XML having “CTarget” as child and having the values of “C”.
• By clicking on the icon you can perform a value mapping i.e. to map specific values of your input metadata to specific values that you set.
Mappings – Value Mappings
Preview Items
55
Preview Items • Click on preview • Select the previews you like in each tab • Click on an item
Preview Items • Click on the red line to see the error
Preview Items
Preview Items
Transform Items
60
Transform Items • Select Transform from the Dataset Op>ons and then select the mapping with which you wish to transform
Preview Transformed Items The transforma>on icon appears next to the dataset and the derived dataset appears under the transforma>on
• If there are no errors in them then you can proceed with the publica>on by clicking on Publish to MORE
Preview Transformed Items (Mapped Item)
Preview Transformed Items (Europeana)
Thank you [email protected] [email protected]
66
LoCloud is funded by the European Commission's ICT Policy Support Programme
The views and opinions expressed in this
presenta>on are the sole responsibility of the authors and do not necessarily reflect the views of
the European Commission.
Funding