locloud mint metadata mapping tool, nikolaos simou, eleni iskou, national technical uuniversity of...

67
MINT MAPPING TOOL Nikolaos Simou, Eleni Iskou NTUA

Upload: locloud

Post on 15-Jul-2015

152 views

Category:

Internet


2 download

TRANSCRIPT

Page 1: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

 MINT  MAPPING  TOOL  Nikolaos  Simou,  Eleni  Iskou  

NTUA  

Page 2: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Overview  •  MINT  Mapping  Tool  – User  Administra>on  – Metadata  Import  – Mappings  –  Transforma>on  –  Reports  

Page 3: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

 Basic  Concepts  

3  

Page 4: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

 Metadata  •  The  term  metadata  refers  to  "data  about  data".  The  term   is   ambiguous,   as   it   is   used   for   two  fundamentally  different  concepts  (types).    •  Structural   metadata   is   about   the   design   and  specifica>on  of   data   structures   and   is  more  properly  called  "data  about  the  containers  of  data";    

•  Descrip>ve   metadata,   on   the   other   hand,   is   about  individual   instances   of   applica>on   data,   the   data  content.   In   this   case,   a   useful   descrip>on   would   be  "data  about  data  content"  or  "content  about  content"  thus  metacontent.    

Page 5: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

User  AdministraCon  

5  

Page 6: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

USER  &  ORGANIZATION  REGISTRATION  •  User  Registra>on    •  Self-­‐registra>on  from  MINT  Mapping  Tool    •  User  registra>on  without  an  organiza>on    •  User  registra>on  under  an  exis>ng  organiza>on    •  User  management  (&  User  crea>on  under  an  organiza>on  by  his  administrator)  

•  Organiza>on  Registra>on  &  Management      

Page 7: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

MINT  –  Instance  for  Locloud  ¨  hVp://mint-­‐projects.image.ntua.gr/locloud/  ¨  Click  on  “I  want  to  register”  

Page 8: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

User  Registra>on  

•  Fill  in  the  form  and  click  on  “Submit”  

8  

Page 9: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Create  new  organiza>on  

Page 10: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Create  new  organiza>on  (Cont.)  •  Fill  in  the  form  and  click  on  “Submit”  

Page 11: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Create  children  organiza>ons  •  Create  a  new  organiza>on  and  this  >me  set  the  parent  organisa>on  

Page 12: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Create  new  user  for  Parent  organiza>on  

Page 13: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Create  new  user  •  Fill  in  the  form  and  click  on  “Submit”  

13  

Page 14: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

User  registra>on  under  organiza>on  (children  organiza>on)  •  hVp://mint-­‐projects.image.ntua.gr/Locloud/    •  Click  on  “I  want  to  register”  

14  

Page 15: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

User  registra>on  under  organiza>on  (Cont.)  

•  Fill  in  the  form    •  Select  organiza>on    •  Click  on  “Submit”  

Page 16: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Rights  assignment  to  user  •  The  administrator  has  to  assign  rights  to  user  

Page 17: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

User  roles  

•  Administrator:  This  user  can  create/update/delete  users  and  children  organiza>ons  for  the  organiza>on  he  is  administering.    

•  Annotator  &  Publisher:  This  user  has  all  the  rights  of  an  annotator  as  well  as  rights  to  perform  final  publishing  of  data.  

•  Annotator:  This  user  can  upload  data  for  his/her  organiza>on  (and  any  children  organiza>ons)  and  perform  all  available  data  handling  func>ons  (view  items,  delete  items,  mappings  etc)  provided  by  the  system,  apart  from  final  publishing  of  data.  

•  Data  Viewer:  This  user  only  has  viewing  rights  for  his  organiza>on  

•  No  role:  A  user  that  has  registered  for  an  organiza>on  but  has  not  yet  been  assigned  any  rights.  

Page 18: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

User  roles  

Administrator  

Annotator  &  Publisher  

Annotator  

Data  Viewer  

No  role  

18  

Page 19: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Metadata  Import  

19  

Page 20: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Import  metadata    •  Formats  

–  CSV  •  UTF-­‐8  Encoding  

–  XML  file  containing  metadata  for  one  or  many  records  –  ZIP  files  containing  an  XML  file  per  cultural  heritage  object  

•  Import  Recommenda>ons  –  ZIP  files  containing  no  more  than  30.000  files    

Page 21: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Import  metadata  

Page 22: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Import  metadata  (Cont.)  

Page 23: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

q    Import   the  file  containing  your  data  either  via   local  upload,  or  via  Remote  FTP/ΗTTP  ,  OAI  URL  and  click  “Submit”    (Different  upload  protocols  are  supported)  

Import  metadata  (Cont.)  

Page 24: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Import  metadata    •  By  selec>ng  on  the  uploaded  file  from  “My  workspace”  view,  

the  “Dataset  Op>ons”  appear  •  Aher   impor>ng   a   file   to   MINT   Inges>on   plaiorm   it   can   be  

viewed   in  “My  Workspace  menu”  either  with  a  green        >ck  that   indicates   that   the   import   was   successful   or   with   a   red      that  indicates    a  problem  during  upload  

Page 25: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Define  Items  •  Set    –  The  item  level  of  your  import  (root  item)  –  The  item  label  of  your  import  (>tle)  –  The  iden>fier  of  your  import  by  dragging  and  dropping  the  appropriate  elements  to  the  appropriate  textboxes.  

 

Page 26: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Define  Items  (Cont.)  

Page 27: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Define  Items  (Cont.)  

Page 28: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Dataset  Sta>s>cs  

Page 29: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Show  all  items  

Page 30: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Show  all  items  (Cont.)  •  Select  a  mapping  (not  applicable  at  this  point)  •  Select  the  previews  you  like  •  Click  on  an  item  from  the  list  

Page 31: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Create  New  Mapping  

31  

Page 32: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Create  new  mapping  •  Select  the  schema  to  which  you  want  to  map  your  metadata  

Page 33: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mapping  editor  

Input Schema Area

Mapping Area

Navigation Area

Page 34: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Input  Schema  Area  

•  The   tree   represents  the   snapshot   of   the  XML   schema   that   is  used  as   input   for   the  mapping  process.  The  u s e r   i s   a b l e   t o  navigate   and   access  element   sta>s>cs  and   also   to   search  the   tree  by  using   the  text  field  on  the  top.    

Page 35: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mapping  Area  

Page 36: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Naviga>on  Area  •  Shortcuts  to  the  EDM  classes  

Page 37: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Naviga>on  Area  (Cont.)  •  Bookmarks    – A  user  can  set/unset  a  bookmark  to  an  element  by  clicking  on  the  star  (          )  on  its  right  

Page 38: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Naviga>on  Area  (Cont.)  •  Mandatory  elements  that  are  not  mapped  

Page 39: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Naviga>on  Area  (Cont.)  •  Search  the  target  schema  

Page 40: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mapping  editor  nota>on    On  the  top  of  each  element  in  the  mapping  area  –  the  schema  prefix  and  the  element  name  are  shown  –  (eg.  edm:  ProvidedCHO)  there  are  some  indicators  described  in  the  following  table:  

Page 41: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mapping  editor  nota>on  (Cont.)  Icon Description

Appears on the left of the mapping to indicate that no conditional mapping is used. By clicking on it conditional mapping is activated.

Appears on the left of the mapping to indicate that a conditional mapping is used. By clicking on it the conditional mapping is de-activated.

Appears on the left of the mapping to indicate that no functional mapping is used. By clicking on it the functional mapping is activated.

Appears on the left of the mapping to indicate that a functional mapping is used. By clicking on it the functional mapping is de-activated.

Appears on the left of the mapping to indicate that no value mapping is used. By clicking on it the value mapping is activated.

Appears on the left of the mapping to indicate that a value mapping is used. By clicking on it the value mapping is de-activated.

Appears on the top left of a mapping. By clicking on it concatenate mapping is activated.

Appears on the top left of a mapping. By clicking on it you remove the mapping.

Page 42: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  

Mapping  

Xpath  

Constant  

Concatenate  

Value  

Func>onal  

Condi>onal  

Structural  

Thesaurus  

Page 43: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Xpath  mapping  •  Xpath   mapping   is   performed   simply   by   dragging   the   xpath  

from  the  input  tree  and  dropping  it  to  the  desired  element  of  the  mapping  area.  

 

Page 44: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Enumerated  Mapping  

•  Double  click  on  an  element  that  takes  values  from  an  enumerated  list.    

Page 45: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Constant  Mapping  

•  By   double   clicking   on   the   unmapped   area   you   can   type   a  constant  value  that  will  be  applied  to  all  items.    

Page 46: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Concatenate  mapping  •  By   clicking   on   the           icon   you   can   perform   a   concatenate  

mapping   i.e.   to   combine   more   than   one   mappings   for  producing  a  new  mapping  

 

Page 47: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Func>onal  Mappings  •  By   clicking   on   the             buVon   you   can   perform   a  func>onal  mapping  i.e.  to  modify  the  value  of  an  input  xpath  by  applying  a  string  manipula>on  func>on  to  it.    

 

Page 48: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Func>onal  Mappings  –  Substring  –  You  set  the  start  and  the  end  index.  –  Substring  aIer  –  You  set  the  substring  of  the  original  string  aher  which  the  

value  is  taken.  –  Substring  before  –  You  set  the  substring  of  the  original  string  before  which  

the  value  is  taken.  –  Substring  between  –  You  set  the  substrings  of  the  original  string  aher  and  

before  which  the  value  is  taken.  –  Split  –  You  set  the  delimiter  for  tokeniza>on  and  the  start  index  of  the  

original  string.  –  Replace  string  -­‐  You  set  a  string  to  be  replaced  with  the  replacement  –  Trim  –Trims  spaces  –  Replace  with  regex  -­‐  Replace  all  occurrences  matching  the  regular  expression  

(first  argument)  with  the  second  argument  (string)  –  Split-­‐  You  set  the  delimiter  for  the  tokeniza>on  and  the  start  index  of  the  

original  string  –  Tokenize  content  and  generate  an  element  per  content  –  You  set  the  

delimiter  for  tokeniza>on.  –   Custom  funcCon  –  You  can  set  a  custom  XSLT  func>on  

 

Page 49: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Func>onal  Mappings  

Page 50: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Condi>onal  Mapping  •  By  clicking  on  the        buVon  you  can  perform  a  condi>onal  mapping  i.e.  to  

transform  the  value  from  an  input  xpath  by  using  condi>ons.  On  the  leh  the  drop  down  menu  with  the  type  of  condi>on  appears  that  can  be  AND  or  OR.  A  condi>on  is  set  using  one  of  the  following  func>ons.    –  Is  equal  to  –  sets  a  condi>on  that  is  sa>sfied  when  the  given  xpath  is  equal  to  

the  given  value.  –  Is  not  equal  to  –  sets  a  condi>on  that  is  sa>sfied  when  the  given  xpath  is  not  

equal  to  the  given  value.  –  Exists  –  sets  a  condi>on  that  is  sa>sfied  if  the  given  xpath  exists.  It  is  

important  to  note  at  this  point  that  the  fact  the  xpath  of  an  element  exists  in  the  input  tree  does  not  mean  that  it  exists  for  all  the  data  in  the  imported  collec>on.  (In  other  words  the  input  tree  shown  on  the  leh  aggregates  all  the  possible  xpaths  found  in  the  input  data).  

–  Does  not  exist  –  sets  a  condi>on  that  is  sa>sfied  if  the  given  xpath  does  not  exist.  It  is  important  to  note  at  this  point  that  the  fact  the  xpath  of  an  element  exists  in  the  input  tree  does  not  mean  that  it  exists  for  all  the  data  in  the  imported  collec>on.  (In  other  words  the  input  tree  shown  on  the  leh  aggregates  all  the  possible  xpaths  found  in  the  input  data).  

Page 51: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Condi>onal  Mapping  –  Contains  –  sets  a  condi>on  that  is  sa>sfied  if  the  given  xpath  contains  the  given  value.  

– Does  not  contain  –  sets  a  condi>on  that  is  sa>sfied  if  the  given  xpath  does  not  contain  the  given  value.  

–  Starts  with  –  sets  a  condi>on  that  is  sa>sfied  if  the  given  xpath  starts  with  the  given  value.  

– Does  not  start  with  –  sets  a  condi>on  that  is  sa>sfied  if  the  given  xpath  does  not  start  with  the  given  value.  

–  Ends  with  –  sets  a  condi>on  that  is  sa>sfied  if  the  given  xpath  ends  with  the  given  value.  

– Does  not  end  with  –  sets  a  condi>on  that  is  sa>sfied  if  the  given  xpath  does  not  end  with  the  given  value.  

Page 52: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Condi>onal  Mapping  •  If  the  value  of  xpath  tns:Descrip>on  contains  “southwest”  

then  the  value  of  the  xpath  tns:Descrip>on  will  be  mapped  to  the  xpath  edm:ProvidedCHO/dc:descrip>on  of  the  target  schema.  

Page 53: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Mappings  –  Structural  Mapping  •  Structural  mappings  form  a  special  category  of  mapping.  

As   you   may   have   no>ced   in   the   complex   types   of   the  target   schema   illustrated   in   the   mapping   area   text  “structural”  appears  instead  of  “unmapped”.  At  this  area  you  can  map  complex  elements  of  your  input  metadata.    

•  Let’s  assume  you  have  a  complex  element  named  “B”  in  your  metadata  –  having  “C”  as  a  child  –  and  B  appears  3  >mes   in  only  one  record.  Also  assume  complex  element  “BTarget”   –   having   “CTarget”   as   a   child   –   in   the   target  schema.   If   you   make   a   structural   mapping   of   B   (by  dragging   it   and   dropping   it)   to   “BTarget”   and   then   you  map  “C”  to  “CTarget”  3  “BTarget”  complex  elements  will  appear   in  the  output  XML  having  “CTarget”  as  child  and  having  the  values  of  “C”.  

Page 54: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

•  By  clicking  on  the        icon  you  can  perform  a  value  mapping  i.e.  to  map  specific  values  of  your  input  metadata  to  specific  values  that  you  set.  

 

Mappings  –  Value  Mappings  

Page 55: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Preview  Items  

55  

Page 56: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Preview  Items  •  Click  on  preview  •  Select  the  previews  you  like  in  each  tab  •  Click  on  an  item    

Page 57: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Preview  Items  •  Click  on  the  red  line  to  see  the  error  

Page 58: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Preview  Items  

Page 59: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Preview  Items  

Page 60: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Transform  Items  

60  

Page 61: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Transform  Items  •  Select  Transform  from  the  Dataset  Op>ons  and  then  select  the  mapping  with  which  you  wish  to  transform  

Page 62: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Preview  Transformed  Items  The  transforma>on  icon          appears  next  to  the  dataset  and  the  derived  dataset  appears  under  the  transforma>on  

Page 63: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

•  If  there  are  no  errors  in  them  then  you  can  proceed  with  the  publica>on    by  clicking  on  Publish  to  MORE    

Page 64: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Preview  Transformed  Items  (Mapped  Item)  

Page 65: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Preview  Transformed  Items  (Europeana)  

Page 66: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

Thank  you  [email protected]  [email protected]  

66  

Page 67: LoCloud MINT metadata mapping tool, Nikolaos Simou, Eleni Iskou, National Technical Uuniversity of Athens

LoCloud  is  funded  by  the  European  Commission's    ICT  Policy  Support  Programme  

 The  views  and  opinions  expressed  in  this  

 presenta>on  are  the  sole  responsibility  of  the    authors  and  do  not  necessarily  reflect  the  views  of    

the  European  Commission.  

Funding