a practical approach to metadata management mark jessop prof. jim austin university of york
DESCRIPTION
A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York. Introduction. Follow on from DAME/Broaden (York) Neuroscience Domain Aims to promote collaboration and enable sharing of resources: Data, Analysis - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/1.jpg)
A Practical Approach to Metadata Management
Mark JessopProf. Jim AustinUniversity of York
![Page 2: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/2.jpg)
Introduction
• Follow on from DAME/Broaden (York)• Neuroscience Domain• Aims to promote collaboration and enable sharing of
resources: Data, Analysis• Online Portal to store Data, Analysis Code, Experimental
protocols.• Current deployment: Upload and annotate experimental
data and apply security, search across data, analyse with services, share and download.
• Working on workflows and a common data format.
![Page 3: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/3.jpg)
e - Neuroscience
• Neuroscience at start of e-science journey.
• Proprietary data formats.• Private Local data.• Primitive data annotation
(Metadata).• Desktop tools.
x
x
x
xx
A
B
A: Neuro-Scientists
B: Computer-Scientists
![Page 4: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/4.jpg)
Metadata
• Metadata is essential to allow resource discovery, interpretation, evaluation and re-use.
• Resources (Data, Services, Workflows) must be adequately annotated.
• Metadata needs to searchable.• Metadata needs to be viewable!
![Page 5: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/5.jpg)
Managing Metadata
• Comprehensive Metadata definition provided for each resource type.
• Electrophysiology data described by the MINI.– Based on FuGE object model (Materials, Data,
Protocols).• Services described by MIAOWS.
![Page 6: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/6.jpg)
Metadata Systems
• Symba data archive tool integrated into CARMEN.– Implements FuGE-OM.– Early in development program.
• User trials revealed problems.– Form complexity.– Response times.
![Page 7: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/7.jpg)
Metadata Systems Take 2
• Revisit Requirements– Capture Mini Schema.– Must be responsive.– Must be simple to use.– Must be able to re-use metadata.
• System built based on forms.• Generic metadata storage.• Search across schemas.
![Page 8: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/8.jpg)
Implementation
• Form/Schema designer generates XML description of forms and schema.
• XML schema stored in a database.• Portal requests XML which is used to generate input
forms or to display existing metadata.
![Page 9: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/9.jpg)
Were we Successful?
• Some users complete the full document.• Some users complete enough to facilitate searching.• Templates are widely used.• Many users re-use complete templates resulting in
repeated metadata.
![Page 10: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/10.jpg)
Metadata for Services
• Combine WSDL and user metadata to describe services.• Generate invocation forms from metadata.
– Default parameters.– Validation.
• Search on function.• Metadata applied to Service output.
– Provenance.– Re-use.
![Page 11: A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York](https://reader035.vdocuments.mx/reader035/viewer/2022062309/56814d6c550346895dbab655/html5/thumbnails/11.jpg)
Future Work
• Ontologies.• Organisation of metadata – prevent repeats.• Smarter templates.• Ways to encourage completion of full metadata.