Geospatial Metadata and Spatial Data Workshop, The James Hutton Institute

PRESENTATION SESSION: Background information Metadata, standards and application profiles UK Academic Geospatial Metadata Application Profile,

Version 2.1 (UK AGMAP 2.1) and guidelines Geodoc Metadata Editor tool, GoGeo portal and other

resources ShareGeo Open spatial data repository GoGeo Spatial Data Infrastructure for data management

and sharing

DEMONSTRATION/HANDS-ON SESSION:

Geodoc Metadata Editor tool, GoGeo portal and ShareGeo Open spatial data repository

Programme

three decades of geographical (spatial) data digitisation

eclectic range of academic disciplines using

Geographic Info System (GIS) statistical packages image processing software GPS

2006 data audits at four universities revealed:

522 datasets + 100s of legacy datasets

= considerable cost and time lost

Requires a spatial data management, discovery and sharing

solution delivered through online portal technology and metadata.

Background

So what is METADATA?

Meta (think Greek):

but metadata means something else to data creators….

Photographic Images copyright: Jupiter Images 2006

Data (think Latin):

sunny holidays in Greece and Italy?

Photographic Images copyright: Jupiter Images 2006

and it’s not sun and holiday in the Mediterranean

Represents a documented and ordered summary of information that describes something, in this case, spatial data.

Provides the What, When, Where and Why information for spatial data.

Includes Ownership and Contact (Who) details and Access and Use conditions.

Metadata (data describing data)

Photographic Images copyright: Jupiter Images 2006

Think of metadata as a recipe for making beer

What are the ingredients?

Where can ingredients bepurchased?

What are the brewing steps?

When does the fermentation process end?

Beer metadata

Photographic Images copyright: Jupiter Images 2006

Think of metadata as food product labelling

What are the ingredients and their nutritional value?

When is the product’s expiry date?

Where was it produced?

Who produced it?

Food metadata

Where are these datasets’ study

areas?

When were the data collected?

Why were these datasets created? 

Who created these datasets?

- type of application?- spatial reference system?

- spatial accuracy?- processes or algorithms used?

Can you tell me from any of these files…

Now think of metadata as spatial data labelling

What attributes are associated with these polygons?

What do these polygons represent?

What do these SOILCLASS

values mean?

What does this attribute mean?

Geospatial metadata

Metadata Recordshold descriptions and file locations

Spatial datasets’ file locations

Spatialdatasets’

descriptions

The importance of geospatial metadataManage spatial

data

Geoportal: an interface to run catalogue searches to discover metadata records representing spatial data and geo-services.

Search: free text, resource and data type, geographic location (co-ordinate and place name) and date.

Geoportal

Metadata Records

Spatial Datasetsand Geo-services

Share and discover spatial data via a geoportal

Discovering spatial data through metadata offers the prospect of developing new

applicationsDatasetsMetadata Predictive Modelling

and creating new datasets

Contour data

Raster data

Draped 3D Model

© Crown Copyright/database right 2008

© Crown Copyright/database right 2008

© Crown Copyright/database right 2008

Metadata

Metadata

Protects investments of time and cost dedicated to dataset creation and development. Maintains a dataset inventory to reduce time required to

re-assess existing datasets for new and future applications.

Ensures integrity of existing datasets using metadata as a tracking mechanism to monitor changes and edits to datasets.

Eliminates or reduces the risk of redundancy in dataset collection.

Saves against accidental deletion of dataset files or damage to storage media.

Reduces and minimises the disruptive effects of staff taking annual leave or departing for new careers.

Easier to read a description of a dataset than to explain it. Faster to bundle a metadata record with its dataset when

sharing it.

Photographic Images copyright: Jupiter Images 2006 Other

benefits

* Intellectual Property Rights (IPR);* legacy data; * trust, liability fears, privacy and security;* residual licensed data rights for derived data; * concerns over data quality; and* which standard to use, which version?

time and cost for the following: - creating and updating metadata records (descriptive

level); - creating anonymised data for release;

- delivering data, including normalisation, transformation and

harmonisation (scale, projections, positional accuracy and formats); and

- infrastructure performance, maintenance, enhancement, and long-term investment towards data and software archiving.

Spatial data and metadata concerns

Nature Journal, 2013

http://www.flickr.com/photos/musebrarian/3289649684/#/

Metadata Standards and Application Profiles

Provide precise specifications to enforce and ensure consistency and interoperability.

Define and describe metadata entities and elements and, classify and group relevant metadata elements with entities.

Assign structure and conditions (obligations, data type, domain).

Metadata standards

Dublin Core (ISO 15836)

15 elements to facilitate simple resource discovery in

a networked environment (e.g. internet or library).

T

Photographic Images copyright: Jupiter Images 2006

University of Edinburgh

Library Catalogue

University of Edinburgh

Library Catalogue

University ofAberdeen

Library Catalogue

University of Sheffield

Library Catalogue

Federal Geographic Data Committee (FGDC) Content Standard for Digital Geospatial Metadata (CSDGM)

* Introduced in the mid 1990s for documenting spatial datasets.

ISO 19115 Metadata Standard for Geographic Information

* Ratified in 2003 and supersedes FGDC.

* Defines the schema required for describing geographic information and geo-services.

* Provides information about the identification, the extent, the quality,

the spatial and temporal schema, spatial reference and distribution

of digital geographic data.

* Can be extended to many other forms of geographic data such as

maps, charts and textual documents as well as non-geographic data.

Geospatial Metadata Standards

ISO 19115 Core Elements (22)

Dublin Core

United Modelling Language: Metadata Class Diagrams

Represents a reduction or extension of a standard’s elements to suit a discipline’s/sector’s spatial data documentation requirements.

An ISO 19115-compliant application profile should

* include the ISO 19115 core elements for creating discovery level metadata to support spatial data sharing;

* provide additional ISO 19915 elements to create descriptive level metadata to support spatial data management; and

* be extended to include elements best suited to support a discipline’s specialisation.

Provides elements to document biological information such as taxonomy, methodology and analytical tools.

http://www.flickr.com/photos/f10n4/186861991/

Geospatial Metadata Application Profile

Example: The Biological Data Profile (BDP)

Creating an application profile from ISO 19115

ISO 19115 Core Element

Set

Application

Profile

Schema,Stylesheet

,Schematr

on

* INSPIRE Directive Metadata Guidelines

* UK GEMINI 2.2, an INSPIRE-compliant geospatial metadata standard (application profile) for the UK

* UK Academic Geospatial Metadata Application Profile 2.1 (UK AGMAP)

Infrastructure for Spatial Information

in the European Community (INSPIRE)

*European Commission (EC)

*European Environment Agency (EEA)

*Representatives from Member States (Mapping/GIS)

INSPIRE Directive Metadata Guidelines

Comprises about 30+ elements to provide a discovery level description of a dataset, dataset series or geo-service in support of the INSPIRE Directive.

INSPIRE Metadata Editor and Geoportal

INSPIRE Directive [2007 /2/ EC]

The INSPIRE Directive came into force on 15 May 2007.

31 December 2009 for England, Northern Ireland and Wales; Scotland’s Parliament enacted a complementary regulation on the same date.

Full implementation: 2019.

Targets electronic spatial data and services for environmental information.

A European Spatial Data Infrastructure (SDI) based on Member States’ infrastructures to improve interoperability.

Make data and services readily and transparently available to ensure good governance at all levels.

Public authorities obliged to produce and keep ‘metadata’ current.

Provide metadata catalogues to reveal what information is available.

Combine online data discovery, view, download and transformation (interoperability) services to provide users with seamless spatial information from different sources across Europe.

Licensing arrangements to allow for information sharing, access and use in accordance with each State’s regulations.

Introduce monitoring mechanisms to show that information is being made available.

Introduce co-ordination mechanisms to ensure effective operation of the infrastructure.

Must comply with the 34 spatial data specifications in three annexes

(reference geographies, environmental datasets).

INSPIRE Regulations for Member States

INSPIRE deadlines for Annex I, II and III metadata

Practical example from Defra: poultry disease outbreak

* Released in 2004 to support creation of ISO 19115 and e-GMS compliant metadata - superseded the National Geospatial Data Framework (NGDF).

* 2010: UK GEMINI revised to be INSPIRE-compliant.

* Targets the UK public sector.

* Comprises 30+ elements to provide a discovery level description of a dataset, dataset series or geo-service.

UK GEMINI 2.2

UK Location Metadata Editor

DATA.GOV.UK

Scottish SDI Discovery Metadata Catalogue

43

GoGeo Spatial Data Infrastructure (SDI)for UK academia

UK Academic Geospatial Metadata Application Profile, Version 2.1 (UK AGMAP 2.1)

UK AGMAP 2.1 created to support the specific needs of UK academia.

Comprises elements from ISO 19115, UK GEMINI 2.1 and INSPIRE.

Supports documentation of a dataset, dataset series or geo-service (discovery and descriptive levels).

AGMAP elements mapped to Dublin Core, FGDC, INSPIRE, UK GEMINI 2.1 and DDI.

ExtendedMetadata

ISO 19115Core Elements

ISO 19115INSPIRE &UK GEMINI

UK AGMAP

UK AGMAP 2.1: to describe

datasets and dataset series

29 mandatory

90 elements

UK AGMAP 2.1: to describe geo-services

39 elements

22 mandatory

Provide descriptions and examples to introduce AGMAP to academics and students from eclectic range of disciplines.

UK AGMAP 2.1 Guidelines

We need to move it from there to an

electronic file(metadata).

Metadata Creation

Photographic Images copyright: Jupiter Images 2006

How might we do this?

Most spatial data information

is stored in our heads.

Photographic Images copyright: Planet Vulcan Images, AD 2568

Mind reading aliens?

Information extraction devices?

Subtle persuasion?

Geodoc Metadata Editor Tool

* Java-built online tool

* UK federation authentication access

53

text fields drop-down

lists

Automated lists

Direct access to UK AGMAP guidelines

Transfer your contact details to each record

Geodoc co-ordinate tool for capturing extents

Capturing extents for a Nation with one click

Private and secure

Store, edit and export metadata records

AGMAP 2.1 ISO 19115 UKGEMINI 2.1INSPIRE Dublin Core DDI FGDC

Exports XML files to following formats:

and to PDF format

Import XML metadata records:Dublin Core, INSPIRE and UK GEMINI 2.1

Publish records: open / private metadata catalogues

1) collect and process data to create dataset;2) use Geodoc to document dataset to create a metadata record;3) validate and submit record for review; 4) metadata creator is contacted; and5) record is published on the GoGeo portal.

1 2 3

Easy steps to the creation and publication of a geospatial metadata

record

Photographic Images copyright: Jupiter Images 2006

4

5

Geodoc users from 54 academic

institutions have created

2,539 metadata records

A geoportal designed for UK academia to run queries to discover metadata for spatial datasets, and to locate geographical resources

GoGeo Portal

(http://geonetwork-opensource.org/)

Based primarily on ISO 19115, it’s a free and open source catalogue application to manage spatially referenced resources through the web.

Provides:

* advanced search interface

* online editing

* immediate search access to local and distributed metadata catalogues

* embedded interactive Web Map Viewer for (WMS)

GoGeo portal built with GeoNetwork

GoGeo Simple SearchPlacename search using Unlock middleware gazetteer

GoGeo

PortalSearc

hEngin

e

Leeds GeoNodeNational Soils

Research Institute

GoGeo Portal catalogue

INSPIREEU Portals’ catalogues

data.gov.ukcatalogue

GoGeo metadata search results and extents display

Metadata record and spatial data

GoGeo Advanced Search

Access to almost 23,000 metadata records

WMS Viewer

GoGeo private metadata

catalogues for academic

institutions departments orresearch groups

a repository for you to store and manage your metadata thus savings in cost and time;

use metadata to announce your data and applications;

advertise (and sell?) your spatial datasets to other interested parties in academia and in the private and public sectors;

metadata in the portal can be referenced and cited for project proposals;

could be configured as an internal resource to access and share datasets; and

allow for more ‘application spontaneity’ amongst other GoGeo users as they browse and search published metadata records.

Why publish metadata on the GoGeo portal?

5,100 + resources with daily additions

GoGeo portal’s GIS Resources channels

Learn about Metadata resources

Reference material – UK AGMAP

Metadata learning objects

Geodoc learning objects

GoGeo Metadata bi-annual newsletters

Metadata workshops and resources

Previous Geospatial Metadata Workshops/Seminars

Future GoGeo enhancements

GoGeo App Metadata Translator

More metadata catalogues

A repository for deposit and extraction of spatial data.

Supports access to and sharing of spatial data.

Holds national and international spatial datasets (raster, vector and tabular).

Key to delivering a Spatial Data Infrastructure (SDI) for the UK

academic GI community.

ArcGIS plugin to create metadata to deposit with data.

245 datasets available for download.

Downloads (average) a month: 3,000

UK academia: 50 - 400

ShareGeo Open Spatial Data Repository

Spatial dataset download

* Discovery level information for metadata creation * Extents extracted from dataset

Spatial dataset submission

The GoGeo Spatial Data Infrastructure (SDI) for data

management and sharing

Vision I: spatial data management

create and store metadata records for personal data

management.

to create and share metadata records with project colleagues

using the GoGeo portal’s private catalogue

create and export metadata records to

share information and data with a

colleague

Use Geodoc to

Establishing departmental metadata catalogues

for internal information sharing

GoGeo Portal

Metadata catalogues

Geography

College of Science and Engineering

Biological Sciences

Civil Engineering

GeoInformatics

College of Humanities and Social Sciences

College of Medicine and Veterinary Medicine

Geology

Health Informatics

Public HealthScience

AnimalScience

Archaeology

History

92

ShareGeo Open Data Repositor

y

Spatial Data User

GoGeo Open Portal

Vision II: open spatial data sharing

Discover

Locate

Access

Use

Publish

Fit for purpose?

Preserve

Achieve digital spatial data immortality

Thank you!

Metadata creation = well-deserved holiday