validation of services, data and metadata

®

Validation of services, data and metadataLuis Bermudez (OGC)

ESIP Summer Meeting 2016Durham, NCJuly 21, 2016

Composition of this talk

• Why validation• ESIP needs• OGC Compliance Program• The tool

2

WHY validation?

3

Maps

CoveragesVector

Time Series

Eureka! My model is perfect

Server

Client

Maps

CoveragesVector

Time Series

? ?

??

Service Service

CatalogAre the

services correctly registered so that they can be found and use?

OGC®

© 2016 Open Geospatial Consortium, Inc.

ESIP community has documented the need

8

Discovery Grand Challenge

http://wiki.esipfed.org/index.php/Discovery_White_Paper#The_Grand_Challenge

Need for validation

OGC®

© 2016 Open Geospatial Consortium, Inc.

OGC compliance program

11

Open Geospatial Consortium

534 volunteer organizations

6905 portal users

More than 60 standards

Conformance =  fulfillment of specified requirements

http://www.sxc.hu/photo/149744

Implementations can get OGC Certified

Currently851 implementations203 compliant products

For Users: Proof that a solution works

(www.opengeospatial.org/ resource/products/compliant)

http://www.opengeospatial.org/resource/products/compliant

For implementers: Get more business

How does it work?

OGC®

© 2016 Open Geospatial Consortium, Inc.19

Conformant = Compliant =

Super passing the test+

license

If not we can say Implement

Available and Expected Tests 2016

Available Tests Version Projected in 2016 Version

Catalogue Service - Web (CSW) 2.0.2 Catalogue Service - Web (CSW) 3.0Geography Markup Language (GML) 3.2.1 GeoPackage 1.0OGC KML 2.2 KML 2.3Sensor Observation Service (SOS) 1.0.0 O&M 2.0Sensor Observation Service (SOS) 2.0 SensorML 1.0Sensor Planning Service (SPS) 1.0 SensorML 2.0Sensor Planning Service (SPS) 2.0 SensorThings API 1.0Simple Feature Access - SQL (SFS) 1.1 WFS (Basic) 1.1Simple Feature Access - SQL (SFS) 1.2.1 WMTS 1.0Web Coverage Service (WCS) 1.0.0 WPS 1.0Web Coverage Service (WCS) 1.1.1 DGIWG ProfilesWeb Coverage Service (WCS) 2.0.1Web Feature Service (WFS) 1.0.0Web Feature Service (WFS) 1.1.0Web Feature Service (WFS) 2.0Web Map Service (WMS) 1.1.1Web Map Service (WMS) 1.3.0WMS Client 1.3

How to ask for compliance?

“ … Purchaser seeks geospatial products that provide maximum interoperability with purchaser’s and data sharing partner’s systems. To accomplish this, purchaser seeks to make maximum use of open standards provided by the Open Geospatial Consortium (OGC), ISO …”

OGC Compliance Overview - Guide for Software Acquisition White paper (15-002r5)

http://docs.opengeospatial.org/wp/15-002r5/15-002r5.html

The Open Source Tool

Tools, community and support

Code Contributors

Public Forum Support

Open SourceXSLT

Tools

Communities Collaboration

Giacomo MartiranoStefania Morrone

Enable testing of INPSIRE metadata profiles

Processing non-ASCII chars

GML CRS, and polygons definitions

Anybody can run the test

Tester selects test suite

Tester names session

Selection of Test

Testing in ProgressTester provides end point of the service

Console provides feedback on test assertions

Tester Selects Options

Summary of Results

Types of Tests

• Encodings– SensorML, KML, GML, Metadata in XML, …

• Servers– CAT, WFS, WMS, WCS, SOS, …

• Clients– WMS 1.3

Example in EuropeExample in Europe

Data validation for INSPIRE Themes

In collaboration with Epsilon ItaliaTEAM Engine and GML 3.2.1 test suit

Metadata and Services Validation for

Germany and INSPIRETEAM Engine and

CSW and WMS test suiteshttp://cloud.epsilon-italia.it/ http://testsuite.gdi-de.org/gdi/

Community Support

Metadata Validation

used in

CINERGI

(Community Inventory of EarthCube Resources for

Geosciences Interoperability)

32

Goals

• Large inventory of high quality information resources across disciplines, with traceable provenance, usable across EarthCube research scenarios

• Engaging geoscience community in creating and curating the inventory

• Enabling search and integration across domains, and facilitating navigation across information objects of different types (resources, people, software, etc..)

34

3 Levels Community Inventories Validation

1 – Schema2 – Rules not enforced by schema3 – Community rules

http://cite-dev-03.opengeospatial.org/teamengine/

Level 1 - Schema

Level 2 – Rules not enforceable via Schema

Level 3 – Community Rules

Results

Example files for metadata validation

Go to the validation web site:http://cite-dev-03.opengeospatial.org/teamengine/

Provide an XML instancehttp://cinergi.sdsc.edu/getmetadata/F3ACDE93-F0E3-4F7E-AD26-F2B87DD4DB4B.xml

And if needed provide a schematronhttp://cite-dev-03.opengeospatial.org/teamengine/geo-extend-iso.sch

41

GML ValidationCommon Database on Designated Areas

1.4 GB100,181 FeaturesCDDA application schemaINSPIRE Protected Sites schema

XML Schema ValidationAbout 1 min to test against Schema with 1 GB Java heap size

Test data provided by

Epsilon Italia

OGC®

© 2016 Open Geospatial Consortium, Inc.

Catalog (CAT 3.0) Validation

43

• https://www.youtube.com/watch?v=dWf0X6naiRU

CAT 3.0 Blog

http://www.opengeospatial.org/blog/2448

link

http://demo.pycsw.org/cite/csw?mode=opensearch&service=CSW&version=3.0.0&request=GetRecords&elementsetname=full&typenames=csw:Record&resulttype=results&

q=Greece

Help and questions when testingHelp and questions when testing

cite-forum@lists.opengeospatial.org

Community support with about

About 300 members

Thank you

Luis Bermudezlbermudez@opengeospatial.org

@berdezhttps://www.linkedin.com/in/bermudez

Presentation at: http://bit.ly/2a1Ttm5