validation of services, data and metadata
TRANSCRIPT
®
Validation of services, data and metadataLuis Bermudez (OGC)
ESIP Summer Meeting 2016Durham, NCJuly 21, 2016
Composition of this talk
• Why validation• ESIP needs• OGC Compliance Program• The tool
2
WHY validation?
3
Maps
CoveragesVector
Time Series
Eureka! My model is perfect
Server
Client
Maps
CoveragesVector
Time Series
? ?
??
Service Service
CatalogAre the
services correctly registered so that they can be found and use?
OGC®
© 2016 Open Geospatial Consortium, Inc.
ESIP community has documented the need
8
Discovery Grand Challenge
http://wiki.esipfed.org/index.php/Discovery_White_Paper#The_Grand_Challenge
Need for validation
OGC®
© 2016 Open Geospatial Consortium, Inc.
OGC compliance program
11
Open Geospatial Consortium
534 volunteer organizations
6905 portal users
More than 60 standards
Conformance = fulfillment of specified requirements
http://www.sxc.hu/photo/149744
Implementations can get OGC Certified
Currently851 implementations203 compliant products
For Users: Proof that a solution works
(www.opengeospatial.org/ resource/products/compliant)
http://www.opengeospatial.org/resource/products/compliant
For implementers: Get more business
How does it work?
OGC®
© 2016 Open Geospatial Consortium, Inc.19
Conformant = Compliant =
Super passing the test+
license
If not we can say Implement
Available and Expected Tests 2016
Available Tests Version Projected in 2016 Version
Catalogue Service - Web (CSW) 2.0.2 Catalogue Service - Web (CSW) 3.0Geography Markup Language (GML) 3.2.1 GeoPackage 1.0OGC KML 2.2 KML 2.3Sensor Observation Service (SOS) 1.0.0 O&M 2.0Sensor Observation Service (SOS) 2.0 SensorML 1.0Sensor Planning Service (SPS) 1.0 SensorML 2.0Sensor Planning Service (SPS) 2.0 SensorThings API 1.0Simple Feature Access - SQL (SFS) 1.1 WFS (Basic) 1.1Simple Feature Access - SQL (SFS) 1.2.1 WMTS 1.0Web Coverage Service (WCS) 1.0.0 WPS 1.0Web Coverage Service (WCS) 1.1.1 DGIWG ProfilesWeb Coverage Service (WCS) 2.0.1Web Feature Service (WFS) 1.0.0Web Feature Service (WFS) 1.1.0Web Feature Service (WFS) 2.0Web Map Service (WMS) 1.1.1Web Map Service (WMS) 1.3.0WMS Client 1.3
How to ask for compliance?
“ … Purchaser seeks geospatial products that provide maximum interoperability with purchaser’s and data sharing partner’s systems. To accomplish this, purchaser seeks to make maximum use of open standards provided by the Open Geospatial Consortium (OGC), ISO …”
OGC Compliance Overview - Guide for Software Acquisition White paper (15-002r5)
http://docs.opengeospatial.org/wp/15-002r5/15-002r5.html
The Open Source Tool
Tools, community and support
Code Contributors
Public Forum Support
Open SourceXSLT
Tools
Communities Collaboration
Giacomo MartiranoStefania Morrone
Enable testing of INPSIRE metadata profiles
Processing non-ASCII chars
GML CRS, and polygons definitions
Anybody can run the test
Tester selects test suite
Tester names session
Selection of Test
Testing in ProgressTester provides end point of the service
Console provides feedback on test assertions
Tester Selects Options
Summary of Results
Types of Tests
• Encodings– SensorML, KML, GML, Metadata in XML, …
• Servers– CAT, WFS, WMS, WCS, SOS, …
• Clients– WMS 1.3
Example in EuropeExample in Europe
Data validation for INSPIRE Themes
In collaboration with Epsilon ItaliaTEAM Engine and GML 3.2.1 test suit
Metadata and Services Validation for
Germany and INSPIRETEAM Engine and
CSW and WMS test suiteshttp://cloud.epsilon-italia.it/ http://testsuite.gdi-de.org/gdi/
Community Support
Metadata Validation
used in
CINERGI
(Community Inventory of EarthCube Resources for
Geosciences Interoperability)
32
Goals
• Large inventory of high quality information resources across disciplines, with traceable provenance, usable across EarthCube research scenarios
• Engaging geoscience community in creating and curating the inventory
• Enabling search and integration across domains, and facilitating navigation across information objects of different types (resources, people, software, etc..)
34
3 Levels Community Inventories Validation
1 – Schema2 – Rules not enforced by schema3 – Community rules
http://cite-dev-03.opengeospatial.org/teamengine/
Level 1 - Schema
Level 2 – Rules not enforceable via Schema
Level 3 – Community Rules
Results
Example files for metadata validation
Go to the validation web site:http://cite-dev-03.opengeospatial.org/teamengine/
Provide an XML instancehttp://cinergi.sdsc.edu/getmetadata/F3ACDE93-F0E3-4F7E-AD26-F2B87DD4DB4B.xml
And if needed provide a schematronhttp://cite-dev-03.opengeospatial.org/teamengine/geo-extend-iso.sch
41
GML ValidationCommon Database on Designated Areas
1.4 GB100,181 FeaturesCDDA application schemaINSPIRE Protected Sites schema
XML Schema ValidationAbout 1 min to test against Schema with 1 GB Java heap size
Test data provided by
Epsilon Italia
OGC®
© 2016 Open Geospatial Consortium, Inc.
Catalog (CAT 3.0) Validation
43
• https://www.youtube.com/watch?v=dWf0X6naiRU
CAT 3.0 Blog
http://www.opengeospatial.org/blog/2448
link
http://demo.pycsw.org/cite/csw?mode=opensearch&service=CSW&version=3.0.0&request=GetRecords&elementsetname=full&typenames=csw:Record&resulttype=results&
q=Greece
Help and questions when testingHelp and questions when testing
Community support with about
About 300 members
Thank you
Luis [email protected]
@berdezhttps://www.linkedin.com/in/bermudez
Presentation at: http://bit.ly/2a1Ttm5