sdi workshop – esdin best...
TRANSCRIPT
SDI Workshop – ESDIN Best Practices
2011-06-28
INSPIRE conference, Edinburgh
Arnulf Christl, Metaspatial
Download this slide set as ODP or PDF at http://arnulf.us/Publications
INSPIRE 2011 SDI Workshop Edinburgh, UK 2 / 25
Arnulf ChristlGeospatially aware software developer since 1991. Manager and Spatial Systems Architect.● Current President of OSGeo● OGC Architecture Board Member ● OpenStreetMap Advocate
Founder of several companies and initiatives, talks and travels too much.
INSPIRE 2011 SDI Workshop Edinburgh, UK 3 / 25
What? Consultation and Implementation of- Spatial Data Infrastructures- Metadata
Why? To leverage your spatial data
How: Open Source Software- Open Standards- Agile management
INSPIRE 2011 SDI Workshop Edinburgh, UK 4/25
ESDIN is an eContentplus Best Practice Network project• Run time from September 2008 to March 2011 & ongoing• coordinated by EuroGeographics
Key goal: help member states, candidate countries and EFTA States prepare their data for INSPIRE Annex 1 spatial data themes and improve access:
1. Coordinate Reference Systems
2. Administrative Boundaries
3. Cadastral Parcels
4. Hydrography
5. Transport Networks
6. Geographical Names
ESDIN Introduction
INSPIRE 2011 SDI Workshop Edinburgh, UK 5/25
• EuroGeographics
• Bundesamt für Kartographie und
Geodäsie (BKG), Germany
• IGN Belgium,
• IGN France,
• Statens Kartverk, Norway,
• The Finnish Geodetic Institute,
• Lantmäteriet, Sweden,
• Kort & Matrikelstyrelsen,Denmark,
• National Land Survey of Finland,
• interactive instruments, Bonn
• Bundesamt für Eich- und
Vermessungswesen (BEV), Austria
● Beuth Hochschule für Technik, Berlin
● Geodan Software Development & Technology, Netherlands,
● 1Spatial, UK● EDINA, University Edinburgh, UK● National Agency for Cadastre and
Real Estate Publicity, Romania● National Technical University of
Athens, Greece● Institute of Geodesy, Cartography
and Remote Sensing, Hungary● Helsinki University of Technology,
Finland
Project partners
INSPIRE 2011 SDI Workshop Edinburgh, UK 6/25
Specific Objectives:
● Implement Annex 1 INSPIRE compliant web based services which support the aggregation of harmonised data across borders and across themes
Secure Environment
ProtectedNMCA data
fdsa OGC WFS
MaintainCore Data
Daily delivery
INSPIRE 2011 SDI Workshop Edinburgh, UK 7/25
Quality Evaluation
Edge Matching
Generalization
Unique IDs
INSPPIRE Annex Themes
Reference Data
Daily delivery
Automized processing to achieve: ● Highest quality
products ● With near real
time delivery
INSPIRE 2011 SDI Workshop Edinburgh, UK 8/25
Specific Objectives:
● Aggregate data through development of INSPIRE web services at different levels of detail.
EU Commission
Banking and Insurances
Public Administration
Real Estate, Industry
Citizens
Emergency
Education
Utilitiy Companies
Traffic Control
Environment Protection
NATO
Geology
sub
scrip
tion
high deliveryfrequency
low deliveryfrequency
Global
Regional (OGC WFS)
High Resolution INSPIRE (OGC WFS)
INSPIRE 2011 SDI Workshop Edinburgh, UK 9/25
Test INSPIRE Imple-mentation Rules and specifications in a live environment and recommend improvements.
NMCALocalData
Schema & CRSTransformation
DataIntegration
& Conflation
EdgeMatching
GeometricGeneralisation
CartographicEnhancement
Transform local schemas to common INSPIRE data specification framework.
Integrate INSPIRE data into compatible collaborative dataset(s).
Ensure cross-border consistency across neighbouring data.
Reduce data complexity, for effective use at alternate scales.
Modify and enhance data for mapping
purposes.
INSPIRE 2011 SDI Workshop Edinburgh, UK 10/25
Outcomes:● Greater understanding of the technical
consequences of INSPIRE for key content stakeholders, eg, the European NMCAs
● Greater understanding of the business consequences of INSPIRE
● Wider access to geospatial digital content, eg, to the European academic sector
● Core components of the ESDI established● Operational services covering 6 INSPIRE Annex 1 themes● Test environment
INSPIRE 2011 SDI Workshop Edinburgh, UK 11/25
Specifically the Project will (1):
Provide data for INSPIRE Annex 1 themes at a range of scales.
● "Range of scales" are realized through "varying Level of Detail"
Assess the suitability of this information as a basis for linking to other themes.
● The result are plans for a European Location Framework forming the foundation for LinkedData
INSPIRE 2011 SDI Workshop Edinburgh, UK 12/25
Specifically the Project will (2):
Put in place services capable of transforming and providing access to data.
● The project has successfully supported several (but not enough) NMCAs in setting up services
Develop a quality model.● Quality of originating data, processing steps,
generalization as basis for fitness of use in different domains.
INSPIRE 2011 SDI Workshop Edinburgh, UK 13/25
WP6: Migrate existing pan European small scale products to ExM:
EuroGlobalMap
EuroRegionalMap
EuroBoundaryMap
ExM Data Specification
INSPIRE Data Specs INSPIRE Data Specifications
as framework. Note overlap
INSPIRE 2011 SDI Workshop Edinburgh, UK 14/25
WP7: Extend ExM to incorporate large scale data:
European NMCAs large scale products: Cadastral parcels
ExM Data Specification
INSPIRE Data Specs • INSPIRE is scale independent, but access to multiple scales
is important for large numbers of users• Transformation and generalisation services required!
INSPIRE 2011 SDI Workshop Edinburgh, UK 15/25
WP10 ExM Transformation specificationsExM
INSPIRE
Large scale
Medium scale
Small scale
Large scale
Medium scale
Small scale
INSPIRE aware Location framework
NMCA 1
Large scale
Medium scale
Small scale
NMCA N
Multiple European NMCAs
Transformation
Implement transformation rules for participating NMCAs. Prepare for generalisation.
INSPIRE 2011 SDI Workshop Edinburgh, UK 16/25
WP9: NMCA Data maintenance and business processes
• Improve geospatial maintenance at the European level
– Edge-matching methodologies
– Stable Unique Identifiers
– Near real-time Change-only Updates for power users (subscription model)
INSPIRE 2011 SDI Workshop Edinburgh, UK 17/25
Edge Matching
INSPIRE 2011 SDI Workshop Edinburgh, UK 18/25NMCA 1
ExMLarge
ExMSmall
NMCAMaster data
Trans-formation
Dow
nloa
d
Quality evaluation
Conformance testing
Edge-matchingConformance
testing
Edge-matching
Generalization
Conformance testing
Generalization
Trans-formation
Quality evaluation
Conformance testing
Conformance testing
Conformance testing
Generalization
NMCA 2
Dow
nload
EB
M
Euro-Geographics D
ownl
oad
EB
M
ER
M
Dow
nloa
d
EG
M
Do
wnl
oad
Generalization
Datasets downloaded for user applications
EBM, ERM and EGM are just specific download services from respective ExMsEG services are ’cascading’ to NMCA servicesEG GeoRM is a ’broker’ for NMCA GeoRM
This NMCA derives both ExM Large and ExM Medium from its Master data
This NMCA derives ExM Large from its Master data, and generalize ExM Medium from ExM Large
ExMMeta-data
Meta-data
ExMMedium
Conformance testing EBM ERM EGM
EBM ERM EGM
ExMLarge
ExMSmall
ExMMedium
Meta-data
ExMLarge
ExMSmall
ExMMedium
NMCAMaster
data
Addi-tional data
EB
M
ER
M
Dow
nloa
d
EG
M
Dow
nloa
d
ER
M
Dow
nload
EG
M
Dow
nload
Transformation
Initially plannedArchitecture
INSPIRE 2011 SDI Workshop Edinburgh, UK 19/25Protected
Protected Area
ProtectedNMCA data
ProtectedNMCA data
Quality Evaluation
asynchronousreporting
Edge Matching
Generalization
Unique IDs
OGC WFS
MaintainCore Data
Offline
MaintainCore Data
EU Commission
Banking and Insurances
Academia
Su
bsc r
iptio
n /
Web
Ho o
ks
High frequency: Daily delivery
Low delivery frequency, yearly
! !
INSPPIRE Annex Themes
Reference Data
Real Estate, Industry
Citizens & AdministrationInitial CapabilityScenario
INSPIRE 2011 SDI Workshop Edinburgh, UK 20/25
Quality Evaluation
asynchronous reporting
Edge Matching
Generalization
Unique IDs
Secure Env
ProtectedNMCA data
Schema Transformation
Secure Environment
ProtectedNMCA data
Schema Transformation
EU Commission
Real Estate, Industry
Citizens & Administration
Banking and Insurances
Academiasubs
c rip
tion
! !
INSPPIRE Annex Themes
Reference Data
Secure Environment
ProtectedNMCA data
Schema Transformation
Secure Environment
ProtectedNMCA data
Schema Transformation
Secure Environment
ProtectedNMCA data
Schema Transformation
Secure Environment
ProtectedNMCA data
Schema Transformation
Secure Env
ProtectedNMCA data
Schema Transformation Frequeny of delivery
Production Scenario
Architecture – Addressing Diversity
Publication service integrated with production
Production with manual transformation for publication service
Service oriented productionwith semi automatic
transformation process
Lassi Lehto, FGI FinlandArnulf Christl, Metaspatial
Architecture – Addressing Stability
Publication data available through INSPIRE view and Download Servicesplus additional"mass market" formats andinterfaces.
Replication of publicationdata adapted to NMCAs processes.
Centraldata cacheallows for optimized scalabilityand availability of pan-European data
Arnulf Christl, Metaspatial
Proposed Integrated Architecture
EuroGeographicsArchitecture integrated with INSPIRE conceptual model
INSPIRE 2011 SDI Workshop Edinburgh, UK 24/25
INSPIRE SDI Challenges● Distributed Work Teams● Availability of production quality
WFS services (eg no GML 3.2.1)● Licencing Policies● Time and manpower constraints of
participating NMCAs● Involvement of stakeholders
INSPIRE 2011 SDI Workshop Edinburgh, UK 25/25
Adopting new Project Methodology● Introducing Scrum in WP 11 Development
● Clear definition of roles● Product Manager: focus on maximising ROI● Team: daily stand-up meetings improve focus● Scrum Master: Removes impediments
● High acceptance by development teams and management (after some positive experience)!
INSPIRE 2011 SDI Workshop Edinburgh, UK 26/25
Scrum Outline● Create ad hoc focused distributed teams● Maintain Product Backlog● Define Sprint Goal● Create Sprint Backlog● Iterate ● Report● Amend
24h 10 days
INSPIRE 2011 SDI Workshop Edinburgh, UK 27/25
ESDIN: Practical Outcomes● European Location Framework● Ready to serve as reference for LinkedData● ESDIN Architecture and Data Viewer (dev)
● Access Security using Shibboleth● Best Practice: How to get things done the
INSPIRE way● Outreach through seminars, articles, etc.
INSPIRE 2011 SDI Workshop Edinburgh, UK 28/25
Conclusion –Prospects for the European Location Framework
• Using ESDIN best practice and tools will– Improve process efficiencies– Enable interoperability– Support users processes with
consistent, reliable reference data
• Coordination of INSPIRE data is needed
• An emergent community supports the ELF
www.esdin.eu
INSPIRE 2011 SDI Workshop Edinburgh, UK 29 / 25
Thank you for your attention!
Time for Questions and Answers
This Slide set can be used, reused and modified by anybody for any purpose. See also: Copystraight.
Copyright: Arnulf Christl 2011
The internationalOpen Source Conference for the
Geospatial Domain http://2011.foss4g.org
Download this slide set as ODP or PDF at http://arnulf.us/Publications
INSPIRE 2011 SDI Workshop Edinburgh, UK 30 / 25
Wait, what are these URLs?
● http://kademo.nl/gs2/inspire/wms?request=GetCapabilities
● http://kademo.nl/gs2/inspire/wms?LAYERS=CP.CadastralParcel&FORMAT=image%2Fpng&TRANSPARENT=true&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A4258&BBOX=7.00152,52.26366,7.01570,52.27183&WIDTH=810&HEIGHT=466