ordnance survey ireland's approach to spatial big data management · 2014. 6. 3. · database...

21
Ordnance Survey Ireland’s Approach to Spatial Big Data Management

Upload: others

Post on 20-Aug-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Ordnance Survey Ireland’s Approach to Spatial Big Data Management

Page 2: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

About us…..

Our History •  Founded in 1969 •  Headquarters in Cambridge, UK with offices in Australia, Ireland, France and Belgium •  200 staff •  AIM Listed

Our Business A specialist solutions and services provider to data providers, government and utilities

Page 3: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Some of our Customers

Page 4: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Great Expectations

Page 5: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

The Challenge

Data providers supplying rich, intelligent data

Page 6: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Assisting Humans Delivering Productivity, Power & Performance

Page 7: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Ordnance Survey Ireland

National Mapping Agency Established in 1824

HQ Dublin Cork Galway Sligo Kilkenny Clare Longford

640+ Terabytes

40 Terabytes per annum Data from 1824 - 2014

Oracle Technology Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager

Page 8: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Ordnance Survey Ireland Next Generation Mapping

“..the most significant revision to OSi’s data creation and management practices in over

30 years”

Colin Bray Chief Executive

•  Next generation national core reference data

•  Foundation for National Spatial Data Infrastructure

•  Seamless real-world feature data model

•  Inter-feature references

Page 9: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Topologically seamless Skin of the Earth Superimposed Features sit on top of Skin of the Earth Network Features including “Way”, “Water” and “Rail”

Ordnance Survey Ireland Next Generation Mapping

© Ordnance Survey Ireland/Government of Ireland Copyright Permit No. MP 0004213

Page 10: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Estimated 5 -7yr manual project

Completed in 18 months

•  Automation played a key role in its creation –  Build real world features through rules and actions –  Classify features and set properties –  Data validation

Ordnance Survey Ireland Next Generation Mapping

Page 11: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Migrating from tiled cartographic data ….

© Ordnance Survey Ireland/Government of Ireland Copyright Permit No. MP 0004213

Page 12: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Migrating from tiled cartographic data ….

© Ordnance Survey Ireland/Government of Ireland Copyright Permit No. MP 0004213

Page 13: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

…. to a seamless real-world feature database

© Ordnance Survey Ireland/Government of Ireland Copyright Permit No. MP 0004213

Page 14: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey
Page 15: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

11g 12c

Workspace Manager

Application Express

Page 16: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Ordnance Survey Ireland An Automated Approach

Page 17: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

A Product Ready National Spatial Database

Page 18: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Ordnance Survey Ireland Management Reporting

Page 19: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Ordnance Survey Ireland Business Benefits

Efficiency by Automating

Do More With Less

Efficiency by Consolidating

21 spatial data silos 1 RAC database 6 production application 1WebLogic deployment

Performance Gains

14x Faster

Survey to Supply

Page 20: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

Performance Testing

sdo_aggr_union test

'Townland' polygon features from 5 counties in Ireland and creating an aggregate union of them.

6,510 polygons with an average of 372 vertices per polygon.

12c without SVA 5 mins 36 seconds

12c with SVA 14 seconds

11g 9 mins 8 seconds

Page 21: Ordnance Survey Ireland's Approach to Spatial Big Data Management · 2014. 6. 3. · Database 9i, 10g, RAC 11g, 12c Spatial & Graph WebLogic & BPEL Workspace Manager . Ordnance Survey

[email protected] Thank You