1 copyright © 2011, oracle and/or its affiliates. all rights...
TRANSCRIPT
2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Spatial on Oracle Exadata Database Machine Jim Steiner Vice President, Server Technologies
3 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Program Agenda
• Exadata Database Machine • Oracle Spatial Architecture • Questions
4 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Exadata Database Machine A complete system - compute, storage, networking
• Database Grid – Intel-based database servers – Oracle Linux or Solaris 11 – Oracle Database 11g R2 – 10 Gig Ethernet (to data center)
• Storage Grid – Intel-based storage servers – Up to 336 terabytes raw disk – 5.3 terabytes Flash storage – Exadata Storage Server Software
• InfiniBand Network – Internal connectivity (40 Gb/sec)
5 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
• Intelligent storage – Smart Scan query offload – Scale-out storage
+ + +
• Hybrid Columnar Compression – 10x compression for warehouses – 15x compression for archives
Compressed
primary
standby
test
dev’t
backup
Uncompressed
• Smart Flash Cache – Accelerates random I/O up to 30x – Doubles data scan rate
Data remains compressed for scans and
in Flash
Benefits Multiply
Key Exadata Innovations
6 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Spatial Architecture Benefits on Oracle Exadata Database Machine
7 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Exadata Extreme Performance for Spa3al Workloads
• Only Oracle Spatial is designed for the Exadata architecture
• Breaks new boundaries for ingesting spatial data
• Data warehouse performance increases of up to 100x faster
• Box and distance queries up to 25x faster
8 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Exadata Oracle Spatial Resides in Oracle Database Kernel
• Code resides in Database Address Space • Index operations performed in Database
SGA • Spatial operators are parallel enabled by
default and execute in Database Address Space for maximum scalability
• Seamlessly exploit Database security, compression, partitioning services
9 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Exadata Faster Index and Query Opera3ons
• Spatial query analysis up to 100x faster – Spatial operations can be performed in up
to 2 Terabytes of Database System Global Area memory
10 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Exadata Extreme Compression for Point Data Sets
• Exadata Hybrid Columnar Compression of point data sets reduces storage required
• Supports high speed inserts with 1.5x compression with spatial index enabled
• Over 10x compression in high archive mode
11 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Exadata Extreme Scalability for Millions of Spa3al Objects
• Millions of spatial objects evaluated in minutes – Point in polygon analysis – Polygon to polygon analysis – Deviation from route – Distance covered
• Millions of Spatial objects ingested in minutes – Weather readings – Traffic readings – Sensor readings
12 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Exadata Extreme Performance for Spa3al Workloads
• Massive ingestion of Spatial data from sensors, weather data, satellites, and other streams by government environmental and analysis agencies
• Polygon to Polygon overlay analysis for image cloud cover evaluation – millions of polygons evaluated
• Millions of concurrent subscribers evaluating routes and tracks
• National cadastral data cleansing, geometry validation, and digital map processing
• Telematic tracking application
• Oil and Gas workload up to 80x faster query of spatial assets
13 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Parallel Query and Spatial Parallel Enabled Pipleline Table Functions
14 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Parallel Pipelined Table Function
• Exadata ¼ RAC Has 24 Cores
• Batch geocoding – 1365/second • Batch reverse geocoding – 3388/second • Batch DEM get_cell_value raster lookups – 8951/
seconds
Exadata ¼ RAC (high performance disk) - Results
15 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
EHCC and Spatial Exadata Hybrid Columnar Compression and Spatial
16 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
EHCC and Spatial
Point data Within_distance Query
Uncompressed Query Low 3.5x
Query High 5.3x
Archive High 6.8x
4 mile (323 rows)
0.02 sec 0.02 sec (0.0x)
0.06 sec (3.0x)
1.36 sec (68x)
5 mile (1251 rows)
0.03 sec 0.06 sec (2.0x)
0.12 sec (4.0x)
2.77 sec (92x)
10 mile (31466 rows)
0.29 sec 0.61 sec (2.1x)
1.3 sec (4.5x)
32.11 sec (110x)
17 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
EHCC and Spatial
Line / Polygon data Within_distance Query (lines)
Uncompressed Query Low 3.5x
Query High 5.3x
4 mile (809 rows)
0.25 sec 0.75 sec (3.0x)
2.35 sec (9.4x)
5 mile (3079 rows)
0.65 sec 2.02 sec (3.1x)
6.00 sec (9.2x)
10 mile (80771 rows)
2.93 sec 8.69 sec (2.9x)
26.0 sec (8.97x)
18 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Customer Experience
Oracle Spatial on Exadata Applications include telecommunications, land management, oil and gas exploration, retail BI.
19 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Customer Experience Santos Oil and Gas
20 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
About Santos
• Australian energy pioneer since 1954 • Leading gas producers, supplying Australian and Asian
customers • Santos’ total production was 49.9million barrels of oil equivalent • 146,800 square kilometers exploration portfolio • Supplies 16% of Australia total Natural Gas Market • Annual Revenues of $2,181million • 4500 employees • Major Focus in Coal Seam Gas ($16 Billion project)
© 2011 Oracle Corporation
21 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
About Santos – Areas of Operation
© 2011 Oracle Corporation
22 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Current Challenges
• Conflicting Service Levels around Database • Exploding data consumption • Performance
– Need to produce reports on probable reserves to the market. Current report taking 175 Hours to produce the report.
• Business Challenges – Existing Asset Base Nearing End of Life – Major investment in future Coal Seam Gas Business
© 2009 Oracle Corporation
23 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Results – In production for Spatial dataset
© 2009 Oracle Corporation