extremedatawarehouseperformance’ withoracle exadata’’’ days... ·...

Download ExtremeDataWarehousePerformance’ withOracle Exadata’’’ Days... · ExtremeDataWarehousePerformance’ withOracle Exadata ... – Buton

Post on 30-Jan-2018

225 views

Category:

Documents

2 download

Embed Size (px)

TRANSCRIPT

  • Managed Services Cloud Services Consul3ng Services Licensing

    Extreme Data Warehouse Performance with Oracle Exadata Kasey Parker Enterprise Architect Kasey.Parker@centroid.com

    Managed Services

    Cloud Services

    Consul3ng Services

    Licensing

  • Managed Services Cloud Services Consul3ng Services Licensing

    Who is Centroid?

    Centroid is a leading provider of Oracle Technology, Applica8ons and Infrastructure/Hos8ng solu8ons

    Established in 1997

    Office loca8ons: Troy, MI (HQ); San Francisco, CA; Los Angeles, CA; Dallas, TX

    200+ Consultants

    Oracle Pla8num Partner Selected to Oracles Top 25 Strategic Partner Program Top 5 Oracle Partner for Hardware/Storage

    100% Oracle Red Stack Focused

    Clients for life approach to customer rela8onships

    Oracle Exadata Center of Excellence established in 2011 Centroid Authored - Oracle Exadata Recipes (Published Feb-2013)

    QUICK FACTS

  • Managed Services Cloud Services Consul3ng Services Licensing

    Agenda Exadata Overview Why Exadata? Exadatas Secret Sauce GeAng the Most out of Exadata DW

    Avoiding the 3X Club Other Data Warehouse Best Prac3ces

  • Managed Services Cloud Services Consul3ng Services Licensing

    EXADATA OVERVIEW

  • Managed Services Cloud Services Consul3ng Services Licensing

    Exadata Architecture Database hardware and soIware plaKorm in a box

    Scale-Out Database Servers 8x 2-socket, or 2x 8-socket Xeon database servers Oracle Database, ASM, RAC; Linux or Solaris Standard Ethernet to data center

    Scale-Out Intelligent Storage Servers 2-socket storage servers, Exadata Storage SoIware Up to 672 terabytes disk per rack 56 PCI Flash memory cards per rack

    InfiniBand Network Unified internal connec3vity ( 40 Gb/sec )

  • Managed Services Cloud Services Consul3ng Services Licensing

    Exadata Configura3on Op3ons Start small and grow as needed upgraded onsite

    Half Rack Full Rack Quarter Rack Eighth Rack

  • Managed Services Cloud Services Consul3ng Services Licensing

    Exadata Hardware Summary X4-2 Full X4-2 Half X4-2 Quarter X4-2 Eighth

    Database Servers 8 4 2 2

    Database Grid Cores 192 96 48 24

    Database Grid Memory (GB) 2048 (max 4096) 1024 (max 2048) 512 (max 1024) 512 (max 1024)

    InfiniBand switches 2 2 2 2

    Ethernet switch 1 1 1 1

    Exadata Storage Servers 14 7 3 3

    Storage Grid CPU Cores 168 84 36 18

    Raw Flash Capacity 44.8 TB 22.4 TB 9.6 TB 4.8 TB

    Raw Storage Capacity High Perf 200 TB 100 TB 43.2 TB 21.6 TB

    High Cap 672 TB 336 TB 144 TB 72 TB

    Usable mirrored capacity High Perf 90 TB 45 TB 19 TB 9 TB

    High Cap 300 TB 150 TB 63 TB 30 TB

    Usable Triple mirrored capacity High Perf 60 TB 30 TB 13 TB 6.3 TB

    High Cap 200 TB 100 TB 43 TB 21.5 TB

  • Managed Services Cloud Services Consul3ng Services Licensing

    Exadata Hardware Exadata X4-2 SQL IO Performance

    1 - Bandwidth is peak physical scan bandwidth achieved running SQL, assuming no compression. Effec3ve data bandwidth will be much higher when compression is factored in. 2 - IOPS Based on read IO requests of size 8K running SQL, typically with sub-millisecond latencies. Note that the IO size greatly effects flash IOPS. Others quote IOPS based on 2K, 4K or smaller IOs that are not relevant for databases and measure IOs using low level tools instead of SQL. 3- Actual Performance varies by applica3on. 4 Load rates are typically limited by database server CPU, not IO. Rates vary based on load method, indexes, data types, compression, and par33oning

    X4-2 Full Rack

    X4-2 Half Rack

    X4-2 Quarter

    X4-2 Eighth

    Flash Cache SQL Bandwidth1,3

    High Cap Disk 100 GB/s 50 GB/s 21.5 GB/s 10.7 GB/s

    High Perf Disk 100 GB/s 50 GB/s 21.5 GB/s 10.7 GB/s

    Flash SQL IOPS2,3 8K Reads 2,660,000 1,330,000 570,000 285,000

    8K Writes 1,960,000 980,000 420,000 210,000

    Disk SQL Bandwidth1,3

    High Cap Disk 20 GB/s 10 GB/s 4.5 G/s 2.25 GB/s

    High Perf Disk 24 GB/s 12 GB/s 5.2 GB/s 2.6 GB/s

    Disk SQL IOPS High Cap Disk 32,000 16,000 7,000 3,500

    High Perf Disk 50,000 25,000 10,800 5,400

    Data Load Rate4 20 TB/hr 10 TB/hr 5 TB/hr 2.5 TB/hr

  • Managed Services Cloud Services Consul3ng Services Licensing

    WHY EXADATA?

  • Managed Services Cloud Services Consul3ng Services Licensing

    Why Exadata? Exadata is designed to eliminate the most common bomleneck for large databases

    Timely transfer of large data sets from storage subsystem to database server

  • Managed Services Cloud Services Consul3ng Services Licensing

    Why Exadata? Solving the IO BoTleneck Solu3on 1: Enlarge the pipe

    Physical disks, on all cells, work in parallel to serve IO requests Large Infiniband pipe (40GB/Sec)

  • Managed Services Cloud Services Consul3ng Services Licensing

    Why Exadata? Cant we do that with other high performance storage soluVons?

    YES There is nothing Magical about Exadata hardware, and its s3ll the same Oracle Database

  • Managed Services Cloud Services Consul3ng Services Licensing

    Why Exadata? Solving the IO BoTleneck Solu3on 2: Reduce the IO opera3ons

    Done using Exadatas Secret Sauce: Smart Storage, Smart Flash Cache and Hybrid Columnar Compression

    10X reduc3on in data sent to database servers is common

  • Managed Services Cloud Services Consul3ng Services Licensing

    Exadata Innova3ons Some are automa3c, with limited configura3on ability Storage Indexes Smart Flash Cache

    Some may require some effort Smart Scans Hybrid Columnar Compression (HCC) IORM (Resource Manager)

  • Managed Services Cloud Services Consul3ng Services Licensing

    Storage Indexes

    Exadata Storage Indexes maintain summary information about table data in memory

    Store MIN and MAX values of columns Typically one index entry for every MB of disk

    Eliminates disk I/Os if MIN and MAX can never match where clause of a query

    Completely automatic and transparent

    A B C D

    1 3 5 5 8 3

    Min B = 1 Max B =5

    Table Index

    Min B = 3 Max B =8

    Select * from Table where B

  • Managed Services Cloud Services Consul3ng Services Licensing

    Smart Flash Cache Caches Read and Write I/Os in PCI flash Transparently accelerates read and write intensive

    workloads Up to 2.66 million 8K read IOPS from SQL Up to 1.96 million 8K write IOPS from SQL

    Persistent write cache speeds database recovery Exadata Flash Cache is much more effec3ve than

    flash 3ering architectures used by others Caches current hot data, not yesterdays Caches data in granules 8x to 16x smaller than 3ering

    Greatly improves the effec3veness of flash

    I/Os

    2.66 Million 8K Read 1.96 Million 8K Write IOPS from SQL

    Other Flash Features can be configured if needed E.g. Cache compression, Cache pinning, Flash Disks (for Temp)

  • Managed Services Cloud Services Consul3ng Services Licensing

    Avoid the 3X Club

    Some Exadata op3miza3ons may require a limle effort but theyre worth it. Data Warehouse workloads should

    improve >7X on Exadata

  • Managed Services Cloud Services Consul3ng Services Licensing

    Avoid the 3X Club Tune for Smart Scans Wisely use Parallelism Compress with HCC where appropriate Invoke Resource Management (IORM) S3ll follow Data Warehouse Best Prac3ces

  • Managed Services Cloud Services Consul3ng Services Licensing

    Avoid the 3X Club an Example EDW for Large Organiza3on in Salt Lake valley Moved to Exadata beginning September 2012 Configured/Tuned Exadata op3miza3ons for October 2012

    Average Response Time

  • Managed Services Cloud Services Consul3ng Services Licensing

    Avoid the 3X Club Tune for Smart Scans Wisely use Parallelism Compress with HCC where appropriate Invoke Resource Management (IORM) S3ll follow Data Warehouse Best Prac3ces

  • Managed Services Cloud Services Consul3ng Services Licensing

    Smart Scan Processing

    Select name, customer#... Where city=SALT LAKE CITY

    Smart Scan idenVfies rows / columns in the 1 TB tables that match the SQL (1000 rows)

    IO is executed and 20MB returned from storage to PGA

    Who are my customers in

    Salt Lake City?

    Oracle DB Grid Exadata

    Storage Grid

    1000 rows returned to client

  • Managed Services Cloud Services Consul3ng Services Licensing

    Smart Scan Comparison

    8K Blocks

    SGA

    Rows and Columns

    PGA

    Standard Operations Smart Scans

    22

    Storage Servers

    Database Servers

  • Managed Services Cloud Services Consul3ng Services Licensing

    Smart Scan Requirements

    Full table scan or index fast full scan No IOTs, Clustered Tables or LOBs

    Direct path reads Direct path reads happen for

    Serial queries of large tables (11gR2) Func3on of Buffer Cache Size, threshold an