exadata database technical overview

Upload: kentotchan

Post on 07-Apr-2018

237 views

Category:

Documents


1 download

TRANSCRIPT

  • 8/4/2019 Exadata Database Technical Overview

    1/25

    Oracle Exadata Database MachineTechnical Overview

    Copyright 2010, Oracle Corporation and/or its affiliates

  • 8/4/2019 Exadata Database Technical Overview

    2/25

    Copyright 2010, Oracle Corporation and/or its affiliates 2

    Best Machine for Data Warehousing

    Best Machine for OLTP

    Best Machine for Database Consolidation

    Unique Architecture Makes it

    Fastest, Lowest Cost

    Exadata Database MachineBest Platform to Run the Oracle Database

  • 8/4/2019 Exadata Database Technical Overview

    3/25

    Exadata in the MarketplaceRapid adoption in all geographies and industries

    Copyright 2010, Oracle Corporation and/or its affiliates 3

  • 8/4/2019 Exadata Database Technical Overview

    4/25

    Standardized and Simple to Deploy

    All Database Machines are the same Delivered ready-to-run

    Tested

    Highly supportable

    No unique configuration issues

    Identical to config used by Oracle Engineering

    Runs existing OLTP and DW applications

    Full 30 years of Oracle DB capabilities

    No Exadata certification required

    Leverages Oracle ecosystem

    Skills, knowledge base, people, partners

    Deploy in Days,Not Months

    Copyright 2010, Oracle Corporation and/or its affiliates 4

  • 8/4/2019 Exadata Database Technical Overview

    5/25

    Start Small and GrowField Upgradeable

    Copyright 2010, Oracle Corporation and/or its affiliates 5

    Oracle Exadata X2-2 Oracle Exadata X2-8

    QuarterHalf

    Full, Multi-Rack

    Multi-RackFull-Rack

  • 8/4/2019 Exadata Database Technical Overview

    6/25

    Exadata Hardware Architecture

    Database Grid Intelligent Storage Grid

    InfiniBand Network

    Redundant 40Gb/s switches

    Unified server & storagenetwork

    14 High-performance low-cost

    storage servers

    8 Dual-processor x64

    database servers

    OR

    2 Eight-processor x64database servers

    Scaleable Grid of industry standard servers for Compute and Storage

    Eliminates long-standing tradeoff between Scalability, Availability, Cost

    100 TB High Speed disk, or336 TB High Capacity disk

    5.3 TB PCI Flash

    Data mirrored acrossstorage servers

    Copyright 2010, Oracle Corporation and/or its affiliates 6

  • 8/4/2019 Exadata Database Technical Overview

    7/25

    Exadata Storage Server Building Block

    High-performance storage server built fromindustry standard components

    12 disks - 600 GB 15000 RPM HighPerformance SAS or 2TB 7200 RPM HighCapacity SAS

    2 Six-Core Intel Xeon Processors (L5640)

    Dual ported 40 Gb/sec InfiniBand

    4 x 96 GB Flash Cards

    Intelligent Exadata Storage Server Software

    Hardware by Sun

    Software by Oracle

    Copyright 2010, Oracle Corporation and/or its affiliates 7

  • 8/4/2019 Exadata Database Technical Overview

    8/25Copyright 2010, Oracle Corporation and/or its affiliates 8

    Exadata Database Machine X2-2 Full RackPre-Configured for Extreme Performance

    X2-8

    Full Rack

    X2-2

    Full Rack

    X2-2

    Half Rack

    X2-2

    Quarter Rack

    Database Server

    Sun Fire X4170 M2for X2-2

    Sun Fire X4800 for

    X2-8

    128 Cores(64 per server)

    2 TB memory(1 TB per server)

    16 x 10GbE ports(8 per server)

    96 Cores(12 per server)

    768 GB memory(96 GB per server)

    16 x 10GbE ports(2 per server)

    48 Cores(12 per server)

    384 GB memory(96 GB per server)

    8 x 10GbE ports(2 per server)

    24 Cores(12 per server)

    192 GB memory(96 GB per server)

    4 x 10GbE ports(2 per server)

    Storage Server14 Exadata Storage

    Servers14 Exadata Storage

    Servers7 Exadata Storage

    Servers3 Exadata Storage

    Servers

    InfiniBand Switch

    36 Ports at 40Gb/sec

    3 3 3 2

    1 Admin Cisco Ethernet switchKeyboard, Video, Mouse (KVM) hardware (for X2-2 Only)Redundant Power Distributions Units (PDUs)

  • 8/4/2019 Exadata Database Technical Overview

    9/25

    Raw Disk DataBandwidth

    High Perf 25 GB/s 25 GB/s 12.5 GB/s 5.4 GB/s

    High Cap 14 GB/s 14 GB/s 7 GB/s 3 GB/s

    Raw Flash Data Bandwidth 50 GB/s 50 GB/s 25 GB/s 11 GB/s

    Disk IOPS High Perf 50,000 50,000 25,000 10,800

    High Cap 25,000 25,000 12,500 5,400

    Flash IOPS 1,000,000 1,000,000 500,000 225,000

    Data Load Rate 5 TB/hr 5 TB/hr 2.5 TB/hr 1 TB/hr

    Copyright 2010, Oracle Corporation and/or its affiliates 9

    Exadata Capacity And PerformanceX2-8

    Full Rack

    X2-2

    Full Rack

    X2-2

    Half Rack

    X2-2

    Quarter Rack

    Raw Disk High Perf 100 TB 100 TB 50 TB 21 TBHigh Cap 336 TB 336 TB 168 TB 72 TB

    Raw Flash 5.3 TB 5.3 TB 2.6 TB 1.1 TB

    User Data(assuming no

    compression)

    High Perf 28 TB 28 TB 14 TB 6 TB

    High Cap 100 TB 100 TB 50 TB 21 TB

  • 8/4/2019 Exadata Database Technical Overview

    10/25

    Exadata Storage Software Unique Features

    Exadata Smart Scans 10X or greater reduction in data sentto database servers

    Exadata Storage Indexes Eliminate unnecessary I/Os

    Hybrid Columnar Compression Efficient compression increases

    effective storage capacity andincreases user data scan bandwidthsby a factor of up to 10X

    Exadata Smart Flash Cache Breaks random I/O bottleneck by

    increasing IOPs by up to 20X

    Doubles user data scan bandwidths

    I/O Resource Manager (IORM)

    Enables storage grid by prioritizingI/Os to ensure predictableperformance

    Quality of Service (QoS) Actively meet and maintain SLAs

    Memory Guard to protect existingcurrent transactions from memory-based failures

    Copyright 2010, Oracle Corporation and/or its affiliates 10

  • 8/4/2019 Exadata Database Technical Overview

    11/25Copyright 2010, Oracle Corporation and/or its affiliates 11

    Simple Query Example

    ExadataStorage Grid

    SUM

    Optimizer

    ChoosesPartitions andIndexes toAccess

    10 TB scanned

    1 GB returned to servers

    OracleDatabase Grid

    What were mysales yesterday?

    Selectsum(sales)whereDate=24-Sept

    Scan compressedblocks inpartitions/indexes

    Retrieve salesamounts forSept 24

  • 8/4/2019 Exadata Database Technical Overview

    12/25

    Exadata Intelligent Storage

    Exadata storage servers also run more complexoperations in storage

    Join filtering

    Incremental backup filtering

    I/O prioritization

    Storage Indexing Database level security

    Offloaded scans on encrypted data

    Data Mining Model Scoring

    10x reduction in data sent to DB serversis common

    ExadataIntelligent Storage

    Grid

    Copyright 2010, Oracle Corporation and/or its affiliates 12

  • 8/4/2019 Exadata Database Technical Overview

    13/25Copyright 2010, Oracle Corporation and/or its affiliates 13

    Exadata Storage IndexTransparent I/O Elimination with No Overhead

    Exadata Storage Indexes maintain summaryinformation about table data in memory

    Store MIN and MAX values of columns

    Typically one index entry for every MB of disk

    Eliminates disk I/Os if MIN and MAX can nevermatch where clause of a query

    Completely automatic and transparent

    A B C D

    1

    35

    5

    8

    3

    Min B = 1Max B =5

    Table Index

    Min B = 3Max B =8

    Select * from Table where B

  • 8/4/2019 Exadata Database Technical Overview

    14/25

    Exadata Smart Flash CacheExtreme Performance OLTP & DW

    5X More I/Os than1000 Disk Enterprise

    Storage Array

    Exadata has 5 TB of flash

    56 Flash PCI cards avoid diskcontroller bottlenecks

    Intelligently manages flash

    Smart Flash Cache holds hot data

    Avoids large scan wipe-outs of cache

    Gives speed of flash, cost of disk

    Exadata flash cache achieves:

    Over 1 million IO/sec from SQL (8K)

    Sub-millisecond response times

    Copyright 2010, Oracle Corporation and/or its affiliates 14

  • 8/4/2019 Exadata Database Technical Overview

    15/25

    Copyright 2010, Oracle Corporation and/or its affiliates 15

    Fastest Disk Throughput

    Much Faster with Flash

    50 TB of data fits in Flash

    Using 10x Query Compression

    Effective Query Throughput on

    compressed data is even higher Hundreds of GB/sec

    10

    20

    25

    TeradataNetezzaTwinFin 12

    Exadata

    Query ThroughputGB/sec Uncompressed DataSingle Rack

    Flash

    Disk

    Faster than DW Appliances75 GB/sec!

    Flash

    2650 4600

    < 38

    Disk

    Disk

  • 8/4/2019 Exadata Database Technical Overview

    16/25

    Copyright 2010, Oracle Corporation and/or its affiliates 16

    2.5

    9

    < 6

    11 ???

    25

    IBM

    XIV

    NetApp

    6080

    IBM

    DS8700

    Hitachi

    USP V

    EMC

    VMAX

    Exadata

    V2

    Exadata is fastest

    and scales with more racks

    Storage Arrays already cant

    deliver disk bandwidth

    No extra bandwidth from Flash

    No CPU offload

    No Columnar Compression

    No InfiniBand

    Storage Data Bandwidth(Uncompressed GB/sec)

    Fla

    sh

    Faster than High End Arrays

    Disk

    Exadata

    V2

    75 GB/sec!

    1 RackMultiple Racks

  • 8/4/2019 Exadata Database Technical Overview

    17/25

    Exadata Hybrid Columnar Compression

    Highest Capacity, Lowest Cost

    Data is organized and compressed by column Dramatically better compression

    Speed Optimized Query Mode for DataWarehousing

    10X compression typical Runs faster because of Exadata offload!

    Space Optimized Archival Mode forinfrequently accessed data

    15X to 50X compression typical

    Quer

    y

    Faster and Simpler

    Backup, DR, Caching,Reorg, Clone

    Benefits Multiply

    Copyright 2010, Oracle Corporation and/or its affiliates 17

  • 8/4/2019 Exadata Database Technical Overview

    18/25

    Copyright 2010, Oracle Corporation and/or its affiliates 18

    Exadata CompressionReduce Disk Space Requirements

    3x

    10x 15x

    1.4x

    2.5x

    UncompressedData

    Data WarehouseAppliances

    OLTPData

    DWData

    ArchiveData

    Oracle

    OracleHybridColumnarCompression

    OracleAdvancedCompression

  • 8/4/2019 Exadata Database Technical Overview

    19/25

    Copyright 2010, Oracle Corporation and/or its affiliates 19

    More Data Capacity

    Exadata10x Compression

    Teradata 26501.4x Compression(block compression is archival)

    Netezza TwinFin

    2x to 4x Compression

    EMC VMAX3x Oracle Compression

    Equivalent Capacity SystemsAll with Largest Disks,

    Best Compression

    4X

    3X

    7X

    41X for 4600flash appliance

  • 8/4/2019 Exadata Database Technical Overview

    20/25

    Copyright 2010, Oracle Corporation and/or its affiliates 20

    Benefits Multiply with Compression

    1 TB withcompression

    10 TB of user data

    Requires 10 TB ofIO

    100 GB with partitionpruning

    20 GB with StorageIndexes 5 GB Smart Scan onMemory or Flash

    Sub second

    On Database

    Machine

    Data is 10x Smaller, Scans are 2000x faster

  • 8/4/2019 Exadata Database Technical Overview

    21/25

    Exadata I/O Resource ManagementMixed Workloads and Multi-Database Environment

    Ensure different databases areallocated the correct relative amount ofI/O bandwidth

    Database A: 33% I/O resources

    Database B: 67% I/O resources

    Ensure different users and tasks withina database are allocated the correctrelative amount of I/O bandwidth

    Database A:

    Reporting: 60% of I/O resources

    ETL: 40% of I/O resources

    Database B: Interactive: 30% of I/O resources

    Batch: 70% of I/O resources

    Exadata Cell

    InfiniBand Switch/Network

    Database A Database B

    Exadata Cell Exadata Cell

    Copyright 2010, Oracle Corporation and/or its affiliates 21

  • 8/4/2019 Exadata Database Technical Overview

    22/25

    Copyright 2010, Oracle Corporation and/or its affiliates 22

    Oracle Database 11g Release 2Resource Manager Instance Caging Ideal for Exadata

    More flexible alternativeto server partitioning

    Wider platform supportthan operating system

    resource managers

    Lower administrationoverhead thanvirtualization

    Set CPU_COUNT perinstance and enableresource manager

    Instance A

    Instance B

    Instance C

    Instance D

    Sum of cpu_counts

    8

    12

    16 Total Number

    of CPUs = 16

    4

  • 8/4/2019 Exadata Database Technical Overview

    23/25

    Copyright 2010, Oracle Corporation and/or its affiliates 24

    Exadata Storage Management & Administration

    Enterprise Manager

    Manage & administer Database and ASM

    Monitor the Exadata Database Machine Hardware

    Plug-ins to monitor the Exadata Storage Cells and othercomponents in the Database Machine

    Auto Service Request (ASR) File SRs automatically for common hardware faults

    Comprehensive CLI

    Local Exadata Storage cell management

    Distributed shell utility to execute CLI across multiple cells Embedded Integrated Lights Out Manager (ILOM)

    Remote management and administration of hardware

  • 8/4/2019 Exadata Database Technical Overview

    24/25

    Exadata Database MachineIdeal Database Platform

    Best for Data Warehousing

    Best for OLTP

    Best for Database Consolidation

    Hybrid ColumnarCompression

    IntelligentStorage Grid

    Fastest, Lowest Cost

    Smart FlashCache

    Business answers in seconds, not hours

    HardwareDecryption

    Copyright 2010, Oracle Corporation and/or its affiliates 25

  • 8/4/2019 Exadata Database Technical Overview

    25/25

    C i ht 2010 O l C ti d/ it ffili t 26