Quick Start Steps

Unleash Oracle 12c Performance with Cisco UCS Tushar PatelAprils 2014Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.1Oracle Database 12C Unleashing PerformanceGoal: Define and Develop blueprint for Multitenant Database architectureBest practices for Pluggable Databases Flex ASM - Allows to separate ASM from databasesMultitenant design running OLTP, DSS and in memory databasesTraditional database and containers running together

Container Database

System Resources

Container Database

CPUIODSSDSSDSSCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Unlike a traditional database where only one database can exist per instance, the Oracle 12c pluggable databases allow multiple databases within an instance. Oracle pluggable databases ease the movement into database consolidation because the data dictionary information (obj$, tab$ and source$) are independent of any container database. All PDB's within the container share a common LGWR process.

2009, Cisco Systems, Inc. All rights reserved.Presentation_ID.scr2Cisco UCS: Many Server Form Factors, One SystemIndustry-Leading Compute Without CompromiseCurrent UCS Compute PortfolioPerformance Optimized for Bare Metal, Virtualized, and Cloud ApplicationsUCS C220 M3Versatile, General Purpose Enterprise Infrastructure, and Application Server Enterprise PerformanceUCS C240 M3Ideal Platform for Big Data, ERP, and Database ApplicationsUCS B200 M3Optimal Choice for VDI, Private Cloud, or Dense Virtualization/ Consolidation WorkloadsIntensive/Mission CriticalUCS B420 M3Enterprise Class, 4-Socket Blade for Large, Memory-Intensive Bare Metal and Virtualized ApplicationsUCS C420 M3Enterprise Class, 4-Socket Server for Large, Memory-Intensive Bare Metal, and Virtualized ApplicationsUCS C24 M3Entry, Expandable Rack Server for Storage Intensive WorkloadsUCS C22 M3Entry Rack Server for Distributed and Web Infrastructure ApplicationsUCS B22 M3Entry Blade Server for IT Infrastructure and Web ApplicationsScale OutRackBlade

UCS C260 M2Mission-Critical, 2-Socket Extended Memory Server for Large, Memory-Intensive ApplicationsUCS C460 M2Mission-Critical, 4-Socket Server for Large, CPU-Intensive ApplicationsUCS B440 M2Mission-Critical, 4-Socket Blade for Large, CPU-Intensive Bare Metal and Virtualized ApplicationsUCS B230 M2Density-optimized CPU andMemory-Intensive 2-Socket Blade for Bare Metal and Virtualized Applications

Available

Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.3

UCSB420M3 4 Socket Servers @ 256 GB RAM4 x 8 Gbps vHBA and 2 x 10Gbps vNICS on each bladeStorageEMC VNX 8000.256 SAS, 50 SAS flash drives and 600GB of flash Cache.32 x 8Gb FC Connections through N5K.OS and DatabasesLinux uek2 r2 kernel with EMC PowerPath.Oracle CRS and RDBMS 12.1.0.1.2 along with ACFSOLTP database 4TBDSS database 6 TBCPU and CRS 1 TB WorkloadsOracle OAST workload for performance and stress tests.

Oracle 12c Certification ArchitectureCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.4Hardware Calibration Orion IOPS and Bandwidth tests8 node Oracle RAC cluster 2 chassis, 8 x B420 Blade servers750K IOPs at very low latency (< 2 ms)25 GBytes/Sec. bandwidth (200 Gbps)

Linear Scalability IOPs and Bandwidth as cluster nodes added

Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.5Oracle Orion Tests Running OLTP and DSS together OLTP workload Random 8K Reads70% Reads, 30% Writes330K IOPs at very low latency (< 2 ms)Storage Pool with 50 SSDsDSS workloadLarge Reads 1 MB size90% Reads, 10% writes17GB/Sec BandwidthStorage Pool with 25 SSDs,160 SAS drivesCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Oracle 12c 8-Node UCS cluster - Logical ArchitectureASM Flex ClusterOLTP Disk Group

CPUCRS Disk Group

REDO Disk Group

OCRVOTE Disk Group

DSS Disk Group

APXAPXASM+APXASM+APX

ASM+APXAPXAPXAPX

Scan Listeners8 Node UCS clusterUEK2 R2 Linux kernel12.1.0.1 CRS on 8 hub nodes with Flex ASMCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.7Multiple Containers vs Single Container with PDBsTPM 1,162,648Throughput = 154,864 IOPSBandwidth = 10,356 MB/secInterconnect = 2,426 MB/sec

Interconnect Non-CDB database

Interconnect Non-CDB database

TPM 1,241,552Throughput = 132,570 IOPSBandwidth = 10,270 MB/secInterconnect = 2,377 MB/sec12.1CPUERP

Container Database

CPUDSSOLTPDSS (6000 GB)OLTP (4000GB)CPU Stress (500 GB) DSS PDB (6000 GB)OLTP PDB (4000GB)CPU Stress PDB (500 GB))Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.8Stress Tests

Oratop snapshot Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.EM Cloud 12c Performance Data

Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Destructive TestsCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Oracle RAC on Cisco UCS Improved AvailabilityFailureDescriptionResponse1 or 2 or 3 or 4Single Link Failure (Public Interface)Represents Port Failurenodes Should Continue to Work1 and 2 or3 and 4All Links Failure (Public Interface)Nodes Should Continue to Work via Failover5 or 6 or 7 or 8Single Link (Private Interconnect)Represents Port Failure Nodes Should Continueto Work5 and 6 or 7 and 8All Links (Private Interconnect)Nodes Should Continue to Work via Failover9Storage Path Failure1 IO Path LostNo Effect, All IO Paths Nodes Should Reboot

Common Failures tested at high stress levelsCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.We talked about UCS performance in the previous slides. Let us look at how UCS failover provides improved availability against common hardware/cable failures.12Flex ASM Failover

ASM Flex ClusterDisk Group 1

Disk Group 2

Node1Node2Node3Node4

ASM Flex ClusterDisk Group 1

Disk Group 2

Node1Node2Node3Node4

Node 1 ASM killedASM Instance migrates12c DB on Node1 continues to operateCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.13

All Oracle products are certified with Cisco UCSOracle RAC extensively tested on Unified Fabric Oracle 10g R2/11g R2/12cBest Practices determined via Cisco Validated Designs and studiesFocus on application benchmarks, sizing data entered into sizing toolsIntegrated Solutions (Vblock, Flexpod) fully documented with OracleCustomer successes documented TCO, Scaling, PerformanceMajority of activity performed in consultation with Oracle

Cisco Validated Solutions for OracleSizing & Best Practice Guides, Scaling Studies, Product Certifications

Customer Case Studies and TCO AnalysisOracle Focus AreasOracle Application, Database and Industry Standard Benchmarks

Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Focus:Details the key documents/elements that are created for each Oracle DB and core ERP application product suites that Cisco develops for each Oracle key product

Key points:Oracle certifies all products to an OS and version number then any server/blades certified for that same OS and version is regarded by Oracle as certified to run those Oracle productsOracle Linux, Oracle VM require same certification as RHET and Vmware etcDue to Unified Fabric, Oracle requires a separate certification by OS for Oracle RAC 10g R2 and 11gR2. Currently, RHEL, OL, and SlLES 11 (Only 11gR2) are certified. NO certification planned for Solaris due to lack of a test kit from Oracle.Primary focus has been Oracle DB and RAC, then Oracle E-Business Suite, PeopleSoft, JD Edwards, Siebel, Fusion. Other apps are defined a niche apps and so while we can size for UCS due to market requirements are a 2nd tier focus 14Thank you.Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Hardware Destructive TestsTestStatus1Multiple Network Connection FailuresRampup to full load. Disconnect 2xpublic (chassis1) and 2xprivate (chassis2 ).Chassis2 servers reboot and join cluster.2Network failures between FI and Corporate NetworkRamp thesystem to full load. Disconnect connection from each outbound switch one after the other.No disruption to Oracle clients.3Fabric Failover TestsRun the system onfull load. Reboot FabricA, followed by FabricB.Fabric failovers should not cause disruption (FC output is reduced )4Path FailureTestsRunthe system on full load. Disconnect the FC connections. Reconnect them back during restart.Servers rebooted and joinedback the cluster.5Swapthe bladesUnder full load, swap out oneblade from each chassisAfterrediscovery, the blades joined the cluster.Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Hardware Destructive TestsTestStatus6ACFS Test1Kill the volume driver process vdbg under full load, on couple of nodes,that handles extentslocks and other volume management functions.DB instances crash as the underlying acfs files system isnot available.7ACFS Test2Rampup the system load and enlarge the ACFS file systemNo disruption to Oracle clients.8ACFS Test3Kill the ASMCKPT process under full loadProcess re-spawned and workloadcontinues.9Flex ASMSendsigkill tothe asm pmon process when running under full load.ASM process migrates to another node and there is no interruptionto Oracle Work loadCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Performance Data

AWR DataInterconnect from EM Cloud controlInterconnect from dstatCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.18Hardware Calibration Orion IOPS and Bandwidth tests8 node Oracle RAC cluster 2 chassis, 8 x B420 Blade servers750K IOPs at very low latency (< 2 ms)25 GBytes/Sec. bandwidth (200 Gbps)

Cisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.19Oracle Orion Tests at expected workloads

OLTP workload Random 8K Reads70% Reads, 30% Writes330K IOPs at very low latency (< 2 ms)Storage Pool with 50 SSDsDSS workloadLarge Reads 1 MB size90% Reads, 10% writes17GB/Sec BandwidthStorage Pool with 25 SSDs,160 SAS drivesCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.Oracle 12c 8-Node UCS cluster - Logical ArchitectureASM Flex ClusterOLTP Disk Group

CPUCRS Disk Group

REDO Disk Group

OCRVOTE Disk Group

DSS Disk Group

ASM+APXASM+APXASM+APXAPXAPXAPXAPXAPX

Scan Listeners8 Node UCS clusterUEK2 R2 Linux kernel12.1.0.1 CRS on 8 hub nodes with Flex ASMCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.21UCS improved availability Oracle RAC

Normal Operating conditionsPrivate interconnect traffic is localized Extremely Low Latency

FailFailCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.UCS improved availability Oracle RAC

FailFailCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.

12.1DSS

12.1CRM

12.1DW

Container Database

12.1BackgroundProcesses

MemoryDatabaseFilesDSS

Container Database

12.1BackgroundProcesses

MemoryDatabaseFilesOLTP

Container Database

12.1BackgroundProcesses

MemoryDatabaseFilesCPU

Container Database

CPUIOICCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.CDB vs PDB PerformanceTPM 1,162,648Throughput = 224,864 IOPSBandwidth = 10,356 MB/secInterconnect = 2,426 MB/secMultiple ContainersOLTPCDBCPUCDBCRSnon-CDBDSSCDBTPM 1,241,552Throughput = 132,570 IOPSBandwidth = 10,270 MB/secInterconnect = 2,377 MB/secCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.TPM 1,162,648Throughput = 224,864 IOPSBandwidth = 10,356 MB/secInterconnect = 2,426 MB/secMultiple Containers vs Single Container with PDBs

12.1CPU12.1ERP

Container Database

CPUDSSOLTPInterconnect Non-CDB database

Interconnect Non-CDB database

TPM 1,241,552Throughput = 132,570 IOPSBandwidth = 10,270 MB/secInterconnect = 2,377 MB/secCisco Confidential# 2013-2014 Cisco and/or its affiliates. All rights reserved.