exadata x4 hardware overview

Upload: imran-shahid

Post on 07-Jul-2018

218 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/18/2019 Exadata X4 Hardware Overview

    1/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1

    Exadata Hardware Overview

     

    Last updated !ov 2", 2013

  • 8/18/2019 Exadata X4 Hardware Overview

    2/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2

    Exadata Database Machine

    The ultimate platform for all database w

      OL#$, %arehousing, &ata'ase as a (ervic

    Most advanced hardware

      )ully scale*out servers and intelligent stora

    nfini-and connectivity and $C flash

    Most advanced software  &ata'ase optiied copute, storage, and

    algoriths draatically iprove perforan

    Standardized, optimized, hardened end

  • 8/18/2019 Exadata X4 Hardware Overview

    3/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3

    Exadata Hardware

  • 8/18/2019 Exadata X4 Hardware Overview

    4/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

    Exadata !rchitectureCoplete Optiied (tandardied ardened &ata'ase $latfo

    Standard Database Servers

      45 2*socet servers  162 cores, 2#- or 

      25 4*socet servers  190 cores, #-

    "nified "ltra#ast $etwork  0 :' nfini-and internal connectivity  all p

      10 :' or 1 :' ;thernet data center connecti

    Scaleout %ntelli&ent Stora&e Servers  15 2*socet servers    194 cores in s

      194 (A( dis drives  9"2 #- C or

     

  • 8/18/2019 Exadata X4 Hardware Overview

    5/70Copyright © 2013, Oracle and/or its affiliates. All rights reserved.<

    )rebuilt and Optimized Outofthe*ox

       )

      e  r   f  o  r  m  a  n  c  e   !  c   h   i  e  v  e  m

      e  n   t

       )

      e  r   f  o  r  m  a  n  c  e   !  c   h   i  e  v  e  m

      e  n   t

    #ie

    >&ays?

    #ie

    >8onths?

    100@

    Measure,diagnose,tune and

    reconfigure

    Test & debug

    failure modes

    Assembledozens of

    components 

    Multi- vendorfinger

    pointing 

    Custo Configuration

  • 8/18/2019 Exadata X4 Hardware Overview

    6/70Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9

    Standardized and Simple to Deplo'

    • !ll Database Machines are the same

    ‒ &elivered ready*to*run

    ‒#ested

    ‒ ighly supporta'le

    Deplo' in Da's,

    $ot Months

      eady

    -

    to- un

    ‒ !o uniue config

    ‒ dentical to confi

    'y Oracle ;ngine

    • (uns existin& O+T) and D application

    ‒ )ull 30 years of Oracle &- capa'ilities

    ‒!o ;5adata certification reuired

    • +evera&es Oracle ecos'stem

    ‒ (ills, no+ledge 'ase, people and partners

  • 8/18/2019 Exadata X4 Hardware Overview

    7/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved."

    Scalable from Ei&hth(ack to Multi(ac

    #ield "p&radeable Supports

    Multiple -enerations of

    Hardware

    Half #ull

    Multi(ack

    Ei&hth .uarter 

  • 8/18/2019 Exadata X4 Hardware Overview

    8/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4

    Exadata Database Machine /01 #ull ($re*Configured for ;5tree $erforance

    B 4 eon*'ased &ual*processor &ata'ase (ervers  162 cores >2 per server?  204 :- eory e5panda'le to 069 :- >2< per server?

    B .4 #- igh (peed )lashB 1 ;5adata (torage (ervers *2

      All +ith igh $erforance 12 5 1.2 #- (A( dissO7

      All +ith igh Capacity 12 5 #- (A( diss

    B 2 (un &atacenter nfini-and (+itch 39  39*port 8anaged D&7 >0:'/s? s+itch

    B 1 EAdinF ;thernet s+itchB 7edundant $o+er &istri'utions Gnits >$&Gs?

    !dd more racks for additional scalabilit'

  • 8/18/2019 Exadata X4 Hardware Overview

    9/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6

    Exadata Database Machine /23 #ull (;5tree $erforance for Consolidation, Large OL#$ and

    B 2 eon*'ased ;ight*processor &ata'ase (ervers  igh Core, igh 8eory &ata'ase (ervers

      190 C$G cores >40 per server?  #- eory >2#- per server?

      10 :ig; connectivity to &ata Center B 19 5 10:' ;*ports >4 per server?

    B .4 #- igh (peed )lashB 1 ;5adata (torage (ervers *2

      All +ith igh $erforance 12 5 1.2#- (A( dissO7  All +ith igh Capacity 12 5 #- (A( diss

    B 2 (un &atacenter nfini-and (+itch 39  39*port 8anaged D&7 >0:'/s? s+itch

    B 1 EAdinF ;thernet s+itchB 7edundant $o+er &istri'utions Gnits >$&Gs?

    !dd more racks for additional scalabilit'

  • 8/18/2019 Exadata X4 Hardware Overview

    10/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10

    Exadata /01 Memor' Expansion 4it

    Optional it for *2 custoers +ho consolidate larg

    data'ases and reuire ore eory  Changes eory configuration of the *2 data'ase s

    :- >19 5 19 :-? to 19 5 32 :-?

     Availa'le for *2 )ull, alf, Duarter, and ;ighth 7a

  • 8/18/2019 Exadata X4 Hardware Overview

    11/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11

    Exadata Stora&e Expansion /01 #ull ()or additional storage 'acups, historical data, unstructu

     Add storage capacity to &ata'ase 8achine online

    14 ;5adata (torage (ervers *2

       All +ith igh $erforance 12 5 1.2 #- (A( diss

    O7

       All +ith igh Capacity 12 5 #- (A( diss

  • 8/18/2019 Exadata X4 Hardware Overview

    12/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12

    Exadata Database Machine Hardware S3*4 )ull *2 )ull *2 alf *2 D

    Database Servers 2 4 2

    Database -rid 5ores 190 162 69 4

    Database -rid Memor' 6-*7 069 204 >a5 069? 102 >a5 204? a5

    %nfini*and switches 2 2 2 2

    Ethernet switch 1 1 1 1

    Exadata Stora&e Servers 1 1 " 3

    Stora&e -rid 5)" 5ores 194 194 4 39

    (aw #lash 5apacit' .4 #- .4 #- 22. #- 6.9 #

    (aw Stora&e 5apacit'

    Hi&h )erf  200 #- 200 #- 100 #- 3.2

    Hi&h 5ap 9"2 #- 9"2 #- 339 #- 1

    "sable mirrored capacit'Hi&h )erf  60 #- 60 #- < #- 16 #

    Hi&h 5ap 300 #- 300 #- 1

  • 8/18/2019 Exadata X4 Hardware Overview

    13/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13

    Exadata Stora&e Expansion (ack Sum*2 )ull *2 alf *2 Duarter

    %nfini*and switches 3 3 2

    Ethernet switch 1 1 1

    Exadata Stora&e Servers 14 6

    Stora&e -rid 5)" 5ores 219 104 4

    (aw #lash 5apacit'

  • 8/18/2019 Exadata X4 Hardware Overview

    14/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1

    /01 Database Server !e+ 12*core Evy-ridgeF C$Gs, )aster nfini-and Card, L

    $rocessors 1 Twelve5ore %ntel8 /eon8 E91:;< v1 )rocessors 61=)5%e 2=>? *oth )o

    5 1:';/10:'; -ase*# ;thernet $orts

    2 5 10:'; ;thernet ()$= $orts >1 &ual*port 10:'; $Ce 2'ased on the ntel 42

  • 8/18/2019 Exadata X4 Hardware Overview

    15/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1<

    /01 Stora&e Server 9*core vy-ridge C$Gs, Larger diss, Larger )lash Cards, )lash

    $rocessors 1 Six5ore %ntel8 /eon8 E91:2> v1 )rocessors 61=: -Hz

    8eory ;: -* > 5 4:- = 5 19:-? More memor' needed to ma

    &iss 12 5 @=1 T* @>4 ()M igh $erforance (A( >hot*s+ap?

      O7

    12 5 0 T* ".2H 7$8 igh Capacity (A( >hot*s+ap? 3.> -* (un )lash Accelerator #3> $Ce Cards Hardwa

    &is Controller &is Controller -A +ith )5%e 2=>? *oth )ort

    ;'edded :iga'it ;thernet $orts for anageent connectiv

    7eote 8anageent 1 ;thernet port >LO8?

    $o+er (upplies 7edundant ot*(+appa'le po+er supplies and fans

  • 8/18/2019 Exadata X4 Hardware Overview

    16/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19

    /23 Database Server 

    $rocessors 4 5 #en*Core ntelI eonI ;"*44"0 $rocessors >2.0 :?

    8eory 2 #- >124 519 :-?Local &iss 4 5 300:- 10H 7$8 (A( &iss >ot*(+appa'le?

    &is Controller &is Controller -A +ith 0:'/s? $orts > &ual*port $C; 2.0 ;8odules?

    #+o !et+or ;5press 8odules >!;8?, providing a total of

    B  4 5 1:'; ;thernet $ortsB  4 5 10 :'; ;thernet ()$= $orts >via )a'ric ;5pres>);8? 'ased ntel 42

  • 8/18/2019 Exadata X4 Hardware Overview

    17/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1"

    Operatin& S'stem "pdates in @@=1=2=2=>

    Oracle Linu5 distri'ution updated to 2.9.

      (ae ernel on data'ase servers >2*soce

    4*socet? and the storage servers

    Oracle (olaris updated to (11 Gpdate 1 (

  • 8/18/2019 Exadata X4 Hardware Overview

    18/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14

    Environmental %nformation

  • 8/18/2019 Exadata X4 Hardware Overview

    19/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16

    Exadata /23 Environmental 6H) and H3*4 )ull $ 3*4 )ull C

    $o+er8a5 111.< JA?

    #ypical 10.10."JA? 10.0 % >10.2 JA?

    Cooling

    8a5 611.3 gs?

    (hipping %t 2163 l's > 66." gs? 2163 l's > 66." gs?

     Acoustics 4.- >operating? 4.- >operating?

    Dimensions "4.99F >? 5 23.92F>%? 5 ".2F>&? >1664 >? 5 900 >%? 5 1200 >&??

    Operatin& Temperature< MC to 32 MC >1 M) to 46.9 M)?, 10@ to 60@ relative huidity, non*condensing . !ltituda5. a'ient teperature is de*rated 'y 1N C per 300 a'ove 600

  • 8/18/2019 Exadata X4 Hardware Overview

    20/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20

    Exadata /01 Environmental 6H5 disks*2 )ull C *2 alf C *2 Duarter C

    $o+er8a5 11.2 % >11.JA? 9.2% >9.3 JA? 3.1% >3.2JA?

    #ypical ".6 % >4.1JA? .3 % >.JA? 2.2% >2.3JA?

    Cooling

    8a534,300 -#G/hr  0,00 K/hr 

    21, 200 -#G/hr 22, 00 K/hr 

    10,900 -#G/hr 11,200K/hr 

    #ypical2",000 -#G/hr 24,C)8? 12639.2 gs? 12"3 l's >

  • 8/18/2019 Exadata X4 Hardware Overview

    21/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21

    Exadata /01 Environmental 6H) disks*2 )ull $ *2 alf $ *2 Duarter $

    $o+er8a5 12.1% >12. JA? 9.9 % >9.4 JA? 3.3 % >3. JA?

    #ypical 4.< % >4." JA? ." % >.4 JA? 2. % >2.< JA?

    Cooling

    8a51,300 -#G/hr 3,900 K/hr 

    22,439

  • 8/18/2019 Exadata X4 Hardware Overview

    22/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22

    Stora&e Expansion /01 Environmental 6H5 d)ull C alf C Dua

    $o+er8a5 4.6% >6.1JA? 9.3JA? 3.9 H% >3." JA? 1.6

    Cooling

    8a5 30,00 -#G/hr  32,100K/hr 

    1",00 -#G/hr  14,00 K/hr 

    4,60 6,

    #ypical21,200 -#G/hr 22,00 K/hr 

    12,300 -#G/hr 13,000 K/hr 

    9,42.2 gs? 1131 l's >operating? ".9-

    Dimensions "4.99F >? 5 23.92F>%? 5 ".2F>&? >1664 >? 5 900 >%? 5 1200 >&??

    Operatin& Temperature< MC to 32 MC >1 M) to 46.9 M)?, 10@ to 60@ relative huidity, non*condensing . !ltitude a5. a'ient teperature is de*rated 'y 1N C per 300 a'ove 600

  • 8/18/2019 Exadata X4 Hardware Overview

    23/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23

    Stora&e Expansion /01 Environmental 6H) d)ull $ alf $ Dua

    $o+er8a5 10.0 % >10.2JA? ".1JA? .0 % >.1 JA? 1.6

    Cooling

    8a5 3,100 -#G/hr  39,000 K/hr 

    16,100 -#G/hr  20,142.2 gs? 1131 l's >operating? ".9-

    Dimensions "4.99F >? 5 23.92F>%? 5 ".2F>&? >1664 >? 5 900 >%? 5 1200 >&??

    Operatin& Temperature< MC to 32 MC >1 M) to 46.9 M)?, 10@ to 60@ relative huidity, non*condensing . !ltitude a5. a'ient teperature is de*rated 'y 1N C per 300 a'ove 600

  • 8/18/2019 Exadata X4 Hardware Overview

    24/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2

    T'pical Data 5enter Deplo'ment 6!irflo

    7ac )ront

    Cold Air nlet

    7ac 7ear 

    ot Air Outlet

    •  Assuing perforated tiles > 00front of the rac for cold air intae

    •   floor tiles for )ull 7ac

    •  3 floor tiles for alf 7ac

    •  1 floor tile for Duarter 7ac

    • #iles can 'e arranged in any ordrac as long as cold air fro the tthe rac

    • nadeuate cold air flo+ could re

    inlet teperatures in the servers drecirculation

    Each data center has a unique environment,universal optimal deployment is not possible

  • 8/18/2019 Exadata X4 Hardware Overview

    25/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2<

    )D" 5hoices

  • 8/18/2019 Exadata X4 Hardware Overview

    26/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.29

    Exadata Database Machine )D"SB ;ach 7ac coes +ith 2 >t+o? redundant $o+er &istri'ution Gnits >$&G

    B )our choices for the ;5adata &ata'ase 8achine *2 and ;5adata (tor

    7acs *2

    * Lo+ Joltage 1e5cluding Kapan / #ai+a

    * igh Joltage 1< JA #hree $hase ;8;A / A$AC >e5cluding Kapan / #ai+an

    B )our choices for the ;5adata &ata'ase 8achine 3*4 >different fro the

    (torage ;5pansion 7ac?* Lo+ Joltage 22 JA (ingle $hase Aericas / Kapan / #ai+an

    * Lo+ Joltage 2 JA #hree $hase Aericas / Kapan / #ai+an

    * igh Joltage 22 JA (ingle $hase ;8;A / A$AC >e5cluding Kapan / #ai+a

    * igh Joltage 2 JA #hree $hase ;8;A / A$AC >e5cluding Kapan / #ai+an

  • 8/18/2019 Exadata X4 Hardware Overview

    27/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2"

    /01 and Stora&e Expansion (ack /01 +ow Bolta&e Sin&le )hase )D" >Aericas / Kapan/ #ai+an?

    2 >#+o? "2Ap 1(i5? $o+er $lugs >3 5 30Ap $lugs per $&G?

    200 20JAC

    &ata Center 7eceptacle #ype * !;8A L9*307

    /0 1 d St E i ( k /0 1

  • 8/18/2019 Exadata X4 Hardware Overview

    28/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.24

    /01 and Stora&e Expansion (ack /01+ow Bolta&e Three )hase )D" >Aericas / Kapan/ #ai+an?

    2 >#+o? 96Ap 1#+o? $o+er $lugs >1 5 90Ap $lug per $&G?

    200 204JAC 3ph

    &ata Center 7eceptacle #ype * ;C306*3$%*$9" 90A 2u''ell euivalent is -L9076%?

    /0 1 d S E i ( k /0 1

  • 8/18/2019 Exadata X4 Hardware Overview

    29/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.26

    /01 and Stora&e Expansion (ack /01 Hi&h Bolta&e Sin&le )hase )D";8;A / A$AC >e5cluding Kapan/ #ai+an?

    2 >#+o? "2 Ap 1(i5? $o+er $lugs >3 5 2< Ap $lugs per $&G?

    220 20JAC

    &ata Center 7eceptacle #ype * ;C306*2$3%*$ 32A 2<

    >u''ell euivalent is -L33279%?

    /0 1 d St E i ( k /0

  • 8/18/2019 Exadata X4 Hardware Overview

    30/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.30

    /01 and Stora&e Expansion (ack /0Hi&h Bolta&e Three )hase )D";8;A / A$AC >e5cluding Kapan/#ai+an?

    2 >#+o? 92."Ap 1#+o? $o+er $lugs >1 5 2

  • 8/18/2019 Exadata X4 Hardware Overview

    31/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.31

    /23 +ow Bolta&e Sin&le )hase )D">Aericas / Kapan/ #ai+an?

    2 >#+o? 110. Ap 22JA $&Gs #otal of 9 $o+er $lugs >3 5 39.4 Ap $lugs per $&G?

    200 20JAC

    &ata Center 7eceptacle #ype * u''ell C(429

  • 8/18/2019 Exadata X4 Hardware Overview

    32/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.32

    /23 +ow Bolta&e Three )hase )D">Aericas / Kapan/ #ai+an?

    2 >#+o? 120Ap 2JA $&Gs

    #otal of >)our? $o+er $lugs >2 5 90Ap $lug per $&G? 200 204JAC 3ph

    &ata Center 7eceptacle #ype * ;C306*3$%*$9" 90A 2u''ell euivalent is -L9076%?

    /2 3 Hi h B lt Si l )h )D"

  • 8/18/2019 Exadata X4 Hardware Overview

    33/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.33

    /23 Hi&h Bolta&e Sin&le )hase )D";8;A / A$AC >e5cluding Kapan/ #ai+an?

    2 >#+o? 69 Ap 22JA $&Gs

    #otal of 9 >(i5? $o+er $lugs >3 5 32 Ap $lugs per $&G?

    220 20JAC

    &ata Center 7eceptacle #ype * ;C306*2$3%*$ 32A 2<

    >u''ell euivalent is -L33279%?

    /2 3 Hi&h Bolta&e Three )hase )D"

  • 8/18/2019 Exadata X4 Hardware Overview

    34/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3

    /23 Hi&h Bolta&e Three )hase )D";8;A / A$AC >e5cluding Kapan/#ai+an?

    2 >#+o? 106Ap 2JA $&Gs

    #otal of >)our? $o+er $lugs >2 5 2

  • 8/18/2019 Exadata X4 Hardware Overview

    35/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3<

    %nfini*and $etwork

    %nfini*and $etwork

  • 8/18/2019 Exadata X4 Hardware Overview

    36/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.39

    %nfini*and $etwork Gnified nfini-and !et+or

      (torage !et+or

      7AC nterconnect

      ;5ternal Connectivity >optional?

    igh $erforance, Lo+ Latency !et+or  40 :'/s 'and+idth per lin >0 :'/s each direction?

      (A!*lie ;fficiency >Pero copy, 'uffer reservation?

      (iple anagea'ility lie $ net+or

    $rotocols  Pero*copy Pero*loss &atagra $rotocol >P&$ 7&(v3?

    Lo+ C$G overhead >#ransfer 3 :-/s +ith 2@ C$G usage?

      nternet $rotocol over nfini-and >$o-?

    Loos lie noral ;thernet to host soft+are >tcp/ip, udp, http, s

    %nfini*and $etwork

  • 8/18/2019 Exadata X4 Hardware Overview

    37/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3"

    %nfini*and $etwork Gses (un &atacenter 39*port 8anaged D&7 >0:'/s? nfini

      7uns su'net anager and autoatically discovers net+or topology

      Only one su'net anager active at a tie

      2 EleafF s+itches to connect individual server - ports  1 EspineF s+itch needed in each rac to scale out to additional 7acs

    &ata'ase (erver and ;5adata (ervers  ;ach server has &ual*port D&7 >0:'/s? - CA >3*4 data'ase serv

    D&7 ;5press odules ?

       Active*Active -onding Assign t+o $ addresses per dual*port CA for

    and *2 storage servers 3*4 &ata'ase servers continue +ith Active*$assive as it is still $C

      Connect one port fro the CA to one leaf s+itch and the other port to s+itch for redundancy

      Connections pre*+ired in the )actory

    /0 1 #ull (ack Server to +eaf Switch

  • 8/18/2019 Exadata X4 Hardware Overview

    38/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.34

    /01 #ull (ack ? Server to +eaf Switch

    B ;ach (erver C'oth leaf s+itche

    B  )ull -and+idthfails

    B Connections pre

    B alf, Duarter, afollo+ sae ca'le5cept they have

    DB Servers (1,2,3,4)

    Exadata Servers (1,2,..,7)

    L1 L2

    11

    DB Servers (5,6,7,8)

    Exadata Servers (8,9,..14)

    DB Servers (5,6,7,8)

    Exadata Servers (8,9,..,14)

    DB Servers (1,2,3,4)

    Exadata Servers (1,2,..,7)

    11

    11

    11

    $ort 1 $ort 1

    $ort 2 $ort 2

    Leaf s+itchLeaf s+itch 7

    /2 3 #ull (ack Server to +eaf Switch

  • 8/18/2019 Exadata X4 Hardware Overview

    39/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.36

    /23 #ull (ack ? Server to +eaf Switch

    B ;ach (erver C'oth leaf s+itche

    B )ull -and+idth fails

    B Connections pre

    DB Server1 (EM 1,2,3,4)

    Exadata Servers (1,2,..,7)

    L1 L2

    11

    DB Server2 (EM 1, 2, 3, 4)

    Exadata Servers (8,9,..14)

    DB Server2 (EM 1, 2, 3, 4)

    Exadata Servers (8,9,..,14)

    DB Server1 (EM 1,2,3,4)

    Exadata Servers (1,2,..,7)

    11

    11

    11

    $ort 1 $ort 1

    $ort 2 $ort 2

    Leaf s+itchLeaf s+itch 7

    Stora&e Expansion (ack? Server to +e

  • 8/18/2019 Exadata X4 Hardware Overview

    40/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.0

    Stora&e Expansion (ack? Server to +e

    B ;ach (erver C'oth leaf s+itche

    B Active R $assiv'et+een leaf s+it

    B )ull -and+idth fails

    B Connections pre

    B alf and Duarterac follo+ saeethodology e5cfe+er servers

    Exadata Servers (1,2,..,9)

    L1 L2

    9

    Exadata Servers (10,11,..18)

    Exadata Servers (10,11,.,18)

    Exadata Servers (1,2,..,9)

    9

    9

    9

    $ort 1 $ort 1

    $ort 2 $ort 2

    Leaf s+itchLeaf s+itch 7

    Multirack cablin&

  • 8/18/2019 Exadata X4 Hardware Overview

    41/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1

    Multirack cablin&

    !eed to purchase - spine s+itches >;5pansion (+itch Hconnecting *2 and 3*4 racs

      ;5cept for uarter rac in ost cases

    !eed to purchase - ca'les as spares its no longer cont

    ca'les

    (ae ulti*rac ca'ling ethodology as 'efore  (ae fat*tree topology to connect ultiple racs

      Can no+ connect ore than 2 Dtr racs 'y siply purchasin

    s+itches for the Duarter racs

    Multirack 5ablin& ? #at Tree Topolo&'

  • 8/18/2019 Exadata X4 Hardware Overview

    42/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2

    Multirack 5ablin& ? #at Tree Topolo&'

    (ingle nfini-and !et+or

    (+itch to a E)at #reeF #opology

      Jalid up to 14 7acs +ith no e5ternal s+itches  Can go to 39 racs +ith 2 e5ternal s+itches

       ;very EleafF s+itch inter*connected +ith every EspineF s+itc

      ELeafF s+itches not connected +ith other EleafF s+itches

      E(pineF s+itches not connected +ith other EspineF s+itches

      &ata'ase and ;5adata (erver ca'ling unchanged.  nter*rac ca'ling done at installation tie

    7efer to the &ata'ase 8achine O+nerSs :uide for e5act appings

    Two (ack 5ase ? #at Tree Topolo&'

  • 8/18/2019 Exadata X4 Hardware Overview

    43/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3

    p &'

    L1L2

    L1

    ( (

    Rack 1 Rack 2

    4

    4

    44 4

    4

    4

    B nstall (pine (+itch in each rac, if no spine s+itch e5istsB 7eove inter*s+itch lins 'et+een leaf s+itches >L1,L2? in eB Connect each leaf s+itch to 'oth the spine s+itches > lins

    Multiple (ack 5ase ? "p to 3 (acks

  • 8/18/2019 Exadata X4 Hardware Overview

    44/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

    Multiple (ack 5ase "p to 3 (acks

    RackRack 1

    !

    Q

    L1L2

    (

    Rack 2

    L1L2

    (

    L1

    (

    B nstall (pine (+itch in each rac, if no spine s+itch e5istsB 7eove inter*s+itch lins 'et+een leaf s+itches >L1,L2? in each raB &istri'ute 4 lins fro every EleafF s+itch to every EspineF s+itch

    B  ;5aple rac case 2 lins fro each leaf to each spine

    Multiple (ack 5ase ? ; to @3 (acks

  • 8/18/2019 Exadata X4 Hardware Overview

    45/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.<

    Multiple (ack 5ase ; to @3 (acks

    RackRack 1

    !Q

    L1L2

    (

    Rack 8

    L1L2

    (

    L1

    B nstall (pine (+itch in 1st eight racs, if no spine s+itch e5istsB 7eove inter*s+itch lins 'et+een leaf s+itches >L1,L2? in each raB &istri'ute 4 lins fro every EleafF s+itch to EspineF s+itch in 1st 4 r

    Q

    Scalin& Out to 2: (acks

  • 8/18/2019 Exadata X4 Hardware Overview

    46/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9

    Scalin& Out to 2: (acks (ingle nfini-and !et+or

    7euire 2 Ee5ternal spineF 39*port nfini-and s+itches

       Add another level to the )at #ree topology

    &ivide 7acs into groups each having 2*4 racs

      :roup related racs together for e5aple, racs that run a codata'ase or are part of a coon cluster 

      nter*connect racs +ithin each group using the t+o level )at #

    nter*connect the groups via the t+o Ee5ternal spineF s+itche

      Connect each Einternal spineF s+itch in each rac to the t+o Ees+itches

    -and+idth fro/to each group is 40 :'/s T nu'er of racs

    Can 'e done online

    Multiple (ack 5ase ? ; to 2: (acks

  • 8/18/2019 Exadata X4 Hardware Overview

    47/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved."

    Multiple (ack 5ase ; to 2: (acks

    "r#$% (2 t# 8 "r#$% 1 (2 t# 8 racks)

    !

    !!

    ;5ternal (pine s+itches

    %nterconnectin& .uarter (acks

  • 8/18/2019 Exadata X4 Hardware Overview

    48/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4

    %nter connectin& .uarter (acks Allo+ liited situations +here a Duarter 7ac can 'e inter*

    +ith other rac +ithout reuiring a spine s+itch in the Duar

    Case 1 * Connect t+o Duarter 7acs

    B #he pre*reuisite is that at least ports reserved for e5ternaare open on each leaf s+itch

    Case 2 Connect one Duarter 7ac +ith one other alf o

    B #he pre*reuisite is that at least ports reserved for e5ternaare open on each leaf s+itch

    Case 3 Connect one Duarter 7ac to t+o or ore racs are either ;5adata alf or )ull 7acs?

    5ase @ ? Two .uarter (acks

  • 8/18/2019 Exadata X4 Hardware Overview

    49/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6

    .

    nter*connect the leaf s+itches 'et+een racs +ith 2 lins ea

    B  Gse the ports reserved for e5ternal connectivity

    L1

    L2

    L1

    L2

    &$arter Rack 1 &$arter Rac

    7 7

    2

    2

    2 2

    5ase 1 ?.uarter (ack with One Half or

  • 8/18/2019 Exadata X4 Hardware Overview

    50/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

  • 8/18/2019 Exadata X4 Hardware Overview

    51/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

  • 8/18/2019 Exadata X4 Hardware Overview

    52/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

  • 8/18/2019 Exadata X4 Hardware Overview

    53/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

  • 8/18/2019 Exadata X4 Hardware Overview

    54/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

  • 8/18/2019 Exadata X4 Hardware Overview

    55/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.i.e connecting s+it

    the sae rac?

    ust 'e opti

       Any ulti*rac involving or ore racs +ill definitely reuire

    longer optical ca'les

      10 ca'les typically sufficient if inter*connecting up to 4 phys

    racs in the sae aisle +ith raised floor 

    %hen in dou't easureY

    Sourcin& cables for multirack situatio

  • 8/18/2019 Exadata X4 Hardware Overview

    56/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.copper? 2121A*optical? "1024"0 \es, >2 5

    optical? "102 5

     !ote * \ou need 2 D()$ (7 transceivers >212A*!? for each optic

    %nfini*and $etwork !ddresses

  • 8/18/2019 Exadata X4 Hardware Overview

    57/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

  • 8/18/2019 Exadata X4 Hardware Overview

    58/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

  • 8/18/2019 Exadata X4 Hardware Overview

    59/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

  • 8/18/2019 Exadata X4 Hardware Overview

    60/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.90

    8anageent net+or

      1 port fro EAdinF ;thernet s+itch

      2 fro the $&Gs

    &ata'ase / Client / Application Access

      !eed to connect a iniu of 1 :'; or 1 10:'; port per &a

      *2 &ata'ase (erver 

    3 5 1:'; / 10 :'; -ase*# ;thernet ports availa'le

    2 5 10:'; ;thernet ()$= ports availa'le  3*4 &ata'ase (erver 

    " 5 1:'; ;thernet ports availa'le

    4 5 10:'; ;thernet ()$= ports availa'le

    !dditional Ethernet $etwork (euirem

  • 8/18/2019 Exadata X4 Hardware Overview

    61/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.91

     Additional ;thernet $ addresses needed if ultiple cluste

    deployed on the &ata'ase 8achine )ull 7ac, alf 7ac,

    7ac  3 $ addresses per additional cluster for (CA! addresses

    (tatic $ addressing only >no &C$?

     All ;thernet $ addresses ust 'e registered in &!(

    Ethernet $etwork !ddresses  *2 3*4 (torage

  • 8/18/2019 Exadata X4 Hardware Overview

    62/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.92

    g

    )ull alf Dtr ;ighth )ull )ull

    LO8 for &ata'ase (ervers 4 2 2 2 *

    LO8 for ;5adata Cells 1 " 3 3 1 14

    ;th0 >gt? for &- (ervers 4 2 2 2 *

    ;th0 >gt? for ;5adata Cells 1 " 3 3 1 14

    8gt port for - s+itches 2 2 2 2 3 3

    $ address for ;thernet (+itch 1 1 1 1 1 1

    $ address for $&Gs 2 2 2 2 2 2

    M&mt Subnet Total 0; 1< @9 @9 23 01

    Client Access &ata'ase (ervers 4 2 2 2 *

    J$s for &ata'ase (ervers 4 2 2 2 *

    (CA! Addresses >per Cluster? 3 3 3 3 3 *

    5lient !ccess Total @; @@ < < <

    Total :3 23 11 11 09 01

    Exadata Database Machine

  • 8/18/2019 Exadata X4 Hardware Overview

    63/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.93

    The ultimate platform for all database w

      OL#$, %arehousing, &ata'ase as a (ervic

    Most advanced hardware

      )ully scale*out servers and intelligent stora

    nfini-and connectivity and $C flash

    Most advanced software

      &ata'ase optiied copute, storage, andalgoriths draatically iprove perforan

    Standardized, optimized, hardened end

  • 8/18/2019 Exadata X4 Hardware Overview

    64/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9

  • 8/18/2019 Exadata X4 Hardware Overview

    65/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9<

    Exadata Database Machine /01 Half ($re*Configured for ;5tree $erforance

  • 8/18/2019 Exadata X4 Hardware Overview

    66/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.99

    $re*Configured for ;5tree $erforance

    B eon*'ased &ual*processor &ata'ase (ervers  69 cores >2 per server?

     102 :- eory e5panda'le to 204 :- >2< per server?

    B 22. #- igh (peed )lashB " ;5adata (torage (ervers *2

      All +ith igh $erforance 12 5 1.2 #- (A( diss

    O7  All +ith igh Capacity 12 5 #- (A( diss

    B 2 (un &atacenter nfini-and (+itch 39  39*port 8anaged D&7 >0:'/s? s+itch

    B 1 EAdinF ;thernet s+itchB 7edundant $o+er &istri'utions Gnits >$&Gs?

    "p&radable to #ull (ack

    Exadata Database Machine /01 .uarte$re*Configured for ;5tree $erforance

  • 8/18/2019 Exadata X4 Hardware Overview

    67/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9"

    $re Configured for ;5tree $erforance

    B 2 eon*'ased &ual*processor &ata'ase (ervers  4 cores >2 per server? 

  • 8/18/2019 Exadata X4 Hardware Overview

    68/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.94

    t y e e Co gu at o

    B 2 eon*'ased &ual*processor &ata'ase (ervers  2 cores >12 per server? 

  • 8/18/2019 Exadata X4 Hardware Overview

    69/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved.96

    )or additional storage 'acups, historical data, unstructu

    Gpgrada'le to )ull 7ac

    6 ;5adata (torage (ervers *2

       All +ith igh $erforance 12 5 1.2 #- (A(

    dissO7

       All +ith igh Capacity 12 5#- (A( diss

    24.4 #- igh (peed )lash

    3 (un &atacenter nfini-and (+itch 39

      39*port 8anaged D&7 >0:'/s? s+itch

    1 EAdinF ;thernet s+itch

    7edundant $o+er &istri'utions Gnits >$&Gs?

    Exadata Stora&e Expansion /01 .uart)or additional storage 'acups, historical data, unstructu

  • 8/18/2019 Exadata X4 Hardware Overview

    70/70

    Copyright © 2013, Oracle and/or its affiliates. All rights reserved."0

    )or additional storage 'acups, historical data, unstructu

    Gpgrada'le to Duarter 7ac

    ;5adata (torage (ervers *2

       All +ith igh $erforance 12 5 91.2 #- (A( diss

    O7   All +ith igh Capacity 12 5 #- (A( diss

    12.4 #- igh (peed )lash

    2 (un &atacenter nfini-and (+itch 39

      39*port 8anaged D&7 >0:'/s? s+itch

    1 EAdinF ;thernet s+itch 7edundant $o+er &istri'utions Gnits >$&Gs?