[중요] deploying a highly available web server on red hat enterprise linux 6

8/12/2019 [ ] Deploying a Highly Available Web Server on Red Hat Enterprise Linux 6

1/100

Deploying a Highly Available Web

Server on Red Hat Enterprise Linux 6

Mark Heslin

Prinipal So!t"are Engineer

#ersion $%&

August '&$$


2/100

1801 Varsity DriveRaleigh NC 27606-2072 USAPhone !1 "1" 7#$ %700Phone 888 7%% $281&a' !1 "1" 7#$ %701P( )o' 1%#88Resear*h +riangle Par, NC 2770" USA

in.' is a registere/ tra/ear, o in.s +orval/s Re/ 3at4 Re/ 3at 5nterrise in.' an/ the Re/ 3atSha/oan logo are registere/ tra/ear,s o Re/ 3at4 9n* in the Unite/ States an/ other*o.ntries

:i*rosot an/ ;in/os are US registere/ tra/ear,s o :i*rosot Cororation

UN9< is a registere/ tra/ear, o +he (en =ro.

9ntel4 the 9ntel logo an/ si/iaries in theUnite/ States an/ other *o.ntries

All other tra/ear,s reeren*e/ herein are the roerty o their rese*tive oners

? 2011 >y Re/ 3at4 9n* +his aterial ay >e /istri>.te/ only s.>@e*t to the ters an/ *on/itions setorth in the (en P.>li*ation i*ense4 V10 or later the latest version is resently availa>le athttBBoen*ontentorgBoen.>B

+he inoration *ontaine/ herein is s.>@e*t to *hange itho.t noti*e Re/ 3at4 9n* shall not >e lia>leor te*hni*al or e/itorial errors or oissions *ontaine/ herein

Distri>.tion oo/iie/ versions o this /o*.ent is rohi>ite/ itho.t the e'li*it erission o Re/3at 9n*

Distri>.tion o this or, or /erivative o this or, in any stan/ar/ aer >oo, or or *oer*ial

.roses is rohi>ite/ .nless rior erission is o>taine/ ro Re/ 3at 9n*

+he =P= ingerrint o the se*.rityre/hat*o,ey isCA 20 86 86 2) D6 "D &C 6# &6 5C C$ 21 "1 80 CD D) $2 A6 05

Sen/ ee/>a*, torear*h-ee/>a*,re/hat*o

"""%redhat%o( ii re!arh)!eedbak*redhat%o(
http://www.opencontent.org/openpub/mailto:[email protected]:[email protected]?subject=Feedback%20on%20Deploying%20a%20Highly%20Available%20Web%20Server%20on%20Red%20Hat%20Enterprise%20Linux%206mailto:[email protected]:[email protected]?subject=Feedback%20on%20Deploying%20a%20Highly%20Available%20Web%20Server%20on%20Red%20Hat%20Enterprise%20Linux%206http://www.opencontent.org/openpub/


3/100

Table of Contents

1 5'e*.tive S.ary 1

2 Coonent (vervie 2

21 Re/ 3at 5nterrise in.' 6 2

22 Re/ 3at Netor, Satellite Server %

2% 3igh Availa>ility A//-(n $

2%1 E.or. $

2%2 Reso.r*e =ro. :anager $

2%% &en*ing #

2%%1 9P:9 6

2%$ &ailover Doains 7

2%# Conga 8

2%#1 .*i 8

2%#2 Ri**i 8

2%6 CCS "

2$ 3A-V: Vol.e 10

2$1 ogi*al Vol.e :anager 10

2$2 &ile Syste 10

2$% D: :.ltiath 11

2# Cl.ster ;e> Servi*e 12

% Reeren*e Ar*hite*t.re Conig.ration 1%

%1 Cl.ster :anageent Server 1$

%2 Cl.ster Server - No/e 1 1$

%% Cl.ster Server - No/e 2 1#

%$ Cl.ster Server - No/e % 1#

%# &i>re Channel Storage Array 16

$ Cl.ster Deloyent 17

$1 Deloyent +as, &lo 17

$2 Deloy :anageent Server 18

$21 9nstall Re/ 3at 5nterrise in.' 6 18

$22 Conig.re Netor,s 1"

re!arh)!eedbak*redhat%o( iii """%redhat%o(


4/100

$2% Conig.re &ireall 20

$2$ 9nstall Cl.ster :anageent Sotare 21

$% Deloy Cl.ster No/es 2%

$%1 9nstall Re/ 3at 5nterrise in.' 6 2%

$%2 Conig.re Netor,s an/ )on/ing 2$

$%% Conig.re &ireall 27

$%$ 9nstall Cl.ster No/e Sotare 2"

$%# Conig.re Storage 2"

$%#1 Conig.re :.ltiathing 2"

$%#2 Create 3A-V: Vol.e %1

$%6 Conig.re ;e> Server %%

$%7 Conig.re S5in.' Se*.rity Paraeters %$

$$ Cl.ster Creation via Conga %6

$$1 Create Cl.ster %6

$$2 A// &en*e Devi*es %"

$$% A// &ailover Doain $$

$$$ A// Reso.r*es $6

$$# A// Servi*e =ro. $"

$$6 Veriy Cl.ster ;e> Servi*e #1

$# Cl.ster Creation via CCS #2

$#1 Create Cl.ster #2

$#2 A// No/es #%

$#% A// &en*e Devi*es #%

$#$ A// &ailover Doain #$

$## A// Reso.r*es #$

$#6 A// Servi*e =ro. ##

$#7 A*tivate Cl.ster ##

$#8 Veriy Cl.ster ;e> Servi*e #6

# Cl.ster :anageent #7

#1 A//ing Cl.ster No/es #7

#2 Reoving Cl.ster No/es 61

#% Relo*ating Cl.ster ;e> Servi*es 6#

#$ &en*ing Cl.ster No/es 6"

## 9orting a Cl.ster 71

6 Con*l.sion 7%

Aen/i' A Reeren*es 7$

"""%redhat%o( iv re!arh)!eedbak*redhat%o(


5/100

Aen/i' ) Re/ 3at 5nterrise in.' 6 F Satellite Conig.ration Details 7#

Aen/i' C &i>re Channel Storage Provisioning 8#

Aen/i' D Cl.ster Conig.ration &ile *l.ster*on 8"

Aen/i' 5 3A-;e> Stat.s S*rit "1

Aen/i' & Cl.ster Conig.ration :atri' "%

Aen/i' = Deloyent Che*,lists "$

re!arh)!eedbak*redhat%o( v """%redhat%o(


6/100

1 Executive SummaryRe/ 3atGs 3igh Availa>ility A//-(n or Re/ 3at 5nterrise in.' 6 is Re/ 3atGs reier highavaila>ility *l.stering sol.tion +he 3igh Availa>ility A//-(n rovi/es relia>ility4 availa>ilityan/ s*ala>ility RAS to *riti*al ro/.*tion servi*es >y eliinating single oints o ail.re an/rovi/ing a.toati* failovero those servi*es in the event o a *l.ster no/e ail.re or error*on/ition

+his reeren*e ar*hite*t.re /etails the /eloyent4 *onig.ration an/ anageent o a highlyavaila>le e> servi*e .sing the 3igh Availa>ility A//-(n or Re/ 3at 5nterrise in.' 6 Athree no/e *l.ster is /eloye/ to r.n the e> servi*e an/ a /e/i*ate/ anageent station is/eloye/ to anage an/ *onig.re the *l.ster

+he .n/erlying storage or the e> servi*e .tiliHes a highly-availa>le V: 3A-V: vol.e3A-V: vol.es erit *l.ster servi*e /ata to >e share/ e'*l.sively aong highly-availa>leno/es or the least *ost an/ highest ossi>le eroran*e +he 3A-V: vol.e ithin this/o*.ent is *reate/ on a &i>re Channel storage array >.t other share/ storage te*hnologies

e.g. - iSCSI ay >e .se/

A//itional re/.n/an*y an/ eroran*e in*reases are a*hieve/ thro.gh the .se o searate.>li* an/ rivate *l.ster inter*onne*t netor,s :.ltile netor, a/aters are .se/ onthese netor,s ith all intera*es >on/e/ together Siilarly4 /evi*e aer .ltiathing is.se/ to a'iiHe eroran*e an/ availa>ility to the 3A-V: vol.e

+o etho/s are availa>le or *reating an/ anaging *l.sters ith the 3igh Availa>ility A//-(n or Re/ 3at 5nterrise in.' 6 +he irst etho/ is thro.gh the .se o Conga an/ thelucigrahi*al .ser intera*e =U9 +he se*on/ etho/ is thro.gh the .se o the Cl.ster

Conig.ration Syste CCS *oan/ line intera*e C9 )oth aroa*hes are /etaile/ithin this reeren*e ar*hite*t.re

+he ost *oon *l.ster anageent tas,s a//ing4 reoving no/es4 relo*ating *l.sterservi*es4 en*ing no/es4 iorting an e'isting *l.ster are also /eonstrate/

+his /o*.ent /oes not reI.ire e'tensive Re/ 3at 5nterrise in.' e'erien*e >.t therea/er is e'e*te/ to have a or,ing ,nole/ge o in.' a/inistration an/ *l.stering*on*ets

re!arh)!eedbak*redhat%o( $ """%redhat%o(


7/100

2 Component Overview+his se*tion rovi/es an overvie on the Re/ 3at 5nterrise in.' oerating syste4 Re/3atGs 3igh Availa>ility A//-(n an/ the other *oonents .se/ in this reeren*e ar*hite*t.re

2.1 Red Hat Enterprise Linux 6Re/ 3at 5nterrise in.' 614 the latest release o Re/ 3atGs tr.ste/ /ata*enter lator4/elivers a/van*es in ali*ation eroran*e4 s*ala>ility4 an/ se*.rity ;ith Re/ 3at5nterrise in.' 614 hysi*al4 virt.al an/ *lo./ *o.ting reso.r*es *an >e /eloye/ ithinthe /ata *enter Re/ 3at 5nterrise in.' 61 rovi/es the olloing eat.res an/ *aa>ilities

Reliability+ Availability+ and Seurity ,RAS-.

:ore so*,ets4 ore *ores4 ore threa/s4 an/ ore eory

RAS har/are->ase/ hot a// o CPUs an/ eory is ena>le/

:eory ages ith errors *an >e /e*lare/ as Joisone/K an/ *an >e avoi/e/

/ile Syste(s.

e't$ is the /ea.lt ilesyste an/ s*ales to 16+)

le as an a//-on an/ *an s*ale to 100+)

&.se allos ile systes to r.n in .ser sa*e alloing testing an/ /eveloent onneer .se->ase/ ile systes s.*h as *lo./ ile systes

High Availability.

5'ten/s the *.rrent *l.stering sol.tion to the virt.al environent alloing or highavaila>ility o virt.al a*hines an/ ali*ations r.nning insi/e those virt.al a*hines

5na>les N&Sv$ reso.r*e agent onitoring 9ntro/.*tion o CCS CCS is a *oan/ line tool that allos or *olete C9

a/inistration o Re/ 3atGs 3igh Availa>ility A//-(n

Resoure Manage(ent.

*gro.s organiHe syste tas,s so that they *an >e tra*,e/ an/ so that other systeservi*es *an *ontrol the reso.r*es that *gro. tas,s ay *ons.e

*.set alies CPU reso.r*e liits to *gro.s4 alloing ro*essing eroran*e to >eallo*ate/ to tas,s

+here are any other eat.re enhan*eents to Re/ 3at 5nterrise in.' 6 Please see the

Re/ 3at e>site or ore inoration

"""%redhat%o( ' re!arh)!eedbak*redhat%o(


8/100

2.2 Red Hat Network Satellite Server+his reeren*e ar*hite*t.re .ses Re/ 3at Netor, Satellite R3N server to rovision the*l.ster no/es All R3N .n*tionality is on the netor,4 alloing .*h greater le'i>ility an/*.stoiHation +he satellite server *onne*ts ith Re/ 3at over the .>li* 9nternet to

/onloa/ ne *ontent an/ ./ates +his o/el also allos *.stoers to ta,e their Re/ 3atNetor, sol.tion *oletely o-line i /esire/ A/vantages o .sing R3N Satellite in*l./e

Se*.rity - an en/-to-en/ se*.re *onne*tion is aintaine/ ro the *lient systes tothe R3N Satellite itho.t *onne*ting to the .>li* 9nternet

5i*ien*y - a*,ages are /elivere/ signii*antly aster over a lo*al area netor,

Control - *lientsG Syste Proiles are store/ on the lo*al R3N Satellite4 not on the*entral Re/ 3at Netor, Servers

C.stoiHe/ ./ates - *reate a tr.ly a.toate/ a*,age /elivery syste or *.stosotare a*,ages reI.ire/ >y *lient systes4 as ell as Re/ 3at a*,ages C.sto*hannels allo ine- graine/ *ontrol o the /elivery o *.sto a*,ages

A**ess *ontrol - syste a/inistrators *an >e restri*te/ to a**ess only those systesithin their aintenan*e resonsi>ilities

)an/i/th anageent - the >an/i/th .se/ or transa*tions >eteen the *lients an/the R3N Satellite is *ontrolle/ >y the organiHation on the lo*al area netor,L R3NSatellite *lients /o not have to *oete ith other *lients a**essing the *entral Re/3at Netor, ile servers

S*ala>ility - R3N Satellite ay oversee an entire organiHationGs servers in *o>inationith R3N Pro'y Server

R3N Satellite is Re/ 3atMs on-reises systes anageent sol.tion that rovi/es sotare./ates4 *onig.ration anageent4 rovisioning an/ onitoring a*ross >oth hysi*al an/

virt.al Re/ 3at 5nterrise in.' servers 9t oers *.stoers oort.nities to gain enhan*e/eroran*e4 *entraliHe/ *ontrol an/ higher s*ala>ility or their systes4 hile /eloye/ on aanageent server lo*ate/ insi/e the *.stoerMs /ata *enter an/ ireall

re!arh)!eedbak*redhat%o( 0 """%redhat%o(


9/100

2.3 High Availailit! Add"#n+he 3igh Availa>ility A//-(n or Re/ 3at 5nterrise in.' rovi/es high availa>ility oservi*es >y eliinating single oints o ail.re )y oering ailover servi*es >eteen no/es

ithin a *l.ster4 the 3igh Availa>ility A//-(n s.orts high availa>ility or . to 16 no/es

C.rrently this *aa>ility is liite/ to a single AN or /ata*enter lo*ate/ ithin one hysi*alsite

+he 3igh Availa>ility A//-(n also ena>les ailover or o-the-shel ali*ations s.*h asAa*he4 :ySE4 an/ PostgreSE4 any o hi*h *an >e *o.le/ ith reso.r*es li,e 9Pa//resses an/ single-no/e ile systes to or highly availa>le servi*es +he 3ighAvaila>ility A//-(n *an also >e easily e'ten/e/ to any .ser-se*iie/ ali*ation that is*ontrolle/ >y an init s*rit er UN9< Syste V SysV stan/ar/s

;hen .sing the 3igh Availa>ility A//-(n4 a highly availa>le servi*e *an ail over ro oneno/e to another ith no aarent interr.tion to *l.ster *lients +he 3igh Availa>ility A//-(nalso ens.res a>sol.te /ata integrity hen one *l.ster no/e ta,es over *ontrol o a servi*ero another *l.ster no/e 9t a*hieves this >y rotly evi*ting no/es ro the *l.ster that are/eee/ to >e a.lty .sing a etho/ *alle/ en*ing4 th.s reventing /ata *orr.tion +he3igh Availa>ility A//-(n s.orts several tyes o en*ing4 in*l./ing >oth oer an/ storagearea netor, SAN >ase/ en*ing

+he olloing se*tions /es*ri>e the vario.s *oonents o the 3igh Availa>ility A//-(n in the*onte't o this reeren*e ar*hite*t.re

2.3.1 QuorumQuorumis a voting algorith .se/ >y the *l.ster anager C:AN C:AN anages *l.sterI.or. an/ *l.ster e>ershi C:AN r.ns as a servi*e on all the *l.ster no/es +o

aintain quorum,the no/es in the *l.ster .st agree a>o.t their stat.s aong theselves+he quorum/eterines hi*h no/es in the *l.ster are /oinant &or e'ale4 i there arethree no/es in a *l.ster an/ one no/e loses *onne*tivity4 the other to no/es *o.ni*ate

ith ea*h other an/ /eterine that the thir/ no/e nee/s to >e en*e/ +he a*tion o en*ingens.res that the no/e hi*h lost *onne*tivity /oes not *orr.t /ata

)y /ea.lt ea*h no/e in the *l.ster has one quorumvote4 altho.gh this is *onig.ra>le +hereare to etho/s the no/es *an *o.ni*ate ith ea*h other to /eterine quorum.+he irstetho/ quorumvia netor, *onsists o a sile a@ority #0 o the no/es !1 e'tra +hese*on/ etho/ is >y a//ing a quorum/is, +he quorum/is, allos or .ser-se*iie/*on/itions to e'ist hi*h hel /eterine hi*h no/es sho.l/ >e /oinant

+his reeren*e ar*hite*t.re .ses netor, quorum- a /e/i*ate/ quorum/is, is not reI.ire/

2.3.2 Resource Group Manager+he reso.r*e gro. anager rgmanager rovi/es ailover *aa>ilities or *olle*tions o*l.ster reso.r*es ,non as reso.r*e gro.s or reso.r*e trees Rgmanageror,s >y alloingsystes a/inistrators to /eine4 *onig.re4 an/ onitor *l.ster servi*es 9n the event o ano/e ail.re4 rgmanagerrelo*ates the *l.stere/ servi*e to another no/e to restore servi*e

"""%redhat%o( 1 re!arh)!eedbak*redhat%o(


10/100

availa>ility Servi*es *an >e restri*te/ to *ertain no/es4 s.*h as restri*ting httpdto one set ono/es hile mysql*an >e restri*te/ to a searate set o no/es

+he olloing list s.ariHes the vario.s ro*esses an/ agents that *onstit.te rgmanager

&ailover Doains - An or/ere/ s.>set o e>ers to hi*h a servi*e ay >e >o.n/

Servi*e Poli*ies - rgmanager'sservi*e start. an/ re*overy oli*ies

Reso.r*e +rees - Reresentations o reso.r*es4 their attri>.tes4 arent B *hil/ an/si>ling relationshis

Reso.r*e Agents

rgmanagerr.ns as a servi*e on all the no/es in a *l.ster 9 the servi*e is not r.nning4 thereso.r*es are not availa>le to >e >ro.ght online Re*overy o rgmanager/een/s on theDistri>.te/ o*, :anager D: 9n the event o a ail.re4 the D: .st re*over rior torgmanagerre*overing servi*es ro a aile/ host

2.3.3 Fencing&en*ing is the /is*onne*tion o a no/e ro the *l.sterGs share/ storage &en*ing reventsthe ae*te/ no/e ro iss.ing 9B( to share/ storage4 th.s ens.ring /ata integrity +he *l.sterinrastr.*t.re erors en*ing thro.gh fenced,the en*e /aeon.

;hen C:AN /eterines that a no/e has aile/4 it *o.ni*ates to other *l.ster-inrastr.*t.re *oonents to inor the that the no/e has aile/ +he aile/ no/e is en*e/

hen fencedis notiie/ (ther *l.ster-inrastr.*t.re *oonents /eterine hat a*tions tota,e - that is4 they eror any re*overy that nee/s to /one &or e'ale4 /istri>.te/ lo*,anager D! an/ =lo>al &ile Syste version 2 "#S$%4 hen notiie/ o a no/e ail.re4s.sen/ a*tivity .ntil they /ete*t that fencedhas *olete/ en*ing the aile/ no/e Uon*oniration that the aile/ no/e is en*e/4 D!an/ "#S$eror re*overy D!releases

lo*,s o the aile/ no/eL "#S$re*overs the @o.rnal o the aile/ no/e

+he en*ing rogra fenced /eterines ro the *l.ster *onig.ration ile hi*h en*ingetho/ to .se +o ,ey eleents in the *l.ster *onig.ration ile /eine a en*ing etho/en*ing agent an/ en*ing /evi*e +he en*ing rogra a,es a *all to a en*ing agentse*iie/ in the *l.ster *onig.ration ile +he en*ing agent4 in t.rn4 en*es the no/e via aen*ing /evi*e ;hen en*ing is *olete4 the en*ing rogra notiies the *l.ster anager+he 3igh Availa>ility A//-(n rovi/es a variety o en*ing etho/s

Poer en*ing - A en*ing etho/ that .ses a oer *ontroller to oer o aninoera>le no/e

Storage en*ing - 9n*l./es en*ing etho/s that /isa>le the &i>re Channel ort that*onne*ts storage to an inoera>le no/e SCS9-% ersistent reservations are another*oonly .se/ storage en*ing etho/ in hi*h a**ess to a *oon share/ storage/evi*e *an >e revo,e/ to an inoera>le no/e

Systes anageent en*ing - &en*ing etho/s that /isa>le 9B( or oer to aninoera>le no/e 5'ales in*l./e 9):O)la/eCenter4 DellODRACB:C4 3PO9(49P:94 an/ 9): RSA 99



11/100

'%0%0%$ 3PM3

+he 9ntelligent Plator :anageent 9ntera*e 9P:9 is a stan/ar/iHe/ *o.ter intera*ethat allos a/inistrators to reotely anage a syste Centere/ aro.n/ a >ase>oar/anageent *ontroller ):C4 9P:9 s.orts .n*tions to a**ess the syste )9(S4 /islayevent logs4 oer on4 oer o an/ oer *y*le a syste

+his reeren*e ar*hite*t.re .ses 9P:9 to en*e a.lty *l.ster no/es a*ross the .>li* netor,thro.gh the fence_ipmilanagent



12/100

2.3.4 Failover DomainsA failover domainis an or/ere/ s.>set o *l.ster e>ers to hi*h a servi*e ay >e >o.n/#ailover domains4 hile .se.l or *l.ster *.stoiHation4 are not reI.ire/ or oeration

+he olloing is a list o seanti*s governing the otions as to ho the /ierent *onig.ration

otions ae*t the >ehavior o a failover domain

&rdering4 restriction4 an/ nofailac(are lags that *an >e *o>ine/ in vario.s ays eg4ordered)restricted4 unordered)unrestricted4 et* +hese *o>inations ae*t >oth hereservi*es start ater initial I.or. oration an/ hi*h *l.ster e>ers ta,e over servi*es inthe event that the servi*e has aile/

Preerre/ no/e or reerre/ e>er - +hepreferred nodeis the e>er /esignate/ tor.n a given servi*e i the e>er is online +his >ehavior *an >e e.late/ >yse*iying an .nor/ere/4 .nrestri*te/ failover domaino e'a*tly one e>er

Restri*te/ /oain - Servi*es >o.n/ to the /oain ay only r.n on *l.ster e>ers

hi*h are also e>ers o the failover domain 9 no e>ers o the failover domainare availa>le4 the servi*e is la*e/ in the stoppedstate 9n a *l.ster ith several

e>ers4 .sing a restri*te/ failover domain*an ease *onig.ration o a *l.ster servi*es.*h as httpd4 hi*h reI.ires i/enti*al *onig.ration on all e>ers that r.n the

servi*e 9nstea/ o setting . the entire *l.ster to r.n the *l.ster servi*e4 set . onlythe e>ers in the restri*te/ failover domainthat are asso*iate/ ith the *l.sterservi*e

Unrestri*te/ /oain - +he /ea.lt >ehavior Servi*es >o.n/ to this /oain ay r.n onall *l.ster e>ers4 >.t r.n on a e>er o the /oain henever one is availa>le 9 aservi*e is r.nning o.tsi/e o the /oain an/ a e>er o the /oain *oes online4the servi*e igrates to that e>er

(r/ere/ /oain - +he or/er se*iie/ in the *onig.ration /i*tates the or/er oreeren*e o e>ers ithin the /oain +he highest-ran,ing online e>er o the/oain hosts the servi*e 9 e>er A has a higher-ran, than e>er )4 the servi*erelo*ates to A i *.rrently r.nning on ) hen A transitions ro oline to online

Unor/ere/ /oain - +he /ea.lt >ehavior :e>ers o the /oain have no or/er oreeren*eL any e>er ay r.n the servi*e 9n an .nor/ere/ /oain4 servi*esalays igrate to e>ers o their failover domainhenever ossi>le

&ail>a*, - Servi*es on e>ers o an or/ere/ failover domainsho.l/ relo*ate >a*, tothe original no/e on*e the ail.re is a//resse/ &ail>a*, *an also >e /isa>le/ torevent servi*e ro ailing over >a*, an/ orth >eteen reI.ently ailing no/es



13/100

2.3.5 CongaConga is an agentBserver ar*hite*t.re or the reote a/inistration o *l.ster no/es +heagent *oonent is *alle/ riccian/ the server *oonent is *alle/ luci (ne luci

anageent server *an *o.ni*ate ith ricciagents installe/ on .ltile *l.ster no/es

;hen a syste is a//e/ to a lucianageent server4 a.thenti*ation is only /one the irsttie No a.thenti*ation is ne*essary aterar/s +he lucianageent intera*e allos

a/inistrators to *onig.re an/ anage *l.ster no/es Co.ni*ations >eteen lucian/

ricciis /one via e installe/ on in/ivi/.al *l.ster no/es >.t or

availa>ility .roses4 it is reera>le to anage *l.ster no/es ith lucion a non-e>er

*l.ster no/e LucireI.ires ort 808$ to >e oen or *o.ni*ations to the ricciagents on

all *l.ster e>er no/es

'%0%2%' Rii

Ricciis the *l.ster anageent an/ *onig.ration /aeon that r.ns on the *l.ster no/es

;hen ricciis installe/ it *reates a .ser a**o.nt *alle/ riccian/ a assor/ is set or the

a**o.nt All riccia**o.nts .st >e *onig.re/ ith the sae assor/ a*ross all *l.ster

no/es to allo a.thenti*ation ith the lucianageent server +he ricci/aeon

reI.ires ort 11111 to >e oen or >oth t* an/ ./ trai*



14/100


15/100


16/100

A ore *oa*t an/ ei*ient ay to tra*, .tiliHe/ sa*e in a ilesyste is the .sage oe'ten/->ase/ eta/ata an/ the /elaye/ allo*ation eat.re +hese eat.res irove ilesyste eroran*e an/ re/.*e the sa*e *ons.e/ >y eta/ata Delaye/ allo*ation allosthe ilesyste to ostone sele*tion o the eranent lo*ation or nely ritten .ser /ata .ntilthe /ata is l.she/ to /is, +his ena>les higher eroran*e sin*e it *an allo or larger4 ore*ontig.o.s allo*ations4 alloing the ilesyste to a,e /e*isions ith .*h >etter

inoration

A//itionally4 ilesyste *he*, an/ reair tie s*, in tis .*h aster than in t$an/t/ Soe ilesyste reairs have /eonstrate/ . to a si'-ol/ in*rease in eroran*eC.rrently4 Re/ 3atMs a'i. s.orte/ siHe or tis 16+) in >oth Re/ 3at 5nterrisein.' # an/ Re/ 3at 5nterrise in.' 6 Ali*ation eroran*e /een/s on anyvaria>lesL in a//ition to the a*t.al ilesyste *hosen4 the ali*ation eroran*e also/een/s on the se*ii* 9B( attern the ali*ation generates an/ the tye o server an/storage har/are .se/

+his reeren*e ar*hite*t.re .ses the tilesyste on the 3A-V: vol.e

2.4.3 DM MultipathDevi*e aer .ltiathing D: :.ltiath allos .ltile 9B( aths to >e *onig.re/>eteen a server an/ the *onne*tion aths to SAN storage array vol.es +he aths areaggregate/ an/ resente/ to the server as a single /evi*e to a'iiHe eroran*e an/rovi/e high availa>ility A /aeon multipathd han/les *he*,ing or ath ail.res an/

stat.s *hanges

+his reeren*e ar*hite*t.re .ses D: :.ltiath on the *l.ster e> servi*e 3A-V: vol.e

re!arh)!eedbak*redhat%o( $$ """%redhat%o(


17/100

2.( )luster *e Servi+e:anage/ >y rgmanager4 the *l.ster e> servi*e is *onig.re/ thro.gh the 3igh Availa>ilityA//-(n /.ring *l.ster *reation +he *l.ster e> servi*e *onsists o the olloing o.rreso.r*es

9P A//ress 10161$%1#0

ogi*al Vol.e :anageent 3A-V:

&ile Syste 5't$

S*rit htt/

Client systes *onne*t to the e> servi*e via the 9P A//ress ro a e> >roser &or/eonstration .roses4 a s*rit 23-4e-Status is r.n ro the*ha*ha-1e*.cgi-in/ire*tory on the 3A-V: vol.e that /islays the *ontents o*etc*motd4 *.rrent /ate an/tie Details on ho to *onig.re the 3A-;e>-Stat.s s*rit *an >e o.n/ in Appendix E. HA)Web Status Sript

9n the event o a no/e ailover4 rgmanageranages the relo*ation o the e> servi*e D.ringrelo*ation4 rgmanagero.nts the 3A-V: vol.e an/ starts the e> server on the no/eres.ing *ontrol +he ro*ess is transarent to *lient systes ith only a >rie /elay as the

e> servi*e is relo*ate/ to the ne't *l.ster no/e &ro a *l.ster anageent erse*tive4the *l.ster e> servi*e l.s the 3A-V: *an >e tho.ght o as one logi*al entity as /ei*te/ in/igure '%2)$. 7luster Web Servie

"""%redhat%o( $' re!arh)!eedbak*redhat%o(

Figure 2.5-1: ClusterWeb Service


18/100

3 Reference Architecture Configuration+his se*tion rovi/es an overvie o the har/are *oonents that ere .se/ in the/eloyent o this reeren*e ar*hite*t.re +he *l.ster no/es ha-1e54 ha-1e$4 ha-1e/

ere *onig.re/ on an 3P )la/eSyste *7000 en*los.re .sing three 3P Proiant )$60* =6)la/e servers +o 10 =>Bs ethernet netor,s ere *onig.re/ or .se as the .>li* an/*l.ster inter*onne*t netor,s +he 3P )la/e servers share e'*l.sive a**ess one no/e at atie to the 3A-V: e> servi*e vol.e lo*ate/ on an 3P Storage;or,s :SA2%2$*i>re*hannel storage array D.ring no/e ailover or relo*ation o the e> servi*e4 the 3A-V:vol.e is o.nte/ >y the no/e res.ing *ontrol4 granting e'*l.sive a**ess to the vol.e

+he *l.ster anageent server as /eloye/ as a QV: virt.al a*hine +he hyervisor hostas *onig.re/ ith a >ri/ge/ netor, to allo the virt.al a*hine to anage *l.ster no/esover the *l.ster inter*onne*t Client a**ess to the *l.ster e> servi*e is over the .>li*netor, .sing a e> >roser

/igure 0)$. 7luster 7on!iguration/ei*ts an overvie o the *l.ster *onig.ration

re!arh)!eedbak*redhat%o( $0 """%redhat%o(

Figure 3-1: Cluster Configuration


19/100

3.1 )luster &anage'ent Server

7o(ponent Detail

3ostnae ha-1e-mgmt

(erating SysteRe/ 3at 5nterrise in.' 61 6$->it26%2-1%101#el6'866$ ,ernel

Syste +ye Virt.al :a*hine QV:

Pro*essor 2 Core

:eory $ =)

Storage %0=>

Netor, 2

Table 3.1: Cluster Management Server Configuration

3.2 )luster Server " Node 1

7o(ponent Detail

3ostnae ha-1e5

(erating SysteRe/ 3at 5nterrise in.' 61 6$->it26%2-1%1$1el6'866$ ,ernel

Syste +ye 3P Proiant )$60* =6

Pro*essor

E.a/ So*,et4 E.a/ Core 16 *ores

9ntel9


20/100

3.3 )luster Server " Node 2

7o(ponent Detail

3ostnae ha-1e$

(erating Syste Re/ 3at 5nterrise in.' 61 6$->it26%2-1%1$1el6'866$ ,ernel

Syste +ye 3P Proiant )$60* =6

Pro*essorE.a/ So*,et4 E.a/ Core 16 *ores9ntel9


21/100


22/100

4 Cluster Deployment

$.1 -eplo!'ent ask ,low

/igure 1%$)$. 7luster Deploy(ent ask /lo"rovi/es an overvie o the or/er in hi*h the/eloyent o the *l.ster anageent server4 *l.ster no/es an/ *l.ster *reation tas,s areerore/

Appendix :. Deploy(ent 7heklistsrovi/es a /etaile/ list o stes to ollo or /eloyinga 3ighly Availa>le ;e> Servi*e on Re/ 3at 5nterrise in.' 6


Figure 4.1-1: ClusterDeployent !as" Flo#


23/100

$.2 -eplo! &anage'ent Server

Prior to *reating the *l.ster4 the olloing series o stes is erore/ to /eloy the luci

anageent server

9nstall Re/ 3at 5nterrise in.' 6 Conig.re Netor,s

Conig.re &ireall

9nstall Cl.ster :anageent Sotare 2igh 3vailaility !anagement 3dd-&n

+he ne't se*tions /es*ri>e ho to eror the /eloyent stes in /etail

4.2.1 Install Red Hat Enterprise Linux 6+he Re/ 3at 5nterrise in.' 6 9nstallation =.i/e1rovi/es *olete /etails on theinstallation o Re/ 3at 5nterrise in.' 6 or 9ntel4 A:D4 an/ 9): ar*hite*t.res +he *l.ster

anageent server *an >e /eloye/ as either a hysi*al or virt.al a*hine A QV: virt.ala*hine as .se/ or this reeren*e ar*hite*t.re Using the virt-install.tility4 the virt.al

a*hine as rovisione/ ith 2 ro*essors4 $ =) eory an/ a >ri/ge/ netor, intera*eas ollos

# virt-install --name ha-web-mgmt --ram 4096 --vcpus=2 --cpuset=auto --os-t!pe=linu" --os-variant=rhel6 --accelerate

--networ#=bridge$vm-bridge --vnc --dis# path=%dev%vm_storage_vg%ha-web-mgmt --p"e

A revio.sly *reate/ %0 =) logi*al vol.e ha-1e-mgmt as *reate/ to hol/ the virt.ala*hine itsel on the hyervisor host &or /etails on the rovisioning o QV: virt.al a*hines4lease *ons.lt the Re/ 3at 5nterrise in.' 6 Virt.aliHation =.i/e%

Regar/less o hether a hysi*al or virt.al a*hine is .se/4 a Re/ 3at 5nterrise in.' 6installation involves the olloing series o stages

1 9nstall Re/ 3at 5nterrise in.' 6

2 &irst)oot

% Aly ./ates

Ater the oerating syste has >een installe/ the syste re>oots an/ enters hat is reerre/to as #irst7oot D.ring #irst7oot4 a/inistrators are g.i/e/ thro.gh the ro*ess o setting/ate an/ tie4 *onig.ring sotare ./ates4 registering ith Re/ 3at Netor, R3N4 initial.ser a**o.nt *reation an/ otions or Qernel 8dump *rash /.s +he syste then re>oots

to a*tivate the *hanges Ater login has >een *olete/ .n/er the nely *reate/ .sera**o.nt4 ./ates to the syste are alie/ to >ring the Re/ 3at 5nterrise in.' 6 server tothe latest versions o all sotare

+he Re/ 3at 5nterrise in.' 6 9nstallation =.i/e1rovi/es *olete instr.*tions on ea*h othese stages Please *ons.lt the g.i/e or .rther installation /etails

"""%redhat%o( $5 re!arh)!eedbak*redhat%o(


24/100

4.2.2 Configure Networks+he anageent server is *onig.re/ to rovi/e a**ess to all *l.ster no/es a*ross >oth the.>li* an/ *l.ster inter*onne*t rivate netor,s +he .>li* netor, 56.59.5/.6 is*onig.re/ on the eth0intera*e an/ the *l.ster inter*onne*t 5:$.59;.5.6 is *onig.re/ on

the eth&intera*e Stati* 9P a//ressing is .se/ thro.gho.t the *l.ster *onig.ration1 Veriy that Netor,:anager is /isa>le/ on start. to revent *onli*ts ith the 3igh

Availa>ility A//-(n *l.ster servi*es

# ch#config 'etwor#(anager off# ch#config 'etwor#(anager --listNetworkManager 0:off 1:off 2:off 3:off 4:off 5:off 6:off

2 Create the intera*e ile or the .>li* intera*e an/ save the ile as*etc*sysconfig*net1or(-scripts*ifcfg-eth6

DEVICE="eth0"H!DD="52:54:00:E2:E:5"

$%%&'%&%=(tat)*%N$%%&="+e("NM,C%N&%--ED="no"I'!DD=10.16.143.154NE&M!/=255.255.255.0!&E!=10.16.143.254

% Create the intera*e ile or the *l.ster inter*onne*t an/ save the ile as*etc*sysconfig*net1or(-scripts*ifcfg-eth/

DEVICE="eth3"H!DD="52:54:00:E:1!:33"$%%&'%&%=(tat)*

%N$%%&="+e("NM,C%N&%--ED="no"I'!DD=12.16.1.154NE&M!/=255.255.255.0

$ Restart the netor, servi*es to a*tivate the *hanges

) service networ# restart

# U/ate*etc*hosts

5/it the*etc*hostsile to in*l./e the 9P a//resses4 hostnaeBaliases o all *l.ster no/ean/ anageent server intera*es



25/100

127.0.0.1 localhost localhost.localdomain##----------------## Cluster Nodes: ##----------------##10.16.143.151 ha-web1 ha-web1.cloud.lab.en.bos.redhat.com

1!2.16".1.151 ha-web1-ci ha-web1-ci.cloud.lab.en.bos.redhat.com10.16.143.152 ha-web2 ha-web2.cloud.lab.en.bos.redhat.com1!2.16".1.152 ha-web2-ci ha-web2-ci.cloud.lab.en.bos.redhat.com10.16.143.153 ha-web3 ha-web3.cloud.lab.en.bos.redhat.com1!2.16".1.153 ha-web3-ci ha-web3-ci.cloud.lab.en.bos.redhat.com

##------------------## anaement Node: ##------------------##10.16.143.154 ha-web-mmt ha-web-mmt.cloud.lab.en.bos.redhat.com

1!2.16".1.154 ha-web-mmt-ci ha-web-mmt-ci.cloud.lab.en.bos.redhat.com

4.2.3 Configure Firewall)eore the *l.ster *an >e *reate/4 the ireall orts .st >e *onig.re/ to allo a**ess to the*l.ster netor, /aeons +he se*ii* orts reI.iring a**ess

Port ;u(ber Protool 7o(ponent

808$ +CP lui Conga A/inistration 9ntera*e

Table !.1.3: Cluster Noe %orts

&ireall a**ess *an >e *onig.re/ ith either the s!stem-configuration-firewallgrahi*al tool or the iptables*oan/ line .tility Using iptables$*onig.re the ireallon ea*h o the three *l.ster no/es F ha-1e54 ha-1e$4 ha-1e/as ollos

1 Create a >a*,. *oy o the *.rrent iptables*onig.ration ile

# cp %etc%s!sconfig%iptables-config %etc%s!sconfig%iptables-config*orig

2 Dislay the *.rrent iptables*onig.ration

# iptables --list --line-numbers --numeric --verboseCha)n IN'& 7o8)*+ !CCE'& 5 7a*ket(9 422 +te(;

n


26/100

% Create a ne iptables*hain *alle/ ha-web-clusteran/ insert it into the +',.

*hain

# iptables --new-chain ha-web-cluster# iptables --insert +',. --/ump ha-web-cluster

$ A// the r.les or the *l.ster *oonents to the ha-web-cluster*hain# iptables --append ha-web-cluster --proto tcp destination-port 1014 --/ump 33,.

# Dislay the ne iptables*onig.ration

# iptables --list --line-numbers --numeric --verboseCha)n IN'& 7o8)*+ !CCE'& 33 7a*ket(9 24 +te(;n7t:04

6 Save the ne r.les an/ veriy iptablesis a*tivate/ on syste >oot

# service iptables save)7ta8e(: /a)ng f)rewa88 rility v 6 or 6$->it '866$

R3N +ools or R35 v 6 or 6$->it '866$

2 Conir the *hannels are availa>le on the *l.ster anageent server

# !um repolist-oa>e> 789 rhn78 Hat re7o()tor)e(.re7o )> re7o naerhe8@F6,64@(erer@6 e> Hat Enter7r)(e -)n


27/100

% 9nstall the *l.ster anageent sotare on ha-1e-mgmt

# !um groupinstall 5igh vailabilit! (anagement7

+his *oletes the /eloyent o the *l.ster anageent server Pro*ee/ to Setion 1%0Deploy 7luster ;odesto >egin the ro*ess o /eloying the three *l.ster no/es

"""%redhat%o( '' re!arh)!eedbak*redhat%o(


28/100

$.3 -eplo! )luster NodesPrior to *reating the *l.ster4 ea*h *l.ster no/e is /eloye/ >y eroring the olloing serieso stes on ea*h *l.ster no/e

9nstall Re/ 3at 5nterrise in.' 6

Conig.re Netor,s an/ )on/ing

Conig.re &ireall

9nstall Cl.ster No/e Sotare J3igh Availa>ilityK A//-(n

Conig.re Storage

Conig.re ;e> Server Sotare

+he ne't se*tions /es*ri>e ho to eror the /eloyent stes in /etail

4.3.1 Install Red Hat Enterprise Linux 6+he installation o Re/ 3at 5nterrise in.' 6 on ea*h o the three *l.ster no/es is erore/.sing a Re/ 3at Satellite server Details on ho the Satellite server as *onig.re/ *an >eo.n/ in Appendix e .se/ in lie. o a Satellite server /eloyent

(n*e the Satellite server has >een *onig.re/4 eror the olloing stes to install Re/ 3at5nterrise in.' 6 on ea*h *l.ster no/e

1 )oot the no/e .sing the Pre>oot ee/ earlieror the anageent server in Setion 1%'%$ 3nstall Red Hat Enterprise Linux 6 &ollo thestes a>ove an/ *ons.lt the Re/ 3at 5nterrise in.' 6 9nstallation =.i/e1or .rtherinstallation /etails

re!arh)!eedbak*redhat%o( '0 """%redhat%o(
http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Installation_Guide/index.htmlhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Installation_Guide/index.html


29/100

4.3.2 Configure Networks and Bonding+he *l.ster no/es are *onig.re/ to rovi/e a**ess to all *l.ster no/es a*ross >oth the .>li*an/ *l.ster inter*onne*t private netor,s +he .>li* netor, 56.59.5/.6 is *onig.re/ onthe eth0intera*e an/ >on/e/ to the eth8intera*e or re/.n/an*y +he *l.ster inter*onne*t

5:$.59;.5.6 is *onig.re/ on the eth2intera*e an/ >on/e/ to the eth&intera*e or

re/.n/an*y Stati* 9P a//ressing is .se/ thro.gho.t the *l.ster *onig.ration1 Veriy that Netor,:anager is /isa>le/ on start. to revent *onli*ts ith the 3igh

Availa>ility A//-(n *l.ster servi*es

# ch#config 'etwor#(anager off# ch#config 'etwor#(anager --listNetworkManager 0:off 1:off 2:off 3:off 4:off 5:off 6:off

2 Create >on/ *onig.ration iles or the .>li* an/ *l.ster inter*onne*t netor,s

# echo alias bond0 bonding :: %etc%modprobe*d%bonding*conf# echo alias bond8 bonding :: %etc%modprobe*d%bonding*conf

% Create the >on/ intera*e ile or the .>li* netor, an/ save the ile as*etc*sysconfig*net1or(-scripts*ifcfg-ond6

DEVICE=on>0I'!DD=10.16.143.151NE&M!/=255.255.255.0!&E!=10.16.143.254/EC&-=no$%%&'%&%=(tat)*%N$%%&=+e($%NDIN,%'&/="o>e=0 ))on=100"

$ Create the >on/ intera*e ile or the *l.ster inter*onne*t netor, an/ save the ile as

*etc*sysconfig*net1or(-scripts*ifcfg-ond5DEVICE=bond1IPADDR=192.168.1.151NETMASK=255.255.255.0USERCTL=noBOOTPROTO=!"!#$ONBOOT=%&BONDIN'(OPTS=)*od&=1)

# :o/iy the intera*e ile or the irst .>li* intera*e an/ save the ile as*etc*sysconfig*net1or(-scripts*ifcfg-eth6

DEVICE=eth0$%%&'%&%=(tat)*H!DD=00:1:!4::24:3C%N$%%&=+e(M!/&E=on>0/-!VE=+e(/EC&-=no

"""%redhat%o( '1 re!arh)!eedbak*redhat%o(


30/100

6 Create the intera*e ile or the se*on/ .>li* intera*e an/ save the ile as*etc*sysconfig*net1or(-scripts*ifcfg-eth5

DEVICE=eth1$%%&'%&%=(tat)*H!DD=00:1:!4::24:3E%N$%%&=+e(

M!/&E=on>0/-!VE=+e(/EC&-=no

7 :o/iy the intera*e ile or the irst *l.ster inter*onne*t an/ save the ile as*etc*sysconfig*net1or(-scripts*ifcfg-eth$

DEVICE=eth2$%%&'%&%=(tat)*H!DD=00:1:!4::24:40%N$%%&=+e(M!/&E=on>1/-!VE=+e(

/EC&-=no

8 Create the intera*e ile or the se*on/ *l.ster inter*onne*t an/ save the ile as*etc*sysconfig*net1or(-scripts*ifcfg-eth/

DEVICE=eth3$%%&'%&%=(tat)*H!DD=00:1:!4::24:42%N$%%&=+e(M!/&E=on>1/-!VE=+e(/EC&-=no

" Restart the netor,ing servi*e# service networ# restart

10Veriy the .>li* >on/ is r.nning

# cat %proc%net%bonding%bond0

Ethernet Channe8 $on>)ng Dr)er: 3.6.0 /e7teer 269 200;

$on>)ng Mo>e: 8oa> a8an*)ng ro@ro)n;MII /tat>r: 00:1:a4::24:3*/8ae G


31/100

MII /tat>r: 00:1:a4::24:40/8ae G


32/100

1% Distri>.te the ile to the other to *l.ster no/es &or e'ale4 i the ile as initially*reate/ on *l.ster no/e ha-1e5then *oy it to the other no/es as ollos

# scp -p %etc%hosts ha-web2$%etc%hosts# scp -p %etc%hosts ha-web&$%etc%hosts

1$ Veriy all .>li* an/ *l.ster inter*onne*t intera*es are roerly *onig.re/ an/

reson/ing# ping ha-web8# ping ha-web8-ci# ping ha-web2# ping ha-web2-ci# ping ha-web ping ha-web&-ci# ping ha-web-mgmt# ping ha-web-mgmt-ci

4.3.3 Configure Firewall

)eore the *l.ster *an >e *reate/4 the ireall orts .st >e *onig.re/ to allo a**ess to the*l.ster netor, /aeons +he se*ii* orts reI.iring a**ess

Port ;u(ber Protool 7o(ponent

#$0$ UDP orosyn>(anCl.ster :anager

#$0# UDP orosyn>(anCl.ster :anager

11111 +CP riiCl.ster Conig.ration

11111 UDP riiCl.ster Conig.ration

2106$ +CP dl(Distri>.te/ o*, :anager

168#1 +CP (odlusterd

80 +CP httpdAa*he

$$% +CP httpdAa*he

Table !.2.3: Cluster Noe %orts

&ireall a**ess *an >e *onig.re/ ith either s!stem-configuration-firewall=U9 or

the iptables.tility Use iptablesto *onig.re the ireall as er the olloing series o

stes on ea*h o the three *l.ster no/es ha-1e54 ha-1e$4 ha-1e/%

1 Create a >a*,. *oy o the *.rrent iptables*onig.ration ile

# cp %etc%s!sconfig%iptables-config %etc%s!sconfig%iptables-config*orig

2 Dislay the *.rrent iptables*onig.ration

# iptables --list --line-numbers --numeric --verboseCha)n IN'& 7o8)*+ !CCE'& 5 7a*ket(9 422 +te(;n


33/100

Cha)n ?%!D 7o8)*+ !CCE'& 0 7a*ket(9 0 +te(;n servi*e *oonents to the ha-web-service*hain# iptables --append ha-web-service --proto tcp --destination-port 10 --/ump 33,.

# iptables --append ha-web-service --proto tcp --destination-port 44& --/ump 33,.

7 Dislay the ne iptables*onig.ration

# iptables --list --line-numbers --numeric --verboseCha)n IN'& 7o8)*+ !CCE'& 5 7a*ket(9 404 +te(;n


34/100

Cha)n ha@we@*87t:54053 0 0 !CCE'& t*7 @@ A A 0.0.0.0B0 0.0.0.0B0 t*7 >7t:111114 0 0 !CCE'& 7 @@ A A 0.0.0.0B0 0.0.0.0B0 7 >7t:111115 0 0 !CCE'& t*7 @@ A A 0.0.0.0B0 0.0.0.0B0 t*7 >7t:21064

6 0 0 !CCE'& 7 @@ A A 0.0.0.0B0 0.0.0.0B0 7 >7t:21064

Cha)n ha@we@(er)*e 1 referen*e(;n7t:443

8 Save the ne r.les an/ veriy iptablesis a*tivate/ on syste >oot

# service iptables save# ch#config iptables on

4.3.4 Install Cluster Node Software9nstall the 2igh 3vailaility 3dd-&nsotare on ea*h o the three *l.ster no/es

# !um groupinstall 5igh vailabilit!7

4.3.5 Configure StorageA vol.e is *reate/ to hol/ the *ontents o the *l.ster e> servi*e that *an >e share/e'*l.sively aong the *l.ster no/es +he vol.e is *onig.re/ so that e'*l.sive a**ess isgiven to the no/e *.rrently rovi/ing the e> servi*e 9n the event o a ailover4 a**ess to thevol.e is *hange/ to >e e'*l.sive to the ne't *l.ster no/e rovi/ing the e> servi*e Sin*eonly one *l.ster no/e at a tie reI.ires a**ess4 the vol.e is *onig.re/ ith the ogical

+he ogical =nit >umer 0=>%or the vol.e .st >e rovisione/ an/ a**essi>le to ea*h othe *l.ster no/es >eore *ontin.ing Appendix 7. /ibre 7hannel Storage Provisioning/es*ri>es ho the UN .se/ or this reeren*e ar*hite*t.re as rovisione/

1%0%2%$ 7on!igure Multipathing

1 9nstall the D! !ultipathPa*,age on ea*h *l.ster no/e

# !um install device-mapper-multipath*"16_64

2 (n the irst *l.ster no/e ha-1e5 *reate a :.ltiath *onig.ration ile*etc*multipath.conf ith .ser rien/ly naes /isa>le/ an/ the /aeon starte/

# mpathconf --enable --user_friendl!_names n --with_multipathd !/tart)ng >aeon: %

re!arh)!eedbak*redhat%o( '8 """%redhat%o(


35/100


36/100

1%0%2%' 7reate HA)L#M #olu(e

1 5ns.re the araeter locking_type is set to a val.e o 1to revent V: eta/ata

*orr.tion in the glo>al se*tion o the ile*etc*lvm*lvm.confon all no/es

# grep loc#ing_t!pe %etc%lvm%lvm*conf > grep -v )

8o*k)ng,t+7e = 1

2 Conig.re the Physi*al Vol.e PV .sing the :.ltiath /evi*e -*dev*mapper*ha-1ean/ /islay the attri>.tes Peror this ste on the irst *l.ster no/e ha-1e5 only

# pvcreate %dev%mapper%ha-web'h+()*a8 o8 'E 0'V ID t)Oe>@M2@3*P@/e0o@M)@G7h(@a0gOkI

% Create a Vol.e =ro. V= *alle/ HA-Web-VGan/ /islay the attri>.tes

Peror this ste on the irst *l.ster no/e ha-1e5 only

# vgcreate --clustered n -?eb-@A %dev%mapper%ha-webVo8


37/100

$ Create a ogi*al Vol.e V *alle/ ha-web-lvol1an/ /islay the attri>.tes

Peror this ste on the irst *l.ster no/e ha-1e5 only

# lvcreate --siBe 80AC --name ha-web-lvol8 -?eb-@A-og)*a8 o8

# lvdispla! -?eb-@A

@@@ -og)*a8 o8eBH!@e@VBha@we@8o81V Nae H!@e@V-V ID w/R%>@I7@1GR(@&f*N@2In3@D


38/100

7 :o.nt the vol.e an/ veriy it *an >e ritten to Peror this ste on the irst *l.sterno/e ha-1e5 only

# mount %dev%-?eb-@A%ha-web-lvol8 %ha%ha-web

# touch %ha%ha-web%ha-web8*test

# ls -l %ha%ha-web%ha-web8*test@rw@r@@r@@. 1 root root 0 Ooot vol.e myvg an/ nae o the no/e *l.ster inter*onne*t ha-1e5

+his restri*ts the list o vol.es availa>le /.ring syste >oot to only the root vol.ean/ revents *l.ster no/es ro ./ating an/ otentially *orr.ting the eta/ata onthe 3A-V: vol.e

o8


39/100

4.3.7 Configure SELinux Security Parameters)y /ea.lt4 Sinuis ena>le/ /.ring the Re/ 3at 5nterrise in.' 6 installation ro*ess &ora'i. se*.rity4 Re/ 3at re*oen/s r.nning Re/ 3at 5nterrise in.' 6 ith Sinuena>le/ 9n this se*tion4 verii*ation is /one to ens.re that Sinuis ena>le/ an/ the ile

*onte't set *orre*tly on the"ha"ha-webilesyste or .se >y Aa*he

1 Veriy hether or not Sinuis ena>le/ .sing the getenforce.tility Peror this

ste on all *l.ster no/es

# getenforce,n+orcin

9 getenforceret.rns JPerissiveK then set to J5nor*ingK an/ veriy

# getenforceermissi'e

# setenforce 1# getenforce,n+orcin

2 5/it the ile*etc*selinu*configan/ set Sinuto >e ersistent a*ross re>ootsPeror this ste on all *l.ster no/es

/E-INQ=enfor*)ng

% A// -a the ile *onte't fcontet or tye -t httpd?sys?contentto the /ire*tory*haan/ all *ontents ithin it +his a,es the *hanges eranent Peror this ste on all*l.ster no/es

# seanage fconte$t -a -t %ttp&'sys'content't ()%a*).+,(

;ote.9 the semanae*usr*sin*semanage .tility is not availa>le4 install the *oreoli*y .tilities ,it

# yu -y install policycoreutils-pyt%on# seanage fconte$t -a -t %ttp&'sys'content't ()%a*).+,(

$ Vie the *.rrent se*.rity oli*y ile *onte't Peror this ste on all *l.ster no/es

# ls -l& )%adrw%r-%r-%. root root uncon+ined&u:obect&r:de+ault&t:s0 ha

# R.n the restorecon*oan/ to aly the *hanges an/ vie the ./ate/ ile*onte't (nly eror this ste on the *l.ster no/e that has"ha"ha-webo.nte/

# restorecon -/ -v )%arestorecon reset ha conte%t uncon+ined&u:obect&r:de+ault&t:s0-sstem&u:obect&r:httd&ss&content&t:s0restorecon reset haha-web conte%t sstem&u:obect&r:+ile&t:s0-sstem&u:obect&r:httd&ss&content&t:s0restorecon reset haha-weblost+ound conte%tsstem&u:obect&r:+ile&t:s0-sstem&u:obect&r:httd&ss&content&t:s0



40/100

restorecon reset haha-webha-web1.test conte%tuncon+ined&u:obect&r:+ile&t:s0-sstem&u:obect&r:httd&ss&content&t:s0# ls -l& )%adrw%r-%r-%. root root sstem&u:obect&r:httd&ss&content&t:s0 ha

+he /eloyent o the *l.ster anageent server an/ *l.ster no/es is no *olete

Setion 1%0 7luster 7reation via 7onga/etails the ro*ess o *reating the *l.ster an/*onig.ring the e> servi*e .sing the lucie> intera*e Alternatively4 Setion 1%1 7luster

7reation via 77S/etails the ro*ess o *reating the *l.ster ro the *oan/ line .sing theCCS .tility



41/100

$.$ )luster )reation via )onga+he lucigrahi*al .ser intera*e ortion o Conga allos a/inistrators to *reate4 o/iy

an/ vie a *l.ster *onig.ration ile on a reote no/e thro.gh the ricciservi*e Using luci

an a/inistrator *an also start4 sto an/ relo*ate *l.ster servi*es on one or ore *l.ster

no/es9n the rior se*tions4 the *l.ster anageent server an/ *l.ster no/es ere .lly /eloye/Do not ro*ee/ ith *reating the *l.ster .ntil these tas,s have >een .lly *olete/

Cl.ster :anageent Station ha-1e-mgmt


Conig.re Netor,s

Conig.re &ireall

9nstall Cl.ster :anageent Sotare J3igh Availa>ility :anageentK A//-(n

Cl.ster No/es ha-1e54 ha-1e$4 ha-1e/ 9nstall Re/ 3at 5nterrise in.' 6


Conig.re &ireall


Conig.re Storage


+he ne't se*tions /es*ri>e the stes involve/ in *reating the *l.ster ro the lucie>

intera*e on the *l.ster anageent server

4.4.1 Create ClusterCreating a *l.ster ith luci*onsists o naing the *l.ster4 a//ing *l.ster no/es to the

*l.ster4 entering ricciassor/s or ea*h no/e an/ s.>itting the reI.est to *reate a

*l.ster 9 the no/e inoration an/ assor/s are *orre*t4 Conga a.toati*ally installs anynee/e/ or issing *l.ster sotare *oonents onto the *l.ster no/es an/ starts the *l.ster&ollo the stes >elo to start the reI.ire/ *l.ster servi*es4 *reate the *l.ster an/ a// theno/es to it

1 Start the ricciservi*e an/ *onig.re to start on syste >oot Peror this ste on all

*l.ster no/es# service ricci start/tart)ng o>>Ro>: % generat)ng //- *ert)f)*ate(... >oneenerat)ng N// >ataa(e... >one/tart)ng r)**): %

# ch#config ricci on



42/100

2 Conig.re a assor/ or the ricci.ser a**o.nt on all *l.ster no/es +he sae

assor/ ay >e .se/ on all *l.ster no/es to siliy a/inistration

# passwd ricciChang)ng 7a((wor> for :et+7e new 7a((wor>:

7a((w>: a88 a (


43/100

6 +he Create New Cluster/ialog >o' oens as shon in /igure 1%1)'. 7reate ;e"7luster Colete the olloing in the /ialog >o'

5nter the Cluster Name Cl.ster naes are restri*te/ to 1# *hara*ters in length

5na>le the otion JUse the same password for all nodesK

5nter the Node Nameo the irst *l.ster no/e >y se*iying the rivate clusterinterconnect +his ena>les *l.ster *o.ni*ations to r.n over the rivatenetor,

5nter Password Se*iy the assor/ or the riccia**o.nt

5nter Hostname Se*iy the .>li* netor, nae

Sele*t Add Another Nodean/ *olete the iel/s or the other to *l.ster no/es asshon ;hen /one4 ena>le the otion Download Packagesthen sele*t Create Cluster


Figure 4.4-2: Create e# Cluster


44/100

4.4.2 Add Fence Devices&en*ing rovi/es rote*tion against /ata *orr.tion *a.se/ >y .ltile *l.ster no/eseroring si.ltaneo.s 9B( to a share/ storage /evi*e &en*ing /is*onne*ts a *l.ster no/ero the share/ storage /evi*e in the event o a *l.ster a.lt or no/e ail.re

+he riary en*ing etho/ .tiliHe/ >y this reeren*e ar*hite*t.re is 9P:9 over ANA//itional en*ing etho/s *an >e alie/ >ase/ on the reso.r*es availa>le ithin a*o.ting environent &ollo the stes >elo to a// a fence device,fence device instancean/ fence methodto ea*h no/e in the the *l.ster

1 &ro the Manage Clusterss*reen4 sele*t the ha-1e-clusterlin, to oen the *l.sterse*ii* age as shon in /igure 1%1)0. /ene Devies

Un/er the Fence Devicesta> sele*t Add

2 +he Add Fence Device !nstance"/ialog >o' oens as shon in /igure 1%1)1. Selet/ene Devie

9n the# $elect a fence device #/ro-/on4 sele*t !PM! %anthen sele*t $ubmit


Figure 4.4-3: Fence Devices

Figure 4.4-4: Select Fence Device


45/100

% +he Add Fence Device !nstance"/ialog >o' is /islaye/ or the en*e tye !PM! %anColete the olloing in the /igure 1%1)2. Add /ene Devie 3nstane/ialog >o'

5nter a Nameor the 9P:9 an /evi*e instan*e

5nter the !P address or hostname

5nter the %ogin 9 the /evi*e has a /ierent login than the *l.ster no/e se*iyit here

5nter Password 9 the /evi*e has a /ierent assor/ than the *l.ster no/ese*iy it here

9n the Authentication t&pe/ro-/on sele*t Password

5na>le the Use %anplusotion

Sele*t $ubmithen /one

"""%redhat%o( 1& re!arh)!eedbak*redhat%o(

Figure 4.4-5: && Fence Device nstance


46/100

$ A// a en*e /evi*e instan*e or the other *l.ster no/es >y olloing stes 2 an/ %a>ove or ea*h no/e ;hen all instan*es have >een *reate/4 the Fence Devicesta>rese>les /igure 1%1)6. /ene Devie 3nstanes>elo

# Un/er the Nodesta> see /igure 1%1)4. 7luster ;odes >elo sele*t the lin, or theirst *l.ster no/e ha-1e5-ci

re!arh)!eedbak*redhat%o( 1$ """%redhat%o(

Figure 4.4-: Fence Device nstances

Figure 4.4-: Cluster o&es


47/100

6 S*roll /on to the roerties o the *l.ster no/e as shon in /igure 1%1)5. Add /eneMethod Un/er Fence Devicessele*t Add Fence Method

7 +he Add Fence Method 'o Node/ialog >o' /igure 1%1)8. Add /ene Method o;ode-oens F enter Arimaryor the Method Namean/ sele*t $ubmit

"""%redhat%o( 1' re!arh)!eedbak*redhat%o(

Figure 4.4-6: && Fence 0et%o&

Figure 4.4-7: && Fence 0et%o& !o o&e


48/100

8 Un/er the nely *reate/ Primar&en*e etho/4 sele*t Add Fence !nstance/igure1%1)$&. Add /ene 3nstane

9n the Add Fence Device !nstance"/ialog >o' /igure 1%1)$$. Add /ene Devie3nstane4 s*roll /on an/ sele*t the nae o the en*e /evi*e revio.sly *reate/ in

ste % or the irst *l.ster no/e ha-1e5-ci

Sele*t $ubmithen /one

" A// a Arimaryen*e etho/ an/ en*e /evi*e instan*e or the other *l.ster no/es >yolloing stes #4 64 an/ 7 or ea*h no/e


Figure 4.4-18: && Fence nstance

Figure 4.4-11: && Fence Device nstance


49/100

4.4.3 Add Failover Domain+he failover domain/eterines the or/er an/ *hara*teristi*s in hi*h *l.ster e>ersanage the failoveran/ failac(o a *l.ster servi*e &ollo the stes >elo to a// a failoverdomainto the *l.ster

1 Un/er the Failover Domainsta> /igure 1%1)$'. Add /ailover Do(ains ab sele*tAdd

2 9n the Add Failover Domain 'o Cluster/ialog >o' /igure 1%1)$0. Add /ailoverDo(ain o 7luster4 enter the Nameha-1e-failover4 ena>le the otion orPrioriti(edan/ set the e>er riorities as shon Sele*t Createhen /one


Figure 4.4-12: && Failover Doains !ab

Figure 4.4-13: && Failover Doain !o Cluster


50/100


51/100

4.4.4 Add Resources+he highly availa>le e> servi*e reI.ires o.r reso.r*es F IA 3ddress4 23 elo to a// the reI.ire/ e> servi*e reso.r*es to the *l.ster

1 &ro the )esourcesta> /igure 1%1)$2. Add Resoures sele*t Add

2 9n the Add )esource 'o Cluster/ialog >o' /igure 1%1)$6. Selet Resoure ype4s*roll /on an/ sele*t !P Address


Figure 4.4-15: && /esources

Figure 4.4-1: Select /esource !ype


52/100

9n the !P Addressreso.r*e /ialog >o' /igure 1%1)$4. Add 3P Address Resoure4enter the !P address56.59.5/.5B6 to >e .se/ or *onne*tions to the e> servi*e5na>le the otion Monitor linkthen sele*t $ubmit:

% Reeat stes 1 an/ 2 to a// an HA %*Mreso.r*e ha-1e-23-


Figure 4.4-1: && 9 &&ress /esource

Figure 4.4-16: && ;


53/100

$ Reeat stes 1 an/ 2 to a// a Files&stemreso.r*e ha-1e-filesystem ith theotions shon in /igure 1%1)$8. Add /ilesyste( Resoure Cli*, $ubmithen /one

# Reeat stes 1 an/ 2 to a// a $criptreso.r*e ha-1e-apache-script ith the otionsshon in /igure 1%1)'&. Add Sript Resoure Cli*, $ubmithen /one


Figure 4.4-17: && Filesyste /esource

Figure 4.4-28: && Script /esource


54/100

4.4.5 Add Service GroupService "roupsare anage/ >y rgmanageran/ *ontain the reso.r*es nee/e/ to rovi/e

highly availa>le servi*es &ollo the stes >elo to a// a Servicenae/ ha-1e-servicean/ the reso.r*es reI.ire/ >y the e> servi*e to the *l.ster

1 &ro the $ervice +roupsta> /igure 1%1)'$. Add Servie :roup4 sele*t Add

2 +he Add $ervice 'o Cluster/ialog >o' oens /igure 1%1)''. Add Servie o7luster 5nter the $ervice nameha-1e-service an/ ena>le the otions shonSele*t $ubmithen /one


Figure 4.4-21: && Service =roup

Figure 4.4-22: && Service !o Cluster


55/100

% A// the IA 3ddressreso.r*e to the servi*e ha-1e-service >y sele*ting Add)esource4 sele*ting the reso.r*e tye 56.59.5/.5B6ro the /ro-/on an/ sele*ting$ubmitas shon in /igure 1%1)'0. Add Resoure o Servie

Reeat the ro*ess or the reaining three reso.r*es - 23 e in/een/ent an/ have no Child )esourcesasso*iate/ ith it

$ +he e> servi*e ha-1e-service is /islaye/ at the to o the $ervice +roupsta>+he stat.s is liste/ as Unknown.ntil it is starte/ /igure 1%1)'1. Servie :roupStatus ?nkno"n

# Start the e> servi*e >y ena>ling the *he*, >o' ne't to the Nameha-1e-servicean/ sele*ting $tartro the en. Alternatively4 the servi*e *an >e starte/ on ase*ii* no/e >y sele*ting the no/e ro the $tart on node,,,/ro-/on >o' thensele*ting the $tarti*on on the right (n*e a servi*e has >een starte/ the stat.s is

./ate/ as shon in /igure 1%1)'2. Servie :roup Status Running

"""%redhat%o( 2& re!arh)!eedbak*redhat%o(

Figure 4.4-23: && /esource !o Service

Figure 4.4-24: Service =roup Status >n"no#n


56/100

9n the a>ove e'ale4 ha-1e-serviceis r.nning on *l.ster no/e ha-1e$-ci

4.4.6 Verify Cluster Web ServiceVeriy the e> servi*e is r.nning >y oening a >roser in/o onto the e> servi*[email protected]/.5B6*cgi-in*23-4e-Status an/ r.nning the test s*rit /igure 1%1)'6. HA)Web)Status


Figure 4.4-25: Service =roup Status /unning

Figure 4.4-2: -Web-Status


57/100

$.( )luster )reation via ))S+he ccsCl.ster Conig.ration Syste *oan/ line intera*e allos a/inistrators to

*reate4 o/iy an/ vie a *l.ster *onig.ration ile on a reote no/e thro.gh the ricci

servi*e or on a lo*al ilesyste Using ccsan a/inistrator *an also start4 sto an/ relo*ate

*l.ster servi*es on one or ore *l.ster no/es9n the rior se*tions4 the *l.ster anageent server an/ *l.ster no/es ere .lly /eloye/Do not ro*ee/ ith *reating the *l.ster via CCS .ntil these tas,s have >een .lly *olete/

Cl.ster :anageent Station ha-1e-mgmt


Conig.re Netor,s

Conig.re &ireall

9nstall Cl.ster :anageent Sotare J3igh Availa>ility :anageentK A//-(n

Cl.ster No/es ha-1e54 ha-1e$4 ha-1e/ 9nstall Re/ 3at 5nterrise in.' 6


Conig.re &ireall


Conig.re Storage


+he ne't se*tions /es*ri>e the stes involve/ in *reating a *l.ster ro the ccs*oan/

line intera*e

4.5.1 Create Cluster

Cl.ster *reation is erore/ ro the *l.ster anageent server ha-1e-mgmt an/./ates are /eloye/ to the *l.ster no/es a*ross the .>li* netor, intera*es +he ro*essinvolves *reating a .ll *l.ster *onig.ration ile *etc*cluster*cluster.conf on one no/e ha-1e5-ci then /istri>.ting the *onig.ration an/ a*tivating the *l.ster on the reaining no/esCl.ster inter*onne*ts are se*iie/ ithin the *onig.ration ile or all no/e *o.ni*ations

Conig.re the aroriate *l.ster servi*es then *reate the *l.ster

1 Start the ricciservi*e an/ *onig.re to start on syste >oot Peror this ste on all*l.ster no/es

# service ricci start# ch#config ricci on

2 Conig.re a assor/ or the ricci.ser a**o.nt on ea*h no/e +he sae assor/

ay >e .se/ on all *l.ster no/es to siliy a/inistration

# passwd ricci



58/100

% Create a *l.ster nae/ ha-web-clusterro the *l.ster anageent server

ha-1e-mgmt%@

# ccs --host ha-web8 --createcluster ha-web-clusterha@we1 7a((wor>: AAAAAAA

4.5.2 Add Nodes(n*e the *l.ster has >een *reate/4 se*iy the e>er no/es in the *l.ster *onig.ration

1 A// the three *l.ster no/es ha-1e5-ci, ha-1e$-ci, ha-1e/-ci to the *l.sterPeror this ste ro the *l.ster anageent server ha-1e-mgmt

# ccs --host ha-web8 --addnode ha-web8-ci nodeid=787No>e ha@we1@*) a>>e>.# ccs --host ha-web8 --addnode ha-web2-ci nodeid=727No>e ha@we2@*) a>>e>.# ccs --host ha-web8 --addnode ha-web&-ci nodeid=7&7No>e ha@we3@*) a>>e>.

4.5.3 Add Fence DevicesA// the en*e etho/ then a// /evi*es an/ instan*es or ea*h *l.ster no/e to the etho/9P:9 AN en*ing is .se/ in this *onig.ration (ther en*ing etho/s an/ /evi*es *an >e.se/ /een/ing on the reso.r*es availa>le Peror all stes ro the *l.ster anageentserver ha-1e-mgmt%.

1 A// a en*e etho/ or the Priary en*ing /evi*es

# ccs --host ha-web8 --addmethod ,rimar! ha-web8-ciMetho> 'r)ar+ a>>e> to ha@we1@*).# ccs --host ha-web8 --addmethod ,rimar! ha-web2-ciMetho> 'r)ar+ a>>e> to ha@we1@*).# ccs --host ha-web8 --addmethod ,rimar! ha-web&-ciMetho> 'r)ar+ a>>e> to ha@we1@*).

2 A// a en*e /evi*e or the 9P:9 AN /evi*e

# ccs --host ha-web8 --addfencedev +,(+-ha-web8-ci agent=fence_ipmilan auth=password ipaddr=80*86*84&*2&8 lanplus=on login=root name=+,(+-ha-web8-ci passwd=password

power_wait=; timeout=20# ccs --host ha-web8 --addfencedev +,(+-ha-web2-ci agent=fence_ipmilan auth=password ipaddr=80*86*84&*2&2 lanplus=on login=root name=+,(+-ha-web2-ci passwd=password

power_wait=; timeout=20# ccs --host ha-web8 --addfencedev +,(+-ha-web&-ci agent=fence_ipmilan auth=password ipaddr=80*86*84&*2&& lanplus=on login=root name=+,(+-ha-web&-ci passwd=password

power_wait=; timeout=20



59/100

% A// a en*e instan*e or ea*h no/e to the Priary en*e etho/

# ccs --host ha-web8 --addfenceinst +,(+-ha-web8-ci ha-web8-ci ,rimar!# ccs --host ha-web8 --addfenceinst +,(+-ha-web2-ci ha-web2-ci ,rimar!# ccs --host ha-web8 --addfenceinst +,(+-ha-web&-ci ha-web&-ci ,rimar!

4.5.4 Add Failover Domain+he ailover /oain se*iies the e>ershi an/ ailover *hara*teristi*s or no/es rovi/inga *l.ster servi*e :.ltile ailover /oains *an >e *reate/ to rovi/e /ierent ailover*hara*teristi*s or /ierent *l.ster servi*es

1 A// a ailover /oain an/ a// the *l.ster no/es to it Se*iy ro.n/-ro>in ailoverstarting ith no/e14 olloe/ >y no/e2 then no/e% Peror these tas,s ro the*l.ster anageent server ha-1e-mgmt%@

# ccs --host ha-web8 --addfailoverdomain ha-web-failover ordered# ccs --host ha-web8 --addfailoverdomainnode ha-web-failover ha-web8-ci 8# ccs --host ha-web8 --addfailoverdomainnode ha-web-failover ha-web2-ci 2

# ccs --host ha-web8 --addfailoverdomainnode ha-web-failover ha-web&-ci &

4.5.5 Add ResourcesDeine ea*h o the reso.r*es that *orise the *l.ster e> servi*e +he olloing reso.r*esare reI.ire/ or *onig.ring a highly availa>le e> servi*e

9P A//ress

3A V:

&ilesyste

S*rit

Peror all stes ro the *l.ster anageent server ha-1e-mgmt

1 A// the 3P Addressreso.r*e 1#$1%$1&'$1(# to the *l.ster *onig.ration +his

reso.r*e rovi/es reote *lient a**ess to the e> servi*e ha-web-service an/

*ontent

# ccs --host ha-web8 --addresource ip address=80*86*84&*8;0 monitor_lin#=on sleeptime=80

2 A// the HA L#Mreso.r*e ha-web-HA-LV) to the *l.ster *onig.ration +his

reso.r*e is resonsi>le or ena>ling an/ /isa>ling e'*l.sive a**ess to the 3A-V:

vol.e a*ross *l.ster no/es# ccs --host ha-web8 --addresource lvm lv_name=ha-web-lvol8 name=ha-web--L@( self_fence=on vg_name=-?eb-@A



60/100

% A// the /ilesyste(reso.r*e ha-web-*ilesystem to the *l.ster *onig.ration

+his reso.r*e is resonsi>le or the o.nting an/ .no.nting o the 3A-V: vol.e

# ccs --host ha-web8 --addresource fs device=%dev%-?eb-@A%ha-web-lvol8

fsid=;64&2 fst!pe=e"t4 mountpoint=%ha%ha-web name=ha-web-files!stem self_fence=on

$ A// the Sriptreso.r*e ha-web-apache-script to the *l.ster *onig.ration +his

reso.r*e is resonsi>le or the starting an/ stoing o the Aa*he httpd e>

server

# ccs --host ha-web8 --addresource script file=%etc%init*d%httpd name=ha-web-apache-script

4.5.6 Add Service GroupServi*e gro.s are *olle*tions o reso.r*es that siliy the anageent o highly availa>le*l.ster servi*es

1 Create a servi*e gro. ha-web-service or the e> servi*e an/ a// the reI.ire/

reso.r*es +,G -L@(G Hiles!stemG Fcript to it

# ccs --host ha-web8 --addservice ha-web-service domain=ha-web-failover ma"_restarts=& name=ha-web-service recover!=restart restart_e"pire_time=&600

# ccs --host ha-web8 --addsubservice ha-web-service ip ref=80*86*84&*8;0# ccs --host ha-web8 --addsubservice ha-web-service lvm ref=ha-web--L@(# ccs --host ha-web8 --addsubservice ha-web-service fs ref=ha-web-files!stem# ccs --host ha-web8 --addsubservice ha-web-service script ref=ha-web-apache-script

4.5.7 Activate Cluster(n*e the *l.ster has >een *reate/4 the *onig.ration nee/s to >e a*tivate/ an/ the *l.sterstarte/ on all no/es

1 Syn*hroniHe an/ a*tivate the *l.ster *onig.ration a*ross all no/es

# ccs --host ha-web8 --s!nc --activateha@we2@*) 7a((wor>:

# ccs --host ha-web8 --chec#conf!88 no>e( )n (+n*.



61/100

2 Start the *l.ster servi*es on all no/es

# ccs --host ha-web8 --startall/tarte> ha@we2@*)/tarte> ha@we3@*)/tarte> ha@we1@*)

4.5.8 Verify Cluster Web Service1 Veriy the *l.ster e> servi*e is availa>le ro one o the *l.ster no/es ha-1e5-ci

# clustatC8 server


Figure 4.5-1: -Web-Status
https://10.16.143.150/cgi-bin/HA-Web-Statushttps://10.16.143.150/cgi-bin/HA-Web-Status


62/100

5 Cluster Management+he revio.s se*tions o this reeren*e ar*hite*t.re /etaile/ the /eloyent an/ *onig.rationtas,s asso*iate/ ith /eloying a highly availa>le e> servi*e .sing the 3igh Availa>ilityA//-(n or Re/ 3at 5nterrise in.' +he olloing se*tions o*.s on the ost *oon*l.ster anageent tas,s .sing >oth the Conga =U9 an/ CCS C9 intera*es

+o no/e *l.sters are a se*ial *ase s*enario reI.iring a *l.ster restart an/ >rieservi*e /ontie to a*tivate the *hange in e>ershi hen a//ing 2 - % orreoving % - 2 a no/e Conga ili*itly han/les the restart hile CCS reI.ires aan.al restart )oth etho/s are /eonstrate/ ithin the se*tions that ollo/es*ri>ing the a//ing an/ reoval o *l.ster no/es

(.1 Adding )luster Nodes7onga :etho/ 1

+he olloing stes /es*ri>e the ro*ess o a//ing a ne no/e ha-1e/-ci to an e'istingto no/e *l.ster .sing Conga an/ the lucie> intera*e

1 (en the lucie> intera*ean/ login .sing the roota**o.nt Un/er the Nodesta>

sele*t Add/igure 2%$)$. Add ;odes ab


Figure 5.1-1: && o&es !ab


63/100

2 9n the Add Nodes 'o Cluster/ialog >o'4 a// the ne no/e to the *l.ster as shon in/igure 2%$)'. Add ;odes o 7luster>elo Se*iy the rivate cluster interconnectnae or Node Name Sele*t Add Nodeshen /one

% Ater the no/e has >een a//e/ an/ the *l.ster *onig.ration ./ate/4 the Nodesta>rese>les /igure 2%$)0. 7luster ;odes ab ) ;e" ;ode Added>elo

Conig.re en*ing Setion 1%1%' Add /ene Devies an/ a// the no/e to thefailover domainSetion 1%1%0 Add /ailover Do(ain to *olete the no/e a//ition


Figure 5.1-2: && o&es !o Cluster

Figure 5.1-3: Cluster o&es !ab - e# o&e &&e&


64/100


65/100

# Proagate the *hange to all *l.ster e>ers an/ start the *l.ster servi*es A >rie/ontie is reI.ire/ to allo the *l.ster no/es to syn*hroniHe an/ a*tivate the*hange +his *an >e r.n ro any *l.ster no/e or the anageent server

# ccs --host ha-web8 --stopall# ccs --host ha-web8 --s!nc --activate

# ccs --host ha-web8 --chec#conf!88 no>e( )n (+n*.# ccs --host ha-web8 --startall/tarte> ha@we2@*)/tarte> ha@we3@*)/tarte> ha@we1@*)

6 Veriy the ne *l.ster stat.s ro any no/e

# clustatC8


66/100


67/100

% +he Nodeta> rele*ts the *hange in *l.ster e>ershi /igure 2%')0. ;ode )Re(oval 7o(plete

+his *oletes the reoval o a no/e .sing Conga an/ the lucie> intera*e


Figure 5.2-2: o&e - Delete

Figure 5.2-3: o&e - /eoval Coplete


68/100

77S:etho/ 2

As an alternative4 *l.ster no/es *an >e reove/ .sing CCS +he olloing stes /es*ri>e thero*ess o reoving one no/e ha-1e/-ci ro a r.nning *l.ster

1 Veriy the *.rrent *l.ster stat.s ro any no/e

# clustatC8e r.n ro

any *l.ster no/e >.t here no/e ha-1e$-ciis .se/

# clusvcadm -r ha-web-service -m ha-web8-ci&r+)ng to re8o*ate (er)*e:ha@we@(er)*e to ha@we1@*).../


69/100

% Sto the *l.ster servi*es on the no/e ha-1e/-cian/ veriy the stat.s +his *an >e r.nro any *l.ster no/e

# ccs --host ha-web&-ci --stop

# clustat

C8rie /ontie is reI.ire/ to allo the *l.sterno/es to syn*hroniHe an/ a*tivate the *hange +his *an >e r.n ro any *l.ster no/eor the anageent server

# ccs --host ha-web8 --rmnode ha-web&-ci# ccs --host ha-web8 --setcman two_node=8 e"pected_votes=8# ccs --host ha-web8 --stopall# ccs --host ha-web8 --s!nc --activate# ccs --host ha-web8 --chec#conf!88 no>e( )n (+n*.

# A*tivate the ne 2-no/e *l.ster *onig.ration +he *l.ster servi*es .st >e restarte/hen /onsiHing to a to no/e *l.ster *onig.ration +his *an >e r.n ro any *l.sterno/e or the anageent server

# ccs --host ha-web8 --startall/tarte> ha@we2@*)/tarte> ha@we1@*)

6 Renae the *l.ster *onig.ration ile on ha-e>%-*i to revent it ro >einga**i/entally @oine/ to the *l.ster >y a**i/ent

# mv %etc%cluster%cluster*conf %etc%cluster%cluster*conf*disabled-0-21-88



70/100

(.3 Relo+ating )luster *e Servi+es

7onga:etho/ 1

+he olloing stes /es*ri>e the ro*ess o relo*ating a r.nning *l.ster e> servi*e ha-1e-service ro one *l.ster no/e to another .sing Conga an/ the lucie> intera*e

1 (en the lucie> intera*ean/ login .sing the roota**o.nt Un/er the $ervice

+roupsta> /igure 2%0)$. Web Servie Status sele*t the lin, or the ha-1e-service

(ening a >roser on the the *l.ster stat.s age also shos the e> servi*e asr.nning on no/e ha-1e5/igure 2%0)'. Web Servie


71/100

2 Relo*ate the *l.ster e> servi*e to another *l.ster no/e >y irst sele*ting ha-1e$-ciro the no/e /ro-/on list /igure 2%0)0. Web Servie Reloate A*tivate the*hange >y sele*ting the start i*on to the right

% +he $ervice +roupsta> is ./ate/ to rele*t the *hange in servi*e lo*ation /igure 2%0)

1. Web Servie Reloated


Figure 5.3-3: Web Service /elocate

Figure 5.3-4: Web Service /elocate&


72/100

Rereshing the *l.ster stat.s age *onirs the e> servi*e is no r.nning on *l.sterno/e ha-1e$ /igure 2%0)2. Web Servie Status A!ter Reloate


Figure 5.3-5: Web Service Status fter /elocate


73/100

77S:etho/ 2

As an alternative4 *l.ster e> servi*es *an >e relo*ate/ ro one *l.ster no/e to anotherro the *oan/ line Any *l.ster no/e *an >e .se/ to relo*ate a servi*e +he olloingstes /eonstrate ho to relo*ate the *l.ster e> servi*e ha-web-service ro no/e

ha-1e$-cito no/e ha-1e5-ci.sing the *l.ster servi*e a/inistration clusvcadm tool on

no/e ha-1e/-ci

1 Veriy the *l.ster stat.s an/ *.rrent lo*ation o the e> servi*e ro no/e ha-1e/-ci

# clustatC8


74/100

(.$ ,en+ing )luster Nodes

&en*ing a no/e *an >e /one to test the en*ing etho/ in .se (nly one *l.ster no/e at atie sho.l/ >e en*e/ to revent otential loss o I.or. 9n the olloing stes4 9P:9 ANen*ing is teste/ >y en*ing no/e1 ha-1e5-ci an/ or*ing the e> servi*e to relo*ate Sin*e

the en*ing >riely oers /on no/e1 all en*ing an/ stat.s *oan/s sho.l/ >e r.n roeither no/e2 ha-1e$-ci or no/e% ha-1e/-ci +he en*ing o no/es *an only >eerore/ ro the *oan/ line C9

1 Veriy the *.rrent stat.s o the e> servi*e ha-1e-service ro no/e% ha-1e/-ci

# clustatC8 7ower,wa)t=5t)eo1-*i has .lly restarte/

# clustatC8


75/100


76/100

(.( /'porting a )luster9orting a *l.ster is .se/ hen a *onig.ration e'ists >.t the Conga luci anageent

intera*e has not iorte/ the *onig.ration into the internal luci/ata>ase 9n sit.ations

here CCS as .se/ to >.il/ a *l.ster4 luciinitially is not aare o the *l.ster .ntil the

*onig.ration has >een iorte/ Peror the olloing stes to iort a *l.ster into the luciintera*e

1 (en the lucie> intera*ean/ login .sing the roota**o.nt Un/er Manage Clusters

sele*t Add/igure 2%2)$. 7luster 3(port

2 +he Add -.isting Cluster/ialog >o' oens Po.late the iel/s as shon >elo in/igure 2%2)'. Add Existing 7luster Sele*t Add Clusterhen *olete


Figure 5.5-1: Cluster port

Figure 5.5-2: && @$isting Cluster


77/100

% +he 3oe>ase *onirs the iort as s.**ess.l /igure 2%2)0. 7luster 3(portSuess!ul

$ +he *l.ster is no iorte/ an/ *an >e anage/ thro.gh the luciintera*e /igure

2%2)1. 7luster ;ode Status


Figure 5.5-3: Cluster port Successful

Figure 5.5-4: Cluster o&e Status


78/100

6 ConclusionRe/ 3atGs 3igh Availa>ility A//-(n or Re/ 3at 5nterrise in.' 6 is Re/ 3atGs reier*l.stering sol.tion +he 3igh Availa>ility A//-(n rovi/es relia>ility4 availa>ility an/ s*ala>ilityRAS to *riti*al ro/.*tion servi*es >y eliinating single oints o ail.re an/ rovi/inga.toati* failovero those servi*es in the event o a *l.ster no/e ail.re or error *on/ition

+his reeren*e ar*hite*t.re /etaile/ the /eloyent4 *onig.ration an/ anageent o ahighly availa>le e> servi*e .sing the 3igh Availa>ility A//-(n or Re/ 3at 5nterrise in.'A three no/e *l.ster as /eloye/ an/ *onig.re/ to .se a highly availa>le V: 3A-V:vol.e or the *l.ster e> servi*e *ontents A /e/i*ate/ anageent station as /eloye/to anage an/ *onig.re the *l.ster +his *onig.ration *an >e s*ale/ o.t >y a//ing ore*l.ster no/es or *onig.re/ to r.n other *l.ster servi*es as reI.ire/ to >est eet the nee/so se*ii* *o.ting environents

Cl.ster *reation an/ anageent as /eonstrate/ .sing >oth Conga an/ the luci

grahi*al .ser intera*e =U94 an/ the Cl.ster Conig.ration Syste CCS *oan/ line

intera*e C9 )oth etho/s *an >e .se/ inter*hangea>ly to *reate4 *onig.re an/ anagea *l.ster

+he ost *oon *l.ster anageent tas,s a//ing4 reoving no/es4 relo*ating *l.sterservi*es4 en*ing no/es4 iorting an e'isting *l.ster ere also /eonstrate/



79/100

Appendix A: References

1 Re/ 3at 5nterrise in.' 6 9nstallation =.i/e9nstalling Re/ 3at 5nterrise in.' 6 or all ar*hite*t.res

5/ition 10

httBB/o*sre/hat*oB/o*sBen-USBRe/3at5nterrisein.'B6B/B9nstallation=.i/eBRe/3at5nterrisein.'-6-9nstallation=.i/e-en-US/

2 Re/ 3at 5nterrise in.' 6 Deloyent =.i/eDeloyent4 Conig.ration an/ A/inistration o Re/ 3at 5nterrise in.' 6

5/ition 10httBB/o*sre/hat*oB/o*sBen-USBRe/3at5nterrisein.'B6B/BDeloyent=.i/eBRe/3at5nterrisein.'-6-Deloyent=.i/e-en-US/

% Re/ 3at 5nterrise in.' 6 Virt.aliHation =.i/e=.i/e to Virt.aliHation on Re/ 3at 5nterrise in.' 6

5/ition %2httBB/o*sre/hat*oB/o*sBen-USBRe/3at5nterrisein.'B6BhtlBVirt.aliHationBin/e'htl

$ Re/ 3at 5nterrise in.' 6 Cl.ster A/inistrationConig.ring an/ :anaging the 3igh Availa>ility A//-(n

httBB/o*sre/hat*oB/o*sBen-USBRe/3at5nterrisein.'B6B/BCl.sterA/inistrationBRe/3at5nterrisein.'-6-Cl.sterA/inistration-en-US/

# Re/ 3at 5nterrise in.' 6 ogi*al Vol.e :anager A/inistrationV: A/inistrator =.i/e

httBB/o*sre/hat*oB/o*sBen-USBRe/3at5nterrisein.'B6B/B

ogi*alVol.e:anagerA/inistrationBRe/3at5nterrisein.'-6-ogi*alVol.e:anagerA/inistration-en-US/

6 Re/ 3at 5nterrise in.' 6 D: :.ltiathD: :.ltiath Conig.ration an/ A/inistration

httBB/o*sre/hat*oB/o*sBen-USBRe/3at5nterrisein.'B6B/BD::.ltiathBRe/3at5nterrisein.'-6-D::.ltiath-en-US/

7 J;hat is a 3ighly Availa>le V: 3A-V: *onig.ration an/ ho /o 9 ileent itTKRe/ 3at Qnole/ge )ase Arti*le - Q)%068httsBBa**essre/hat*oB,>B/o*sBD(C-%068

8 JUsing SCS9 Persistent Reservations ith Re/ 3at 5nterrise in.' 6ith the 3igh Availa>ility A//-(nKRe/ 3at Qnole/ge )ase Arti*le F Q)$%07"httsBBa**essre/hat*oB,>B/o*sBD(C-$%07"

http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Installation_Guide/Red_Hat_Enterprise_Linux-6-Installation_Guide-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Installation_Guide/Red_Hat_Enterprise_Linux-6-Installation_Guide-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Deployment_Guide/Red_Hat_Enterprise_Linux-6-Deployment_Guide-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Deployment_Guide/Red_Hat_Enterprise_Linux-6-Deployment_Guide-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Virtualization/index.htmlhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Virtualization/index.htmlhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Cluster_Administration/Red_Hat_Enterprise_Linux-6-Cluster_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Cluster_Administration/Red_Hat_Enterprise_Linux-6-Cluster_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Logical_Volume_Manager_Administration/Red_Hat_Enterprise_Linux-6-Logical_Volume_Manager_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Logical_Volume_Manager_Administration/Red_Hat_Enterprise_Linux-6-Logical_Volume_Manager_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Logical_Volume_Manager_Administration/Red_Hat_Enterprise_Linux-6-Logical_Volume_Manager_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/DM_Multipath/Red_Hat_Enterprise_Linux-6-DM_Multipath-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/DM_Multipath/Red_Hat_Enterprise_Linux-6-DM_Multipath-en-US.pdfhttps://access.redhat.com/kb/docs/DOC-3068https://access.redhat.com/kb/docs/DOC-43079http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Installation_Guide/Red_Hat_Enterprise_Linux-6-Installation_Guide-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Installation_Guide/Red_Hat_Enterprise_Linux-6-Installation_Guide-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Deployment_Guide/Red_Hat_Enterprise_Linux-6-Deployment_Guide-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Deployment_Guide/Red_Hat_Enterprise_Linux-6-Deployment_Guide-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Virtualization/index.htmlhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Virtualization/index.htmlhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Cluster_Administration/Red_Hat_Enterprise_Linux-6-Cluster_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Cluster_Administration/Red_Hat_Enterprise_Linux-6-Cluster_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Logical_Volume_Manager_Administration/Red_Hat_Enterprise_Linux-6-Logical_Volume_Manager_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Logical_Volume_Manager_Administration/Red_Hat_Enterprise_Linux-6-Logical_Volume_Manager_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/Logical_Volume_Manager_Administration/Red_Hat_Enterprise_Linux-6-Logical_Volume_Manager_Administration-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/DM_Multipath/Red_Hat_Enterprise_Linux-6-DM_Multipath-en-US.pdfhttp://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/DM_Multipath/Red_Hat_Enterprise_Linux-6-DM_Multipath-en-US.pdfhttps://access.redhat.com/kb/docs/DOC-3068https://access.redhat.com/kb/docs/DOC-43079


80/100

Appendix B: Red Hat Enterprise Linux 6

Satellite Configuration Details+he /eloyent o Re/ 3at 5nterrise in.' 6 on the *l.sters no/es as /one .sing a lo*al

Satellite server *onne*te/ to Re/ 3at Netor, R3N +he olloing stes /es*ri>e*onig.ring the Satellite server in rearation o the *l.ster no/e /eloyents

1 (en the Satellite server e> intera*e an/ login /igure $. Satellite @vervie"


Figure 1: Satellite Avervie#


81/100

2 Create an A*tivation Qey Un/er the $&stemsta> sele*t Activation /e&s/igure '.Ativation eys

Sele*t create new ke&


Figure 2: ctivation Beys


82/100

% +he Create Activation /e&s*reen is /islaye/ /igure 0. Ativation ey DetailsColete the iel/s as shon or Description4 /e&4 0ase Channels4 Add12n-ntitlements eave all other iel/s as /ea.lts

Sele*t Create Activation /e&hen /one


Figure 3: ctivation Bey Details


83/100


84/100

# Create a Qi*,start roile Un/er the $&stemsta> sele*t /ickstart/igure 2. 7reate;e" ikstart Pro!ile

Sele*t create new kickstart profile.


Figure 5: Create e# Bic"start 9rofile

8/12/201

[중요] deploying a highly available web server on red hat enterprise linux 6

Documents