sles11!#$%virtualtech.jp/download/090822sles11ha.pdf · É˚›¸ÌŁŒ! •! os:suse linux...

SLES11!"#$%

Xen&'(+HA)*+,-.!

/0&'(123456789:;<6=>CEO

?@A*B7CDEFD

GH7I

[email protected]

JKLMNO3456

/0&'(1234567PQ!

•! 6RL/0&'(123456 –! STRLVirtualTech Japan Inc.

–! UVL/0&'(12WVTJ

•! XYL2006Z12[

•! \0]L14,250,000^

•! 06L_`abcdbc1-1-10

•! :;<LGH7Ie89:;<6=>CEOf •! gh7ije:;<CTOf •! +,klL8Remno5.5Rp&'(12q.rstuv!$f •! URLLhttp://VirtualTech.jp/

•! &'(12wx$%EFyz{|} –! &'(12wx$%~��

–! &'(12wx��l��v�|}

–! &'(12��-��+��"#!

/0��Y�

&'(12q�56e�6��f!

2

�-!

&'(��"#��,O��!

X�!•! X�

–! ��o+��t��Ak��) !v¡¢£��¤s !¥¦��X�

–! §¨©��ª¡*sus«eNs¬�)f

•! �-

–! &'(�¢®��¤s©k£�t�¯°

–! &'(±²eP2V�@��³«��¤sf

•! ´µ¶·

–! rstuv¸¹!

–! 12��¯°

–! Xen��+º�»�NO��!

´µ¶·!

3 Ns¼�u®��*O½�s+�k¡¾��¿¯°!

High Availability Extension7PQ!

•! SUSE Linux Enterprise 11!�HAeHigh

Availabilityf��"#��À�ÁÂ©k£�t

•! OpenAIS�N�+

•! DRBDyz{OCFS2��

•! GUI!XÃÄÅpÆÇ!

È!

ÉÊ�ËÌ��!

•! OS:SUSE Linux Enerprise 11eÍÎ SLES 11f

–!ÏÅÐXenÑÒ³s+��OwÓÔ

•! ÁÂ�l�LSUSE Linux Enterprise 11 High

Availability ExtensioneÍÎ SLES 11 HAEf

–!³?�tlÕ³O�~Ö+�wº×��ØyÙ

•! HA��Ú¡*³¢/ÛÜs¼¢"Ý!"#

–!¡*³¢/¡*³¢ÚÞËÌ

–!ßà!á%eÚâãf

ä!

HA��"#åæ!

1.! SLES 11 HAE�³s+��O

2.! /etc/hosts!�Ö+�RXÃ

3.! NTP�çµ��Ö+�è�éêëì

4.! OpenAIS�)*+,XÃ

5.! DRBDXÃ

6.! )*+,¢��+í�DRBDîïÁÂ

7.! &'�seÍÎvmfðÝ

8.! )*+,¢��+í�vmÁÂ!

ñ!

SLES 11 HAE³s+��O!

1.! òÀ SLES 11�³s+��Oóª+)ô�ÙÚISO³?�t�µõ�ØyÙ

2.! [YaST]![�l��v]![v»ös÷ø]�)¢k)

3.! v»ösÁÂ��ªù�»púû$%�!oüýwþÿØð��!À%

4.! "#��l��v�ÁÂ![$Æµ%]pÁÂ&'Ø(%�!¬�k)�-'Ø)*

5.! ³s+��O+#wSLES 11�³s+��Oóª+)�Q,&'%�!oóª+)�-'%�ISO³?�t�üÃ�Ø)*

-!

R./0�XÃ!

xen1yz{xen2!XÃ

1.! [YaST]![Ak��)��1+]![Ö+�R]�úû

2.! [ÁÂ]�)¢k)

3.! IPv»�+¾Ö+�R¾Ö+��r³¢v+�-K

–! 192.168.0.1 xen1.example.com xen1

–! 192.168.0.2 xen2.example.com xen2

2!

NTP��XÃ!

xen1!XÃ

1.! [YaST]![Ak��)��1+]![NTP��XÃ]�úû

2.! NTPó�3s��+��úûéw|4$%zmXÃ

3.! ëì,³¡56�[Undisciplined Local Clock(LOCAL)]�78

4.! [9:]!;�ÜO<=);k)�XÃ

5.! [»*³��>]![Stratum]�5wÓÔ!

?!

NTP)*³vs�XÃ!

xen2!XÃ

1.! [YaST]![Ak��)��1+]![NTP

��XÃ]�úû

2.! NTPó�3s��+��úûéw|4$%zmXÃ

3.! [ÁÂ]!ëì@A�XÃw[��]�¬�k)�oxen1�v»�+�-K

BC!

OpenAISÛk�vk¡e¡*³¢f!

xen1!XÃ

1.! [YaST]![DEF�O]![)*+,]�úû

2.! [Communication Channel]!çµ$%)*+,M�»�Ak��)v»�+oO¬§¨+�v»�+oO¬§¨+��XÃ –! Bind Network AddressL192.168.0.0

–! Multicast AddressL224.0.0.1

–! Multicast PortL5405

3.! M�»�IDw1�XÃ

4.! rrp mode�activewXÃ!

BB!

OpenAISÛk�vk¡eÛÜs¼¢f7!

xen2!XÃ

1.! [YaST]![DEF�O]![)*+,]�úû

2.! [Communication Channel]!çµ$%)*+,M�»�Ak��)v»�+oO¬§¨+�v»�+oO¬§¨+��XÃ –! Bind Network AddressL192.168.0.0

–! Multicast AddressL224.0.0.1

–! Multicast PortL5405

3.! M�»�IDw2�XÃ

4.! rrp mode�passivewXÃ!

BG!

)*+,�úû¾H)!

¡*³¢/ÛÜs¼¢IJ!XÃ

1.! KL�úû

2.! M�ù�haclusterw©+��»�XÃ –! xen1# passwd hacluster

–! xen2# passwd hacluster

3.! IJ�Ö+��KLzNÍÎ�ºs»!)*+,�úû –! xen1# service openais start

–! xen2# service openais start

4.! ¡*³¢Ö+�!)*+,�GUIXÃF�O�úû –! xen1# crm_gui &

5.! Connection!)*+,wH) –! Server:127.0.0.1

–! User NameLhacluster

–! PasswordLXÃ��©+��»

BO!

)*+,�P0XÃ!

1.! )*+,XÃF�O�QwR%[CRM

Config]�)¢k)

2.! [No Quorum Policy]XÃ�[ignore]wÓÔ

–!DRBD�Sµ�o)T�*��Sµ�½(�À

3.! [Stonith Enabled]�¬�k)�U$

–!STONITH�çV½(�À!

BÈ!

DRBDµîï�W¶!

•! [YaST]!]�+��]![óª+)�àX]�úû

•! LVMµ©��ª�¤s�ÁÂ

•! B¢®��ÄÅ!YÅB¢®��ÁÂ

–!B¢®��«O�¡lv4drbd�ÁÂ

–!YÅB¢®��vmconfigZvmimages�ÁÂ

–! /dev/lv4drbd/vmconfig 3GB

–! /dev/lv4drbd/vmimages 40GB!

Bä!

DRBD�XÃ(vmconfig)!

•! [YaST]![DEF�O]![Drbd]�úû

•! ��+XÃ�78�oAdd�)¢k)

•! DRBD¢��+vmconfig�ÁÂ

Node 1! Node 2!

\[R! vmconfig!

Name! xen1! xen2!

Address:Port! 192.168.0.1:7789! 192.168.0.2:7789!

Device! /dev/drbd0! /dev/drbd0!

Disk! /dev/lv4drbd/vmconfig! /dev/lv4drbd/vmconfig!

Meta-disk! internal! internal!

Syncer Rate! 500M(Advanced Config!XÃ�½(Z250KB)!Bñ!

DRBD�XÃ(vmimages)!

•! DRBD¢��+vmimages�ÁÂ

Node 1! Node 2!

\[R! vmimages!

Name! xen1! xen2!

Address:Port! 192.168.0.1:7790! 192.168.0.2:7790!

Device! /dev/drbd1! /dev/drbd1!

Disk! /dev/lv4drbd/vmimages! /dev/lv4drbd/vmimages!

Meta-disk! internal! internal!

Syncer Rate! 500M(Advanced Config!XÃ�½(Z250KB)!

B-!

DRBD�úû!

¡*³¢/ÛÜs¼¢!DRBD�úû

1.! ¡*³¢��ÛÜs¼¢w/etc/drbd.conf�º×�

2.! KL�úû

3.! DRBD�úû –! xen1# service drbd start

–! xen2# service drbd start

4.! ?,ó�,�ðÝ –! xen1# drbdadm create-md vmconfig

–! xen1# drbdadm create-md vmimages

–! xen2# drbdadm create-md vmconfig

–! xen2# drbdadm create-md vmimages

B2!

DRBD¢��+��ì(!

1.! ¡*³¢!DRBD¢��+��ì( –! xen1# drbdadm -- --overwrite-data-of-peer primary all

2.! DRBD�\]pUpToDatew½%��W^ –! xen1# service drbd status

–! xen2# service drbd status

3.! ¡*³¢!/dev/drbd0yz{/dev/drbd1��ì( –! xen1# mkfs –t xfs /dev/drbd0

–! xen1# mkfs –t xfs /dev/drbd1

4.! ¡*³¢/ÛÜs¼¢IJ!DRBD�ó�3s�_` –! )*+,¢��+Z�Øúû&a%�À

–! # service drbd stop

B?!

DRBD�)*+,¢��+wÁÂ!

1.! ¡*³¢Ö+��KLzNCUI)*+,XÃF�O�úû

–! # crm config

2.! DRBD�)*+,¢��+wÁÂ

–!º×b!c�de

–! 1*�f'gphi�wjõ!

GC!

vmconfigµXÃkl!

•! primitive vmconfig ocf:heartbeat:drbd params drbd_resource=vmconfig op monitor role=Master interval=60s timeout=30s op monitor role=Slave interval=60s timeout=30s

•! ms ms-vmconfig vmconfig meta clone-max=2 notify=true globally-unique=false target-role=stopped

•! primitive fs-vmconfig ocf:heartbeat:Filesystem params fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta target-role=stopped

•! order ms-vmconfig-before-fs-vmconfig mandatory: ms-vmconfig:promote fs-vmconfig:start

•! colocation fs-vmconfig-on-ms-vmconfig inf: fs-vmconfig ms-vmconfig:Master

•! commit

•! quit

GB!

vmimagesµXÃkl!

•! primitive vmimages ocf:heartbeat:drbd params drbd_resource=vmimages op monitor role=Master interval=60s timeout=30s op monitor role=Slave interval=60s timeout=30s

•! ms ms-vmimages vmimages meta clone-max=2 notify=true globally-unique=false target-role=stopped

•! primitive fs-vmimages ocf:heartbeat:Filesystem params fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta target-role=stopped

•! order ms-vmimages-before-fs-vmimages mandatory: ms-vmimages:promote fs-vmimages:start

•! colocation fs-vmimages-on-ms-vmimages inf: fs-vmimages ms-vmimages:Master

•! commit

•! quit

GG!

DRBD¢��+úû!

1.! ¡*³¢!)*+,�GUIXÃF�O�úû

–! # crm_gui

2.! Connection!)*+,wH)

3.! DRBD�¢��+pÁÂ&'Ø(%iZ�W^

4.! master¢��+�78�Ø?u®��úûB,s�)¢k)�Ø¢��+�úû

5.! KLzNdfºs»�m*�ØÍÎw�s�&'Ø(%iZ�W^

–! /dev/drbd0 ! /etc/xen/vm

–! /dev/drbd0 ! /var/lib/xen/images!

GO!

&'�s�ðÝ!

1.! [YaST]![&'(]![&'�s�ðÝ]

�úû

2.! &'�s�ðÝ

–!&'�sRLsles11-ha

–!OS:SLES11

–!n�oÚpqXÃ

•! Windowsô)*+,¢��+Z�ØrsÆÇ!

GÈ!

&'�s�)*+,¢��+wÁÂ!

•! ¡*³¢Ö+��KLzNCUI)*+,XÃF�O�úû

–! # crm config

•! &'�ssles11-ha�)*+,¢��+wÁÂ

–!º×b!c�de

–! 1*�f'gphi�wjõ!

Gä!

&'�sµXÃkl!

•! primitive sles11_ha ocf:heartbeat:Xen params name="sles11-ha" xmfile="/etc/xen/vm/sles11-ha” op monitor interval="10s” op start interval="0s" timeout="30s” op stop interval="0s" timeout="300s"

•! colocation sles11_ha-with-fs-vmconfig inf: sles11_ha fs-vmconfig

•! order sles11_ha-after-fs-vmconfig inf: fs-vmconfig:start sles11_ha:start

•! colocation sles11_ha-with-fs-vmimages inf: sles11_ha fs-vmimages

•! order sles11_ha-after-fs-vmimages inf: fs-vmimages:start sles11_ha:start

•! commit

•! quit

Gñ!

HAûðW^!

1.! &'�sp¡*³¢!ûð�Ø(%iZ�W^

2.! ¡*³¢/ÛÜs¼¢IJ!GUI)*+,XÃF�O�úû�o)*+,�\]�tu

3.! ¡*³¢�v[�OFFw$%

4.! ÛÜs¼¢w!&'�spúû$%iZ�W^

G-!

ZÀ!

•! XÃåæ�xÝyZ�ØÚ75%z�(

•! XÃklpå{á½�p|Ó

•! }ÿÙN:N~�ZZØô��w½%

•! GUIXÃF�Op�S

–!�Ç�wÚ100%!Ú½(p

–!GUIÚzÙ�n%�!oCUIôçmZ�(!

G2!

&'(w�(Ø��(

•!��»��Z~e²Va��&'(�¢®��¤s�ó3ôÆÇ

��ºs�O�ªs«m�#

y��wy�(²VaÙ�&( 29

y�(²Va�!

�&'(��"#��(pohiw��$'�((�ã�!

âÚ��w¿��Ù�&(!

日本仮想化技術株式会社

�� ¡¢£¤¥�¦§��!¨¡¢¤¨©�� ¡¢£¤¥�¦§�!CäCª-ä-BªCä2È!

30

y «!

SSDÚ¬(�ã!

A.!SSDÚ�&nm�

–!$¬½*s¼�v)Û+

–!®¯vK

–!}°

B.! SSD�-Úéì±²ã

–! �m³p´½(

–! � �»*³�µ¶p$(

–!{á·¸Ê¹wºí�»¼!

32

<¥!

TPC-B Ns¬�)½¾!

33

<¥!

Ns¬�)m*��!

•! SASóª+)L2.5” 36.4GB 15krpm " 2¿

•! SSDLIntel X25-E(SLC) 32GB " 2¿ –! RAIDºs�;�*��§¨k�®ÚOff

–! óª+)ÀÁ�§¨k�®�On/Off�ÂÃ

•! FC SANLHP MSA1000 –! SCSI 146GB 10krpm " 14¿wz%RAID 5

–! ºs�;�*�w512MB§¨k�® •! Cache OffLR50%/W50%

•! Cache OnLR0%/W100%

•! PostgreSQL 8.3.7wz%Ns¬�) –! pgbench -c 20 -t 3000

–! 20Êm*�o11ÊÃ20Ê�ÄÅÆ�Çs!

34

<¥!

•! ÈCPUpÉÊë%ÇeËp4%Ìyf

•! CPUºv¹Í&'CPU²�¹p+ô�(½¾Z½ÿØ(%

•! Opteron�8VMÚÎ�«Ú´½(poÏÐ�CPUçµÑÚ68%Ìy!ÒKRNe4ºvÒNf

%ÇÓÔ!

35

Opteron 2435

(2.6GHz)!

Xeon X5570

(2.93GHz HT On)!

Xeon X5570

(2.93GHz HT Off)!

8VM! 1553.1! 68.6%! 2175.3! 96.0%! 2180.3*! 96.2%!

12VM! 2265.4*! 100%! 2207.5! 97.4%! 2171.8! 95.9%!

16VM! 2249.1! 99.3%! 2248.7*! 99.3%! 2166.8! 95.6%!

<¥!

®¯vKÓÔ!

•! Ns¬�)é�+|®¯vK!ÓÔ

•! OpteronÚXeonw@�Ø16%��18%®¯vKp(

•! Hyper Threadingp%ÇÕww@$%®¯vK�ÖÑpR N�Ù½((3.8%:9.4%)!

36

Opteron 2435

(2.6GHz)!

Xeon X5570

(2.93GHz HT On)!

Xeon X5570

(2.93GHz HT Off)!

8VM! 200W! 87.3%! 259W! 113.1%! 253W*! 110.5%!

12VM! 229W*! 100%! 272W! 118.8%! 258W! 112.7%!

16VM! 229W! 100%! 279W*! 121.8%! 255W! 111.4%!

<¥!

sles11!#$%virtualtech.jp/download/090822sles11ha.pdf · É˚›¸ÌŁŒ! •! os:suse linux...

Documents