cơ chế quản lý máy chủ ảo trong điện toán đám mây

7/24/2019 C ch qun l my ch o trong in ton m my

1/79

S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/

I HC THI NGUYN

TRNG I HC CNG NGH THNG TIN V TRUYN THNG

LUN VN THC S KHOA HC MY TNH

Thi Nguyn2014


2/79


LI CM N

Trc ht, ti v cng bit n su sc n Thy gio

ngi thy trc tip dnh nhiu thi gian tn tnh hng dn, cung cp nhng

thng tin, ti liu qu bu gip ti hon thnh bn lun vn ny.

Ti xin chn thnh cm n Ban lnh o Trng i hc Cng ngh thng

tin v Truyn thng - i hc Thi Nguyn to nhiu iu kin gip ti hon

thnh lun vn ny.

Sau cng ti xin by t lng bit n n ngi thn, cng bn b, ng

nghip c quan, nhng ngi lun c v ng vin ti hon thnh bn lun vn tt

nghip Thc s ny.

Thi Nguyn, ngy 26 thng 08 nm 2014

HC VIN


3/79


MC LC

M U ..................................................................................................................... 1CHNG 1 ................................................................................................................ 5TNG QUAN V IN TON M MY V BI TONQUN L MY CH O ........................................................................................ 5

1.1 TNG QUAN V IN TON M MY................................................. 5

1.1.1 Khi nim v in ton m my................................................................ 5

....................................................................... 13

1.1.3 Khi nim v tng quan v o ha............................................................. 16

1.2 BI TON QUN L MY CH O........................................................ 24

1.2.1 Cc phng cch qun l my o trong in ton m my trn th gii .. 24

1.2.2 Vn la chn m hnh ph hp trin khai dch v in ton m myca cc nh cung cp ti Vit Nam........................................................................................... 30

CHNG 2 ................. 33........................................................................................ 33

2.1 CHIA S TI NGUYN MY O................................................................... 33

2.1.1 Thit lp mt mi trng ng dng o....................................................... 33

2.1.2 sp xp li phc tp ca cc vn ............................................... 33

2.1.3 Uc lng hiu sut ca mt ngun lc c cung cp.................... 34

2.1.4 Thut ton chia s ti nguyn...................................................................... 35

2.2 CN BNG TI................................................................................................... 37

2.2.1 K thut cn bng ti................................................................................... 37

2.2.2 Cc thut ton cn bng ti.......................................................................... 39

2.3 LP LCH CNG VIC...................................................................................... 50

2.3.1 Thut ton Lp lch da trn Cn bng ti............................................. 512.3.2 Thut ton Lp lch da trn thut ton Gii thut di truyn ci tin . 53

CHNG 3 ................................................................................... 573.1 T BI TON.................................................................................................... 57

3.2 PHN TCH NH GI LA CHN CNG C GII QUYT BI

TON .. .................................................................................................................................57

3.2.1 Thit k h thng......................................................................................... 57

3.2.2 Thit k mng........................................................................................... 57


4/79


3.2.3Ci t Eucalyptus................................................................................. 59

3.2.4 Ci t Hadoop......................................................................................... 59

3.2.5 S dng mt s gi m ngun m.............................................................. 62

3.2.6 S dng thut ton lp lch da trn cn bng ti gii quyt bi ton..... 67

3.3 MT S KT QU.............................................................................................. 68

KT LUN ............................................................................................................... 68TI LIU THAM KHO ........................................................................................ 73


5/79


DANH MC CC CH VIT TT

VM Virtual Machine My oCS Cloud Scheduler Lp biu m my

VMM Virtual machine monitor Mn hnh my oIaaS Infrastructure as a Service C s h tng l mt dch vSaaS Software as a service Phn mm l mt dch vPaaS Platform as a service Nn tng l mt dch vOS Operating System H iu hnhECP Elastic Computing Platform Nn tng in ton mm doCLC Cloud Controller B iu khin m my

NC Node Controller B iu khin nt

PM Physical machine My vt l


6/79


DANH MC CC HNH

S hiu hnh Tn hnh Trang

1.1 M hnh in ton m my 51.2 in ton m my di gc nhn 3D 6

1.3 Phn loi in ton m my da vo v tr 81.4 M hnh phn lp ca kin trc IaaS 10

1.5 S truy cp ti nguyn phn cng ca cc my o 14

1.6 161.7 - based 191.8 Kin trc Hypervisor-based 191.9 201.10 S truy cp ti nguyn phn cng ca cc my o 21

1.11 o trong TM 231.12 241.13 262.1 333.1 563.2 Cu hnh Hadoop gi phn tn 583.3 593.4 603.5 61

3.6 623.7 Kin trc ca EUCALYPTUS 633.8 Giao din chnh ca chng trnh th nghim 65

3.9 Khi to my ch o 66

3.10 Chn thng s my ch o 66


7/79

S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/1

M U1. t vn

Ti Vit Nam, in ton m my ang l ch cng ngh mang tnh thi s

v c phn kh mi m, s am hiu v in ton m my ni chung v vn qun

l my o trong in ton m my ni ring cn c phn hn ch.La chn m hnh hot ng theo c ch no trin khai dch v in ton

m my l mt bi ton quan trng i vi nh cung cp dch v.

V d, nu trin khai theo c ch thit lp mt mi trng ng dng o bng

cch s dng cc ng dng o nh mt c ch chia s ti nguyn, th bt c khi no

c yu cu cung cp nhiu ti nguyn hn, h thng t ng trin khai thm cc

ng dng o khc.Vi cch tip cn ny liu c gy lng ph cc ngun ti nguyn khng?

Trong ton b thi gian p ng yu cu ca ngi dng, khng phi tt c

cc ti nguyn cm u bn. Khi ngi dng cn x l cc ng dng d liu ln, h

li phi ch cho mt cng vic phi c hon thnh trc khi nhim v ca mnh

c th c x l, ngi dng nu khng th s dng tt c cc cm sn c s gy

lng ph ngun lc.

Ngoi ra cc my ch o cn cung cp mt lp cc phn mm to thnh mi

trng c bn nh th vin, d liu, nhng chng trnh m sn sng phc vngi dng ti bt k cm ti nguyn no.

V vy, cc nh cung cp dch v in ton m my cn phi c mt phng

php qun l cc my ch o.

ng thi, nh cung cp dch v cn chng mnh cho ngi s dng thy

rng, dch v in ton m my theo m hnh m mnh xy dng hon ton c

th p ng c cc tiu ch nh: hiu sut, tc cp pht b nh, hiu sut trao

i thng tin ca cc my o tng t nh cc my vt l.T nhng l do trn ti chn v nghin cu thc hin ti C ch qun l my

ch o trong in ton m mydi s hng dn ca thy TS. L Vn Phng.

2. i tng v phm vi nghin cu

i tng nghin cu ca lun vn l h thng my ch o trong in ton

m my. Phm vi nghin cu gi hp v c ch qun l my ch o ca h thng

qun l cm o thng qua vic xem xt cc kha cnh: Tnh linh ng, kh nng cn

bng ti. Kt qu phi hp gia nghin cu l thuyt v thao tc thc t dn n


8/79


vic ci t cc h thng, p dng cc kch bn tnh ton phn tn vo cc cm o,

v d nh MapReduce framework cng nh cc nh gi v ci tin. t c

iu ny, cn phi nghin cu rt nhiu v li, m my, cng ngh o ha, cm

o, my ch h iu hnh Linux, v cc gi m ngun m nh Eucalyptus v

Hadoop, MapReduce.

3. Hng nghin cu ca ti:

Mc tiu chnh ca lun vn ny l nghin cu v c ch qun l my ch o

trong in ton m my. V vy, ni dung lun vn cn phi lm r cc nhim v

sau y:

- Th hin r bn cht ca EUCALYPTUS v Hadoop, Mapreduce.

- Chi tit ha cc c ch ca h thng qun l cm o v cc gi m ngun m.

- Ci t, cu hnh, nghin cu c ch qun l my ch o ca mt s h thng

in ton m my hin hnh.

- Ch ra u im, khuyt im ca cc c ch, h thng (bao gm c phn tch

v nh gi).

- xut ci tin v lm sng t tnh kh thi ca n.

4. Nhng ni dung nghin cu chnh

D kin lun vn gm: Phn m u, ba chng chnh, phn kt lun, ti liutham kho v ph lc c b cc nh sau:

Chng 1. Tng quan v in ton m myv bi ton qun l my ch o

Tm hiu tng quan v in ton m my, trnh by cc khi nim, cu trc,

o ha.

Chng 2. Mt s c ch qun l my ch o trong in ton m my

l my ch o trong in ton m my.

Chng 3. Th nghim

5. Phng php nghin cu

Thu thp, phn tch v tng hp cc thng tin, ti liu lin quan n ti

t tt c cc ngun.

Da theo kin chuyn gia, la chn v th hin gii quyt vn .

Phn tch thit k cc m phng ca chng trnh.


9/79


Kim tra nh gi kt qu.


10/79


6. ngha khoa hc ca ti

Lun vn nhm m rng tri thc v bo m khoa hc my tnh ni chung,

ng thi em n s hiu bit v c ch qun l my ch o trong in ton m

my ni ring.

ngha khoa hc ca ti th hin ch tng hp c tri thc qun l hiu

qu my ch o, cn bng ti, cc ph, chia s ti nguyn trong h thng qun l

cm o, t xut nhng phng php khoa hc bo m v nng cao c

c ch qun l cc my ch o nhm p ng nhanh nht, tt nhtyu cu ngi dng.

Kt qu cc th nghim da trn h thng c ci t s thuyt phc ngi

s dng dch v in ton m my, to ra cm gic an ton, tin tng i vi dch

v in ton m my.


11/79


CHNG 1

TNG QUAN V IN TON M MYV BI TON

QUN L MY CH O

1.1 TNG QUAN V IN TON M MY

1.1.1

Khi nim v in ton m my

1.1.1.1 Cc quan im v in ton m my

in ton m my l m hnh in ton s dng cc cng ngh my

tnh v pht trin da vo mng Internet. Dch v in ton m my ha hn p

ng mnh m nhu cu in ton ca ngi dng.

Theo nh ngha ca SYS-CON Media Inc: in ton m my l mt h

thng bao gm nhiu my tnh sao cho cc ti nguyn gm: ngun in (power),

kh nng lu tr (storage), nn tng (platform) v cc dch v c tru tng ha,

o ha , c tnh co dn ng v qun l cung cp cho ngi dng qua Internet.

Theo nh ngha ca NIST: in ton m my l mt m hnh ph

bin, thun li, c kh nng truy cp Internet chia s cu hnh v ngun ti

nguyn mt cch nhanh chng v bt u vi mt chi ph ti thiu hoc

tng tc cc dch v c cung cp.

T phc v theo yu cu: Ngi s dng c th t ch trong qu trnhcung cp kh nng tnh ton m khng i hi c s tng tc gia con ngi vi

nh cung cp dch v.

co gin cao: Ngha l c kh nng thay i nhanh chng v quy m

ty thuc vo nhu cu c th ca ngi dng ti thi im khc nhau.


12/79



13/79


Theo nh ngha ca CISCO: "in ton m my l thng tin v ngun ti

nguyn v dch v c tru tng t c s h tng c bn, cung cp theo yu cu v

quy m trong mt mi ngi a ngi s dng".

Theo yu cu: Cc ngun ti nguyn c cp quyn ngay lp tc khi cnthit, bt u khi khng c yu cu v ch lp ha n khi c s dng.

Theo quy m: C

.

Theo mi trng a ngi s dng: Cc ngun ti nguyn cung cp cho

nhiu ngi s dng t mt hin thc n nht, tit kim c chi ph cho qu trnh

cung cp.

1.2in ton m my di gc nhn 3D


14/79


1.1.1.2 S khc bit gia in ton m my v in ton truyn thng

a. T Sa Cha

Bt k ng dnghoc dch v no ang chy trong mt mi trng in

ton m my c mt tnh cht t sa cha. Trong trng hp ng dng tht bi,

lun lun c mt d phng tc thi ca ng dng sn sng cho cng vic khng

b gin on. C nhiu bn sao ca cng mtng dng - mi bn cp nht chnh n

thng xuyn v vy nhng lntht bi, c t nht mt bn sao ca ng dng c

th ly lnhot ng m thm ch khng cn thay i nh no trong trng thi chy

ca n.

b. Nhiu ngi s dng

Vi in ton m my, bt k ng dng no cng h tr a ngi dng-

l khi nim dng ch nhiu ngi s dng m my trong cng thi gian. H

thng cho php mt skhch hng chia s c s h tng c phn b cho h m

khng ai trong h nhn bitv s chia s ny. iuny c thc hin bi vic o

ha cc my ch trong mt di cc my tnh v sau cp pht cc my ch

nnhiu ngi s dng. iu ny c thc hin theo cch m trong s ring

t ca ngi s dngv bo mt ca d liu ca h khng b tn hi.

c. Kh nng m rng tuyn tnh

Dch v in ton m my c kh nng m rng tuyn tnh. H thng c

kh nngphn chia cc lung cng vic thnh phn nh v phc v n quac s h

tng. Mt tng chnh xc ca kh nng m rng tuyn tnh c th c ly

tthc t l nu mt my ch c th x l 1000giao dch trong mt giy, th hai

my ch c th x l 2.000 giao dch trong mt giy.

d. Hng dch v

H thng in ton m my l tt c cc dch v theo nh hng nhng

dch v nh vy c to ra t nhng dch v ri rc khc.Rt nhiu dch v ri rc

nh vy l s kt hp ca nhiu dch v c lp khc vi nhau to dch v ny.

iu ny cho php vic ti s dng cc dch v khc nhausn c v ang c to

ra. Bng vic s dng cc dch v c to ra trc , nhng dch v khc c

th c to ra t .

e. iu khin SLA(Service level agreement)

Thng thng cc doanh nghip c tha thun v s lng dch v. Kh

nng m rng v cc vn c sn c th lm cho cc tha thun ny b ph v.


15/79


Tuy nhin, cc dch v in ton m my l hng SLA, nh vickhi h thng c

kinh nghim t nh ca ti, n s t ng iu chnhchnh n tun th cc tha

thun cp dch v.Cc dch v s to ra thm nhng thc th ca ng dng

trn nhiu server cho vic ti c th d dng qun l.

f. Kh nng o ha

Cc ng dng trong in ton m my hon ton tch ri khi

phn cng nm bn di. Mi trng in ton m my l mt mi trng o ha

y .

g. Linh hot

Mt tnh nng khc ca ccdch v in ton m my l chng linh hot.

Chng c th c dng phc v rt nhiu loi cng vic c khi lng khc

nhau t ti nh ca mt ng dng nh cho n ti rt nng ca mt ng dng

thng mi.

1.1.1.3 Phn loi in ton m my

Da votiu ch v tr ni cc cloud ng vai tr l my ch, in ton m

my c chia thnh 4 loi: Private Cloud (m my ring), Public Cloud (m

my cng cng), Hybrid cloud (m my lai) v Community Cloud (m

my truyn thng).

1.3


16/79


a. Public Cloud (m my cng cng)

Public Cloud c nh ngha nh sau:

C s h tng tnh ton c lu ti nh cung cp dch v v c s

chia s c s h tng ny gia cc t chc vi nhau.

Ngi dng khng nhn thy c v tr t my ch trong c s h

tng in ton m my.

Cc nh cung cp dch v public cloud c th k ti l: Amazon,

Winsdow Azure, Google Apps

b. Private Cloud (m my ring)

Private Cloud c nh ngha nh sau:

C s h tng tnh ton c quyt nh bi khch hng. V vy, ngnhin khch hng s bit c v tr my ch t u v khng c s chia s gia

cc t chc vi nhau.

Do ch c mi khch hng s dng nn chi ph thng thng khch

hng b ra s tn hn nhiu v nng cao c tnh bo mt hn Public Cloud. in

hnh cho nh cung cp Private Cloud c th k ti l trang eBay.com.

c. Community Cloud (m my truyn thng)

Community Cloud c nh ngha nh sau:

C s h tng c chia s gia cc t chc c cng mt mi quan tm

chung vi nhau nh bo mt, thm quyn, chuyn mn

c qun l ni b bi nhng t chc trong nhm hoc giao cho bn

th ba (a third-party) ng tin cy qun l.

V tr t my ch c th trong hoc ngoi nhm.

Chi ph b ra ca nhng ngi s dng trong Community Cloudthng s t hn Public Cloud nhng s tn nhiu hn Private Cloud.

d. Hybrid Cloud (m my lai)

Hybrid Cloud c nh ngha nh sau:

y l s kt hp gia hai hay nhiu loi cloud k trn (Private

Cloud, Public Cloud, Community Cloud) hnh thnh nn mt Hybrid Cloud.

Do c s kt hp trn nn my ch c qun l ging nh Public

Cloud v cc ng dng lin quan n bo mt c qun l nh Private Cloud.


17/79


Bng n in ton m my l thut ng dng xc nh mt h thng t chc s

dng c s h tng ring ca mnh cho vic s dng bnh thng, nhng li s dng

in ton m my trong gi cao im. Cc giai on pht trin ca cloud c th

c trnh by tm lc qua hnh 1.3 gm c 4 giai on t qu trnh lu tr d liu

t pht nhiu trung tm khc nhau cho n hnh thnh qu trnh s dng chung

cc ngun ng dng qua s kt hp ca nhiu loi cloud khc nhau.

1.4 M hnh phn lp ca kin trc IaaS

1.1.1.4 Phn tch u vnhc im ca in ton m my

a. u im

Khi s dng cc ng dng trn in ton m my, ngi dng s c nhng

u im sau:

Li ch v chi ph: Ngi dng ch cn tr cc chi ph lin quan ti vn

hnh h thng v chi ph s dng c ng dng. Ngha l ngi dng s dng bao

nhiu th ch cn tr chi ph cho mc ch m thi.

Tnh linh hot: Nhanh chng cung cp dung lng ph hp cho nhu

cu s dng, d dng thay i cc khi lng cng vic vi nhau.

Ci thin kh nng t ng ha: Cung cp cc dch v cn thit theo yu

cu ngi s dng.


18/79


Tp trung vo kh nng ct li: Nghin cu cc li ch ca ngun ti

nguyn chung trong in ton m my cung cp cc dch v cn thit cho ngi s

dng di s iu tit v gim st ca c quan trc thuc chnh ph.

Tnh bn vng: in ton m my c nng lng tiu th t hn so vi

mt trung tm lu tr d liu thng thng trong cng phng din lu tr d liu.

b. Nhc im

Tuy nhin, trc nhng u im khi s dng ng dng trn in ton m

my, n cng c mt s nhc im:

Cn phi c ng truyn Internet tc cao thc hin ng dng.

p ng c yu cu v bo mt v cu hnh ca h thng.

Kh nng cng tc gia cc in ton m my ca nhiu t chc khc nhau.

V cng c rt nhiu cu hi cha vn ang ch cu tr li thuyt phc

nh, tnh ring t, cc thng tin ngi dng v d liu c cha trn in ton

m my c m bo c ring t, v liu cc thng tin c b s dng v mt

mc ch no khc khng, iu vn cha c cu tr li thuyt phc.

Tnh sn dng, liu cc dch v m my c b "treo" bt ng, khin cho

ngi dng khng th truy cp cc dch v v d liu ca mnh trong nhng khongthi gian no khin nh hng n cng vic?

Mt d liu, mt vi dch v lu tr d liu trc tuyn trn m my

bt ng ngng hot ng hoc khng tip tc cung cp dch v, khin cho ngi

dng phi sao lu d liu ca h t "m my" v my tnh c nhn. iu ny s

mt nhiu thi gian. Thm ch mt vi trng hp, v mt l do no , d liu ngi

dng b mt v khng th phc hi c.

Tnh di ng ca d liu v quyn s hu, mt cu hi t ra, liu

ngi dng c th chia s d liu t dch v m my ny sang dch v ca m my

khc? Hoc trong trng hp khng mun tip tc s dng dch v cung cp t m

my, liu ngi dng c th sao lu ton b d liu ca h t m my? V lm cch

no ngi dng c th chc chn rng cc dch v m my s khng hy ton b

d liu ca h trong trng hp dch v ngng hot ng.

Kh nng bo mt, vn tp trung d liu trn cc "m my" l cch


19/79


thc hiu qu tng cng bo mt, nhng mt khc cng li chnh l mi lo ca

ngi s dng dch v ca in ton m my. Bi l mt khi cc m my b tn

cng hoct nhp, ton b d liu s b chim dng. Tuy nhin, y khng thc s

l vn ca ring "in ton m my", bi l tn cng nh cp d liu l vn

gp phi trn bt k mi trng no, ngay c trn cc my tnh c nhn.

1.1.2 C u trc in ton m my

1.1.2.1. Khi nim IaaS

IaaS l mt m hnh dch v m s cung cp cc thit b nhm htr hot ng h

thng cho khc hng. Cc thit b bao gm kho d liu, phn cng, my ch v

cc thnh phn networking. Nh cung cp s lm ch cc thit b v chu trch

nhim cho vic hot ng v bo tr h thng. Khch hng s tr tin cho cc hp ng

dch v .

Cc bn hp ng cc mc dch v khc nhau : i vi tng nhu cu

khc nhau m cc khch hng c th chn nhng dch v thch hp. ng vi cc

dch v s c nhng hp ng tng ng.

Khi s dng dch v IaaS th phi tr ph.

IaaS u da trn cc hot ng ca my o. C ch ca vic s dng cc

thit b o trong in ton m my th rt thch hp bi v n c nhiu li ch trongvic chia s, qun l ti nguyn.

IaaS tp trung ch yu vo vic cho thu cc thit b phn cng nh l

my ch (server) , k thut networking v khng gian lu tr hn l mua v ci t

n trong trung tm d liu ca ring bn. IaaS cn c internet. in ton m my lin

quan ti vic phn phi cc dch v my ch. Mt dch v cloud th c 3 im khc nhau

chnh so vi dch v hosting truyn thng trn internet. l : n c bn theo nhu

cu c tnh theo gi, kh nng cung cp v hn v linh ng theo nhu cu v dch v

hosting c qun l bi nh cung cp.

1.1.2.2. Cc c im chnh ca IaaS

Cc ti nguyn IaaS th c phn phi nh l dch v. Cc ti nguyn l:

cc my ch (server), thit b networking, b nh, CPU, khng gian vng nh, .v.v.

C s h tng thay i ng : bn c th iu chnh cc ti nguyn theo yu cu

s dng ca bn. IaaS trong cloud s p ng nhanh chng vic tng hay gim ti


20/79


nguyn mt cch d dng. C chi ph bin i ngha l ty vo nhu cu s dng khc

nhau th cc khch hng s tr trn cc dch v . Khng c nh chi ph cho bt c

dch v no. IaaS thng c nhiu ngi thu. IaaS c nhng mc dch v khc nhau

p ng cho tt c nhu cu ca ngi dng.

1.1.2.3.

Kin trc v hot ng ca IaaS trong in ton m my

Khi thc thi mt yu cu t ngi s dng, cng vic c th thc hin song song

v chia s ti nguyn p ng yu cu cng nhanh cng tt.

Hoc l c th truy cp cc kho d liu khc nhau c th tha mn nhu cu ca

khch hng. IaaS trong m my phi m bo v s thc thi (performance) v

hiu qu chi ph trong khi bo tr cc iu khin trung tm v kh nng tng ti nguyn

bo m dch v khng b gin on.


21/79


1.5 S truy cp ti nguyn phn cng ca cc my o

C 03 thnh phn chnh trong kin trc ca h thng cloud. l: cloud

manager, cluster manager v computer manager

Cloud manager l im truy cp vo cloud ni m cc nh thu bao ng

k ti khon, qun l cc ti nguyn m h thu t cloud v truy cp d liu. N thc


22/79


hin vic truy cp ti nguyn mc u tin (top level). N quyt nh c ti

nguyn p ng yu cu khch hng hay khng v cluster manager s thc hin

yu cu. Cloud manager cng thc hin cc lut trn cloud i vi yu cu t khch

hng.

Cluster manager: Chu trch nhim vn hnh cc my thng qua

network. Cluster manager s nhn lnh / queries truy cp ti nguyn t cloud

manager v xc nh ti nguyn no c th p ng yu cu t ngi s dng . Sau

hin thc truy cp ti nguyn.

Computer manager: Hp tc vi hypervisor chy trn mi h thng my

tnh trong mt cluster. Trong vic p ng cc queries t Cluster manager. Cluster

manager tr v thng tin trng thi lin quan n ti nguyn c s dng v csn m c th c s dng.

1.1.3 Khi nim v tng quan v o ha

1.1.3.1. Khi nim o ha

o ho l cng ngh tin tin nht trong mt lot cc cuc cch mng cng

ngh nhm tng mc o ha h thng cho php tng hiu sut lm vic ca my tnh

ln mt cp cha tng c.

Cng ngh o ha cho php nhiu h iu hnh cng hot ng ng thitrn mt my vt l thng qua mn hnh my o (Virtual machine monitor - VMM

hoc hypervisors)

Hnh 1.6 minh ha mt cch tru tng v my o (Virtual Machine

Abstraction) khi thc hin ng dng, h iu hnh, ng b phn cng trn cc my

o khc nhau.


23/79


1.6

o ha h thng my ch tc l ta tin hnh phn chia mt server thnh

nhiu server o hoc kt hp nhiu my ch vt l thnh mt my ch logic, i

vi ngis dng h nhn bit v s dng cc server o ging nh mt my vt l

c lp c cc ti nguyn cn thit (b vi x l, b nh, kt ni mng, ), trong

khi cc server o khng h c nhng ti nguyn c lp nh vy, n ch s dng ti

nguyn c gn t my ch vt l.

y, bn cht th nht l cc server o s dng ti nguyn ca my ch

vt l, bn cht th hai l cc server o c th hot ng nh mt server vt l c lp.

o ha tr thnh mt thnh phn khng th thiu trong mi m my datrn kh nng tru tng ha v bao ng. m my cn phi chy nhiu ng dng

ca ngi dng v tt c nhng ng dng hin th nh th chng ang c chy

ng thi v s dng tt c ti nguyn c sn ca cloud. o ha cung cp mc

tru tng cn thit nh cc ti nguyn tnh ton, lu tr, ti nguyn mng c

ng nht thnh pool hoc resource overlay. o ha cung cp tnh bao ng cho ng

dng c th c cu hnh, ci t, nng cp tng tnh bo mt v qun l tt hn.


24/79


in ton m my hng n o ha trong hin thc v mt s l do sau:

Nhiu ng dng c th chy trn cng mt server, ti nguyn c th

c s dng hiu qu hn.

Kh nng cu hnh cao, nhiu ng dng yu cu ti nguyn khc nhau

nh s lng core, dung lng b nh. Vic cu hnh ny kh thc hin c mc

phn cng nhng l d dng trong o ha. V d: VMware.

Kh nng sn sng ca ng dng cao. o ha cung cp kh nng phc

hi nhanh sau nhng h hng cng nh kh nng nng cp m khng gy ngt

qung qu trnh s dng dch v ca ngi dng.

Kh nng p ng cao. o ha cung cp cc c ch theo di v bo tr

ti nguyn mt cch t ng, mt s ti nguyn thng thng c th c cache chovic dng li.

1.1.3.2. Li ch ca gii php o ha

Thng thng vic u t cho mt trung tm cng ngh thng tin l rt tn

km. Chi ph u t mua cc my ch cu hnh mnh v cc phn mm bn quyn

l rt t . Trong thi bui kinh t kh khn hin nay doanh nghip no cng

mun ct gim v hn ch ti a cc chi ph khng cn thit m vn p ng c

nng sut v tnh n nh ca h thng. Th nn vic ng dng o ha tr thnh nhu

cu cn thit ca bt k doanh nghip ln hay nh. Thay v mua mi my ch cho

mi ng dng th ch cn mua mt hoc hai my ch c h tr o ha th vn c

th chy tt mi ng dng trn. iu ny cho ta thy s khc bit gia h thng

o ha v khng o ha. Bn cnh vic ng dng o ha cn em li nhng li ch

sau y:

Qun l n gin

Trin khai nhanh

Phc hi v lu tr h thngnhanh

Cn bng ti v cung cp ti nguyn linh hot

Tit kim

o ha gp phn tngcng tnh lin tc

1.1.3.3. Kin trc o ha

Xt v kin trc h thng, cc kin trc o ha h thng my ch c th cc


25/79


dng dng chnh l: Host-based, Hypervisor-based (cn gi l baremetal

hypervisor, n c chia nh ra lm hai loi l Monothic Hypervisor v

Microkernel Hypervisor), Hybrid. Ngoi ra, ty theo tng sn phm o ha c

trin khai (nh VMWare, Microsoft HyperV, Citrix XEN Server) m mc o ha

c th s khc nhau.

Cc kin trc o ha my ch bao gm:

a. Kin trc Hosted-based:

Cn gi l hosted hypervisor, kin trc ny s dng mt lp hypervisor chy

trn nn tng h iu hnh, s dng cc dch v c h iu hnh cung cp phn

chia ti nguyn ti cc my o. Nu ta xem hypervisor ny l mt lp phn mm ring

bit, th cc h iu hnh khch ca my o s nm trn lp th 3 so vi phn cng

my ch.

Mt h thng o ha s dng M hnh Hosted-based c chia lm 4 lp hot

ng nh sau:

Nn tng phn cng

H iu hnh Host

H thng mn hnh my o - virtual machine monitor (hypervisor)

Cc ng dng my o: S dng ti nguyn do hypervisor qun l.


26/79


1.7 ted - based

b. Hypervisor-based:

Cn gi l bare-metal hypervisor. Trong M hnh ny, lp phn mm

hypervisor chy trc tip trn nn tng phn cng ca my ch, khng thng qua

bt k mt h iu hnh hay mt nn tng no khc. Qua , cc hypervisor ny c kh

nng iu khin, kim sot phn cng ca my ch. ng thi, n cng c kh nng

qun l cc h iu hnh chy trn n. Ni cch khc, cc h iu hnh s chy trn

mt lp nm pha trn cc hypervisor dng baremetal.


27/79


1.8Kin trc Hypervisor-based

Mt h thng o ha my ch s dng nn tng Baremeta l hypervisor bao

gm 3 lp chnh:

Nn tng phn cng:Bao gm cc thit b nhp xut, thit b lu tr (Hdd,

Ram), b vi x l CPU, v cc thit b khc (cc thit b mng, vi x l ha, mthanh )

Lp nn tng o ha Virtual Machine Monitor (cn gi l hypervisor),

thc hin vic lin lc trc tip vi nn tng phn cng pha di, qun l v cung

cp ti nguyn cho cc h iu hnh khc nm trn n.

Cc ng dng my o: Cc my o ny s ly ti nguyn t phn cng,

thng qua s cp pht v qun l ca hypervisor, khi mt h iu hnh thc hin

truy xut hoc tng tc ti nguyn phn cng trn h iu hnh ch.

c. Hybrid

Hybrid l mt kiu o ha mi hn v c nhiu u im. Trong lp o

ha hypervisor chy song song vi h iu hnh my ch . Tuy nhin trong cu trc

o ha ny cc my ch o vn phi i qua h iu hnh my ch truy cp phn

cng nhng khc bit ch c h iu hnh my ch v cc my ch ou chy

trong ch ht nhn. Khi mt trong h iu hnh my ch hocmt my ch o

cn x l tc v th CPU s phc v nhu cu cho h iu hnh my ch hoc my


28/79


ch o tng ng. L do khin Hyrbird nhanh hn l lp o ha chy trong trong

ch ht nhn (chy song song vi h iu hnh) tri vi Virtual Machine

Monitor vi lp o ha chy trong trong ch ngi dng (chy nh mt ng

dng ci trn h iu hnh).

Phng php o ha Hybird c s dng trong hai sn phm o ha ph

bincal Microsoft Virtual PC 2007 v Microsoft Virtual Server 2005 R2.

1.9

1.1.3.4. Cng ngh my o (Virtual Machine)

My o l mt my tnh c ci trn mt h iu hnh khc hay mt my

tnh khc. Mt my o cng bao gm phn cng, cc ng dng phn mm v h iu

hnh. iu khc bit y l lp phn cng camy o khng phi l cc thit b

thng m ch l mt mi trng hay phn vng m n c cp pht mt s

ti nguyn nh l chu k CPU, b nh, a .

Cng ngh my o cho php ci v chy nhiu my o trn mt my tnh vt l.


29/79


Mi my o c mth iu hnh my khch ring l v c phn b ti nguyn,

cng, card mng v cc ti nguyn phn cng khc mt cch hp l. Vic phn b

ti nguyn ny ph thuc vo nhu cu ca tng my o ng dng v cng ty

thuc vo phng php o ha c dng.

c bit khi my o cn truy xut ti nguyn phn cng th n hot ng

ging nh mt my tht hon chnh. V ch l mt tp tin c phn vng trn

a nn vic di chuyn cc my o t my ch ny sang my ch khc l rt d dng

v khng cn quan tm n vn tng thch phn cng hay nh hng ti my ch.

1.10 S truy cp ti nguyn phn cng ca cc my o


30/79


Trong kin trc ca mt b x l o ha c chia thnh 4 lp:

Lp 0 l lp c quyn cao nht c th truy cp v can thip su nht n ti

nguyn phn cng. Lp 0 thng l cc h iu hnh ch c ci trn chnh my ch.

Lp 1 l lp o ha Hypervisor. Lp ny dng qun l v cung cp ti nguyn

n cc my o.

Lp 2 l cc h iu hnh khch chy trn cc my o. truy cp ti nguyn

phn cng n phi lin lc vi lp o ha v phi qua h iu hnh my ch.

Lp c quyn can thip thp nht n ti nguyn l lp 3. y l cc ng

dng hot ng trn cc my o. Trong cc h thng my tnh ln dng x l

cc ng dng thng mi v khoa hc (mainframe), h iu hnh chy trn phn

cng my thc ch u tin v ch c h iu hnh ch mi c php sa i

v can thip vo phn cng bn di n. Cn my o lm vic ch gii hn v

phn cng m n nhn thy ch lcc thit b o. Khi my o yu cu cc lnh hoc

tin trnh thng thng th h iu hnh ch s chuyn tip chng n b x l

thc thi trc tip, cn i vi cc lnh hoc cc tin trnh c bit nhy cm can thip

su n phn cng bn di s b chn li v c th lm nh hng ti h thng v

my o cn li. H iu hnh ch s thc thi lnh vi b x l trn my thc ri sau

m phng kt qu ri tr v cho my o. y l c ch nhm cch ly my o vimy thc m bo an ton h thng.

1.2 BI TON QUN L MY CH O

1.2.1 Cc phng cch qun l my o trong in ton m my trn th gii

Ti nguyn my o trong in ton m my c chia thnh 3 tng:

Tng Infrastructure (c s h tng): Dng qun l cc ti nguyn tnh

ton nh my tnh, RAM, ni lu tr d liu v h tng mng.

Tng Platform (nn tng):Bao gm i tng lu tr, tnh ng b, thi

gian thc, hng i v c s d liu.

Tng Application (ng dng): Bao gm cc ng dng nh ng dng

theo di, giao tip, truyn thng, ti chnh.


31/79


Da trn vic qun l ti nguyn 3 tng trong in ton m my, cc ti

nguyn c phn thnh hai dng chnh:

Ti nguyn vt l (physical resources): My tnh, a lu tr, c s d

liu, h tng mng.

Ti nguyn lun l (logical resources): Cc ng dng dng thc thi,

v ng dng truyn thnggiao tip.


32/79


Cc m hnh ca cc tng ti nguyn my o trong dch v in ton m my bao gm.

Infrastructure as a service (IaaS):y l m hnh dch v c bn nht cain ton m my, nh cung cp s cung cp my tnh c th l my vt l hoc

my o, ni lu tr, firewall, load balance v network. H scung cp theo nhng

ti nguyn d theo yu cu v thng thng n s c tch hp li trong mt trung

tm d liu v c truy xut thng qua a ch IP.

trin khai mt ng dng, ngi dng phi ci t h diu hnh thng qua cc

mn hnh o cng nhcc ng dng cn thit. Trong m hnh ny, ngi dng chu

trch nhim cho vic duy tr h iu hnh v phn mm ng dng. Nh cung cp stnh ph da trn cc ti nguyn c cp pht v tiu th.

Vi m hnh ny, cn phi qun l c ch chia s ti nguyn bao gm: Ti nguyn

phn cng, tng la bo v v mng.

Platform as a service (PaaS):Trong m hnh ny, nh cung cp s cung cp

nn tng in ton v gii php thc thi nhim v bao gm: H iu hnh, mi trng

thc thi ngn ng lp trnh, c s d liu v web server. Ngi pht trin ng dng

c th pht trin v chy cc gii php phn mm trn nn tng m my m khng


33/79


quan tm n chi ph v phc tp ca vic mua bn, qun l phn cng v phn

mm. Vi mt s dch v cung cp, cc ti nguyn lu tr v tnh ton c th c

m rng mt cch t ng thng qua nhu cu ca ng dng, ngi dng khng phi

cp pht v qun l ti nguyn ny mt cch th cng.

Vi m hnh ny cn qun l c ch chia s ti nguyn nn tng t ng nh th

no cho hp l.

Software as a service (SaaS): Trong m hnh ny, nh cung cp s ci t,

thc thi cc ng dng trn m my v sau ngi dng truy xut nhng ng

dng t m my clients. Ngi dng khng bit cu hnh c s h tng m

my, cc phn mm hthng m ng dng thc thi trn . iu ny loi b i

vic ci t v chy ng dng trn my tnh ca ngi dng nhm n gin ha vic

bo tr.

c im ni bt lm cho ng dng m my khc bit nhng ng dng khc

chnh l tnh linh hot cao. Khnng ny cho php nhn bn cc cng vic thc

thi trn nhiu my o ti cng mt thi im.Vic iu phi c thc hin thng

qua load balancer. Qu trnh ny trong sut i vi ngi dng, h ch thy mt

im nhp duy nht. Chnh iu ny lm cho m my c kh nng phc v cho

nhiu ngi dng ti mt thi im thay v phi s dng hng i v phc v tun tnh li.

Vi m hnh ny cn c c ch iu phi cc ti nguyn my o nh th no cho

hp l.

C ch chia s ti nguyn o cho h thng gm hai cng vic chnh:

Lp lch hot ng cho cc my o.

Qun l cc my o.

C hai kiu lp lch cho cc my o.

Power aware scheduling: Cc cng vic c lp lch theo cch thc

gim thiu ti a lng nhit tng th trong cc trung tm d liu. Thay v gim nng

lng cho cc my ch, chin lc ny s lm gim nng lng phc v cho cc hot

ng lm mt trung tm d liu.

Themal aware scheduling: Cc cng vic c ln lch theo cch thc

nhm gim cng sut ca cc my ch v phn ln vic x l cc cng vic u din


34/79


ra cc my ch.

Hnh 1.13

Qun l my o:Cng vic ny lin quan n qun l my o bng cch bt,

tt my o mt cch hp l. Vi mt chin lc hp l, nhng my khng s dng s

dng k thut tt my ng (dynamic shutdown techniques) tt v bt li khi cn

thit. C th dng Wake On LAN trong vic hin thc chin lc bt tt my o ny.

a.Lp qun l ti nguyn v qun l cng vic

B lp biu m my (CS) gim st cc cng vic v cc ngun ti nguyn

vi cc m my. Cc lp qun l m my bao gm cc lp ResourcePool, lp

nhm my o (Cluster classes), v cc lp my o (Virtual Machine classes).

ResourcePool l mt danh sch cc ti nguyn m my c c khi

khi to h thng, v c th cp nht theo thi gian thc.

Cluster class bao gm cc thng tin c nh miu t cc thuc tnh ca

mi m my v mt danh sch linh ng cc my o chy trn m my .

Virtual Machine classes bao gm cc thng tinv thuc tnh v tnh


35/79


trng ca mt my o.

Lp qun l cng vic bao gm cc lp JobPool v cc lp cng vic (Job

Classes). Lp JobPool cha mt danh sch cc i tng cng vic c truy hi t b

lp trnh cng vic HTC Condor. Lp cng vic c thuc tnh ca cng vic t ngi

s dng yu cu.

b. Qun l my o

Khi b lp biu m my bt u khi ng v c cc file cu hnh m my.

Chui JobPoller duy tr trng thi v cc siu d liu ca cng vic

c a vo hng i v ang c chy trnB lp biu cng vic Condor v xp

cc hng i B lp trnh cng vic Condor vo JobPool.

Da trn cc thng tin Jobpool, b lp biu s kim sot cc my otheo cc yu cu cng vic.

Chui Cleanup dng cc my o khng cn c yu cu. N cng c

th cp nht li trng thi ca cng vic trong JobPool. Nu mt my o bt k b

ngt do xy ra mt li no , chui CleanUp s thay i trng thi cng vic trong

JobPool t c lp biu thnh hin trng mi, sau mt my o mi c th c

to rali cho cng vic .

Nu B lp biu m my b ngt, cc my o cng c th b ngt hocchng c th duy tr trng thi hin ti ca mnh. Do , cc my o c th tip tc

chy cc cng vic. Sau , B lp biu m my s ti li hin trng khi ckhi

ng li hoc khi phc li cc cng vic v cc ngun ti nguyn. Trong trng

hp ny, cc my o c cung cp cho tt c cc ngi dng vi cc cng vic

trong hng ch. Khi c yu cu mi t cc ngi dng khc, B lp biu m my

s lm cn bng li cc chia s ti nguyn my o bng cch ngt cc my o b qu

ti v khi ng cc my o cha qu ti.

c.Lp lch cng vic

B lp lch cng vic HTC Condor [7] c thit k qun l cc cng

vic u tin v lp k hoch. Nh cp, Cloud Scheduler c th nh hng

n vic lp k hoch cng vic ca Condor. V d, hy xem xt hai vic xp hng

i, cng vic trnh u tin i hi mt my o c kiu l VM-A, v mt cng

vic c yu cu th hai i hi mt my o c kiu l VM-B. NuCloud Scheduler


36/79


bt u ln u tin vi VM-B (gi s cc ngun ti nguyn khi ng my o

VM-B c sn), sau cng vic VM-B s chy trc khi cng vic VM-A c

yu cu.

Cloud Scheduler c th c cu hnh a lm cho cc ti khon ngi

dng cn bng v ti nguyn v m bo tnh u tin s dng. Hin nay, Cloud

Scheduler s bt u vi nhiu my o cng vi cc ngun ti nguyn sn c trn h

thng. Cc my o c cung cp ng u n tt c ngi s dng vi cc cng vic

trong hng i.

Cloud Scheduler ti cn bng cung cp my o bng cch tt cc my o

c cung cp v khi ng cc my o khc c cp.

V d, mt ngi s dng s nhn c cp pht y ca my o My

Scheduler, nhng mt khi ngi dng th hai trnh cng vic, mt na s ngi s

dng my o u tin s c ng ca cc ngun ti nguyn min ph cho ngi

s dng th hai.

Cloud Scheduler c th ti cn bng cung cp my o bng cch tt my o

mt cch t t hoc bng cch ngay lp tc. Khi cu hnh tt my t t, Cloud

Scheduler chuyn tnh trng ca Condor sang cp pht chnh thc, v yu cu cc

my o trn phn b cho mt nhm khc. Khi Cloud Scheduler c cu hnh ttmy ngay lp tc, cc my o s tt my ngay lp tc m khng cn ch i cho cng

vic kt thc. Nu mt my o c tt trong khi cng vic ang chy, b lp trnh

cng vic HTC Condor s lp lch li cho cng vic v a n vo hng i ch

thc hin.

1.2.2 Vn la chn m hnh ph hp trin khai dch v in ton

m my ca cc nh cung cp ti Vit Nam

i vi Vit Nam, in ton m my ang l ch cng ngh nng hi v

c phn kh mi m, s am hiu v in ton m my ni chung v vn chia s

ti nguyn my o trong in ton m my ni ring cn cphn hn ch.

Mi m hnh dch v in ton m my c trin khai theo mt c ch khc

nhau. La chn m hnh hot ng theo c ch no trin khai dch v in ton

m my l mt bi ton quan trng i vi nh cung cp dch v.

C rt nhiu vn t ra lm sng t c bi ton nh:Dch v theo m hnh c phc tp trong vic trin khai khng?


37/79


Nguyn l xy dng dch v theo m hnh ra sao?

M hnh c tiu tn ti nguyn khng?

Tc x l, hiu sut ca m hnh nh th no?C ging vi cc h

thng my thc vt l hay khng ?

Song song vi vic la chn m hnh dch v, nh cung cp dch v cn chng

mnh cho ngi s dng bit rng dch v o ha theo m hnh m mnh xy

dng hon ton c th p ng c cc tiu ch nh: Ngun ti nguyn dch v lun

sn sng p ng cng vic; M hnh ang trin khai hon ton ging vi h thng

my vy l tht nh trc y v tc ...

V d, nu trin khai theo c ch thit lp mt mi trng ng dng o bng

cch s dng cc ng dng o nh mt c ch chia s ti nguyn, th bt c khi noc yu cu cung cp nhiu ti nguyn hn, h thng t ng trin khai thm cc ng

dng o khc.Vi cch tip cn ny liu c gy lng ph cc ngun ti nguyn khng?

Trong in ton m my, cc nh cung cp dch v cho php khch hng

thu mt ngun ti nguyn o, trong h c th ty chnh li h iu hnh v mi

trng cho cc ng dng. Vic chia s ti nguyn gia cc cng vic l kh khn

bi v mi cng vic c yu cu ti nguyn khc nhau m khng th c tnh trc

mt cch chnh xc.Trong mt h thng cm o, khi ngi dng gi i mt yu cu, my o s p

ng thc hin cc nhim v. Nhng my o ny c iu khin bi mn hnh my

o. Bn cnh , cc mn hnh my o cqun l bi h thng qun l my o c

th cung cp ti nguyn cho cc trng hp my o ang chy trn cc cm vt l.

V mt l thuyt, s dng cng ngh my o lm tng s dng cm, v n ch

cung cp cho ngi s dng nhng ngun ti nguyn m h cn n. Cc my tnh

cho php hiu chnh li vic chia s ti nguyn trc tuyn c thc hin nh l mt

phn ca cc Mn hnh my o v h thng qun l my o. Tuy nhin, n rt phc

tp t c mc tiu bi v vn tn ti mt s tnh hung gi nh c th lm

gim hiu sut ca cc cm o. Cc gi nhbao gm:

CPU v b nh yu cu cho cc ng dng c th chy.

Mi cng vic yu cu ch c duy nht mt my o c thit lp.

Khi lng cng vic l c nh vi yu cu ngun ci nguyn khng i v


38/79


khng c cng vic c nhp vo vo a ra khi h thng.

Cng ngh my o cho php chia s cc kh nng tnh ton ca mt my

ch lu tr trn CPU b rng buc .

Nhng thch thc ny c th lm tht bi ng dng chy trn m my.

Thng thng, cc thit b o c cu hnh li v sn sng chy my o cho cc

ng dng c th. gii quyt nhng vn trn y, cn nghin cu mt s c ch

chia s ti nguyn my o trong in ton m my, t xut ra mt c ch trin

khai th nghim dch v trn mt cm o, thc hin cc th nghim, a ra kt qu v

nhn xt nh gi, chng minh tnh kh thi ca n.


39/79


CHNG 2

MT S

2.1 CHIA S TI NGUYN MY O

2.1.1 Thit lp mt mi trng ng dng o

H trin khai thit b o trn my vt l ring bit[1] cho cc ng dng c bit

v s dng mt b nh v ra quyt nh lp k hoch trn c s khi lng cng

vic c yu cu. Bt c khi no c yu cu cung cp nhiu ti nguyn hn, h

thng t ng trin khai thm cc ng dng o khc. Vi cch tip cn ny gy

lng ph cc ngun ti nguyn, bi v h cung cp cng mt lng ngun ti

nguyn thit b o mi cng c th hot ng ging nh cc thit b o khc ang

hot ng. Ngoi ra, s dng cc ng dng ang chy trong mi trng my o

c th theo di nhu cu ti nguyn ca h, v vic chia s ti nguyn c c linh

ng, mm do hn. N ngn chn rt tt cc xung t mt khi cc ng dng chia s

cc ngun ti nguyn cng chy.

2.1.2 sp xp li phc tp ca cc vn

H nh thc ha vn chia s ti nguyn ni chung da trn cc gi nh can. Sau , h sp xp li phc tp ca cc vn v xut cc thut ton

gii quyt vn .

H thng xem xt mt nhm cm my o ng nht da trn mt kt ni chuyn

mch, v c qun l bi mt h thng chia s ti nguyn. H thng p ng yu cu

ti nguyn ngi dng bng cch to ra mt nhm cc my o gi l "cm o", cng

vic s c gii quyt trn cm o.

Cc my o chy trn my ch vt l, v mi my o c kim sot bi mn

hnh my o. Mn hnh my o s yu cu ngun ti nguyn khc nhau cho mi my

o trn mi my ch vt l. Mn hnh my o hot ng di s qun l v iu hnh

ca h thng qun l cm my o hay gi l h thng qun l cm o. H thng qun

l cm o s xc nh v iu khin vic cp pht ti nguyn cho mi my o.

Ngoi ra, h thng qun l cm o cn c th iu khin vic di chuyn my o

gia cc my ch vt l, mi my ch vt l gi l mt nt, da trn tnh nng cnbng ti, vic iu khin di chuyn my o qua li gia cc my ch vt l vi mc


40/79


ch s dng s lng t nht my ch vt l c th trong h thng cm o, nhng

vn p ng c yucu cng vic t ngi dng, gii phng cc my ch hot

ng vi cng sut thp. Do h thng qun l cm o s cung cp c ch phn b

ngun ti nguyn cho mi cng vic khi c yu cu.

Quyt nh chia s ti nguyn s c thc hin bi mt b cp pht ti nguyn

trong h thng cm o, quyt nh lin quan ti vic yu cu s b t chi hay chp

nhn khi ng ng mt my o no , lin quan ti vic di di my o t my ch

vt l sang my ch vt l khc, lin quan n t l tiu th ti nguyn b iu

chnh cc my o ca h thng. Mc tiu ca c ch l thit k mt thut ton phn

b ngun ti nguyn m thanh c thc hin ti trung tm ca cc cp pht ti nguyn.

2.1.3 Uc lng hiu sut ca mt ngun lc c cung cp

Trong c ch ny, tc gi trnh by mt kin trc c th c lng hiu sut

ca mt ngun lc c cung cp v tm mt gii php chia s ti nguyn ti u

trong khng gian tm kim vi quy m rt ln, l kin trc TARA

2.1Kin trc TARA

Cng c d bo c th vch ra c cc yu t chia s ngun ti nguyn theo

cc thng s s ph hp vi hm mc tiu. Sau cc ngun ti nguyn ny s c


41/79


ch nh p dng vo cc yu cu cng vic c th. Trong h thng nguyn mu

ny, lp o ha v lp IaaS cng cungcp cc thng tin v ngun ti nguyn sn c

cho cng c d bo trc khi cng vic c ch nh ngun ti nguyn. Cu trc ny

gip nng cao kh nng chia s cc ngun ti nguyn vo cc nhm o. Mt cng vicno cn mt ngun ti nguyn s c cung cp y v hiu qu chy ng

dng mt cch hiu qu.2.1.4 Thut ton chia s ti nguyn

a) tng

Xy dng mt kin trc framework nhm mc ch qun l chia s ti

nguyn tnh ton trong in ton m my mt cch t ng, gim thiu vic tiu

th nng lng n mc c th km theo vic duy tr cht lng dch v mcchp nhn c. Mc tiu ca framework ny bao gm:

- a ra nhng chnh sch v c ch qun l ti nguyn mt cch t ng.

- Theo di v duy tr nhng mc tiu v hiu sut ca ng dng.

- Gim thiu ti a vic s dng nng lng khi chy cc dch v in ton

m my.

b) Thut ton

Input: Cc my ch o, ti nguyn my server vt l

Output: Server s p ng yu cu cho my o vi phng n ti u nht


42/79


S khica thut ton:

Bt u

Theo di thng s vhiu sut ca my o

So snh vimc tiu

Tnh ton ti nguyntha yu cu rng buc

Chuyn yu cu vPhysical Machine

Manager

Kt thc

Thamn

khngtha mn


43/79


c) Ci t

2.2 CN BNG TI

2.2.1 K thut cn bng ti

Nh chng ta bit, bcn bng ti c nhim vkt ni gia ngi dng v

server, do n c th hot ng nh mt proxy hoc gateway. Mt proxy c

nhim vlun chuyn yu cu v dliu p trgia ngi dng v server, trong

khi mt gateway chc nhim vto ra mt kt ni hai i tng ny v khng

lm g thm. C thsdng phn cng hoc phn mm c ci t trn mt front

server, hoc trn chnh web server [2]. Thm na, khi slng ngi dng tng ln,

trnh SPOF, cn thit phi ci t 2 bcn bng ti song song, hot ng theo c

chactive-active hoc active-backup.

Cc phn mm cn bng ti thng c ci t nh m t proxy. xy

dng mt b cn bng ti phn mm, cc k thut cn phi ch trng, l: kim


44/79


tra trng thi server, la chn server tt nht gi yu cuv k thut duy tr kt

ni ca ngi dng.

2.2.1.1 Kim tra trng thi server

chn c server ph hp gi request, b cn bng ti cn phi bit

c server no ang c sn. V vy, n cn phi dng bin php no kim tra

trng thi ca server, chng hn nh gi lnh ping, cc yu cu, thkt ni hay bt

cphng php no m ngi qun trngh l dng c. K thut kim tra ny

thng c gi l health checks

Mt server bdown c thtrli lnh ping nhng khng thtrli cc kt ni

TCP, mt server btreo c khnng trli kt ni TCP nhng khng thtrli cc

yu cu HTTP. Khi mt ng dng web nhiu lp c kch hot, mt syu cu

HTTP c thtrli ngay lp tc trong khi skhc stht bi.

Chnh v th, vic chn mt phng php test ph hp c chp nhn bi

ng dng web v bcn bng ti l rt th v. Mt stest i khi phi cn truy xut

dliu database nhm m bo rng ton bqu trnh ca n l ng. Hn chln

nht l nhng phng php kim tra ny schim ti nguyn ca hthng nh l

CPU, threads

Do , cn bng thi gian kim tra chnh l vn kh nht trong kthut lachn server. Khong thi gian gia 2 ln test lin tip phi di khng tn qu

nhiu ti nguyn ca h thng v cng cn ngn nhanh chng pht hin ra

nhng server cht. V health checks l mt trong nhng kha cnh phc tp

nht ca kthut cn bng ti, nn thng sau mt vi kim tra, cc nh pht trin

ng dng sthc thi mt yu cu c bit dnh ring cho bcn bng ti, gip cho

n thc hin mt skim tra ni b.

Phn mm cn bng ti c khnng cung cp scripting, do n t c

linh hot rt cao. Thm na, nu nh mt bi kim tra no i hi phi chnh sa

code, n c ththc hin trong mt khong thi gian ngn.

2.2.1.2 La chn server tt nht

Vic la chn server tt nht chnh l phn chnh ca thut ton cn bng ti

c cp trong phn 2. Phng php dnht v thng c sdng nht trong

cc h thng nh l Round Robin, cc server c la chn quay vng, tuy nhinphng php ny c nhc im l 2 requests lin tc tmt ngi dng svo 2


45/79


servers khc nhau, thng tin gia 2 yu cu lin tip sbmt, nh vy skhng th

ti u ha c sdng ti nguyn. c bit l khi cn phi ci t kt ni cho cc

phin chyv dnh SSL key negociation srt tn thi gian.

Mt cch khc phc nhc im ny l sdng mt hm bm theo a chIP,

nh vy requests tcng mt a chIP schvo mt server duy nht. Tuy vy

phng php ny i hi ngi dng phi c IP tnh. Vy th cch khc phc cho

nhng hn chtrn l g? chnh l cc kPersistence

2.2.1.3 Kthut Session Persistence

Nh cp trn, vn cn gii quyt chnh l lm sao gicho cc

yu cu ca mt ngi dng c gi vo mt my duy nht trong sut phin lm

vic ca ngi . Tt c cc yu cu ca ngi dng ny cn phi c chuyn

vo cng mt server. Nu server bcht, hoc ngng bo tr, cn phi c c ch

chuyn session ca ngi dng ny sang my server khc. chnh l kthut

Session Persistence.

C mt sgii php c a ra tip cn kthut ny, chng hn nh s

dng mt respone HTTP 302 hay to ra lin kt gia ngi dngserver. Tuy vy

2 phng php ny u c nhng hn ch, sdng HTTP 302 skhin ngi dng

lun lun tm cch kt ni vi mt server duy nht, kckhi server ny cht.Dng cch to lin kt i hi user phi c IP tnh trong sut phin lm vic.

Vy th cu trli cui cng l g? chnh l sdng cookie. Cookie l mt

i tng c iu khin bi Web Servers. Trong kt qutrvcho ngi dng

web servers s chn thm mt s thng tin. Nhng yu cu tip theo ca ngi

dng gi n server scha thm thng tin ca cookie ny, server sc cc cookie

v bit phi lm g vi cc yu cu ny.

2.2.2 Cc thut ton cn bng ti

2.2.2.1 Thut ton Round Robin (RR)

a) tng

RR l thut ton c dng thng xuyn nht trong cc h thng va v

nh, c t i hi vkhnng mrng. Mt kt ni mi sc gi n server k

tip trong cm server, v c quay vng nh vy. RR lm vic tt trong mi cu

hnh, nhng stt hn nu nh cc trang thit bang c cn bng ti khc nhauvtc xl, tt kt ni hoc bnh.


46/79


Mt cch thc thi thut ton ny l s dng mt server_map. B cn bng

ti s c khai bo nh mt con tr proxy, n s c bin server_map l mt mng

cc server v bin srv_rr_idx ch nh server tip theo trong chu k round robin.

b) Thut ton

Input: hiu nng s dng ca my o, s my o trn mi server

Output: quyt nh di chuyn my o sang server mi


47/79


S khi ca thut ton nh sau:

Bt u

Kim traserver_map

dn ghp my osang server mi

Kim traserver trng

Tt server

Kt thc

tha k

tha k

khng trng


48/79


c) Ci t

/* Kim tra xem c server no sn c khng bng cch kim tra kch thcserver_map */

if(srv_map_size = 0)return NULL;if (srv_rr_idx > proxy->srv_map_size)

/* Nu n cui mng srv_map, update li gi trsrv_rr_idx */srv_rr_idx = 0;

int newidx = px->srv_rr_idx;

do {

srv = proxy ->srv_map[newidx++];

/* Trvserver v update li gi trsrv_rr_idx */

return srv;proxy->srv_rr_idx = newidx;

} while (newidx != px->srv_rr_idx)

/* Thc hin cho n khi ly c server tip theo */

RR hot ng tt khi cc server c khnng xl (cu hnh) tng tnhau,

tuy nhin sc hin tng mt cn bng khi cc server c cu hnh khc nhau, hoc

sau mt thi gian, skt ni ang hot ng mt server ang nhiu hn hn mt

server khc, nhng lng kt ni tip theo m cc server ny nhn c vn bng

nhau. Do mt sserver sphi xl nhiu hn hn cc server khc. Tuy vy, v

tnh n gin ca n, nn n hot ng rt hiu qu(khng phi mt thm thi gian

tnh ton cc thng skhc nn vic phn ti din ra rt nhanh). Nu cc server hot

ng bnh thng v khng xy ra scth sdng RR rt tt.

im yu ca RR l 2 yu cu lin tc t pha mt ngi dng c th s

c gi vo 2 server khc nhau. iu ny khng tt v khi ngi dng ang ckt ni vo mt server, thng tin m hcn ang server , nu kt ni tip theo

vn c server xl th sgp phn tng tc p ng cho ngi dng. Do

thut ton RR thng c ci t cng vi cc phng php duy tr session nh

sdng cookie.

2.2.2.2 Thut ton Weighted Round Robin (Ratio)

a) tng


49/79


Nguyn l hot ng ca thut ton WRR cng ging nh thut ton RR, yu

cu tpha ngi dng sc bcn bng ti chuyn n cc server theo tht

xoay vng. Skhc bit duy nht y l thut ton WRR cn quan tm n kh

nng xl (cu hnh) ca cc server. Trong cng mt chu k, 1 server c khnng

xl gp i server khc snhn c gp i syu cu tpha bcn bng ti.

Gischng ta c 4 server A, B, C, D c cu hnh khc nhau, A v B c cu

hnh ging nhau, C v D c cu hnh mnh gp i A. Vy chng ta c thnh

trng scho A v B l 1, C v D l 2. Khi theo thut ton WRR, thtserver

nhn yu cu tpha bcn bng ti sl ABCDCD.

Thut ton ny c thc thc thi nh sau: Gischng ta mt hng i

cha cc server snhn request. Nu nh 1 server trng sn, trong hng i s

c n chmc (entry) ca cng 1 server ny, chng hn nh v dtrn, mi server

A, B sc 1 chmc, mi server C, D sc 2 chmc. Vi cch lu chmc nh

vy trong hng i, cc server trong WRR s c ly ra theo th t hon ton

ging nh RR.

Thut ton WRR hot ng tt hn RR khi cc server trong cluster c cu

hnh khc nhau. Tuy nhin s dng thut ton ny c th dn ti s mt cn bng ti

ng nu nh ti ca cc yu lin tc thay i trong mt khong rng (v d nhcc yu cu xem video hoc ti cc file c dung lng ln xen k vi cc yu cu

c thng tin...). Trong mt khong thi gian ngn, hon ton c kh nng phn ln

cc yu cu c ti cao s c chuyn hng n cng mt server.

b) Thut ton

Input: danh sch my o trn mi server, danh sch server

Output: khi to my o trn server c la chn


50/79


S khi ca thut ton nh sau:

Bt u

Kim traserver_map

Khi to my o

Kim traserver trng

Kt thc

Gn ch s choserver

tha k

ng

sai


51/79


c) Ci tGisnh chng ta c 3 server A, B, C vi trng sln lt l 1, 2, 3. Thut

ton s phn ti vo server theo th t ABBCCC. iu ny c ch nh trong

srv_map khi chng ta lu cp pht b nh cho mt server mi v lu n vosrv_map. Bin srv_rr_idx c dng chn server tip theo trong thut ton.

Thut ton RR c ci t nh sau: static inline struct server*get_server_rr_with_conns(struct proxy *px) {int newidx;/* Bin ny dng t gi trmi cho srv_rr_idx saukhi chn c server */struct server *srv;/*Kim tra nu kch thc ca srv_map bng khng, nghal khng tn ti server no ang hot ng, thut tontrvnull */

if (px->srv_map_sz == 0)return NULL;

/*Nu nh gi trca srv_rr_idx nhhn 0, hoc vtqu kch thc srv_map_sz, ngha l i n cuiserver map chng ta scp nhp gi trcho n bng 0*/if(px->srv_rr_idx < 0 || px->srv_rr_idx >= px->srv_map_sz)

px->srv_rr_idx = 0;/*Gn gi trca srv_rr_idx cho newidx */newidx = px->srv_rr_idx;

/*Thc hin vng lp cho n khi ly c server phhp lra y v newidx = pr->srv_rr_idx, chng ta sly c lun server tha mn, tuy nhin cn phi loitrtrng hp server y, hoc skt ni hinti ln hn skt ni cho php */

do {srv = px->srv_map[newidx++];if (!srv->maxconn || srv->cur_sess srv_rr_idx = newidx;

return srv;}if (newidx == px->srv_map_sz)

newidx = 0;} while (newidx != px->srv_rr_idx);

return NULL;

}

Thut ton WRR n gin v chy kh n nh trong phn mm Haproxy,

tuy nhin n cng c nhng nhc im m khng thkhc phc c.


52/79


Thnht, v n phn phi ti theo hnh thc xoay vng, nn mt ngi dng

n vi website c thc y n cc server khc nhau, iu ny l khng nn

xy ra, v khi ngi dng c a vo mt server, ngha c thit lp kt

ni vi server , tip tc lm vic vi server ny cc yu cu tip theo sgip

ngi dng khng phi ti li mt scc i tng (chng hn nh c ti v

yu cu trc), hn na, sgip ngi dng khng phi thc hin li vic kt ni

server, iu ny c bit quan trng khi web-server c yu cu vbo mt, chng

hn nh kim tra SSL key. Nu yu cu ca mt ngi dng c a vo cc

server khc nhau, vic kim tra lin tc SSL key smt rt nhiu thi gian, lm tng

thi gian p ng ngi dng.

Chng ta c thkhc phc nhc im ny bng 2 cch. Cch thnht l s

dng cookie nh ni phn cookie ca chng 2. Cch th2 l sdng mt

hm bm theo a chIP ca ngi dng. Khi bcn bng ti nhn yu cu, n s

bm a chIP ca ngi dng. Cng mt gi trbm sc cho vo 1 server. Tuy

nhin phng php ny i hi ngi dng phi c IP tnh.

Nhc im th 2 l v phn phi theo kiu xoay vng, nn c th s xy ra

trng hp mt server phi phc v rt nhiu ngi dng, trong khi server khc li

nhn ri. iu ny c th khc phc bng cch s dng thut ton LeastConnections (LC)

2.2.2.3 Thut ton Least Connections (LC)

a) tng

Trong thut ton LC, yu cu tpha ngi dng sc chuyn vo serverc t kt ni nht trong hthng ti thi im . Thut ton ny c coi nh thutton ng, v n cn phi m skt ni "ang hot ng" ca cc server. Vi mt

hthng c cc server gn ging nhau vcu hnh, LC c khnng hot ng ttngay ckhi ti ca cc kt ni bin thin trong mt khong ln. Do sdng LC

skhc phc c nhc im ca RR.

Gi s chng ta c n server Si, i = 1, 2,...n. S lng connections ang hotng l Ci vi i = (1, 2,...,n). ALL_CONNECTIONS l tng Ci.

Yu cu tip theo s c chuyn n server j, trong :

Cj/ALL_CONNECTIONS = min {Ci/ALL_CONNECTIONS },


53/79


i = (1, 2,...,n).

V gi tr ALL_CONNECTIONSl khng i ti thi im tnh nn chngta c th chn server Cj theo cng thc:

Cj = min {Ci}, i = (1, 2,...,n).

Nhn bn ngoi c v nh LC cng c kh nng hot ng tt khi cc server

c cu hnh bin thin khc nhau, trn thc t iu l khng ng. Vy th

nguyn nhn u? chnh l do trng thi TIME_WAIT ca TCP.

TIME_WAIT ny thng c t l 2 pht, trong 2 pht mt website "bn rn"

c th nhn ti hng chc ngn kt ni lin tc, gi s nh server A c kh nng x

l gp i server B, server A ang x l hng ngn yu cu v gi nhng yu cu

ny trong trng thi TIME_WAIT ca TCP, trong khi server cng phi x l

hng ngn yu cu nh server A, nhng v cu hnh server B yu hn nn s chm

chp hn rt nhiu. Nh vy, thut ton LC hot ng khng tt khi cc server c

cu hnh khc nhau.

b) Thut ton

Input: danh sch kt ni hin ti, danh sch cc server

Output: khi to my o trn server c la chn


54/79


S khi cathut ton nh sau:

Bt u

Kim traserver_map

Khi to my o

Kim traserver trng

Kt thc

sp xp danh schserver theo ds kt ni

tha k

ng

sai


55/79


c) Ci t

gis2 server A, B c trng sln lt l 1 v 2. Thut ton sm bo cho

ssession active B lun xp xgp i ssession active A, v chng ta ang so

snh ssession active/ trng sserver.

V vic kim tra s lng kt ni khng phi c thc hin ngay lp tc.

Trong mt hthng c ti cao, nu mt server l ang c t active session nht, n

snhn c yu cu, sau n snhn c lin tc yu cu, do slng active

session cha kp cp nhp. V vy, trong thut ton ny, chng ta cn trnh phn 2

yu cu lin tip vo cng mt server (chng ta ang xt vi bi ton khng c

cookie, ngha l 2 kt ni n t 2 clients khc nhau). Ngha l server va c

phn ti strthnh server cn trnh trong ln phn ti tip theo. y chng ta s

dng bin struct server *srvtoavoid.

if(srv != srvtoavoid){

}

Sau khi chn c server, chng ta s cp nhp li gi tr srvtoavoid bng

mt bin static

Static struct server *pre_server;

Pre_server = t;

Di y l hm thc thi thut ton least connections:

static inline struct server *get_server_lc(struct proxy

*px, struct server *srvtoavoid) {

int s; /*Sdng ly skt ni t nht ca mi

server da trn trng sca chng */

struct server *srv, *t;

/* Kim tra nu kch thc ca srv_map bng khng, ngha

l khng tn ti server no ang hot ng, thut ton trv

null */

if (px->srv_map_sz == 0)

return NULL;


56/79


t = NULL;

s = 10000000;

/* Thc hin cho n khi tm c server ph hp, tng

gi tri v chn server no c t kt ni nht da trn bincur_sess v trng s*/

for(srv = px->srv; srv != NULL; srv = srv->next) {

if(srv != srvtoavoid) {

if (!srv->maxconn || srv->cur_sess (srv->cur_sess / srv-

>eweight ) || t==NULL) {

t = srv;

s = srv->cur_sess / srv-

>eweight;

}

}

}

}

pre_server = t;

return t;

}

2.3 LP LCH CNG VIC

B lp lch cng vic HTC Condor [7] c thit k qun l cc cng

vic u tin v lp k hoch. Nh cp, Cloud Scheduler c th nh hng

n vic lp k hoch cng vic ca Condor. V d, hy xem xt hai vic xp hngi, cng vic trnh u tin i hi mt my o c kiu l VM-A, v mt cng

vic c yu cu th hai i hi mt my o c kiu l VM-B. Nu Cloud Scheduler

bt u ln u tin vi VM-B (gi s cc ngun ti nguyn khi ng my o

VM-B c sn), sau cng vic VM-B s chy trc khi cng vic VM-A c

yu cu.

Cloud Scheduler c th c cu hnh a lm cho cc ti khon ngi

dng cn bng v ti nguyn v m bo tnh u tin s dng. Hin nay, Cloud


57/79


Scheduler s bt u vi nhiu my o cng vi cc ngun ti nguyn sn c trn h

thng. Cc my o c cung cp ng u n tt c ngi s dng vi cc cng vic

trong hng i.

Cloud Scheduler ti cn bng cung cp my o bng cch tt cc my o

c cung cp v khi ng cc my o khc c cp.

V d, mt ngi s dng s nhn c cp pht y ca my o My

Scheduler, nhng mt khi ngi dng th hai trnh cng vic, mt na s ngi s

dng my o u tin s c ng ca cc ngun ti nguyn min ph cho ngi

s dng th hai.

Cloud Scheduler c th ti cn bng cung cp my o bng cch tt my o

mt cch t t hoc bng cch ngay lp tc. Khi cu hnh tt my t t, Cloud

Scheduler chuyn tnh trng ca Condor sang cp pht chnh thc, v yu cu cc

my o trn phn b cho mt nhm khc. Khi Cloud Scheduler c cu hnh tt

my ngay lp tc, cc my o s tt my ngay lp tc m khng cn ch i cho cng

vic kt thc. Nu mt my o c tt trong khi cng vic ang chy, b lp trnh

cng vic HTC Condor s lp lch li cho cng vic v a n vo hng i ch

thc hin.

2.3.1Thut ton Lp lch da trn Cn bng tia) tng

Ti ca my o c th hin qua thi gian thc thi d on ca nhim v

chy trn my o, gi l Vli. V ti ca host c biu din bi ti trung bnh ca my

o chy trn n, gi l HLi, ta c HLi=1

n

j

j

VL

n trong n l s my o chy trn

host.T HLi, gi tr ti trung bnh avgl v gi tr nh gi cn bng ti B ca mi

trng in ton m my c th nh ngha nh sau:

avgl= 1

m

i

HLi

m

B=

2

1

( )m

i

Li avgl

m


58/79


Trong cc phng trnh trn, s host l m, gi tr B cng nh th cn bng ti

cng tt v gi tr B cng ln th cn bng ti km hn.

b) Thut ton

Input: ti nguyn host, cng sut x l ca host

Output: my o c ti nh nht

Cc bc thut ton:

Bc 1. Theo m hnh ti nguyn host, to tp ti nguyn host nh sau

H = {h0, h2, ... hm-1} v xp theo th t t di ln theo cng sut x l.

Bc 2. Theo m hnh nhim v, to tp nhim v H = {t0, t2, ... tm-1} Trong

qu trnh ny, b lp lch mc th nht to m t my o theo cc c tnh ca nhim

v, cung cp thng tin cu hnh cho vic gn ti nguyn v to my o.

Bc 3. Theo m t my o ca Nhim v t i T, chn mt ti nguyn host hj

c th t c ti nguyn yu cu v ti l nh nht. Nu host tn ti, to my o v

gn ti nguyn yu cu cho n, sau cp nht ti nguyn kh dng hFcap ca Host hj ,

nu khng nhim v tis xung cui hng i nhim v v ch lp lch tip theo.

Bc 4. Nu yu cu ti nguyn ca nhim v t igim i, th gii phng ti

nguyn tha m my o chim gi, v cp nht ti nguyn kh dng gi bi host.

Bc 5. Nu nhim v ti c hon thnh, th hu my o canhim v tiv gii phng ti nguyn c chim gi cho cc nhim v cha c thc thi khc.

Bc 6. Tnh gi tr nh gi cn bng ti B trong mi trng hin ti, nu B

ln hn ngng gi tr B0, iu ny ch ra trng thi cn bng ti km i, th chn mt

my o vi ti nh hn v chuyn n n host m c th t c yu cu ti nguyn

vi ti nh nht.

Bc 7. Lp li bc 3 n 6 cho n khi mi nhim v c hon thnh.

Trong thut ton trn, my o c lp lch cho host c ti nh nht trong mi

ln thc hin. u im l trnh qu ti cho host gi nhiu ti nguyn hn. Nu my

o hin thi c lp lch cho mt host, khi lng tnh ton tng ln, dn n ti ca

my o nng gy mt cn bng ti, th hot ng di chuyn ng c s dng,gi cn

bng ti trong mi trng hin ti.

c) Ci t

struct server {struct server *next;


59/79


int state; /* server state (SRV_*) */

int cklen; /* the len of the cookie, to

speed up checks */

char *cookie; /* the id set in the cookie */

char *id; /* just for identification */

struct list pendconns; /* pending connections */

int nbpend, nbpend_max; /* number of pending

connections */

struct task *queue_mgt; /* the task associated

to the queue processing */

struct sockaddr_in addr; /* the address to

connect to */

struct sockaddr_in source_addr; /* the address to

which we want to bind for connect() */

short check_port; /* the port to use for the

health checks */

int health; /* 0->rise-1 = bad; rise->rise+fall-1 =

good */

int rise, fall; /* time in iterations */

int inter; /* time in milliseconds */

int result; /* 0 = connect OK, -1 = connect KO */

unsigned char uweight, eweight; /* user-specified

weight-1, and effective weight-1 */

unsigned int wscore; /* weight score, used during

srv map computation */

int cur_sess, cur_sess_max; /* number of currently

active sessions (including syn_sent) */

unsigned int cum_sess; /* cumulated number of

sessions really sent to this server */

unsigned int maxconn, minconn; /* max # of active

sessions (0 = unlimited), min# for dynamic limit. */

unsigned failed_checks, down_trans; /* failed checks

and up-down transitions */

unsigned failed_conns, failed_resp; /* failed

connect() and responses */

unsigned failed_secu; /* blocked responses because

of security concerns */

struct proxy *proxy; /* the proxy this server

belongs to */

};

2.3.2 Thut ton Lp lch da trn thut ton Gii thut di truyn ci tina) tng


60/79


Phn ny s nghin cu thut ton lp lch GA ci tin, trong cc phng

php lp lch Min-Min v Max-Min c st nhp trong mt thut ton GA tiu chun.

Cc k thut Min-Min, Max-Min v Genetic c phn tch trong hiu nng cui cng

ca thut tonGA tiu chun v c s so snh vi GA ci tin.

b) Thut ton

Input: ti nguyn host, cng sut x l ca host

Output: my o c ti nh nht

To qun th vi ccphng n ngu nhin

Bt u

c lng miphng n

Chn b m

Phi hp lai cc ib m

nh gi ng vinmi

Chn c th cho th htip theo

Tha mniu kin

C

khng


61/79


Thut ton di truyn ci tin

To qun th vi ktqu buc 2

Bt u

nh gi mi ngvin

Chn b m

Phi hp lai cc ib m

nh gi ng vinmi

Chn c th cho th htip theo

Kt thc

Tha mniu kin

C

khng

Tm phng thc biMin-Min v Max-Min


62/79


c) Ci t

static inline struct server

*get_server_rr_with_conns(struct proxy *px) {

int newidx;

/* Bin ny dng t gi trmi cho srv_rr_idx sau

khi chn c server */struct server *srv;

/*Kim tra nu kch thc ca srv_map bng khng, ngha

l khng tn ti server no ang hot ng, thut ton

trvnull */

if (px->srv_map_sz == 0)

return NULL;

/*Nu nh gi trca srv_rr_idx nhhn 0, hoc vt

qu kch thc srv_map_sz, ngha l i n cui

server map chng ta scp nhp gi trcho n bng 0*/

if(px->srv_rr_idx < 0 || px->srv_rr_idx >= px-

>srv_map_sz)

px->srv_rr_idx = 0;

/*Gn gi trca srv_rr_idx cho newidx */

newidx = px->srv_rr_idx;

/*Thc hin vng lp cho n khi ly c server ph

hp lra y v newidx = pr->srv_rr_idx, chng ta sly c lun server tha mn, tuy nhin cn phi loi

trtrng hp server y, hoc skt ni hin

ti ln hn skt ni cho php */

do {

srv = px->srv_map[newidx++];

if (!srv->maxconn || srv->cur_sess srv_rr_idx = newidx;

return srv;}

if (newidx == px->srv_map_sz)

newidx = 0;

} while (newidx != px->srv_rr_idx);

return NULL;

}


63/79


CHNG 3

3.1 T BI TON

Bi ton t ra l khi khch hng ng k lp hp ng thu 1 my ch vi

cu hnh theo yu cu, khch hng s t chn cu hnh trn website ca cng ty

cung cp dch v, sau h thng s t ng to my ch o tha mn yu cu cu

hnh ca khch hng yu cu.

Trong qu trnh khch hng s dng dch v, h thng tng tin hnh cn

bng ti, chia s ti nguyn my o , t ng lu tr, sao lu hay phc hi d liu

khi c s c ...3.2 PHN TCH NH GI LA CHN CNG C GII QUYT BI TON

3.2.1 Thit k h thng

S dng 2 trm lm vic thit lp nn mt m my vi My ch

Ubuntu 10.04. Ti s dng mt m ngun m l EUCALYPTUS framework

thit lp nn mt m my vi mt B iu khin m my (Cloud Controller -

CLC), mt B iu khin nhm (Cluster Controller - CC) v cc B iu

khin Nt (Node Controller - NC). Ti ci t b iu khin m my v b

iu khin nhm vo nt u, cui v ci t cc b iu khin nt trn mt my

tnh xch tay khc c ni vi mng ring ny. Ti s dng

EUCALYPTUS framework tora cc my o trn cc b iu khin nt. V

cui cng ca cng vic ci t th nghim, ti ci t Hadoop/MapReduce

framework nh gikt qu ca cc th nghim.

Vic thit k h thng bao gm thit k mng, ci t m ngun

Eucalyptus, cc gi software components, trin khai Hadoop/ MapReduce. Kt

qu t c ca thit k l mt h thng cm o hot ng theo c chCloud

Scheduler.

3.2.2 Thit k mng

Th nghim c trin khai trn mt my vi tnh bn v mt my tnh

sch tay nh hnh 3.1:


64/79


\

3.1


65/79


C hai my ch chy trn Ubuntu 10.04 servers OS. Trn my ch 1, ti ci

t b iu khin m my (Cloud Controller), b iu khin nhm

(Cluster Controller) v b iu khin Walrus (Walrus Controller). Trn mt my

ch khc, ti ci t b iu khin nt, my ny phi c tnh nng o ha trong

BIOS trc khi trin khai B iu khin nt Eucalyptus.

3.2.3 Ci t Eucalyptus

Chun b ci t Eucalyptus :

Trc tin, phi cp nht cc b m ngun bin dch bao gm:

C compilers

Java Developer Kit (SDK) phin bn 1.6 hoc cao hn

Apache phin bn 1.6.5 hoc phin bn cao hnlibc development files

pthreads development files

libvirt development files

Axis2C v rampart development files

Curl development files

openssl development files

u tin, cn ci t cc gi yu cu cn thit trc khi ci t

Ecalyptus: apt-get install bzr gcc make apache2-threaded-dev ant openjdk-6-

jdk libvirt-dev libcurl4-openssl-dev dhcp3-server vblade apache2 unzip curl

vlan bridge-utils libvirt-bin kvm vtun.

Sau thit lp mi trng cho Eucalyptus.

3.2.4 Ci t Hadoop

Nhu cu tm kim thng tin qu gi t khi lng ln dliu phi cu trcc to ra bi cc trang web, blog, mng truyn thng x hi.. l rt cao.

Chnh yu t dn lm tng s quan tm n cng ngh m ngun m Hadoop.

Phn mm m ngun m Hadoop, mt d n phn mm qun l d liu

Apache c 2 thnh phn ch yu l h thng file phn tn Hadoop (Hadoop

Distributed File System HDFS [4]) v MapReduce [8], c thit k h tr

cc ng dng s dng c s lng ln d liu cu trc v phi cu trc.


66/79


3.2 Cu hnh Hadoop gi phn tn

Hadoop c th chy cc ng dng vi lng d liu ln mt cch nhanhchng, chnh xc, hiu qu cao bng cch lu v tnh ton d liu trn nhiu node

mt cch c lp, gip x l khi lng c terabyte v thm ch l

petabytes d liu phc tp tng i hiu qu vi chi ph thp hn

Khng ging nh cc h qun tr c s d liu truyn thng, Hadoop

c thit k lm vic vi nhiu loi d liu v d liu ngun. Cng ngh

HDFS ca Hadoop cho php khi lng ln cng vic c chia thnh cc khi

d liu nh hnc nhn rng v phn tn trn cc phn cng ca mt nhm

x l nhanh hn. Cng ngh ny c s dng rng ri bi mt s trang

web ln nht th gii, chng hn nh Facebook, eBay, Amazon, Baidu, v

Yahoo. Cc nh quan st nhn mnh rng Yahoo l mt trong nhng nh

ng gp ln nht i vi Hadoop.


67/79


3.3

Nhn t bn ngoi, files lu trn HDFS cng ging nh lu trong

Windows hay Linux. C th To mi, xa, di chuyn, thay i tn Nhng trn

thc t, d liu c chia ra thnh cc block lu tr trn rt nhiu Node d liu(DataNode), mi block c nhiu bn sao, nhng thng thng, mc nh l 3,

lu trn nhiu DataNode khc nhau, phng khi mt DataNode no c s c th

h thng vn hot ng bnh thng. Ngoi ra cn c 1 (v ch 1) NameNode lm

nhim v qun l d liu v iu tit cc lnh i hi thao tc ng.

D liu u vo c phn chia thnh nhiu phn theo cch cho n c

th c phn phi trong mt cm cc my cho php x l song song. Theo cchnh vy, d liu trung gian to ra c x l song song [4], lm cho cch tip

cn ny l l tng i vi vic x l s lng d liu rt ln. Khi d liu u

vo c cung cp (vo trong h thng tp ca Hadoop [HDFS]), u tin n

c chia thnh cc phn v sau c phn phi ti cc nt [7] trong cm o

m my v c lu tr ti y.Cn MapReduce gip cho vic x l song

song c thun li, t nht gm 3 b phn: hm Map phn tch d liu

thnh cc cp (kha, gi tr); hm Reduce cn c vo cc kha gom tp


68/79


hp cc cp nh vy li vi nhau v a ra kt qu; hm Main iu tit.

Mi mt thao tc Map hoc Reduce c gi l TaskTracker (theo di

nhim v). Thng thng TaskTrackers c chy trn DataNode (nt d

liu) gim ng truyn. Tasktrackers c JobTracker (theo di cng vic)cn c vo thng tin ca blocks khi to trn DataNode ph hp. JobTracker

khng nht thit chy trn cng my viNameNode.

3.2.5 S dng mt s gi m ngun m

a) OpenNebula

OpenNebula l mt ng dng m ngun m theo giy php ca Apache

c pht trin ti i hc Complutense de Madrid. Ngoi vic h tr xy

dng m my ring, OpenNebula ng h tng v cc cc m my lai[5].

m my lai cho php kt hp mt c s h tng m my ring t vi mt c s

h tng m my cng cng (nh Amazon) cho php cc mc m rng cao

hn.

3.4


69/79



70/79


71/79


c) ECP

ECP (Elastic Computing Platform nn tng in ton linh hot) cung

cp mt giao din web ti libvirt, c cc c im ni bt nh kho cha nh v

hng dn ngi dng cng nh kh nng qun l mng rt tt. c im quantrng nht ca ECP l cc kho lu tr ca n v dng c to hnh nh cho my

o, n cho php mt ngi dng t xa truy cp qua din web m ngi dng

ny hon ton khng am hiu v k thut. Cc kh nng lu tr ca ECP hon

ton tha mn cho nhu cu thit k v kim tra cc chi tit ca my o. Tuy

nhin, bi v s gii hn v vic qun l mng ca n v qu trnh ci t yu

cu cn thm vo mt host trong mt cm my o, do ECP [8] vn cn

cha c nhiu ngi s dng ci t.

3.6


72/79


d) Eucalyptus

Mt trong nhng gi m ngun m ph bin nht xy dng cc c s h

tng in ton m my l Eucalyptus (Elastic Utility Computing

Architecture for Linking Your Programs to Useful Systems - Kin trc inton tin ch linh hot lin kt cc chng trnh ca bn vi cc h thng c

ch) [3]. iu lm cho n c nht v nh l giao din ca n l tng thch vi

m my in ton linh hot Amazon - Amazon Elastic Compute Cloud

(Amazon EC2 giao din ca in ton m my ca Amazon). Ngoi ra,

Eucalyptus bao gm Walrus, l mt ng dng lu tr m my tng thch vi

Dch v lu tr n gin ca Amazon Amazon Simple Storage Service

(Amazon S3giao din lu tr m my ca Amazon).

Eucalyptus h tr KVM/Linux v Xen cho cc tng siu gim st v bao

gm vic trnh phn phi cm Rocks qun l phn cm. Kin trc ca h

thng EUCALYPTUS linh ng vi hai c im chnh: Kh nng m rng

v kh nng bo mt.

Kin trc ca EUCALYPTUS

Kin trc ca Eucalyptus c bn lp chnh.


73/79


3.7Kin trc ca EUCALYPTUS

3.2.6 S dng thut ton lp lch da trn cn bng ti gii quyt bi ton

Trong qu trnh khch hng s dng dch v trn my ch o, chng trnh s

theo di v tin hnh lp lch hot ng cho cc my o m bo cho hiu qu hotng ca my o l tt nht.

struct server {

struct server *next;

int state; /* server state (SRV_*) */

int cklen; /* the len of the cookie, to

speed up checks */

char *cookie; /* the id set in the cookie */

char *id; /* just for identification */

struct list pendconns; /* pending connections */

int nbpend, nbpend_max; /* number of pending

connections */

struct task *queue_mgt; /* the task associated

to the queue processing */

struct sockaddr_in addr; /* the address to

connect to */

struct sockaddr_in source_addr; /* the address to

which we want to bind for connect() */short check_port; /* the port to use for the

health checks */

int health; /* 0->rise-1 = bad; rise->rise+fall-1 =

good */

int rise, fall; /* time in iterations */

int inter; /* time in milliseconds */

int result; /* 0 = connect OK, -1 = connect KO */

unsigned char uweight, eweight; /* user-specified

weight-1, and effective weight-1 */

unsigned int wscore; /* weight score, used during

srv map computation */

int cur_sess, cur_sess_max; /* number of currently

active sessions (including syn_sent) */

unsigned int cum_sess; /* cumulated number of

sessions really sent to this server */

unsigned int maxconn, minconn; /* max # of active

sessions (0 = unlimited), min# for dynamic limit. */

unsigned failed_checks, down_trans; /* failed checks

and up-down transitions */


74/79


unsigned failed_conns, failed_resp; /* failed

connect() and responses */

unsigned failed_secu; /* blocked responses because

of security concerns */

struct proxy *proxy; /* the proxy this server

belongs to */

};

3.3 MTS KT QU

Giao din chnh ca chng trnh gm c 2 dch v l "Cloud computer"

dng thit lp cc my ch o, qun l thng tin, nng cp, bo tr bo dng

my ch o v dch v "Cloud monitoring" dng theo di gim st cc tintrnh hot ng ca cc my ch o

Hnh 3.8 Giao din chnh ca chng trnh th nghim


75/79


Trc tin ngi dng tin hnh khi to my ch o, la chn mu h iu

hnh cho my ch o phc v cho qu trnh s dng sau ny.

Hnh 3.9 Khi to my ch o

Tip theo ngi dng tin hnh chn cc thng tin v phn cng my ch o

nh CPU, RAM, HDD ...


76/79


77/79


KT LUN

Trong qu trnh lm lun vn ti thu thp v tm hiu cc ti liu v

in ton m my v cc c ch qun l my ch o trong mi trng in ton

m my. Trong s cc c ch nhm qun l my ch o ti tp trung nghin cu

ba c ch l Chia s ti nguyn my o, Cn bng ti v Lp lch cng vic.

Sau khi hon thnh, lun vn t c mt s kt qu nh sau:

V mt lthuyt:

- Lun vn nu c tng quan m hnh in ton m my, hiu r hn

v ba m hnh dch v chnh trong in ton m my, l dch v Iaas, dch v

PaaS v dch v SaaS. Trong i su vo nghin cu dch v IaaS phc v

cho vic thit k mt h thng m phng, v ci t mt s th nghim kim

chng mc dch v IaaS chng ba.

- Tng hp ti liuv cng ngh o ha, cng ngh nn tng trong xy dng

dch v in ton m my.

- Trnh by c mt s kin thc mi v cc m ngun m Eucalyptus

framework v Hadoop/ Mapreduce, gip xy dng mt h thng m phng v

cm my o in ton m my.- Gip cho cc nh cung cp dch v in ton m my hiu r hn mt s

c ch chia s ti nguyn my o, cn bng ti,i su vo nghin cu c ch lp

lch, t quyt nh la chn m hnh dch v in ton m my theo c ch

ph hp.

V mt thc tin:

- thit k v xy dng mt h thng m my ring da trn m

ngun m Eucalyptus framework v Hadoop/ Mapreduce.

- Thc hin qu trnh p ng ca h thng khi c yu cu t pha ngi

dng bng vic s dng thut ton lp lch cng vic da trn c ch cn bng ti.

Tuy nhin, bn cnh nhng iu t c, lun vn vn cn mt s im

hn ch sau:


78/79


- V m hnh hot ng dch v in ton m my theo c ch chia s ti

nguyn my o, c th l c ch lp lch mi chdng li vic nghin cu

c ch, thit k h thng xy dng nn m hnh hot ng ca h thng cm

my o in ton m my, m cn cha i su vo chng minh tnh ti u ha

ca c ch.

xut nhng hng nghin cu v pht trin tip theo ca lun vn l:

Da trn c s t c, cn nghin cu cc phng php chng minh

tnh ti u ca c ch.

Nghin cu thm cc m ngun m khc xy dng cc h thng, t

c c s la chn ph hp hn cho vic pht trin dch v. Tch hp giao

din nn tng in ton m my Amazon EC2 m m ngun m Eucalyptus

h tr, thng qua EC2 API.

Trong cc nghin cu tip theo, c th ti s a ra c mt vi phng

php khc nhm ti u ha s chia s ti nguyn my o thc s cn thit

trong in ton m my.


79/79

TI LIU THAM KHO

Ti liu ting Vit

[1] Nguyn Vit Hng, Trn L Vinh (2012), Tnh ton li- Qun l

ti nguyn trong in ton m my, Bo co SEMINAR, Trng i hc Bch

khoai hc Quc gia TP.HCM, TP.HCM.

[2] Hng Phc (2005), Ti u Ha Thc Thi Mng Vi Content Switching

Server, Firewall V Cn Bng Ti, NXB Thng k.

Ti liu ting anh

[3] Anat Batat and Dror G. Feitelson (1999), Gang scheduling with

memory considerations, International Parallel and Distributed Processing

Symposium, (14), pp. 109-114.

[4] Damien Cerbelaud, Shishir Garg, and Jeremy Huylebroeck,

(2009), Opening the clouds : qualitative overview of the state-of-the-art

open source VM-based cloud management platforms, ACM/IFIP/USENIX

International Conference on Middleware, (10) pp. 1-8.

[5] Daniel Nurmi, Rich Wolski, Chris Grzegorczyk, Graziano

Obertelli, Sunil Soman, Lamia Youseff, and Dmitrii Zagorodnov (2008),

Eucalyptus: A technical report on an elastic utility computing architecturelinking your programs to useful systems, Computer Science Department

University of California, Santa Barbara Santa Barbara, California.

[6] Dhruba Borthakur (2007), The Hadoop Distributed File System:

Architecture and Design. The Apache Software Foundation.

[7] Mohammad Farhan Husain, Pankil Doshi, Latifur Khan,

and Bhavani Thuraisingham (2009), Storage and Retrieval of Large RDF

Graph Using Hadoop and MapReduce, Martin G. Jaatun, Gansen Zhao, and

Chunming Rong, editors, Cloud Computing, (5931), pp. 680686.

cơ chế quản lý máy chủ ảo trong điện toán đám mây

Documents