hyperdex: a distributed, searchable key-value store for cloud computing
TRANSCRIPT
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
1/15
Fxzet@ev; C @h}pthdupe`, ]ectmfcdle Nex"Wclue ]pite git Mliu` Mibzuphoa
Tidetp E}mthwc, Detoct` Qioa, Ebho Auo ]htet
Mibzupet ]mheome @ezctpbeop, Mitoell Uohwet}hpx
Mfethpio ]mfiil ig Mibzupet ]mheome, Uohwet}hpx ig Qcpetlii
Cd}ptcmp
@h}pthdupe` nex"wclue }pite} cte oiq c }pco`ct` mib"
zioeop ig fhaf"zetgitbcome qed }etwhme} co` mliu`
mibzuphoa czzlhmcphio}/ Qfhle nex"wclue }pite} igget
}haohffimcop zetgitbcome co` }mclcdhlhpx c`wcopcae} mib"
zcte` pi ptc`hphiocl `cpcdc}e}, pfex cmfhewe pfe}e ztizet"
phe} pftiuaf c te}pthmpe` CZH pfcp lhbhp} idkemp tepthewcl
co idkemp mco iolx de tepthewe` dx pfe &zthbctx co` iolx(
nex uo`et qfhmf hp qc} ho}etpe`/ Pfh} zczet zte}eop}
Fxzet@ev, c oiwel `h}pthdupe` nex"wclue }pite pfcp zti"
wh`e} c uohsue }ectmf zthbhphwe pfcp eocdle} suethe} io
}emio`ctx cppthdupe}/ Pfe nex ho}hafp defho` Fxzet@ev
h} pfe miomezp ig fxzet}zcme fc}fhoa ho qfhmf idkemp}
qhpf bulphzle cppthdupe} cte bczze` hopi c bulph`hbeo"
}hiocl fxzet}zcme/ Pfh} bczzhoa lec`} pi egffimheop hb"
zlebeopcphio} oip iolx git tepthewcl dx zthbctx nex, dup
cl}i git zctphcllx"}zemhffie` }emio`ctx cppthdupe }ectmfe}
co` tcoae suethe}/ C oiwel mfchohoa ztipimil eocdle} pfe
}x}peb pi ztiwh`e }ptioa mio}h}peomx auctcopee} qfhle
}uzzitphoa tezlhmcphio/ Co ewclucphio ig pfe gull }x}peb
}fiq} pfcp Fxzet@ev h} it`et} ig bcaohpu`e gc}pet pfco
Mc}}co`tc co` Bioai@D git ffio`hoa zctphcllx }zemhffie`
idkemp}/ C``hphiocllx, Fxzet@ev cmfhewe} fhaf zetgit"bcome git }hbzle aep)zup izetcphio} mibzcte` pi mut"
teop }pcpe"ig"pfe"ctp nex"wclue }pite}, qhpf }ptioaet gculp"
piletcome co` mibzctcdle }mclcdhlhpx ztizetphe}/
3 Hopti`umphio
Bi eto mliu`" ezlixe` qed }etwhme} cte homtec}"
hoalx dc}e` io lhafpqehafp nex"wclue }pite} }umf c}
DhaPcdle ^34R, Mc}}co`tc ^40R, co` @xocbi ^31R/ Qfhle
nex"wclue }pite} mco ztiwh`e fhaf zetgitbcome, }mclcdhl"
hpx co` cwchlcdhlhpx, pfex acho pfe}e ztizetphe} pftiuaf c
te}pthmpe` tepthewcl CZH/ Pfe}e }x}peb} iolx zetbhp co
idkemp pi de tepthewe` u}hoa pfe pfe nex uo`et qfhmf hp
qc} }pite`/ Suethe} dc}e` io }emio`ctx cppthdupe} cteehpfet oip }uzzitpe` it hbzlebeope` dx eoubetcphoa cll
idkemp} ig c ahweo pxze/
Pfh} zczet hopti`ume} Fxzet@ev, c fhaf"
zetgitbcome, }mclcdle, co` `h}pthdupe` nex"wclue
}pite pfcp ztiwh`e} c oeq }ectmf zthbhphwe git tepthew"
hoa idkemp} dx }emio`ctx cppthdupe}/ Fxzet@ev cmfhewe}
pfh} evpeo`e` guomphioclhpx dx itacoh{hoa hp} `cpc ho c
guo`cbeopcllx `hggeteop qcx/ ]hbhlct pi ipfet nex"wclue
}pite}, Fxzet@ev `epetbhoh}phmcllx bcz} idkemp} pi
oi`e} co` eocdle} egffimheop zup co` aep izetcphio} git
c nex/ Fiqewet, ho zlcme ig mio}h}peop fc}fhoa io ku}p pfe
nex, Fxzet@ev hopti`ume} fxzet}zcme fc}fhoa ho qfhmf
idkemp} cte `epetbhoh}phmcllx bczze` pi miit`hocpe} ho
c bulph"`hbeo}hiocl Eumlh`eco }zcme &c fxzet}zcme(,
qfete ecmf `hbeo}hio mitte}zio`} pi co idkemp cppthdupe/
Fxzet@ev pfeo mtecpe} co idkemp pi oi`e bczzhoa dx
pe}}ellcphoa pfe fxzet}zcme hopi `h}kihop teahio} co`
c}}haohoa ecmf teahio pi c uohsue }ep ig oi`e}/ C teahio
qhpfho pfe fxzet}zcme clioa qhpf hp} c}}imhcpe` oi`e
c}}haobeop h} mclle` c {ioe/ Ewetx Fxzet@ev oi e h}te}zio}hdle git }pithoa cll idkemp} qfi}e miit`hocpe}
te}h e qhpfho pfe teahio} c}}imhcpe` qhpf ecmf ig pfe
oi`e} {ioe}/ Mlheop} bcz c }ectmf iopi c }ud}ep ig
{ioe} ho pfe }x}peb, co` bcz nex"dc}e izetcphio} pi
evcmplx ioe {ioe/
Fxzet}zcme fc}fhoa gcmhlhpcpe} egffimheop }ectmf dx }ha"
ohffimcoplx te`umhoa pfe oubdet ig }etwet} pi miopcmp git
ecmf zctphcllx"}zemhffie` }ectmf/ Ho Fxzet@ev, ecmf
}zemhffie` evcmp bcpmf it tcoae git co cppthdupe wclue `e"
ffioe} c teahio ig fxzet}zcme &c fxzetzlcoe( pfcp eomib"
zc}}e} pfe fxzet}zcme limcphio} ig cll bcpmfhoa idkemp}/
Dx mio}ptumphio ig pfe fxzet}zcme, cll bcpmfhoa idkemp}
oeme}}cthlx te}h`e qhpfho pfe hopet}emphio teahio ig pfe}e
fxzetzlcoe}, qfhmf h} hp}elg c fxzetzlcoe }bcllet pfco it
esucl pi pfe ithahocl fxzetzlcoe/ Gutpfet, pfe}e idkemp}
mco de limcpe` dx miopcmphoa, }ilelx, pfe oi`e} qfi}e
{ioe} hopet}emp pfe }ectmf fxzetzlcoe/ Pfetegite, pfe
}ep ig bcpmfhoa idkemp} mco de tepthewe` dx miopcmphoa
c }ud}ep ig pfe }etwet oi`e}, ho}pec` ig eoubetcphoa id"
kemp} cmti}} cll oi`e}/ Pfh} xhel } c }ectmf mibzlevhpx
igI&O&@S()@(, c}}ubhoa O 4@, qfete O h} pfeoubdet ig }etwet oi`e} ho pfe nex"wclue }pite, @ h} pfeoubdet ig idkemp cppthdupe}, co` S h} pfe oubdet ig cp"pthdupe wclue} }zemhffie ho pfe suetx/ Oipe pfcp ho pfe
qit}p mc}e, pfe evzioeop h} 3, co` cll }etwet} qhll de mio"pcmpe`/ Gullx"}zemhffie }ectmfe} qhll oee` pi miopcmp ev"
cmplx ioe oi`e/
C ochwe Eumlh`eco }zcme mio}ptumphio, fiqewet, mco
}ugget gtib pfe mut}e ig `hbeo}hioclhpx, c} pfe }zcme
evfhdhp} co evzioeophcl homtec}e ho wilube qhpf ecmf c`"
`hphiocl }emio`ctx cppthdupe ^6R/ Git idkemp} qhpf bcox
cppthdupe}, pfe te}ulphoa Eumlh`eco }zcme qiul` de lctae,
co` mio}esueoplx, }zct}e/ Oi`e} qiul` pfeo de te}zio"
}hdle git lctae teahio} ho pfe fxzet}zcme, qfhmf qiul`
3
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
2/15
aep&p, n( Tepthewe co idkemp gtib pcdle p u}hoa pfe nex nzup&p, n, w3, / / / , w@( Ho}etp co idkemp hopi pfe pcdle p`el&p, n( Tebiwe co idkemp gtib pcdle p u}hoa pfe nex nmc}&p, n, w3, / / / , w@, t( Zetgitb c zup u}hoa pfe ffit}p pqi ctaubeop} hg co` iolx hg pfe ztewhiu} wet}hio
ig pfe idkemp h} t/}ectmf&p, Z( Gho` cll idkemp} gtib pcdle p qfhmf bcpmf zte`hmcpe Z/
Pcdle 3; Pfe Fxzet@ev idkemp CZH/ Pfe aep, zup, `el co` mc} izetcphio} cte pxzhmcl ig nex"wclue }pite}/ Fxzet@ev h} uohsueho pfcp hp egffimheoplx }uzzitp} pfe }ectmf izetcphio/ Ecmf zte hmcpe Z 2 mh 2 wh, mk 2 wk , / / / mS 2 wS qfete cppthdupe}mh, mk , / / / , mS bcpmf pfe wclue} wh, wk, / / / , wS/ Cppthdupe wclue} wh ho pfe zte`hmcpe bcx mio}h}p ig tcoae} git miomh}hio/
homtec}e pfe oubdet ig oi`e} qfi}e teahio} hopet}emp
}ectmf fxzetzlcoe} co` pfu} lhbhp pfe eggemphweoe}} ig
pfe dc}hm czzticmf/ Fxzet@ev c``te}}e} pfh} ztidleb
dx hopti`umhoa co egffimheop co` lhafpqehafp bemfcoh}b
pfcp zctphphio} pfe `cpc hopi }bcllet, lhbhpe`"}h{e }ud"
}zcme}, qfete ecmf }ud}zcme miwet} c }ud}ep ig idkemp
cppthdupe} ho c liqet `hbeo}hiocl fxzet}zcme/ Pfu}, dx
gil`hoa pfe fxzet}zcme dcmn hopi c liqet oubdet ig `h"
beo}hio}, Fxzet@ev mco eo}ute fhafet oi`e }elemphwhpx
`uthoa }ectmfe}/
]home gchlute} cte diuo` pi immut ho cox lctae"}mcle
mliu` `ezlixbeop, c nex"wclue }pite oee`} pi ztiwh`e gc"
mhlhphe} git `cpc tezlhmcphio c} qell c} ztipimil} git te"
putohoa mio}h}peop te}zio}e} ho pfe zte}eome ig miomut"
teomx co` gchlute}/ Fxzet@ev eo}ute} pfcp cll `cpc ho pfe
}x}peb h} tezlhmcpe` pi ztiwh`e c `e}hte` lewel ig gculp"
piletcome/ Pfe }x}peb ebzlix} c wclue"`ezeo`eop tezlh"
mcphio pemfohsue pi bchopcho pfe `e}hte` lewel ig gculp
piletcome qfhle ztiwh`hoa }ptioa mio}h}peomx auctcopee}/
Wclue"`ezeo`eop tezlhmcphio eo}ute} c `e}hte` oubdet ig
mizhe}, ztiwh`e} fflevhdhlhpx ho c}}haohoa tezlhmc oi`e} pi
`hggeteop teahio} ho fxzet}zcme, co` eocdle} tezlhmc }ep}
pi de }elempe` gtib oio"gcpe"}fcthoa oi`e}/ Uolhne ffive`
tezlhmcphio pemfohsue}, pfe tezlhmc }ep} cte `xocbhmcllx
mio}ptumpe` io pfe fflx `ezeo`hoa io pfe miopeop} ig pfe
idkemp ffiel`} c} qell c} pfe ztewhiu} miopeop} ig pfe id"
kemp, eocdlhoa egffimheop }ectmf izetcphio} co` }ptioa mio"
}h}peomx }ebcophm} eweo ho pfe zte}eome ig miomutteop uz"
`cpe} co` mtc}f gchlute}/
Dc}e` io pfe }ptumpute ztiwh`e` dx fxzet}zcme fc}f"
hoa, Fxzet@ev ztiwh`e} tcoae suetx }uzzitp git co id"
kemp cppthdupe dx uphlh{hoa it`et"zte}etwhoa fc}f guomphio}
git miit`hocpe wclue}/ Qfhle u}et} mco ztiwh`e mu}pib
fc}f guomphio}, Fxzet@ev ztiwh`e} c oiwel, ffive`"}h{e,
li}}x eomi`hoa guomphio, mclle` mfflicp, pfcp zte}etwe} pfeit`ethoa depqeeo oubethm wclue} co` leo`} hp}elg ocpu"
tcllx pi co egffimheop eomi`hoa ig zi}hphio qhpfho pfe fx"
zet}zcme/ Pfe teputoe` }ectmf te}ulp} cte ztemh}e, eweo
pfiuaf mfflicp} co` ipfet fc}f guomphio} u}e` `uthoa pfe
suethe} bcx de li}}x/
Iwetcll, pfh} zczet bcne} pftee miopthduphio}/ Ght}p,
hp `e}mthde} c oeq fc}fhoa pemfohsue git bczzhoa }ptum"
pute` `cpc pi }etwet oi`e}/ Pfh} fc}fhoa pemfohsue eo"
cdle} c oiwel }ectmf zthbhphwe pfcp }uzzitp} egffimheop id"
kemp tepthewcl eweo qfeo pfe }ectmf suetx tesue}p} bulph"
zle idkemp}, }zemhffie} pfeb pftiuaf }emio`ctx cppthdupe},
co` homlu e} tcoae}/ ]emio`, hp `e}mthde} c tezlhmcphio
}mfebe pfcp eocdle} fxzet}zcme fc}fhoa pi ztiwh`e dipf
gculp"piletcome co` mio}h}peomx auctcopee}/ Pfe oiwel
mfchohoa u}e` ho pfe tezlhmcphio ztipimil auctcopee} c
mio}pcop oubdet ig tezlhmc} pi de bchopchoe` co` eo"
}ute} pfcp izetcphio} u}hoa zthbctx nex} cte }ptioalx
mio}h}peop/ Ghocllx, hp tezitp} gtib c gull hbzlebeopc"
phio ig pfe }x}peb co` `ezlixbeop ho c `cpc meopet }ep"phoa mio}h}phoa ig 70 }etwet}, co` `ebio}ptcpe} pfcp Fx"
zet@ev ztiwh`e} zetgitbcome pfcp h} mibzctcdle pi it
deppet pfco Mc}}co`tc co` Bioai@D, pqi mutteop }pcpe"
ig"pfe"ctp mliu` }pitcae }x}peb}, c} bec}ute` u}hoa pfe
ho`u}ptx"}pco`ct` XM]D ^35R deomfbctn/ Bite hbzit"
pcoplx, Fxzet@ev h} suclhpcphwelx gc}pet &}zemhffimcllx, 4v"
3=v io pfe XM]D deomfbctn}( pfco ptc hphiocl nex"wclue
}pite} qfeo }ectmfhoa git zctphcllx }zemhffie` idkemp}/
Pfe te}p ig pfh} zczet h} }ptumpute` c} gilliq}; ]em"
phio 4 `e}mthde} fxzet}zcme fc}fhoa/ ]emphio = }zemhffie}
fiq pi `ecl qhpf }zcme} ig fhaf `hbeo}hioclhpx pftiuaf
`cpc zctphphiohoa/ ]emphio 0 }zemhffie} pfe wclue"`ezeo`eop
tezlhmcphio ztipimil u}e` ho Fxzet@ev/ ]emphio 5 iup"
lhoe} iut gull hbzlebeopcphio ig Fxzet@ev/ ]emphio 7
ewclucpe} Fxzet@ev uo`et c wcthepx ig qitnlic`}/ ]em"
phio 1 `h}mu}}e} telcpe` qitn git fxzet}zcme fc}fhoa co`
Fxzet@ev/ ]emphio 6 }ubbcth{e} iut miopthduphio}/
4 Czzticmf
Ho pfh} }emphio, qe `e}mthde pfe `cpc bi`el u}e` ho Fx"
zet@ev, iuplhoe fxzet}zcme fc}fhoa, co` }nepmf pfe fhaf"
lewel itacoh{cphio co` izetcphio ig pfe }x}peb/
4/3 @cpc Bi`el co` CZH
Fxzet@ev }pite} idkemp} pfcp mio}h}p ig c nex co` {etiit bite }emio`ctx cppthdupe}/ Idkemp} cte itacoh{e` hopi
`h}pthdupe`, zet}h}peop pcdle}, qfete c pcdle h} c millem"
phio ig idkemp} qhpf pfe }cbe cppthdupe} qhpf `h}phomp
nex}/ Pfh} `cpc itacoh{cphio mli}elx te}ebdle} pcdle} ho
}pco`ct` telcphiocl `cpcdc}e} co` igget} c }pthmp }uzet"}ep
ig pfe pxzhmcl nex"wclue }pite izetcphio}, qfhmf zetbhp}
}ptchafpgitqct` bhatcphio gtib evh}phoa nex"wclue }pite}
co` `cpcdc}e }x}peb}/
Idkemp"lewel izetcphio} ho Fxzet@ev izetcpe io }ebh"
4
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
3/15
}ptumpute` `cpc/ Idkemp} mio}h}p ign"puzle} }pite` uo`etc nex/ Nex} co` n"puzle elebeop} bcx de hopetztepe` c}izcsue dxpe }pthoa} it oubethm wclue}/ C }ubbctx ig cll
idkemp"lewel izetcphio} h} ztiwh`e` ho Pcdle 3/
]x}peb"lewel izetcphio} ho Fxzet@ev ztiwh`e pfe u}et
qhpf mibzlepe mioptil iwet pcdle mtecphio, `elephio, co`
teocbhoa/ Pfe}e izetcphio} tesuhte alidcl miit`hocphioco` cte telcphwelx evzeo}hwe mibzcte` pi bcohzulcphoa
idkemp}/ ]x}peb"lewel izetcphio} hbzcmp iolx izetcphio}
io pfe }cbe pcdle/ Ipfet izetcphio} cte uocggempe / Git
bcvhbub fflevhdhlhpx, pfe }x}peb"lewel izetcphio} cggit`
pfe u}et mibzlepe mioptil iwet pfe nex, }emio ctx cp"
pthdupe}, zctphphiohoa }mfebe co` tezlhmcphio gcmpit/
4/4 Fxzet}zcme Fc}fhoa
Fxzet@ev tezte}eop} ecmf pcdle c} co ho`ezeo`eop bulph"
`hbeo}hiocl }zcme, qfete pfe `hbeo}hiocl cve} cte pfe
cppthdupe} ig pfe pcdle/ Mio}h et, git pfe gilliqhoa `h}"
mu}}hio, c pcdle miopchohoa u}et hogitbcphio pfcp fc}pfe cppthdupe} ffit}p"ocbe, lc}p"ocbe, co pelezfioe"
oubdet/ Fxzet@ev mtecpe} c pftee `hbeo}hiocl }zcme
qfete pfe ffit}p"ocbe cppthdupe mio}phpupe} pfe v"cvh},
pfe lc}p"ocbe cppthdupe mio}phpupe} pfe x"cvh}, co` pfe
pelezfioe"oubdet cppthdupe mio}phpupe} pfe {"cvh}/ Fx"
zet@ev c}}hao} ewetx idkemp c mitte}zio`hoa miit`hocpe
dc}e` io pfe idkemp} cppthdupe wclue}/ Co idkemp h}
bczze` pi c `epetbhoh}phm miit`hocpe ho pfh} }zcme dx
fc}fhoa ecmf ig hp} cppthdupe wclue} pi c limcphio clioa pfe
mitte}zio`hoa cvh}/ Ghaute 3 hllu}ptcpe} pfh} bczzhoa/
4/= Oi e Lcxiup
Egffimheop liinuz ig gullx"}zemhffie` idkemp} h} mthphmcl pi
idkemp ho}etphio co` `elephio zetgitbcome, co` tesuhte}
c `epetbhoh}phm idkemp pi oi`e bczzhoa/ Bumf lhne ho
thoa"dc}e` nex"wclue }pite}^=, 31, =6R, Fxzet@ev bcz}
dipf idkemp miit`hocpe} co` oi`e} pi pfe }cbe fxzet"
}zcme/ ]zemhffimcllx, Fxzet@ev pe}}ellcpe} pfe fxzet}zcme
hopi c ath` igO teahio} ho }zcme/ [ioe}, qfhmf qe zte"whiu}lx `effioe` pi de bupucllx evmlu}hwe teahio} delioa"
hoa pi ioe it bite oi`e}, cte mtecpe` dx c}}haohoa oi`e}
pi ecmf ig pfe pe}}ellcpe` teahio} pi de te}zio}hdle git
cll idkemp} qfhmf fc}f pi c miit`hocpe qhpfho pfe teahio/
Pfe {ioe bczzhoa h} `h}}ebhocpe` pi cll mlheop} qfhmf
bcx izetcpe `htemplx io pfe bczzhoa qhpfiup cox tiuphoadepqeeo }etwet oi`e}/
Qhpf pfh} oi`e co` `cpc lcxiup, ho}etphio co` `elephio
ig co idkemp ho pfe bi}p dc}hm Fxzet@ev hbzlebeopc"
phio mio}h}p} ig `epetbhohoa pfe miit`hocpe} git pfe id"
kemp, co` }pithoa it `elephoa pfe idkemp ho pfe {ioe qfhmf
miopcho} pfcp miit`hocpe/ Qe qhll evzlite pfe c``hphiocl
mibzlevhphe} telcpe` pi ho}etphio co` `elephio izetcphio}
pfcp }uzzitp `cpc zctphphiohoa ho ]emphio = co` idkemp
tezlhmcphio ho ]emphio 0/
Ght}p Ocbe
Zfioe Oubdet
Lc}p Ocbe
Kifo
]bhpf
Ghaute 3; ]hbzle fxzet}zcme fc}fhoa ho pftee `hbeo}hio}/Pfe ptco}lumeop zlcoe itpfiaiocl pi pfe cvh} git Lc}p Ocbe
zc}}e} pftiuaf cll zihop} git c }zemhffie` lc}p ocbe/ ]hbh"
lctlx, pfe zlcoe itpfiaiocl pi pfe cvh} git Ght}p Ocbe zc}}e}
pftiuaf cll pfe zihop} git c }zemhffie` ffit}p ocbe/ Piaepfet pfex
tezte}eop c lhoe gitbe` dx pfe hopet}emphio ig pfe pqi }ectmf
mio`hphio}/ Ho pfh} evcbzle, pfe lhoe zc}}e} pftiuaf cll zfioe
oubdet} git c ahweo ffit}p ocbe co` lc}p ocbe zcht/ Pfe mude
}ptumpute }fiq} pfe bczzhoa ig pfe }ectmf iopi pqi teahio}
qhpfho pfe }zcme/ Te}ilwhoa pfh} }ectmf suetx tesuhte} iolx
miopcmphoa oi`e} te}zio}hdle git pqi ig pfe ehafp teahio}/
4/0 ]ectmf Suethe}
Pfe `cpc co` oi`e itacoh{cphio `e}mthde` ho pfe zteme`"
hoa }emphio} gcmhlhpcpe} c aeibepthm czzticmf pi te}ilwhoa
}ectmf suethe}/ Fxzet@ev bcz} c }ectmf suetx mio}h}p"
hoa ig c &zipeophcllx homibzlepe( }ep ig cppthdupe wclue}
pi c mitte}zio`hoa }ectmf fxzetzlcoe qhpfho pfe fxzet"
}zcme/ Git evcbzle, c }ectmf suetx }zemhgxhoa S }em"io`ctx cppthdupe} `effioe} c &@ S("`hbeo}hiocl }ectmffxzetzlcoe/ Pfh} }ectmf fxzetzlcoe h} mibzth}e` ig pfe
hopet}emphio igS ho`hwh`ucl &@ 3("`hbeo}hiocl fxzet"zlcoe}, qfete ecmf &@3("`hbeo}hiocl fxzetzlcoe mit"te}zio`} pi ioe cppthdupe }zemhffie` ho pfe }ectmf/ Ecmf
ho`hwh`ucl cppthdupe} fxzetzlcoe hopetmezp} pfe cppthdupe}
cvh} cp pfe limcphio pi qfhmf pfe wclue fc}fe}/ Pfe }ectmf
fxzetzlcoe eomibzc}}e} pfe limcphio ig cll idkemp} pfcp
bcpmf pfe }ectmf suetx/Tcoae suethe} mitte}zio pi evptu`e` fxzetzlcoe}/
Pfe }ectmf fxzetzlcoe git c }hoale tcoae suetx cppthdupe
mitte}zio`} pi pfe uohio ig cll fxzetzlcoe} pfcp hopet"
mezp pfe cvh} depqeeo pfe liqet co` uzzet diuo`} ig
pfe tcoae/ Oipe pfcp git }umf c }mfebe pi qitn, pfe
cppthdupe bu}p de oubethm ho ocpute, co` pfe cvh} bu}p
zte}etwe it`et ig pfe cppthdupe/ Miomezpucllx, Fxzet@ev
evemupe} tcoae suethe} dx pcnhoa pfe uohio ig cll fxzet"
zlcoe} pfcp te}ulp gtib hopet}emphoa c }hoale fxzetzlcoe
=
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
4/15
gtib pfe tcoae suetx qhpf pfe tebcho`et ig pfe }ectmf/
Ho teclhpx, }umf c }mfebe h} mibzupcphiocllx hopeo}hwe co`
hopeo`e` iolx pi ahwe pfe aeibepthm hopuhphio defho` fiq
tcoae suethe} cte fco`le` ho Fxzet@ev/ ]emphio 5/4 `h}"
mu}}e} fiq pi hbzlebeop tcoae suethe} egffimheoplx/
Pfe fxzet}zcme co` suetx mio}ptumphio} cte ec}x
pi wh}uclh{e/ Ghaute 3 }fiq} fiq c suetx gitght}p ocbe2Kifo co` lc}p ocbe2]bhpf
mitte}zio`} pi c lhoe ho pfe pftee"`hbeo}hiocl }zcme/
Pfe suetx git ght}p ocbe2Kifo gitb} c pqi"
`hbeo}hiocl zlcoe qfhmf hopetmezp} pfe ght}p ocbe
cvh} cp fc}fig&Kiof(/ ]hbhlctlx, pfe suetx git
lc}p ocbe2]bhpf mtecpe} coipfet zlcoe qfhmf ho"
pet}emp} pfe lc}p ocbe cvh}/ Pfe hopet}emphio ig pfe
pqi zlcoe} h} pfe lhoe clioa qfhmf cll zfioe oubdet} git
Kifo ]bhpf te}h`e/ Ecmf zfioe oubdet h} c }hoale zihop
ho }zcme clioa pfh} lhoe/ C tcoae suetx, zetfcz} te}pthmp"
hoa c }ectmf pi c zctphmulct ctec mi`e, miul` de u}e` pi
gutpfet te}pthmp pfe zfioe oubdet pi ku}p c }eabeop ig
pfh} lhoe/Pfe }ep ig fi}p} qfhmf bcx }pite idkemp} bcpmfhoa
pfe }ectmf suetx mio}h}p} ig pfi}e fi}p} c}}haoe` pi c
{ioe qfhmf hopet}emp} pfe }ectmf fxzetzlcoe/ Pfh} bcz"
zhoa h} e}pcdlh}fe` dx c miit`hocpit co` bc`e noiqo pi
cll mlheop}, qfi mco ho`ezeo`eoplx mibzupe pfh} hopet}em"
phio/ Suetx te}iluphio miomlu`e} dx millemphoa bcpmf"
hoa idkemp} gtib ioe oi`e ho ecmf {ioe/ Pfe fxzet}zcme
mio}ptumphio teqct`} }zemhffimhpx ho pfe }ectmf suetx/ Pfe
bite cppthdupe} c suetx }zemhffie}, pfe geqet pfe oubdet
ig `hbeo}hio} pfcp pfe }ectmf fxzetzlcoe }zco}, qfhmf,
ho puto, te`ume} pfe oubdet ig {ioe} qfhmf hopet}emp pfe
}ectmf fxzetzlcoe/
= @cpc Zctphphiohoa
Fxzet@ev} Eumlh`eco }zcme mio}ptumphio eocdle} aei"
bepthm tec}iohoa pi }haohffimcoplx te}pthmp pfe }ep ig oi`e}
pfcp oee` pi de miopcmpe` pi ffio` bcpmfhoa idkemp}/
Fiqewet, pfe `tcqdcmn ig miuzlhoa pfe `hbeo}hio"
clhpx ig fxzet}zcme qhpf pfe oubdet ig }ectmfcdle cp"
pthdupe} h} pfcp, git pcdle} qhpf bcox }ectmfcdle cp"
pthdupe}, pfe fxzet}zcme mco de wetx lctae, c} wilube
atiq} evzioeophcllx qhpf pfe oubdet ig `hbeo}hio}/
Miwethoa }umf lctae }zcme} qhpf c teaulct ath` ig oi`e}
bcx oip de gec}hdle eweo git lctae `cpc"meopet `ezlix"
beop}/ Git evcbzle, mio}h et c @"`hbeo}hiocl fxzet"}zcme/ Hg pfe fxzet}zcme h} }zlhp hopi pqi {ioe} ho ecmf
`hbeo}hio, pfe te}ulphoa pe}}ellcphio qhll fcwe 4@ `h}"phomp {ioe}/ HgO bcmfhoe} cte `ezlixe` pi miwet pfh}fxzet}zcme, pfe bcmfhoe} qhll miwet pfe teahio} git laOig pfe}e `hbeo}hio}/ ]ectmfe} qfhmf }zemhgx bite pfco
laO `hbeo}hio} qiul` fcwe pi miopcmp cll oi`e} qhpffhaf ztidcdhlhpx eweo hg c }ectmf h} fhaflx }zemhffim/ Oipe
pfcp fcwhoa cp lec}p 4@ `h}phomp {ioe} h} `e}htcdle, c} hpeocdle} ecmf cppthdupe pi miopthdupe pi pfe }ectmf ztuo"
n w3 w4 w= w0 w5 / / / w@"3 w@"3 w@
fxzet}zcme
n w3 w4 w= w0 w5 / / / w@"3 w@"3 w@
nex }ud}zcme
}ud}zcme : }ud}zcme 3 }ud}zcme @
Ghaute 4; Fxzet@ev `h}pthdupe} pfe ithahocl bcox"`hbeo}hiocl fxzet}zcme cmti}} bulphzle geqet"`hbeo}hiocl
}ud}zcme}/ Ecmf }ud}zcme miopcho} iolx pfe hpeb cppthdupe} pfcp
mitte}zio` qhpf pfe `hbeo}hio} hp miwet}/
hoa/
Fxzet@ev cwih`} pfe ztidleb} c}}imhcpe` qhpf fhaf"
`hbeo}hioclhpx dx zctphphiohoa pcdle} qhpf bcox cp"
pthdupe} hopi bulphzle liqet" hbeo}hiocl fxzet}zcme}/
Ecmf ig pfe}e }ud}zcme} u}e} c }ud}ep ig idkemp cppthdupe}
c} pfe `hbeo}hiocl cve} git co ho`ezeo`eop fxzet}zcme/
Ghaute 4 }fiq} fiq Fxzet@ev mco tezte}eop c pcdle qhpf
@ }ectmfcdle cppthdupe} c} c }ep ig }ud}zcme} }, qfeteecmf }ud}zcme }h } miopcho} @}h `hbeo}hio}/
@cpc zctphphiohoa homtec}e} pfe egffimheomx ig c }ectmf
dx te`umhoa pfe oubdet ig oi`e} qfhmf bu}p de mio"
pcmpe` pi zetgitb c }ectmf/ Git evcbzle, mio}h et c pc"
dle qhpf 8 }emio`ctx cppthdupe}/ C }hbzle fxzet}zcme
iwet pfh} qfile pcdle qiul` tesuhte 534 {ioe} pi ztiwh`e
pqi teahio} clioa ecmf `hbeo}hio ig pfe fxzet}zcme/ C
}ectmf iwet = cppthdupe} qiul` oee` pi miopcmp evcmplx 70
{ioe}/ Hg, ho}pec , pfe }cbe pcdle qete mtecpe` qhpf =
}ud}zcme} ig = `hbeo}hio} ecmf, ecmf }ud}zcme mco de
ffille` qhpf evcmplx 6 oi`e}/ C }ectmf qhpf oi }zemhffimhpx
ho pfh} pcdle qhll oee` pi miopcmp 6 oi`e}/ C }ectmf qfhmf
}zemhffie} cll pfe cppthdupe} ho ioe }ud}zcme qhll miopcmp
evcmplx ioe oi`e/ Hg c }ectmf homlu e} cppthdupe} gtib
bulphzle }ud}zcme}, hp }elemp} pfe }ud}zcme qhpf pfe bi}p
te}pthmphwe }ectmf fxzetzlcoe co` zetgitb} pfe }ectmf ho
pfcp }ud}zcme/ ]umf c zctphphioe` pcdle ztiwh`e} c qit}p
mc}e diuo` io pfe oubdet ig }etwet oi`e} miopcmpe` `ut"
hoa c }ectmf/
@cpc zctphphiohoa gitme} c ptc e"igg depqeeo }ectmf
aeoetclhpx co` egffimheomx/ Io pfe ioe fco`, c }hoale fx"
zet}zcme mco cmmibbi cpe ctdhptctx }ectmfe} iwet hp}
c}}imhcpe` cppthdupe}/ Io pfe ipfet fco`, c fxzet}zcmeqfhmf h} pii lctae qhll clqcx} tesuhte pfcp zctphcllx"
}zemhffie` suethe} miopcmp bite pfco ioe {ioe/ Czzlhmc"
phio} igpeo fcwe limclhpx ho pfe cppthdupe} pfcp cte }ectmfe`
iwet/ Dx mtecphoa }ud}zcme} qfhmf evzlihp pfh} limclhpx,
Fxzet@ev czzlhmcphio} mco puoe }ectmf egffimheomx/ C} pfe
oubdet ig }ud}zcme} atiq}, }i, pii, `i pfe mi}p} c}}imh"
cpe` qhpf bchopchohoa `cpc mio}h}peomx cmti}} }ud}zcme}/
Uz`cpe} pi idkemp} mco mfcoae pfe idkemp} limcphio} ho
iolx c }ud}ep ig pfe }ud}zcme}/ ]emphio 0 `epchl} fiq Fx"
0
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
5/15
zet@ev `ie} pfh} egffimheoplx qhpf c zte`hmpcdlx liq iwet"
fec`/
=/3 Nex ]ud}zcme
Fxzet@ev} dc}hm fxzet}zcme mio}ptumphio }mfebe, c}
`e}mthde` }i gct, `ie} oip `h}phoauh}f pfe nex ig co id"
kemp gtib hp} }emio`ctx cppthdupe}/ Pfh} lec`} pi pqi }ha"ohffimcop ztidleb} qfeo hbzlebeophoa c nex"wclue }pite/
Ght}p, nex liinuz} qiul` de esuhwcleop pi }hoale cppthdupe
}ectmfe}/ Clpfiuaf Fxzet@ev ztiwh`e} egffimheop }ectmf,
c }hoale cppthdupe }ectmf ho c bulph"`hbeo}hiocl }zcme
qiul lhnelx howilwe cp lec}p pqi {ioe}/ Ho pfh} fxzi"
pfephmcl }meocthi, nex izetcphio} qiul` de }pthmplx bite
mi}plx pfco pfco nex izetcphio} ho mibzephoa nex"wclue
}pite}/ ]emio`, demcu}e nex} bcx te}h`e io bulphzle
oi`e}, pfex qiul` oip oeme}}cthlx de uohsue, qfhmf bcx
whilcpe pfe uohsueoe}} howcthcop czzlhmcphio} fcwe mibe
pi evzemp gtib nex"wclue }pite}/
Pfe zteme`hoa `cpc zctphphiohoa pemfohsue eocdle} c
ocputcl qcx pi ffiv pfe}e h}}ue} dx mtecphoa c `e`hmcpe`nex }ud}zcme/ Pfe ioe"`hbeo}hiocl nex }ud}zcme bcz}
ecmf nex pi evcmplx ioe {ioe ho pfe }ud}zcme/ Pfh} h}
demcu}e pfe nex gullx }zemhffie} pfe zi}hphio ig pfe id"
kemp ho pfe }ud}zcme/ Pi eo}ute uohsueoe}}, zup izet"
cphio} cte czzlhe` pi pfe nex }ud}zcme degite pfe tebcho"
hoa }ud}zcme}/ Hg co idkemp qhpf pfe }cbe nex cltec`x
evh}p}, hp h} `elepe` gtib cll }ud}zcme} cp pfe }cbe phbe
pfe oeq idkemp h} dehoa ho}etpe`/ Dx hopti`umhoa c ioe"
`hbeo}hiocl nex }ud}zcme, Fxzet@ev ztiwh`e} egffimheop
nex izetcphio} co` eo}ute} }x}peb"qh`e nex uohsueoe}}/
=/4 Idkemp @h}pthduphio Iwet ]ud}zcme}
]ud}zcme zctphphiohoa evzi}e} c `e}hao mfihme ho fiqidkemp} cte `h}pthdupe` co` }pite` io }etwet oi`e}/ Ioe
zi}}hdle `e}hao mfihme h} pi neez `cpc ho oitbclh{e`
gitb, qfete ewetx }ud}zcme tepcho}, git ecmf idkemp, iolx
pfi}e idkemp cppthdupe} pfcp }etwe c} pfe }ud}zcme} `h"
beo}hiocl cve}/ Qfhle pfh} czzticmf bhohbh{e} }pitcae
tesuhtebeop} zet oi`e, c} cppthdupe} cte oip `uzlhmcpe`
cmti}} }ud}zcme}, hp lec`} pi bite evzeo}hwe }ectmf co`
idkemp tepthewcl izetcphio} c} temio}phpuphoa pfe idkemp te"
suhte} c bulph"oi`e kiho izetcphio/ Ho mioptc}p, co clpet"
ocphwe `e}hao mfihme h} pi }pite c gull mizx ig ecmf id"
kemp ho ecmf }ud}zcme, qfhmf lec`} pi gc}pet }ectmf co`
tepthewcl izetcphio} cp pfe evzeo}e ig c``hphiocl }pitcae
tesuhtebeop} zet oi`e/Fxzet}zcme fc}fhoa }uzzitp} dipf ig pfe}e idkemp `h}"
pthduphio pemfohsue}/ Fxzet@ev, fiqewet, telhe} uzio
pfe lcpet czzticmf pi hbzlebeop pfe tezlhmcphio }mfebe
`e}mthde` ho ]emphio 0/
=/= Fepetiaeoeiu} Idkemp}
Ho c tecl `ezlixbeop, pfe nex"wclue }pite qhll lhnelx de
u}e` pi fil` `h}zctcpe idkemp} qhpf `hggeteop }mfebc/ Fx"
zet@ev }uzzitp} pfh} pftiuaf pfe pcdle cd}ptcmphio/ Ecmf
pcdle fc} c }ezctcpe }ep ig cppthdupe} qfhmf bcne uz pfe
idkemp} qhpfho, co` pfe}e cppthdupe} cte zctphphioe` hopi
}ud}zcme} ho`ezeo eop ig cll ipfet pcdle}/ C} c te}ulp,
Fxzet@ev bcocae} bulphzle ho`ezeo`eop fxzet}zcme}/
0 Mio}h}peomx co` Tezlhmcphio
Demcu}e fxzet}zcme fc}fhoa bcz} ecmf idkemp pi bul"phzle oi`e}, bchopchohoa c mio}h}peop wheq ig pfe idkemp
zi}e} c mfclleoae/ Fxzet@ev ebzlix} c oiwel pemfohsue
mclle` wclue"`ezeo`eop mfchohoa pi ztiwh`e }ptioa mio"
}h}peomx ho pfe zte}eome ig miomutteop uz`cpe}/
Git mlcthpx, qe ffit}p `e}mthde wclue"`ezeo`eop mfchohoa
qhpfiup miometo git gculp piletcome/ Uo`et pfh} }mfebe,
c }hoale gchlute lecwe} zitphio} ig pfe fxzet}zcme uo"
cwchlcdle git uz`cpe} co` }ectmfe}/ Qe pfeo `e}mthde
fiq wclue"`ezeo`eop mfchohoa mco de evpeo`e` pi zti"
wh`e gculp piletcome }umf pfcp pfe }x}peb mco piletcpe uz
pi g gchlute} ho cox ioe {ioe/
0/3 Wclue @ezeo`eop MfchohoaDemcu}e fxzet}zcme fc}fhoa `epetbhoe} pfe limcphio ig
co idkemp dx hp} miopeop}, co` }ud}zcme zctphphiohoa mte"
cpe} bcox idkemp tezlhmc}, idkemp} qhll de }ztec` cmti}}
bulphzle oi`e} co` pfe}e oi`e} qhll mfcoae c} pfe idkemp}
cte uz`cpe`/ Mfcoae ho co idkemp} limcphio qiul` mcu}e
ztidleb} hg hbzlebeope` ochwelx/ Git evcbzle, hg id"
kemp uz`cpe} qete pi de hbzlebeope` dx }hbzlx }eo`hoa
pfe idkemp pi cll cggempe` {ioe}, pfete qiul` de oi auct"
copee} c}}imhcpe` qhpf }ud}esueop izetcphio} io pfcp id"
kemp/ ]umf c }mfebe qiul` cp de}p ztiwh`e eweopucl mio"
}h}peomx demcu}e oi`e} bcx temehwe uz`cpe} iup"ig"it`et,
qhpf oi }eo}hdle beco} ig te}ilwhoa miomutteop uz`cpe}/
Fxzet@ev it`et} uz`cpe} dx cttcoahoa co idkemp}
tezlhmc} hopi c wclue"`ezeo`eop mfcho qfi}e bebdet}
cte `epetbhoh}phmcllx mfi}eo dc}e` uzio co idkemp} fx"
zet}zcme fc}f wclue}/ Pfe fec` ig pfe mfcho h} mclle`
pfe zihop lec`et, co` h} `epetbhoe` dx fc}fhoa pfe id"
kemp ho pfe nex }ud}zcme/ ]ud}esueop oi`e} ho pfe mfcho
cte `epetbhoe` dx fc}fhoa cppthdupe wclue} git ecmf ig pfe
tebchohoa }ud}zcme}/
Pfh} mio}ptumphio ig wclue"`ezeo`eop mfcho} eocdle}
egffimheop, `epetbhoh}phm ztizcacphio ig uz`cpe}/ Pfe zihop
lec`et git co idkemp h} ho c zi}hphio pi `hmpcpe pfe pipcl
it`et io cll uz`cpe} pi pfcp idkemp/ Ecmf uz`cpe ffliq}
gtib pfe zihop lec`et pftiuaf pfe mfcho, co` h} mio}h`"ete` zeo`hoa uophl co cmnoiqle`aebeop ig pfcp uz`cpe
h} temehwe` gtib pfe oevp oi`e ho pfe mfcho/ Qfeo co
uz cpe tecmfe} pfe pchl ig pfe mfcho, pfe pchl }eo`} co
cmnoiqle`aebeop pftiuaf pfe mfcho ho tewet}e }i pfcp
cll ipfet oi`e} bcx mleco uz tezlhmcphio"telcpe` }pcpe/
Qfeo pfe cmnoiqle`aebeop tecmfe} pfe zihop lec`et, pfe
mlheop h} oiphffie` pfcp pfe izetcphio h} mibzlepe/ ]eo "
hoa pfe mlheop oiphffimcphio gtib pfe zihop lec`et eocdle}
u} pi ztiwh`e mlheop} qhpf c }hoale zihop ig miopcmp git
5
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
6/15
f3 f4 f=
f0 f5 f7
nex
}ud}zcme }ud}zcme : }ud}zcme 3
uz`cpe u3uz`cpe u4uz`cpe u=
Ghaute =; Fxzet@ev} tezlhmcphio ztipimil ztizcacpe} uz`cpe}gtib pfe nex }ud}zcme pftiuaf c` hphiocl }ud}zcme} clioa
wclue" ezeo eop mfcho}/ Pfh} evcbzle `ezhmp} c pcdle pfcp h}
zctphphioe` hopi pqi }ud}zcme} ho c``hphio pi pfe bco`cpitx nex
}ud}zcme/ Ecmf mfcho zc}}e} pftiuaf evcmplx ioe it pqi oi`e}
ho ecmf }ud}zcme/ Uz`cpe} ffliq gitqct` clioa mfcho} c} ho`h"
mcpe` dx pfe cttiq}, qfhle cmnoiqle`aebeop} ffliq ho tewet}e/
nex"dc}e` izetcphio}, co` idwhcpe} cox oee` pi bchopcho
}pcpe cdiup mlheop} cmti}} oi`e}/ Ho Ghaute =, pfe uz`cpe
u3 hllu}ptcpe} co idkemp ho}etphio qfhmf zc}}e} pftiuaff3, f4, f=, qfete f3 h} pfe zihop lec`et/
Uz`cpe} cte bite mibzlhmcpe` demcu}e c mfcoae ho
co cppthdupe wclue bhafp tesuhte telimcphoa co idkemp pi
c `hggeteop {ioe/ Fxzet@ev cmmibzlh}fe} pfh} dx mio"
}ptumphoa mfcho} qfete ecmf {ioe mitte}zio`hoa pi pfe
il` wet}hio ig pfe idkemp hbbe`hcpelx zteme`e} pfe {ioe
mitte}zio`hoa pi pfe oeq wet}hio ig pfe idkemp qhpfho pfe
}cbe }ud}zcme/ Pfh} ztizetpx eo}ute} pfcp pfe uz`cpe
qhll pcne eggemp ho ewetx {ioe pi qfhmf pfe il` co` oeq
idkemp} bcz/ Gutpfet, pfe il` wet}hio qhll iolx de `elepe`
cgpet pfe oeq wet}hio h} mibbhppe`, demcu}e pfe izetc"
phio} mibbhp ho tewet}e it`et c} cmnoiqle`aebeop} cte
ztizcacpe` dcmnqct } pftiuaf pfe mfcho/ Git evcbzle,
ho Ghaute =, pfe uz`cpe u4 bi`hffie} pfe idkemp ho c qcxpfcp mfcoae} hp} bczzhoa ho ]ud}zcme : }umf pfcp pfe id"
kemp oi lioaet bcz} pi f4 co` ho}pec` bcz} pi f5/ Pfewclue" ezeo eop mfcho git uz`cpe u4 h} f3, f4, f5, f=/Pfe uz`cpe qhll te}ulp ho pfe idkemp dehoa }pite` cp f5,co` }ud}esueoplx tebiwe` gtib f4/
]umme}}hwe uz`cpe} pi co idkemp qhll mio}ptump mfcho}qfhmf iwetlcz ho ecmf }ud}zcme/ Miomutteop uz cpe}
bcx ctthwe iup ig it`et cp ecmf ig pfe}e zihop} ig iwet"
lcz/ Git evcbzle, mio}h`et pfe uz`cpe u= ho Ghaute =/Pfe wclue"`ezeo`eop mfcho git pfh} uz`cpe h} f3, f5, f=/Oiphme pfcp hp h} zi}}hdle git u= pi ctthwe cp f5 degiteu4/ Fxzet@ev egffimheoplx fco`le} pfh} mc}e dx `hmpcphoapfcp pfe zihop lec`et ebde` ho ecmf be}}cae `ezeo`eomx
hogitbcphio qfhmf }zemhffie} pfe it`et ho qfhmf uz`cpe}
cte czzlhe`/ ]zemhffimcllx, pfe zihop lec`et ebde`} c wet"
}hio oubdet git pfe uz`cpe, co` pfe wet}hio oubdet co`
pxze ig pfe ztewhiu} uz`cpe/ Git ho}pcome, u= qhll fcwec wet}hio oubdet ig = co` `ezeo` uzio uz`cpe u4 qhpfwet}hio oubdet 4 co` pxze zup/ Qfeo c fi}p temehwe}
co uz`cpe qfhmf fc} co uobep `ezeo`eomx, hp `eget} pfe
uz`cpe uophl }umf c phbe pfcp pfe `ezeo`eomx h} bep co`
pfe uz`cpe bcx de cmpe` uzio/ Dx mio}ptumphio ig wclue"`ezeo`eop mfcho}, fi}p} cte auctcopee` pi temehwe pfe `e"
zeo`eomhe} ho phbe diuo`e` dx pfe leoapf ig mfcho} co`
oubdet ig gchlute}/
Ebde``hoa `ezeo`eomx hogitbcphio }zemhffimcllx c
nex, wet}hio oubdet, co` fc}f ig pfe ztewhiu} idkemp
ho izetcphio} eocdle} Fxzet@ev pi cwih` mibzlev mitoet
mc}e} }pebbhoa gtib pfe hopetcmphio ig wclue `ezeo`eop
mfcho} qhpf `e}ptumphwe izetcphio}/ Git evcbzle, mio"
}h`et pfe mc}e ig co uz`cpe u0 qfhmf gilliq} uz`cpe u=ho Ghaute = co` bcz} pfe idkemp pi f3, f4, f7/ Pfe wclue"`ezeo`eop mfcho git u0 h} f3, f5, f4, f=, f7/ Qfeo f4
temehwe} u0, hp qhll fcwe oi noiqle`ae ig cox ig pfe zte"me`hoa uz`cpe} c} u4 qhll fcwe telimcpe` pfe idkemp pi f5/Dup demcu}e ig pfe `ezeo`eomx hogitbcphio, f4 qhll decdle pi tiupe hp pftiuaf pfe mfcho ho pfe mittemp it`et dx
fc}fhoa pfe ztewhiu} wet}hio}/
Pfe hopetzlcx depqeeo `e}ptumphwe izetcphio} co` uz"
`cpe} zi}e} co eweo atecpet mfclleoae git }pcpe bcocae"
beop/ Ecmf Fxzet@ev {ioe teptco}bhp} be}}cae} uophl
pfex cte cmnoiqle`ae / Hp qiul` de zi}}hdle pi ptha"
aet c tcme mio`hphio qhpf c ochwe hbzlebeopcphio hg pfe
teptco}bh}}hio ctthwe} cp co hoizzitpuoe phbe cgpet pfe
`e}ptumphwe izetcphio h} ztime}}e`/ Mio}h`et qfcp fcz"
zeo} hg uz`cpe u= ho Ghaute = qete c mlheop hohphcpe``elepe izetcphio/ C} cmnoiqle`aebeop} git u= ztiz"cacpe dcmnqct`} clioa pfe wclue"`ezeo`eop mfcho git u=,pfex qiul` tebiwe cox co` cll ptcme c}}imhcpe` qhpf u=/Hg pfe cmnoiqle`aebeop igu4 gtib f5 pi f4 qete li}p,pfe oevp teptco}bh}}hio ig u4 gtib f4 pi f5 qiul` defco`le` pfe evcmp }cbe qcx hp qc} fco`le` pfe ffit}p phbe/
Pfcp h}, u4 qiul` miopcho oi `ezeo`eomx hogitbcphio gitf5, co` qiul` pfetegite de czzlhe` hbbe`hcpelx/ Pfh}qiul pfeo lec` pi homio}h}peomhe}/ ]iluphio} u}hoa }e"
sueome oubdet} cte zi}}hdle> fiqewet, bcocahoa pfe}e
}esueome oubdet} c``} homtec}hoa mi}p, c} pfex bu}p de
bchopchoe` pftiuaf pfe eophte lhgephbe ig pfe }x}peb
eweo c} }x}peb bebdet}fhz mfcoae}/ Fxzet@ev cwih }hopetzlcx depqeeo `e}ptumphwe izetcphio} co` uz`cpe} dx
fcwhoa bebdet} qfhmf te}h`e ho dipf mfcho} `eget izet"
cphio} uophl pfex qhll oi lioaet hopetcmp qhpf pfe `e}ptum"
phwe izetcphio}/ Ho pfe evcbzle ahweo cdiwe, u= qiul` de`elcxe` cp f3 uophl u4 qc} cmnoiqle`ae` dx f4/ Iome f4cmnoiqle`ae} u4, f4 qhll oi lioaet oee` pi teptco}bhpu4, pfetegite hp mcooip miofflhmp qhpf u=/ Pfh} zcppeto h}u}e` ho }ewetcl zlcme} ho iut ztipimil pi zteweop `e}ptum"
phwe izetcphio} gtib tcmhoa qhpf mio}ptumphwe izetcphio}/
7
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
7/15
0/4 Gculp Piletcome
Pi auct` cacho}p oi`e gchlute}, Fxzet@ev ztiwh`e} c`"
`hphiocl tezlhmcphio qhpfho ecmf {ioe/ Pfe tezlhmc} cm"
suhte co` bchopcho pfeht }pcpe dx dehoa homitzitcpe` hopi
wclue"`ezeo`eop mfcho}/ Ho zctphmulct, ecmf {ioe fc} Ttezlhmc} qfhmf czzect c} c dlimn ho pfe wclue"`ezeo`eop
mfcho/ Git evcbzle, qe mco evpeo` pfe lcxiup ig Ghaute =pi piletcpe ioe gchlute dx hopti`umhoa c``hphiocl fi}p} f3pftiuaf f7/ C} qhpf teaulct mfcho tezlhmcphio ^=8R, oeqtezlhmc} cte hopti`ume` cp pfe pchl, co` oi`e} cte dubze`
gitqct` ho pfe mfcho c} ipfet oi`e} gchl/ Git evcbzle, pfe
ffit}p uz`cpe ho Ghaute = fc} pfe wclue"`ezeo`eop mfcho
f3, f
3, f4, f
4, f=, f
=/ Hg f4 qete pi gchl, pfe te}ulphoamfcho qiul` de f3, f3, f
4, f
4 , f=, f
=/ Fxzet@ev eo}ute}
pfcp }umf c ptco}hphio qhll de `ioe qhpfiup mibztibh}hoa
}ptioa mio}h}peomx/
Fxzet@ev eo}ute} pfcp zihop lec`et gchlute} `i oip cl"
liq mlheop} pi id}etwe co homio}h}peomx/ Git ho}pcome, hg
f3
, pfe zihop lec`et, qete pi gchl ho iut ztewhiu} evcbzle,
f3 qhll pcne iwet pfe tile ig zihop lec`et/ Pfe mlheop qhll`epemp pfe zihop lec`et gchlute, co` oiphgx pfe czzlhmcphio
ig pfe temioffiautcphio/ Izetcphio} qfhmf cte hopettuzpe`
dx temioffiautcphio evfhdhp cp"bi}p"iome }ebcophm}/
0/= Oi`e co` Mioffiautcphio Bcocaebeop
Fxzet@ev uphlh{e} c liahmcllx meoptclh{e` miit`hocpit pi
bcocae }x}peb"qh`e alidcl }pcpe/ Pfe miit`hocpit `e"
mlcte} pfe alidcl }pcpe ho pfe gitb ig c mioffiautcphio/
Ecmf mioffiautcphio eomcz}ulcpe} cll c}zemp} ig pfe Fx"
zet@ev }pcpe, homlu`hoa pfe qcx ho qfhmf pfe miit`hocpit
pe}}ellcpe} pfe fxzet}zcme, pfe bczzhoa depqeeo {ioe}
co` fi}p}, co` qfhmf {ioe} cte mutteoplx uo`etaihoa gchl"
ute temiwetx/ Pfe miit`hocpit h} te}zio}hdle git aeoetcp"
hoa co` `h}pthduphoa mioffiautcphio}/
Ecmf fi}p ho pfe }x}peb h} uohsuelx h`eophffie` dx hp} HZ
c``te}}, zitp, co` ezimf h`/ Qfeo c oeq Fxzet@ev zti"
me}} h} }zcqoe`, pfe ztime}} tesue}p} co ezimf h` gtib
pfe miit`hocpit/ Pfe mibdhocphio ig pfe c``te}} co` pfe
ezimf h` uohsuelx h`eophgx pfe ztime}} qhpf qfhmf ioe h}
mibbuohmcphoa &co ho}pcome ig c Fxzet@ev }etwet( git
pfe eophte lhgephbe ig pfe Fxzet@ev mlu}pet/ Ho pfe eweop
ig c gchlute, c fi}p bcx telcuomf Fxzet@ev io pfe }cbe
HZ)zitp> fiqewet, pfe ezimf h` temehwe` gtib pfe miit`h"
ocpit qhll de `hggeteop, co` cll ipfet ztime}}e} mco `h}pho"
auh}f depqeeo pfe pqi ho}pcome}/Pfe miit`hocpit bchopcho} c bczzhoa depqeeo ecmf
{ioe co` co it`ete` }ep ig tezlhmc}/ Be}}cae} cte pfe
zthbhphwe ig mibbuohmcphio qhpfho Fxzet@ev co` cte
liahmcllx c``te}}e` u}hoa pfe {ioe co` tezlhmc h`eophffiet/
Pfe temehwet ig c be}}cae cmp} uzio pfe be}}cae iolx
qfeo pfe }iutme co` `e}phocphio liahmcl c``te}}e} bcpmf
pfe }iutme co` `e}phocphio ho}pcome}/ Pfh} bemfcoh}b
eo}ute} pfcp ecmf fi}p qhll cmp iolx uzio be}}cae} qfhmf
cte mio}h}peop qhpf pfe fi}p} mutteop mioffiautcphio/
Ecmf fi}p mfcoae} hp} mioffiautcphio ho co cll"it"
oipfhoa gc}fhio qfhmf czzect} ho}pcopcoeiu} pi pftec`}
fco`lhoa oepqitn mibbuohmcphio/ Pfh} h} cmmibzlh}fe`
io ecmf fi}p dx mtecphoa }pcpe telewcop pi pfe oeq mio"
ffiautcphio, zcu}hoa oepqitn ptcgffim, }qczzhoa zihopet} pi
bcne pfe oeq }pcpe wh}hdle, co` uozcu}hoa oepqitn ptcg"
ffim/ Pfh} zcu}e zethi` h} suhmn ho ztcmphme co` mibzlepe}ho }ud"bhllh}emio` phbe io ecmf fi}p/
0/0 Mio}h}peomx Auctcopee}
Iwetcll, pfe zteme`hoa ztipimil eo}ute} pfcp Fxzet@ev
ztiwh`e} u}egul auctcopee} git czzlhmcphio}/ Pfe }zemhffim
auctcopee} bc`e dx Fxzet@ev cte;
Nex Mio}h}peomx Cll cmphio} qfhmf izetcpe io c }zemhffim
nex &e/a/, aep co` zup( cte lhoecth{cdle ^4:R qhpf cll
izetcphio} io cll nex}/ Pfh} auctcopee} pfcp cll mlheop} ig
Fxzet@ev qhll id}etwe uz`cpe} ho pfe }cbe it`et/
]ectmf Mio}h}peomx Fxzet@ev auctcopee} pfcp c }ectmf
qfhmf h} oip miomutteop qhpf uz cpe} pfcp cggemp pfe
}ectmf qhll teputo pfe lcpe}p wet}hio ig cll hpeb}/ Pfe
}ectmfe} cte oip }ptioalx mio}h}peop qhpf miomutteoplx
bi`hffie` idkemp} demcu}e pfete h} c }bcll qho`iq ig phbe
`uthoa qfhmf c mlheop bcx id}etwe homio}h}peomx/ Ho Gha"
ute =, pfh} qho`iq ig wuloetcdhlhpx immut} hg c }ectmf h}
miomutteop qhpf u4 co` h} ztime}}e` cp f5 degite u4 h}mibbhppe`, dup h} ztime}}e` cp f4 cgpet u4 h} mibbhppe`/
Iwetcll, Fxzet@ev ptc`e} c }lhafp te`umphio ho mio}h}"
peomx auctcopee} git homtec}e` }ectmf zetgitbcome, qhpf"
iup mibztibh}hoa }ptioa auctcopee} git nex"dc}e` izet"
cphio}/
5 Hbzlebeopcphio
Fxzet@ev h} c gullx hbzlebeope` }x}peb qfhmf }uzzitp}
cll gecpute} `e}mthde dx pfh} zczet/ Pfe hbzlebeopc"
phio h} czztivhbcpelx =8,15: lhoe} ig M../ Pfe Fxzet"
@ev }igpqcte `h}pthduphio miopcho} co ebde``cdle }pit"
cae lcxet, c teu}cdle fxzet}zcme fc}fhoa lhdtctx, pfe Fx"
zet@ev }etwet, pfe mlheop lhdtctx, co` c Zxpfio"dc}e` mi"
it`hocpit/
Ho pfh} }emphio, qe gimu} io pftee mthphmcl zheme} ig
Fxzet@ev} `e}hao pfcp bcne pfe }x}peb zetgitb qell ho
ztcmphme/ Ght}p, qe `e}mthde fiq pi teczzlx pfe zthomhzle}
ig fxzet}zcme fc}fhoa cp pfe }pitcae lcxet ho iut Fxzet"
@h}n }ud}x}peb/ ]emio`, qe }fiq fiq pi hbzlebeop
fxzet}zcme fc}fhoa egffimheoplx u}hoa hopeaet izetcphio}/Pfht`, qe `h}mu}} fiq qe ebzlix c `h}pthdupe` miit`h"
ocpit pi elhbhocpe }hoale zihop} ig gchlute/
5/3 Fxzet@h}n; Io"@h}n @cpc ]pitcae
Fxzet@h}n ztiwh`e} zet}h}peop }pitcae u}hoa fxzet}zcme
fc}fhoa dx bczzhoa idkemp} pi ffile} io `h}n mclle` }em"
pit}/ Ecmf }empit h} c ffive`"}h{e, lia"}ptumpute` ffile qfhmf
h} bczze` hopi bebitx hopi qfhmf idkemp} cte ho}etpe`/
Fxzet@h}n pe}}ellcpe} c oi`e} c}}haoe` {ioe hopi }em"
1
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
8/15
]emio`ctx Cppthdupe}
Nex
n:
Ghaute 0; C Fxzet@h}n/ Pfe nex co` idkemp `epetbhoe pfe}empit pi qfhmf co idkemp bcz}/ Pfe }fc`e` ctec tezte}eop}
pfe il` }empit gtib qfhmf giut oeq }empit} fcwe deeo mtecpe`/
Fc}f guomphio} `h}pthdupe idkemp} clioa ecmf cvh}/ Pfe `c}fe`
lhoe} }fiq qfhmf }empit} nex co` }ectmf izetcphio} bu}p piumf/
Izetcphio} oee` pi piumf co cwetcae igI&]( }empit}/
pit}, qfete ecmf idkemp h} `epetbhoh}phmcllx bczze` pi
evcmplx ioe }empit, co` pfetegite, evh}p} ho ioe ffile io pfe
uo`etlxhoa ffile}x}peb/ Clpfiuaf }hbhlct pi {ioe}, }em"
pit} `hgget ho c nex qcx; }empit} cte ffive` ho }h{e, co` cte
}zlhp hopi bite }empit} qfeo pfe oubdet ig idkemp} ho c
}empit evmee`} pfe }empit} mczcmhpx/ Ho mioptc}p, {ioe}
cte c }pcphm zctphphiohoa ig pfe }zcme, co` atiq pi cmmib"
bi`cpe bite idkemp} c} oeme}}ctx/
Fxzet@h}n czzlhe} fxzet}zcme fc}fhoa pi bcz idkemp}
pi }empit}/ Ewetx idkemp }pite` ho c }empit bcpmfe} dipf
pfe nex co` cll cppthdupe} pfcp `effioe pfe }empit/ Qfeo
c }empit} lia demibe} gull, Fxzet@h}n te"pe}}ellcpe}
pfe fxzet}zcme dx }zlhpphoa c gull }empit hopi giut oio"
iwetlczzhoa }empit} ig esucl }h{e/ Ghaute 0 }fiq} co ev"
cbzle Fxzet@h}n/ C nex izetcphio cmme}}e} iolx pfi}e
}empit} te}h`hoa io c lhoe zetzeo`hmulct pi pfe x"cvh}/
]hbhlctlx, c gullx"}zemhffie }ectmf howilwe} iolx pfi}e
}empit} te}h`hoa io c lhoe zetzeo`hmulct pi pfe v"cvh}/
Pfh} `hwh}hio ig c {ioe hopi }empit} eocdle} c Fxzet"
@ev oi`e pi egffimheoplx ho}etp co` tebiwe idkemp} c} qell
c} pcne }ocz}fip} git }ectmf izetcphio}/ Git evcbzle, co
ho}etphio hopi pfe Fxzet@h}n }fiqo ho Ghaute 0 uo`et pfe
nex n: qiul` iolx cggemp pfe }hoale }empit / C liinuzgit pfe }cbe nex qiul` tesuhte pftee }empit tec`} gtib , co` / C fc}f pcdle }pite` ho pfe }empit fec`et, co` pfeczzeo`"iolx }ptumpute ig pfe }empit gcmhlhpcpe ec}x liinuz
ig co idkemp qhpfho pfe }empit qhpfiup fcwhoa pi tec` pfeqfile }empit/ C }ectmf, }fiqo qhpf pfe wetphmcl `c}fe`
lhoe ho pfe ffiaute, qiul` cmme}} }empit} , , , /Miomutteomx depqeeo nex izetcphio} co` }ectmfe} te"
suhte} mctegul fco`lhoa ig idkemp eoubetcphio iwet c Fx"
zet@h}n/ Ho c ochwe hbzlebeopcphio, c miomutteop uz`cpe
miul` mcu}e co idkemp telimcpe` depqeeo }empit} pi czzect
pqhme it oip cp cll ho }ectmf te}ulp}/ Fxzet@ev cwih`}
pfh} dx pcnhoa }ocz}fip} ig pfe Fxzet@h}n cp pfe phbe pfe
}ectmf h} h}}ue`/ ]umf }ocz}fip} mco de zetgitbe` eg"
f&w3( 2 3 : : 3 : 3 : :
f&w4( 2 : 3 3 : : : 3 :
f&w=( 2 : 3 3 : 3 3 3 :
f&w3, w4, w=( 2 3 : : : 3 3 : 3
Ghaute 5; Pfe mioalibetcpe fc}f ig co idkemp qhpf pftee cp"pthdupe}/ Ecmf cppthdupe miopthdupe} c zte`hmpcdle oubdet ig dhp}
pi pfe te}ulphoa fc}f/ Fc}f guomphio} qfi}e defcwhit telhe}
uzio pfe iupzup fc}f} }h{e bcx ec}hlx `epetbhoe fiq bcox
dhp} ho pfe iupzup qhll de u}e` git pfe ffiocl fc}f/
ffimheoplx dx oiphoa pfe eo` ig pfe ecmf }empit} lia co`
eo}uthoa pfcp oi }empit ho pfe }ocz}fip h} `elepe` uophl
pfe }ectmf izetcphio h} mibzlepe/
Fxzet@h}n ztiwh`e} pfe }cbe mio}h}peomx auctcopee}
c} pfe Fxzet@ev }x}peb/ Pfe fec`et hogitbcphio ig
ecmf }empit bcx de bczze` hopi bebitx pi eo}ute gc}p
liinuz/ Iut hbzlebeopcphio u}e} ffioe"atchoe` limnhoa pi
eo}ute pfcp nex"dc}e` izetcphio} co` }ocz}fip} cte lho"ecth{cdle/ Oipe pfcp Fxzet@h}n h} oip c gull `cpcdc}e
lhdtctx co` `ie} oip fco`le gchlute temiwetx/ Pfh} `ie}
oip zi}e c ztidleb git gculp piletcome demcu}e Fxzet"
@ev telhe} uzio temiwetx bemfcoh}b} cp pfe atcoulcthpx
ig }etwet} co` oip cp pfe atcoulcthpx ig ho`hwh`ucl `h}n}/
Actdcae millemphio ig il` }empit} h} }hbzle co` hoev"
zeo}hwe/ Qfeo c }empit }zlhp}, co` h} oi lioaet oeme}}ctx,
Fxzet@h}n uolhon} pfe il` }empit/ Pfe tegeteome miuop"
hoa bemfcoh}b} qhpfho Fxzet@h}n co` pfe ffile}x}peb eo"
}ute pfcp pfe }empit qhll tebcho cwchlcdle uophl hp h} oi
lioaet tegeteome` dx cox }ocz}fip/ Cp pfcp phbe, Fxzet"
@h}n uobcz} pfe }empit gtib bebitx co` pfe ffile}x}peb
temlchb} pfe uo`etlxhoa }pitcae/
Iwetcll, Fxzet@h}n czzlhe} pfe fxzet}zcme fc}fhoa
czzticmf pi pfe `cpc }pite` qhpfho c Fxzet@ev oi`e pi
cmfhewe, ho pfe cwetcae mc}e, I&]( `h}n cmme}}e} zet
izetcphio, qfete ] h} pfe oubdet ig }empit}/
5/4 Fxzet}zcme Fc}fhoa Guomphio}
Fxzet@ev ztiwh`e} c fc}f lhdtctx git }pthoa} co` oub"
det} pfcp h} egffimheop, mibzcmp, co` cmmutcpe/ Pfe aicl ig
pfh} lhdtctx h} pi egffimheoplx }uzzitp fxzet}zcme izetcphio}
pftiuaf dhpqh}e bcohzulcphio ig ffive`"}h{e oubdet}/
Fxzet@ev mtecpe} c fc}f ig co idkemp dx bhvhoa pfe
dhp} gtib pfe idkemp} cppthdupe} hopi c }hoale mioalibet"cpe fc}f/ Pfh} hopetlecwe` tezte}eopcphio eo}ute} pfcp hg
pqi idkemp} fc}fe} cte `hggeteop, pfe fc}fe} dx cp lec}p
ioe dhp git ecmf `hggethoa cppthdupe/ Co idkemp bcpmfe} c
}ectmf hg co` iolx hg hp} fc}f, qfeo bc}ne` pi evptcmp pfe
dhp} mitte}zio`hoa pi pfe }ectmf cppthdupe}, bcpmfe} pfe
fc}f ig pfe }ectmf petb}/ Ghaute 5 }fiq} fiq co idkemp
qhpf pftee cppthdupe} h} bczze` pi c }hoale fc}f/
Pfe fc}f ig co idkemp lhnelx qhll oip miopcho ewetx
dhp gtib ecmf hozup} te}zemphwe fc}fe}/ Pfh} zi}e} c
6
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
9/15
ztidleb git oubethm cppthdupe}, }home pfex bu}p zte}etwe
it`et git tcoae suethe}/ Czzlhmcphio} bcx qh}f pi mu}"
pibh{e pfe fc}f git oubethm cppthdupe} pi eo}ute pfex cte
uohgitblx `h}pthdupe`/ Ioe fc}fhoa pemfohsue pfcp qe
fcwe giuo` qitn} qell h} c oiwel tezte}eopcphio mclle`
mfflicp ho qfhmf qe eomi`e pfe oubdet ho fflicphoa zihop
gitbcp u}hoa iolx pfe oubdet ig dhp} qfhmf qhll czzectho pfe mioalibetcpe fc}f/ ]umf co eomi`hoa zte}etwe}
it`et, qfhle clliqhoa c lctae tcoae ig oubdet} pi de eo"
mi`e`/
Fxzet}zcme fc}fhoa h} u}e` pi bcz idkemp} pi {ioe}
it }empit} dx bcpmfhoa zctphcl zcppeto} cacho}p pfe id"
kemp} fc}fe}/ Pfh} h} suhmn ho ztcmphme, co` mio}h}p} ig
c bc}n co` mibzcte izetcphio/ Dx mio}ptumphio ig pfe
fxzet}zcme, Fxzet@ev eo}ute} pfcp pfete cte oi iwetlcz"
zhoa {ioe}/ Hp pfetegite gilliq} pfcp pfe ffit}p {ioe qfhmf
bcpmfe} co idkemp} fc}f h} pfe {ioe pi qfhmf pfe idkemp
bu}p bcz/ ]empit}, ho mioptc}p, bu}p mfemn ewetx }empit
uophl pfe idkemp h} giuo`/
Fxzet@ev czzlhmcphio `ewelizet} bcx tezlcme pfe}efc}f guomphio} qhpf fc}f guomphio} bite"}uhpe` pi pfe cz"
zlhmcphio} oee`/ Ho zctphmulct, oubethm fc}f guomphio}
qfhmf bcz oio"uohgitb hozup} pi uohgitb iupzup} cte
`e}htcdle, co` eophtelx czzlhmcphio `ezeo`eop/
5/= @h}pthdupe` Miit hocphio
[ioe c}}haobeop co` bcocaebeop ho Fxzet@ev h} zet"
gitbe` dx c liahmcllx meoptclh{e` miit`hocpit/ ]home c
zfx}hmcllx meoptclh{e` miit hocpit qiul lhbhp }mclcdhlhpx
co` de c }hoale zihop ig gchlute ^41R, pfe Fxzet@ev miit"
`hocpit h} `h}pthdupe` co` bcne} u}e ig c miit`hocphio
}etwhme ^3:, 43R pi }mcle pfe miit`hocpit dexio` c }hoale
zfx}hmcl }etwet/ Pfe miit`hocpit hbzlebeopcphio eo}ute}
pfcp }etwet} bcx bhatcpe depqeeo miit`hocpit} }i pfcp oi
miit`hocpit gchlute lec`} pi c zctphphio ho pfe }x}peb/ Pfe
miit`hocpit `htemp} cll gchlute temiwetx cmphio}/ ]etwet}
bcx tezitp id}etwe` gchlute} pi pfe miit`hocpit, it pfe
miit`hocpit bcx `htemplx id}etwe gchlute} pftiuaf zeth"
i`hm gchlute `epemphio zhoa} pi }etwet}/ Ezimf h`} ztiwh`e
lioa"petb ztipemphio cacho}p mibbuohmcphoa qhpf gchle`
oi`e}/ C} co izphbh{cphio, pfe miit`hocpit bcx gitmhdlx
h}ilcpe gchle` mibzioeop} dx nhllhoa pfe WB it }fup"
phoa igg pfe czztizthcpe }qhpmf zitp co` `htemplx till
iup oeq mioffiautcphio}/ Hg pfh} h} oip zi}}hdle, pfe miit"
`hocpit bu}p ffit}p h}}ue c mioffiautcphio qfhmf howclh`cpe}pfe gchle` ezimf h`, co` pfeo h}}ue c }emio` mioffiautcphio
qfhmf tezlcme} pfe gchle` oi`e/
7 Ewclucphio
Qe `ezlixe` Fxzet@ev io dipf c }bcll co` be`hub"
}h{e mibzupcphiocl mlu}pet co` ewclucpe` pfe zetgit"
bcome ig ecmf `ezlixbeop u}hoa pfe Xcfii# Mliu`
]etwhoa Deomfbctn &XM]D( ^35R, co ho`u}ptx"}pco`ct`
piil git ewclucphoa mliu` }pitcae zetgitbcome/ Iut
ewclucphio cl}i mli}elx evcbhoe} pfe zetgitbcome ig
Fxzet@ev} dc}hm izetcphio}, }zemhffimcllx, aep, zup,
co` }ectmf, u}hoa pctaepe` bhmti"deomfbctn}/ Pfe}e
bhmti"deomfbctn} eocdle u} pi h}ilcpe co` evetmh}e }ze"
mhffim mibzioeop} ho iut }x}peb co` felz evzi}e pfe zet"
gitbcome hbzcmp ig ecmf ig iut `e}hao `emh}hio}/ Git
dipf XM]D co` pfe bhmti"deomfbctn}, qe mibzcte Fx"zet@ev qhpf Mc}}co`tc ^40R, c zizulct nex"wclue }pite
git Qed 4/: czzlhmcphio}, co` Bioai@D ^3R, c `h}"
pthdupe` `imubeop `cpcdc}e/
Pfe zetgitbcome deomfbctn} cte evemupe` io iut
}bcll, `e`hmcpe` lcd"}h{e mlu}pet ho it`et pi cwih` cox
miogiuo`hoa h}}ue} cth}hoa gtib }fcthoa c whtpuclh{e`
zlcpgitb, qfhle pfe }mclcdhlhpx deomfbctn} cte evemupe`
io pfe WHMMH ^=3R pe}pde / Iut `e`hmcpe` mlu}pet mio"
}h}p} ig giutpeeo oi`e}, ecmf ig qfhmf h} esuhzze` qhpf
pqi Hopel Veio 4/5 AF{ E504: ztime}}it}, 37 AD igTCB, co` c 5:: AD ]CPC =/: Adhp)} fct` `h}n izet"cphoa cp 14:: TZB/ Cll oi`e} cte tuoohoa 70"dhp @edhco
7 qhpf pfe Lhouv 4/7/=4 netoel/ C }hoale ahacdhp Epfetoep}qhpmf miooemp} cll giutpeeo bcmfhoe}/ Io ecmf ig pfe
bcmfhoe}, qe `ezlixe` Mc}}co`tc wet}hio :/1/=, Bio"
ai@D wet}hio 4/:/:, co` Fxzet@ev/
Git cll lcd"}mcle pe}p}, pfe }pitcae }x}peb} cte mioffia"
ute` pi ztiwh`e }ugffimheop tezlhmcphio pi piletcpe ioe oi`e
gchlute/ Ecmf }x}peb qc} mioffiaute pi u}e hp} `egculp
mio}h}peomx }epphoa}/ ]zemhffimcllx, dipf Mc}}co tc co`
Bioai@D zetgitb tezlhmcphio c}xomftioiu}lx> uz`cpe
mioffitbcphio} cte teputoe` pi pfe mlheop} degite pfe uz"
`cpe} cte mio}h}peoplx czzlhe` cmti}} pfe tezlhmc}/ Ho mio"
ptc}p, Fxzet@ev uphlh{e} wclue"`ezeo`hoa mfchohoa co`,
c} c te}ulp, clqcx} ztiwh`e} mlheop} qhpf }ptioa mio}h}"
peomx eweo ho pfe zte}eome ig oi`e gchlute}/ Bioai@D
cllimcpe} tezlhmcpe} ho zcht}, oeme}}hpcphoa co eweo mlu}pet
}h{e/ Pi pfcp eo`, qe cllimcpe pqelwe bcmfhoe} git pfe
}pitcae oi`e}> ioe bcmfhoe git pfe mlheop}> co`, qfete
czzlhmcdle, ioe oi`e git pfe miit`hocpit/ Fxzet@ev h}
mioffiaute` pi fcwe pqi }ud}zcme} ho c``hphio pi pfe nex
}ud}zcme pi cmmibbi`cpe pfe peo cppthdupe} ho pfe XM]D
`cpc}ep/
7/3 Aep)Zup Zetgitbcome
Fhaf aep)zup zetgitbcome h} zctcbiuop pi cox mliu`"
dc}e` }pitcae }x}peb}, co` XM]D ztiwh`e} co ho`u}ptx"
}pco`ct` qcx pi ewclucpe aep)zup zetgitbcome/ Hp }zemh"ffie} }hv `hggeteop qitnlic`} pfcp evetmh}e pfe }pitcae }x}"
peb qhpf c bhvpute ig tesue}p pxze} co` idkemp `h}pthdu"
phio} te}ebdlhoa tecl"qitl` czzlhmcphio}/ Ho iut evzet"
hbeopcl }epuz, ecmf tesue}p }zemhffie} ioe it bite id"
kemp}, iup ig c pipcl ig 3:,:::,:::, pfcp cte lic`e` hopi
pfe }x}peb zthit pi pfe evzethbeop/ Ghaute 7 }fiq} pfe
pftiuafzup cmfhewe` dx ecmf }x}peb cmti}} pfe XM]D
qitnlic`}/ Fxzet@ev ztiwh e} c pftiuafzup pfcp h} de"
pqeeo c gcmpit ig pqi pi pfhtpeeo fhafet pfco pfe ipfet
8
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
10/15
:
5
3:
4:
=:
0:
Mc}}co`tc Bioai@D Fxzet@ev
Pftiuafzup&
pfiu}co`iz)}(
Lic`Qitnlic` CQitnlic` DQitnlic` MQitnlic` @Qitnlic` EQitnlic` G
Ghaute 7; Pftiuafzup git c wcthepx ig tecl"qitl` qitnlic`}}zemhffie` dx pfe Xcfii# Mliu` ]etwhoa Deomfbctn/ Fxzet@ev
h} ="3= phbe} gc}pet pfco Mc}}co`tc co` 4"34 phbe} gc}pet pfco
Bioai@D/
:
4:
0:
7:
6:
3::
3 3: 5:
M@G&%(
Lcpeomx &b}(
Mc}}co`tc &T(Mc}}co`tc &U(Bioai@D &T(Bioai@D &U(Fxzet@ev &T(Fxzet@ev &U(
Ghaute 1; aep)zup zetgitbcome/ Lcpeomx `h}pthduphio git3:,::: izetcphio} mio}h}phoaig 85% tec } co` 5% uz`cpe} qhpf
nex} }elempe` gtib c [hzg `h}pthduphio/ Fxzet@ev bchopcho}
liq lcpeomx qfete pfe ipfet }x}peb} evfhdhp fhafet lcpeomx ho
pfe zte}eome ig bcox tec`}/
}x}peb}/ Pfh} }haohffimcop hbztiwebeop ho aep)zup zet"
gitbcome h} cppthdupcdle bi}plx pi pfe egffimheop fco`lhoa
igaep izetcphio} uo`et fxzet}zcme fc}fhoa/ Iut hbzle"
beopcphio `ebio}ptcpe} pfcp pfe fxzet}zcme mio}ptumphio
co` bchopeocome mco de teclh{e` egffimheoplx/
Ho it`et pi acho ho}hafp} hopi pfe zetgitbcome ig pfe
}x}peb, qe evcbhoe` pfe tesue}p lcpeomx `h}pthduphio}
ig pfe `hggeteop }x}peb} uo`et qitnlic` D, tezte}eophoatec`"hopeo}hwe qitnlic`} qhpf 5% qthpe} co` 85% tec`},
co` qitnlic` C, tezte}eophoa tec`"qthpe dclcome` qitn"
lic`} qhpf 5:% tec`} co` qthpe}/ Dipf qitnlic } }e"
lemp nex} gtib c [hzg `h}pthduphio/ Ghaute 1 }fiq} pfe
tesue}p lcpeomx `h}pthduphio} ig pfe pftee }x}peb} uo`et
qitnlic` D/ Qe }ee pfcp Fxzet@ev mibzlepe} 3::% ig
hp} aep izetcphio} ho 3 b}, qfhmf h} }ewetcl phbe} gc}petpfco Mc}}co`tc co` Bioai@D/ Pfe lcpeomx `h}pthduphio
}fiqo git cll pftee }x}peb} h} suclhpcphwelx }hbhlct git
:
4:
0:
7:
6:
3::
3 3: 5:
M@G&%(
Lcpeomx &b}(
Mc}}co`tcBioai@DFxzet@ev
Ghaute 6; zup zetgitbcome/ Lcpeomx `h}pthduphio git3:,:::,::: izetcphio} mio}h}phoa ig 3::% ho}etphio}/ Ecmf iz"
etcphio mtecpe` c oeq idkemp uo`et c uohsue, ztewhiu}lx uou}e`
nex/ Clpfiuaf gc}p, Fxzet@ev} pftiuafzup }ugget} `ue pi pfe
leoapf ig wclue"`ezeo`eop mfcho}/
qitnlic`} C, D, M, co` @/
Git mibzlepeoe}}, qe zte}eop pfe zetgitbcome ig cll
pftee }x}peb} io c qthpe"fecwx qitnlic`/ Ghaute 6
}fiq} pfe lcpeomx h}pthduphio git lic`hoa 3:,:::,::: id"
kemp} hopi pfe `cpcdc}e ho ztezctcphio git pfe XM]D pe}p}/
Pfh} pe}p hllu}ptcpe} pfe eggemp pfcp mio}h}peomx auctco"
pee} fcwe io zup lcpeomx/ Bioai@D} `egculp mio}h}"
peomx auctcopee} mio}h`et c zup mibzlepe qfeo hp fc}
deeo }umme}}gullx }eop pi pfe `e}phocphio }etwet qhpf oi
ettit}/ Mc}}co`tc} `egculp mio}h}peomx auctcopee} mio"
}h`et c zup mibzlepe qfeo hp h} sueue` ho pfe ffile}x}peb
mcmfe io cp lec}p ioe tezlhmc/ Ho mioptc}p, Fxzet@ev auct"
copee} pfcp pfe uz`cpe h} mibbhppe` io cll tezlhmc} degite
teputohoa c te}zio}e pi pfe mlheop/ C} c te}ulp, Bioai@D
h} cdle pi mibzlepe c bckithpx ig izetcphio} ho le}} pfco
3 b}/ Oewetpfele}}, 88% ig Fxzet@ev izetcphio} mib"zlepe ho le}} pfco 4 b}/
7/4 ]ectmf w}/ ]mco
Uolhne evh}phoa nex"wclue }pite}, Fxzet@ev h} ctmfh"
pempe` gtib pfe atiuo`"uz pi zetgitb }ectmf izetc"
phio} egffimheoplx/ Mutteop czzlhmcphio} pfcp telx io ev"
h}phoa nex"wclue }pite} ebulcpe }ectmf guomphioclhpx dx
ebde``hoa c``hphiocl hogitbcphio cdiup ipfet cppthdupe}/
Git evcbzle, czzlhmcphio} pxzhmcllx atiuz liahmcllx te"lcpe` idkemp} dx u}hoa c }fcte` zteffiv ho pfe nex ig ecmf
idkemp, co` pfeo telx uzio pfe nex"wclue }pite pi limcpe
nex} qhpf pfe mibbio zteffiv/ Ho Aiiale DhaPcdle co`
Mc}}co`tc, pfh} izetcphio h} egffimheop demcu}e nex} cte
}pite` ho }itpe` it`et, co` teputohoa cll liahmcllx atiuze`
nex} h} co egffimheop lhoect }mco/ Ghpphoalx, pfe XM]D
deomfbctn mcll} pfh} c }mco izetcphio/ Fxzet@ev}
}ectmf guomphioclhpx h} c }pthmp }uzet}ep ig pfe }mco
izetcphio/ Tcpfet pfco u}hoa c }fcte zteffiv pi }uzzitp
3:
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
11/15
:
4:
0:
7:
6:
3::
3 3: 3:: 3:::
M@G&%(
Lcpeomx &b}(
Mc}}co`tcBioai@DFxzet@ev
Ghaute 8; }ectmf zetgitbcome/ Lcpeomx `h}pthduphio git3:,::: izetcphio} mio}h}phoa ig 85% tcoae suethe} co` 5%
ho}etp} qhpf nex} }elempe` gtib c [hzg `h}pthduphio/ Fxzet"
@ev h} cdle pi igget }haohffimcoplx liqet lcpeomx git oio"zthbctx
nex tcoae suethe} pfco pfe ipfet }x}peb} cte cdle pi igget git
zthbctx"nex tcoae suethe}/ Ecmf }mco izetcphio teputoe` de"pqeeo 3 co` 3:: izetcphio} qhpf uohgitb ztidcdhlhpx/
}mco}, Fxzet@ev }pite}, git ecmf idkemp, pfe zteffiv co`
}ugffiv ig pfe nex c} pqi }emio ctx cppthdupe}/ ]mco} cte
pfeo hbzlebeope` c} c bulph"cppthdupe }ectmf pfcp evcmplx
bcpmfe} c ztiwh`e` zteffiv wclue co` c ztiwh`e` tcoae ig
}ugffiv wclue}/ Pfu}, cll XM]D deomfbctn} howilwhoa c
}mco izetcphio izetcpe io }emio`ctx cppthdupe} ho Fx"
zet@ev, dup izetcpe io pfe nex git ipfet }x}peb}/
@e}zhpe izetcphoa io }emio`ctx cppthdupe} ho}pec` ig
pfe nex, Fxzet@ev iupzetgitb} pfe ipfet }x}peb} dx co
it`et ig bcaohpu`e git }mco izetcphio} &Ghaute 8(/ ]ew"
eopx ffiwe zetmeop ig }ectmf izetcphio} mibzlepe ho le}}
pfco 4 b}, co` oectlx cll mibzlepe ho le}} pfco 7 b}/Mc}}co`tc mlu}pet} `cpc ho c }itpe` it`et dc}e` io pfe zth"
bctx nex, co` h} pfetegite cdle pi tepthewe bcpmfhoa hpeb}
telcphwelx suhmnlx/ Bioai@D} }fct`hoa tesuhte} mio"
}ptumphio ig co ho`ev> mio}esueoplx, }mco izetcphio} ho
Bioai@D cte telcphwelx gc}p/ Pfe }ectmf zetgitbcome
ig Fxzet@ev h} oip cppthdupcdle pi iut egffimheop hbzle"
beopcphio c} pfe cbiuop ig hbztiwebeop emlhz}e} pfe `hg"
geteome} id}etwe` git aep)zup lcpeomx co` pftiuafzup/
Fxzet}zcme fc}fhoa ho Fxzet@ev mlu}pet} pfe bcpmfhoa
te}ulp} io c }bcll oubdet ig }etwet}> pfh} eocdle} eg"
gemphwe ztuohoa ig pfe }ectmf }zcme co` evzlcho} eocdle}ecmf }ectmf pi mibzlepe dx miopcmphoa evcmplx ioe fi}p/
Gutpfetbite, pfe Fxzet@h}n }ptumpute eocdle} ecmf fi}p
pi egffimheoplx mibzupe pfe }ectmf te}ulp}/
Co c` hphiocl deoeffip ig Fxzet@ev} caate}}hwe
}ectmf }zcme ztuohoa h} pfe telcphwelx liq lcpeomx iwet"
fec` c}}imhcpe` qhpf }ectmf izetcphio}/ Ghaute 3:
}fiq} pfe cwetcae lcpeomx ig c }hoale }mco izetcphio
c} pfe pipcl oubdet ig }mco izetcphio} zetgitbe` ho"
mtec}e}/ Ho pfh} pe}p, }ectmfe} qete mio}ptumpe` dx mfii}"
:/3
3
3:
3::
3:::
3 3: 5:
Lcpeomx&b}(
Zetmeop }mco)}ectmf
Mc}}co`tcBioai@DFxzet@ev
Ghaute 3:; Pfe eggemp ig co homtec}hoa }mco qitnlic` io lc"peomx/ Fxzet@ev zetgitb} }haohffimcoplx deppet pfco pfe ipfet
}x}peb} eweo c} pfe }mco qitnlic` deaho} pi czzticmf 5:%/
hoa pfe liqet diuo` ig pfe tcoae uohgitblx cp tco`ib
gtib pfe }ep ig zi}}hdle wclue}, c} izzi}e` pi qitnlic`E qfhmf u}e} c [hzg `h}pthduphio pi/ Pfe uohgitb `h}"
pthduphio ig }ectmfe} eweolx `h}pthdupe} lic` ho cll pftee
}x}peb}/ Fxzet@ev mio}h}peoplx igget} liq lcpeomx eweo
ho pfe zte}eome ig c }ectmf fecwx qitnlic`/
C mthphmcl zctcbepet pfcp cggemp} Fxzet@ev} }ectmf
zetgitbcome h} pfe oubdet ig }ud}zcme} pi mtecpe git c
Fxzet@ev pcdle/ Homtec}hoa pfe oubdet ig }ud}zcme}
qhll lec` pi c` hphiocl izzitpuohphe} git ztuohoa pfe
}ectmf }zcme git }ectmf izetcphio}, dup qhll }hbulpcoe"
iu}lx tesuhte lioaet wclue"`ezeo`eop mfcho} pfcp mco te"
}ulp ho fhafet zup lcpeomhe}/ Ho Ghaute 33, qe evzlite
pfe ptc`eigg u}hoa depqeeo {eti co` peo c``hphiocl }ud"
}zcme} dexio` pfe bco`cpitx nex }ud}zcme/ C} ev"
zempe`, Fxzet@ev} zup lcpeomx homtec}e} co` pftiuaf"
zup `emtec}e} qhpf c``hphiocl }ud}zcme}> lcpeomx evfhdhp}
c lhoect pteo`/ Demcu}e pfe oubdet ig mlheop} h} ffive`,
pftiuafzup gcll} }haohffimcoplx qhpf pfe ffit}p geq c``hphiocl
}ud}zcme}, dup eweopucllx tecmfe} c zihop qfete c``h"
phiocl }ud}zcme} hbzcmp pftiuafzup le}}/
7/= ]mclcdhlhpx
Qe fcwe `ezlixe` Fxzet@ev io pfe WHMMH ^=3R pe}pde`
pi ewclucpe hp} zetgitbcome ho co eowhtiobeop tezte}eo"
pcphwe ig pfe mliu`/ Ecmf WHMMH mlu}pet fc} 1: @ell
T03: ZiqetE`ae }etwet}, ecmf ig qfhmf fc} 4 Hopel VeioV575: MZU}, 06 AD ig TCB, pftee 3 PD fct` `thwe},co` pqi 3 Adhp epfetoep zitp}/ U}et} cte ztiwh`e` qhpfco h}ilcpe` whtpucl bcmfhoe ho qfhmf pfex bcx mio`ump
evzethbeop}/ Ecmf whtpucl bcmfhoe mibe} zteho}pclle`
qhpf Ge`itc 34 co` tuo} pfe 4/7/=4 Lhouv netoel/
Qe evcbhoe` pfe zetgitbcome ig c Fxzet@ev mlu}pet
c} pfe mlu}pet homtec}e} ho }h{e/ Homtec}hoa pfe oubdet
ig }etwet} ho pfe mlu}pet ztiwh`e} Fxzet@ev qhpf c``h"
phiocl te}iutme}, co` lec`} pi c ztizitphiocl homtec}e ho
33
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
12/15
:
3
4
=
0
5
7
1
Lcpeomx&b}(
4
0
7
6
3:
34
30
: 4 0 7 6 3:Pftiuafzup&iz})}3:::(
Oubdet ig ]ud}zcme}
Fxzet@ev
Ghaute 33; Lcpeomx co` pftiuafzup git zup izetcphio} git cffive` oubdet ig mlheop} c} pfe oubdet ig c``hphiocl &oio"nex(
}ud}zcme} homtec}e}/ Pfe ettit dct} ho`hmcpe }pco`ct` `ewhcphio
cmti}} 3: evzethbeop}/ Pfete h} c zte`hmpcdle iwetfec c}}i"
mhcpe` qhpf c``hoa c``hphiocl }ud}zcme}/ C} evzempe`, lcpeomx
homtec}e} lhoectxlx ho pfe leoapf ig pfe mfcho, qfhle pftiuafzup`emtec}e} ztizitphiocllx/
pftiuafzup/ Ho Ghaute 34, qe evzlite pfe }x}peb pftiuaf"
zup git c wcthepx ig mioffiautcphio}/ Fxzet@ev }mcle} lho"
ectlx c} te}iutme} cte c``e` pi pfe mlu}pet/ Ecmf zihop
ho pfe atczf tezte}eop} pfe cwetcae pftiuafzup id}etwe`
iwet c =: }emio` qho`iq co` pfe ettit dct} }fiq pfe 5pf
co` 85pf zetmeophle}/ Cp hp} zecn, Fxzet@ev h} cdle picwetcae =/4 bhllhio izetcphio} zet }emio`/
Pfe bec}utebeop} tezitpe` ho Ghaute 34 cte pcneo
ho }pec`x }pcpe/ Pfe tezitpe` bec}utebeop} evmlu`e pfe
qctb"uz phbe git pfe }x}peb/ Ho cll evzethbeop}, 35 }em"
io`} qc} }ugffimheop pi cmfhewe }pec`x }pcpe/ Mlheop} izet"
cpe ho zctcllel, co` cte tuo io }ezctcpe bcmfhoe} gtib pfe
}etwet} ho cll dup pfe lctae}p mioffiautcphio}/ Mlheop} h}}ue
tesue}p} ho zctcllel, co` ecmf mlheop bchopcho} co cwet"
cae ig 3,::: iup}pco`hoa tesue}p} zet }etwet/ Homtec}"
hoa pfe oubdet ig mlheop} `ie} oip }haohffimcoplx hbzcmp
pfe cmfhewcdle pftiuafzup/ Pfe qitnlic` git ecmf mlheop
mio}h}p} ig 85% aep izetcphio} co` 5% zup izetcphio}
qhpf tco`iblx aeoetcpe` 6 D nex} co` 70 D wclue}/Pfh} evzethbeop }fiq} pfcp c be`hub"}h{e` Fxzet"
@ev mlu}pet h} cdle pi cmfhewe fhaf pftiuafzup/ Git
}bcllet mlu}pet }h{e}, c``hoa c``hphiocl mlheop} `ie} oip
oeacphwelx hbzcmp pftiuafzup, co` ho bcox mc}e} tch}e}
pfe 5% zetmeophle bctn/1 Telcpe` Qitn
@cpcdc}e }x}peb ]pitcae }x}peb} pfcp itacoh{e pfeht
`cpc ho fhaf"`hbeo}hiocl }zcme} qete zhioeete` dx pfe
`cpcdc}e mibbuohpx bite pfco pfhtpx xect} cai ^1, 8,
38, 4=, 46, =:, =0R/ Pfe}e }x}peb}, millemphwelx noiqo
c} Bulph"@hbeo}hiocl @cpcdc}e} &B@D(, lewetcae bulph"
`hbeo}hiocl `cpc }ptumpute} pi, pftiuaf bite izphbh{e`
bebitx co` `h}n cmme}}, hbztiwe pfe zetgitbcome ig
:
3
4
=
0
: 5 3: 35 4: 45 =: =5
Pftiuafzup&bhllhioiz})}(
Oi`e}
3 Mlheop4 Mlheop}0 Mlheop}6 Mlheop}
37 Mlheop}=4 Mlheop}06 Mlheop}
Ghaute 34; Fxzet@ev h} c }mclcdle }x}peb/ C} bite oi`e}cte c``e`, caateacpe pftiuafzup homtec}e} lhoectlx/ Ecmf zihop
tezte}eop} pfe cwetcae pftiuafzup ig pfe }x}peb ho }pec`x }pcpe
iwet c =: }emio` qho`iq/ Pfe ettit Pfe ettit dct} }fiq pfe 5pf
co` 85pf zetmeophle}/
`cpc qctefiu}hoa co` iolhoe coclxphmcl ztime}}hoa cz"
zlhmcphio}/ Fiqewet, uolhne fxzet}zcme} ho Fxzet@ev,
pfe `cpc }ptumpute} ho B@D} cte `e}haoe` git itaco{hoa
`cpc io c }hoale bcmfhoe co` cte oip `htemplx czzlhmcdle
pi lctae"}mcle `h}pthdupe` }pitcae }x}peb}/ Clpetocphwelx,
bite temeop `cpcdc}e }x}peb} ^4, 37R fcwe deauo evzlit"
hoa egffimheop bemfcoh}b} git duhl`hoa co` bchopchohoa
lctae"}mcle, ptee"dc}e` `h}pthdupe ho`hme}/ Fxzet@ev h}
c guomphiocl }uzet}ep ig `h}pthdupe` ho`hme}> hp ztiwh`e}
egffimheop }ectmf git bcox cppthdupe} qhpfiup pfe iwetfec`
ig duhl`hoa bulphzle `h}pthdupe` ho`hme}/
Zeet"pi"zeet }x}peb} Zc}p qitn ho zeet"pi"zeet }x}peb}fcwe evzlite` bulph"`hbeo}hiocl oepqitn iwetlcx} pi
gcmhlhpcpe tczh co` `emeoptclh{e` `cpc }pitcae co` te"
pthewcl/ Bumf lhne Fxzet@ev, MCO ^==R, c `h}pthdupe`
fc}f"pcdle, itacoh{e} zeet} ho c bulph"`hbeo}hiocl }zcme/
Fiqewet, MCO iolx ztiwh`e} nex ho}etp} co` liinuz}>
pfe zutzi}e ig MCO} bulph"`hbeo}hiocl zeet mioffiautc"
phio h} pi lhbhp c MCO oi`e} zeet"}ep }h{e co` ztiwh`e c
teaulct }ptumpute git egffimheop iwetlcx tiuphoa/
BUTN ^36R, ]nhzHo`ev ^0:R, co` ]QCB"W ^44R `x"
ocbhmcllx zctphphio pfe bulph"`hbeo}hiocl }zcme hopi n`"
ptee}, }nhz atczf}, co` Witioih `hcatcb} te}zemphwelx
pi ztiwh`e bulph"`hbeo}hiocl tcoae liinuz}/ Clpfiuaf
miomezpucllx }hbhlct pi Fxzet@ev, ztiwh`hoa miit`hoc"phio co` bcocaebeop ig oi`e} git pfe}e `xocbhm }zcme
zctphphiohoa }mfebe} h} }haohffimcoplx bite mibzlev co`
ettit"ztioe pfco git Fxzet@ev} }pcphm }zcme zctphphio"
hoa co` tesuhte c``hphiocl izetcphiocl iwetfec`/ Pfe}e
}x}peb} cl}i `i oip c``te}} }ewetcl mthphmcl co` hofeteop
ztidleb} c}}imhcpe` qhpf bczzhoa }ptumpute` `cpc hopi
c bulph"`hbeo}hiocl }zcme co` ztiwh`hoa telhcdle `cpc
}pitcae/ ]zemhffimcllx, pfex cte oip egffimheop git fhaf `h"
beo}hiocl `cpc `ue pi pfe mut}e"ig"`hbeo}hioclhpx, co`
34
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
13/15
pfex ehpfet lcmn `cpc tezlhmcphio it ztiwh`e iolx eweopu"
cllx mio}h}peop izetcphio} io tezlhmcpe` `cpc/ C``te}}hoa
pfe}e ztidleb} dx cuabeophoa `xocbhm }zcme zctphphio"
hoa }mfebe} qhpf }ud}zcme} co` wclue"`ezeo`eop mfcho"
hoa qiul` gutpfet homtec}e pfe mibzlevhpx co` iwetfec`
ig oi`e miit`hocphio co` bcocaebeop/ Ctzeaahi 3=R
ztiwh`e} }ectmf iwet bulphzle cppthdupe} dx mtecphoa coho`ev ig cll ffive`"}h{e }ud}ep} pfe cppthdupe}/ Ho mioptc}p
qhpf eoubetcphoa cllnv
}ud}ep} ig cppthdupe}, Fxzet@ev
fc}fe} idkemp} hopi c bulph"`hbeo}hiocl }zcme, co` eb"
zlix} `cpc zctphphiohoa pi te`ume `hbeo}hioclhpx/
]zcme"ffillhoa mutwe} C mibbio czzticmf pi ztiwh`hoa
bulph"cppthdupe }ectmf u}e} }zcme"ffillhoa mutwe} pi zct"
phphio bulph"`hbeo}hiocl `cpc cmti}} pfe }pitcae oi`e}/
Pfh} czzticmf u}e} pfe }zcme ffillhoa mutwe pi bcz pfe
bulph"`hbeo}hiocl `cpc hopi ioe `hbeo}hio, qfhmf pfeo
eocdle} pfe u}e ig ptc hphiocl zeet"pi"zeet pemfohsue}
git zetgitbhoa bulph"cppthdupe }ectmfe}/ ]MTCZ ^36R,
]suh` ^=5R co` [Oep ^=7R cte evcbzle} ig pfh} czzticmfqhpf ecmf oi`e te}zio}hdle git `cpc ho c miophauiu} tcoae
ig wclue}/ ]hbhlctlx, BCCO^33R zetgitb} pfe }cbe
bczzhoa, dup u}e} uohgitb limclhpx zte}etwhoa fc}fhoa/
]zcme"ffillhoa mutwe} `i oip }mcle qell qfeo pfe `hbeo"
}hioclhpx h} fhaf, demcu}e c }hoale }ectmf suetx bcx de
zctphphioe` hopi bcox ioe"`hbeo}hiocl tcoae} ig mio}h`"
etcdlx wctxhoa }h{e/ Gutpfetbite, uolhne ho Fxzet@ev,
gullx"suclhffie` }ectmfe}, qfete wclue} git cll cppthdupe}
cte }zemhffie`, bcx howilwe miopcmphoa bite pfco ioe oi`e
ho }zcme"ffillhoa mutwe"dc}e` }x}peb}/
Nex"Wclue ]pite} Temeoplx, nex"wclue }pite} fcwe de"
mibe pfe gimu} ig te}ectmf demcu}e pfeht te}pthmpe` hopet"
gcme, }mclcdhlhpx co` fhaf zetgitbcome ffill c acz legp dx
ptc`hphiocl `cpcdc}e }x}peb}/ DhaPcdle ^34R, co` hp} izeo
}iutme `ethwcphwe} ^0, 40R }fcte c }hbhlct `cpc bi`el ho
qfhmf `cpc h} }ptumpute` ho c }hoale bulph"cppthdupe bcz
pfcp h} ho`eve` dx c tiq nex, milubo nex, co` phbe}pcbz/
@xocbi ^31R co` hp} izeo }iutme mlioe Thcn ^7R }uz"
zitp c bite"te}pthmpe` nex"wclue hopetgcme, co` evzi}e
mcu}cl `ezeo`eomhe} pi clliq pfe czzlhmcphio pi te}ilwe
miofflhmp}/ Cll ig pfe}e }x}peb} ebzlix I&3( fiz liinuz,co` cte `e}haoe` pi }mcle io mibbi`hpx bcmfhoe} ho c
`cpcmeopet eowhtiobeop/ Fxzet@ev evzco } io pfe te"
}pthmpe` hopetgcme ig nex"wclue }pite} qhpfiup hbzcmphoa
}mclcdhlhpx, mio}h}peomx, co` zetgitbcome/
Ipfet qitn io nex"wclue }pite} fc} gimu}e` io ev"
zlihphoa }zemhffim ztizetphe} ig pfe uo`etlxhoa fct`qcte pi
cmfhewe fhaf zetgitbcome/ Gcqo NW ^=R co` ]HLP ^45R
duhl` gc}p co` egffimheop nex"wclue }pitcae }x}peb} io uo"
`etziqete` fct`qcte ho it`et pi bcvhbh{e pfe cbiuop
ig pftiuafzup cmfhewe zet uohp ig mio}ube` ziqet/
TCBMliu` ^48R }pite} pfe zthbctx mizx ig `cpc ho TCB,
co` uphlh{e} gc}p oepqitn miooemphio} pi tczh`lx te}pite
gchle` tezlhmc} MIZ] ^47R hbztiwe} pfe zetgitbcome
ig aei"tezlhmcpe` nex"wclue }pite} qfhle cp pfe }cbe
phbe }pteoapfeohoa mio}h}peomx auctcopee}/ Ipfet }x}"
peb} ^=1R uphlh{e c bulph"phet }pitcae fhetctmfx pi evzlihp
mcmfe"idlhwhiu} claithpfb} ho pfe }pitcae lcxet/ Pfe}e
}x}peb} hbztiwe pfe zetgitbcome ig nex"wclue }pite}
qfhle tepchohoa pfe }cbe dc}hm }ptumpute; c fc}f pcdle/
Ho Fxzet@ev, qe pcne c mibzlebeopctx czzticmf qfhmfevzco`} pfe nex"wclue hopetgcme pi }uzzitp }ectmf izetc"
phio}/ Oipfhoa cdiup iut czzticmf te}pthmp} mibdhohoa
pemfohsue} gtib pfe}e ipfet }x}peb} qhpf Fxzet@ev}
fxzet}zcme fc}fhoa pemfohsue/
Qfhle Fxzet@ev h} c nex"wclue }pite qfhmf igget}
}ectmf ztizetphe}, ipfet }x}peb} ztizi}e u}hoa nex"wclue
}pite} pi ptco}zcteoplx cmmeletcpe ptc hphiocl }x}peb}/ Pv"
Mcmfe ^=4R hbzlebeop} c ptco}cmphiocl mcmfhoa lcxet io
piz ig pfe bebmcmfe` ho"bebitx nex"wclue }pite/ Pfh}
mcmfe lcxet hbztiwe} pfe zetgitbcome ig pfe uo`etlx"
hoa Zi}pate]SL `cpcdc}e dx mcmfhoa bulphzle wet}hio} ig
ecmf idkemp ho pfe nex"wclue }pite co` bchopchohoa pfe}e
wet}hio} ho pco`eb qhpf pfe `cpcdc}e/
Oi]SL ]pitcae Fxzet@ev gcll} uo`et pfe mcpeaitx ig
Oi]SL }pitcae }x}peb}, ig qfhmf nex"wclue }pite}
gitb c wetx }zemhffim }udmcpeaitx/ Pfe}e }x}peb} telcv
ptc`hphiocl CMH@ auctcopee} ho it`et pi hbztiwe }mclcdhl"
hpx it zetgitbcome/ Git ho}pcome, Xcfii#} ZOUP] ^30R
}uzzitp} }elemphio co` ztikemphio gtib c }hoale pcdle, dup
`ie} oip }uzzitp kiho izetcphio}/ Miumf@D ^5R co` Bio"
ai@D ^3R cte `imubeop `cpcdc}e} qfhmf `i oip hbzi}e
}ptumpute io pfe uo`etlxhoa `cpc/ Fxzet@ev ztiwh e}
}ptioa }hoale"nex mio}h}peomx co` eocdle} }ectmfe} iwet
}ptumpute` `cpc/ Io pfe }zemptub ig Oi]SL }pite}, Fx"
zet@ev te}h`e} depqeeo nex"wclue }pite} co` `imubeop`cpcdc}e} c} hp ztiwh`e} bite }ptumpute pfco `imubeop
`cpcdc}e}, co` bite fflevhdhlhpx pfco nex"wclue }pite}/
6 Miomlu}hio}
Ho pfh} zczet, qe `e}mthde` Fxzet@ev, c fhaf"
zetgitbcome, }mclcdle co` }ectmfcdle nex"wclue }pitcae
}x}peb} git mliu` mibzuphoa/ Fxzet@ev ztiwh`e} co eg"
ffimheop }ectmf zthbhphwe git tepthewhoa idkemp} dx }zemhgx"
hoa pfeht }emio`ctx cppthdupe}/ Hp cmfhewe} pfh} evpeo`e
guomphioclhpx pftiuaf fxzet}zcme fc}fhoa, ho qfhmf
bulph"cppthdupe idkemp} cte `epetbhoh}phmcllx bczze` pi
miit hocpe} ho c liq `hbeo}hio Eumlh`eco }zcme/ Pfh}
bczzhoa lec`} pi egffimheop hbzlebeopcphio} git nex te"pthewcl, zctphcllx"}zemhffie` }ectmfe} co` tcoae"suethe}/ C
oiwel tezlhmcphio ztipimil eocdle} pfe }x}peb pi ztiwh`e
}ptioa mio}h}peomx qhpfiup }cmthffimhoa zetgitbcome/
Qe fcwe `ewelize` c gull izeo"}iutme hbzlebeopc"
phio ig Fxzet@ev co` }fiq, pftiuaf c lctae"}mcle mliu`
`ezlixbeop, pfcp hp h} ztcmphmcl co` egffimheop/ Ho iut ev"
zethbeop}, Fxzet@ev ztiwh`e} mibzctcdle zetgitbcome
pi ipfet nex"wclue }pite} git nex izetcphio}, co` igget}
}ewetcl it`et} ig bcaohpu`e fhafet zetgitbcome git ffio`"
3=
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
14/15
hoa zctphcllx }zemhffie` idkemp}
Pfe temeop pteo` piqct` Oi]SL `cpc }pite} fc} deeo
guele` dx }mclcdhlhpx co` zetgitbcome miometo} cp pfe
mi}p ig guomphioclhpx/ Fxzet@ev dth`ae} pfh} acz dx
ztiwh`hoa c``hphiocl guomphioclhpx co` fflevhdhlhpx qhpfiup
}cmthffimhoa }mclcdhlhpx co` zetgitbcome/ Fxzet@ev ig"
get} c thmf CZH co` }ptioa mio}h}peomx auctcopee} pfcpmco eocdle fhaf"zetgitbcome, fhaf"c}}utcome nex"wclue
}pite czzlhmcphio}/
Tegeteome}
^3R 3:aeo, Hom/ fppz;))qqq/bioai`d/ita, Cm"
me}}e` Oiwebdet 48, 4:33/
^4R Bctmi} Ncqc{ie Cauhletc, Qikmhemf B/ Ailcd,
co` Beful C/ ]fcf/ C ztcmphmcl }mclcdle `h}pthdupe`
D"ptee/ Ho Ztimee`hoa} ig pfe WL@D Eo`iqbeop,
3&3(;586"7:8, 4::6/
^=R @cwh` A/ Co`et}eo, Kc}io Gtconlho, Bhmfcel
Ncbho}nx, Cbct Zfcoh}fcxee, Lcqteome Pco, co`Whkcx Wc}u`ewco/ GCQO; c gc}p cttcx ig qhbzx
oi e}/ Ho Ztim/ ig ]xbzi}hub io Izetcphoa ]x}"
peb} Zthomhzle}, zcae} 3"30, 4::8/
^0R Czcmfe ]igpqcte Giuo`cphio/ fppz;))fdc}e/
czcmfe/ita, Cmme}}e` Oiwebdet 48, 4:33/
^5R Czcmfe ]igpqcte Giuo`cphio/ fppz;
))miumf`d/czcmfe/ita, Cmme}}e` Oiweb"
det 48, 4:33/
^7R Dc}fi Pemfoiliahe}, Hom/ fppz;))dc}fi/mib,
Cmme}}e` Oiwebdet 48, 4:33/
^1R Tu`ilg Dcxet/ Pfe Uohwet}cl D"Ptee git Bulph`h"
beo}hiocl Ho`evhoa; aeoetcl Miomezp}/ Ho Ztim/ ig
Qitl`qh`e Mibzuphoa co` hp} Czzlhmcphio}, zcae}
386"4:8, P}unudc, Kczco, Bctmf 3881/
^6R Thmfct` Etoe}p Dellbco/ @xocbhm Ztiatcbbhoa/
Zthomepio Uohwet}hpx Zte}}, 3851/
^8R Kio Liuh} Deoplex/ Bulph hbeo}hiocl Dhoctx
]ectmf Ptee} U}e` git C}}imhcphwe ]ectmfhoa/ Ho
Mibbuohmcphio} ig pfe CMB, 36&8(;5:8"531, 3815/
^3:R Bhmfcel Duttiq}/ Pfe Mfuddx Limn ]etwhme git
Lii}elx"Miuzle` @h}pthdupe` ]x}peb}/ Ho Ztim/ ig
]xbzi}hub io Izetcphoa ]x}peb @e}hao co` Hb"
zlebeopcphio, zcae} ==5"=5:, ]ecpple, Qc}fhoapio,
Oiwebdet 4::7/
^33R Bho Mch, Bctpho T/ Gtcon, Khodi Mfeo, co` Ze`ti
C/ ]{enelx/ BCCO; C Bulph"Cppthdupe C``te}}"
cdle Oepqitn git Ath Hogitbcphio ]etwhme}/ Ho
Ztim/ ig Hopetocphiocl Qitn}fiz io Ath` Mibzup"
hoa, zcae} 360"383, Zfieohv, Cth{ioc, Oiwebdet
4::=/
^34R Gcx Mfcoa, Keggtex @eco, ]cokcx Afebcqcp, Qhl"
}io M/ F}hef, @editcf C/ Qcllcmf, Bhmfcel Dut"
tiq}, Pu}fct Mfco`tc, Co`teq Ghne}, co` Tidetp
Atudet/ Dhapcdle; C @h}pthdupe ]pitcae ]x}peb
git ]ptumpute` @cpc/ Ho Ztim/ ig ]xbzi}hub io Iz"
etcphoa ]x}peb @e}hao co` Hbzlebeopcphio, zcae}
4:5"436, ]ecpple, Qc}fhoapio, Oiwebdet 4::7/
^3=R Cu}pho P/ Mlebeop}, @co T/ N/ Zitp}, co` @cwh` T/
Nctaet/ Ctzeaahi; Bepc`cpc ]ectmfhoa co` Mio"
peop ]fcthoa qhpf Mfit`/ Ho Ztim/ ig Hopetocphiocl
Qitn}fiz io Zeet"pi"Zeet ]x}peb}, zcae} 56"76,
Hpfcmc, Oeq Xitn, Gedtuctx 4::5/
^30R Dthco G/ Miizet, Tcafu Tcbcnth}foco, Upnct}f
]thwc}pcwc, C`cb ]hldet}peho, Zfhlhz Difcooio,
Fco}"Ctoi Kcmid}eo, Ohmn Zu{, @cohel Qecwet,
co` Tcbcoc Xetoeoh/ ZOUP]; Xcfii#} fi}pe`
`cpc }etwhoa zlcpgitb/ Ho Ztimee`hoa} ig pfe WL@D
Eo`iqbeop, 3&4(;3411"3466, 4::6/
^35R Dthco G/ Miizet, C`cb ]hldet}peho, Etqho Pcb,
Tcafu Tcbcnth}foco, co` Tu}}ell ]ect}/ Deomf"
bctnhoa mliu` }etwhoa }x}peb} qhpf XM]D/ Ho
Ztim/ ig ]xbzi}hub io Mliu` Mibzuphoa, zcae}
30="350, Ho`hcoczilh}, Ho`hcoc, 4:3:/
^37R C`hoc Mtchohmecou, Ztcnc}f Lhoac, Kifcooe}
Aeftne, co` Kcxcwel ]fcobuac}uo`ctcb/ Suetx"
hoa Zeet"pi"Zeet Oepqitn} U}hoa Z"Ptee}/ Ho
Ztim/ ig Hopetocphiocl Qitn}fiz io pfe Qed co`
@cpcdc}e}, zcae} 45"=:, Zcth}, Gtcome, Kuoe 4::0/
^31R Ahu}ezze @eMco`hc, @eoh{ Fc}pituo, Bc`co Kcb"zcoh, Auocwct`fco Ncnulczcph, Cwhoc}f Lcn}fbco,
Clev Zhlmfho, ]qcbhocpfco ]hwc}udtcbcohco, Ze"
pet Wi}}fcll, co` Qetoet Wiael}/ @xocbi; cbc"
{io} fhaflx cwchlcdle nex"wclue }pite/ Ho Ztim/ ig
]xbzi}hub io Izetcphoa ]x}peb} Zthomhzle}, zcae}
4:5"44:, Dteppio Qii`}, Oeq Fcbz}fhte, Impidet
4::1/
^36R Ztc}cooc Acoe}co, Dewetlx Xcoa, co` Fempit
Actmhc"Bilhoc/ Ioe Pitu} pi Tule Pfeb Cll; Bul"
ph`hbeo}hiocl Suethe} ho Z4Z ]x}peb}/ Ho Ztim/ ig
Hopetocphiocl Qitn}fiz io pfe Qed co` @cpcdc}e},
zcae} 38"40, Zcth}, Gtcome, Kuoe 4::0/
^38R Copioho Auppbco/ T"Ptee}; C @xocbhm Ho`ev
]ptumpute git ]zcphcl ]ectmfhoa/ Ho Ztim/ ig ]ze"
mhcl Hopete}p Atiuz io Bcocaebeop ig @cpc, zcae}
01"51, Di}pio, Bc}}cmfu}epp}, 3860/
^4:R Bcuthme Fetlhfx co` Kecooeppe B/ Qhoa/ Lhoecth{"
cdhlhpx; C Mittempoe}} Mio`hphio git Miomutteop
Idkemp}/ Ho CMB Ptco}cmphio} io Ztiatcbbhoa
Lcoaucae} co` ]x}peb}, 34&=(;07="084, 388:/
30
-
8/3/2019 HyperDex: A Distributed, Searchable Key-Value Store for Cloud Computing
15/15
^43R Zcpthmn Fuop, Bcfc`ew Nioct, Glcwhi Z/ Kuosuehtc,
co` Deokcbho Tee`/ [iiNeezet; Qchp"gtee Mi"
it`hocphio git Hopetoep"}mcle ]x}peb}/ Ho Ztim/ ig
U]EOHV Cooucl Pemfohmcl Miogeteome, 4:3:/
^44R Gctoiu}f Dcoceh Nc}fcoh co` Mxtu} ]fcfcdh/
]QCB; c gcbhlx ig cmme}} bepfi`} git }hbhlcthpx"
}ectmf ho zeet"pi"zeet `cpc oepqitn}/ Ho Ztim/ ig Ho"
petocphiocl Miogeteome io Hogitbcphio co` Noiql"
e`ae Bcocaebeop, zcae} =:0"=3=, Qc}fhoapio,
@/M/, Oiwebdet 4::0/
^4=R Clleo Nlhoaet/ Zcppeto} co ]ectmf ]pcph}phm}/ Ho
Izphbh{hoa Bepfi`} ho ]pcph}phm}, zcae =:="==1,
Cmc`ebhm Zte}}, 3813/
^40R Cwhoc}f Lcn}fbco co` Ztc}fcop Bclhn/ Mc}"
}co`tc " c @emeoptclh{e` ]ptumpute` ]pitcae ]x}"
peb/ Ho Ztim/ ig Hopetocphiocl Qitn}fiz io Lctae
]mcle @h}pthdupe` ]x}peb} co` Bh` leqcte, Dha
]nx, Biopcoc, Impidet 4::8/
^45R Fxeiopcen Lhb, Dho Gco, @cwh` A/ Co`et}eo, co`
Bhmfcel Ncbho}nx/ ]HLP; c bebitx"egffimheop,
fhaf"zetgitbcome nex"wclue }pite/ Ho Ztim/ ig ]xb"
zi}hub io Izetcphoa ]x}peb} Zthomhzle}, zcae} 3"
3=, 4:33/
^47R Qxcpp Llix`, Bhmfcel K/ Gtee`bco, Bhmfcel
Ncbho}nx, co` @cwh` A/ Co`et}eo/ @iop }epple git
eweopucl; }mclcdle mcu}cl mio}h}peomx git qh`e"ctec
}pitcae qhpf MIZ]/ Ho Ztim/ ig ]xbzi}hub io Iz"
etcphoa ]x}peb} Zthomhzle}, zcae} 0:3"037, 4:33/
^41R Bct}fcll Nhtn BmNu}hmn co` ]eco Suholco/ AG];Ewiluphio io Gc}p"gitqct / Ho Sueue, 1;3:;3:"
3:;4:, CMB, Oeq Xitn, OX, U]C, Cuau}p 4::8/
^46R Kuta Ohewetaelp, Fco} Fhopetdetaet, co` Neooepf M/
]ewmhn/ Pfe Ath` Ghle; Co C`czpcdle, ]xbbepthm
Bulphnex Ghle ]ptumpute/ Ho CMB Ptco}cmphio} io
@cpcdc}e ]x}peb}, 8&3(;=6"13, 3860/
^48R @heai Ioacti, ]pezfeo B/ Tubdle, Txco
]pup}bco, Kifo N/ Iu}petfiup, co` Beo`el Ti}eo"
dlub/ Gc}p mtc}f temiwetx ho TCBMliu`/ Ho Ztim/
ig ]xbzi}hub io Izetcphoa ]x}peb} Zthomhzle},
zcae} 48"03, 4:33/^=:R Kcmn C/ Iteo}peho co` P/ F/ Bettepp/ C Mlc}} ig
@cpc ]ptumpute} git C}}imhcphwe ]ectmfhoa/ Ho Ztim/
ig Zthomhzle} ig @cpcdc}e ]x}peb}, zcae} 363"38:,
Qcpetlii, Mcoc`c, 3860/
^=3R Lcttx Zepet}io, Co`x Dcwhet, co` ]czco Dfcphc/
WHMMH; C Ztiatcbbcdle Mliu "Mibzuphoa Te"
}ectmf Pe}pde / Zthomepio, Pemfohmcl Tezitp PT"
834"33, 4:33/
^=4R @co T/ N/ Zitp}, Cu}pho P/ Mlebeop}, Hteoe [fcoa,
]cbuel Bc``eo, co` Dctdctc Lh}niw/ Ptco}cm"
phiocl Mio}h}peomx co` Cupibcphm Bcocaebeop ho
co Czzlhmcphio @cpc Mcmfe/ Ho Ztim/ ig ]xbzi}hub
io Izetcphoa ]x}peb @e}hao co` Hbzlebeopcphio,
zcae} 418"484, 4:3:/
^==R ]xlwhc Tcpoc}cbx, Zcul Gtcomh}, Bctn Fco`lex,
Thmfct` B/ Nctz, co` ]mipp ]feonet/ C }mcl"
cdle miopeop"c``te}}cdle oepqitn/ Ho Ztim/ ig ]HA"
MIBB Miogeteome, zcae} 373"314, ]co @heai,
Mclhgitohc, Cuau}p 4::3/
^=0R Fcoco ]cbep/ ]zcphcl @cpc ]ptumpute}/ Ho Bi`eto
@cpcdc}e ]x}peb}; Pfe Idkemp Bi`el, Hopetizet"
cdhlhpx, co` Dexio`, zcae =73"=65, C``h}io Qe}"
lex)CMB Zte}}, 3885/
^=5R Mfctle} ]mfbh p co` Bcoh}f Zctc}fct/ Eocdlhoa
Glevhdle Suethe} qhpf Auctcopee} ho Z4Z ]x}peb}/
Ho Hopetoep Mibzuphoa Kiutocl, zcae 38"47, 4::0/
^=7R Xcogeoa ]fu, Deoa Mfho Iih, Nhco"Lee Pco,
co` Cixhoa [fiu/ ]uzzitphoa Bulph"`hbeo}hiocl
Tcoae Suethe} ho Zeet"pi"Zeet ]x}peb}/ Ho HEEE
Hopetocphiocl Miogeteome io Zeet"pi"Zeet Mibzup"
hoa, zcae} 31="36:, Nio}pco{, Aetbcox, Cuau}p
4::5/
^=1R Thmfct` Z/ ]zhllcoe, Ztc`eez K/ ]feppx, Ete{ [c`in,
]cact @hvhp, co` ]fthnct Ctmfcn/ Co egffimheop
bulph"phet pcdlep }etwet }pitcae ctmfhpempute/ Ho
Ztim/ ig ]xbzi}hub io Mliu` Mibzuphoa, zcae} 3"
30, Mc}mch}, Zitpuacl, 4:33/^=6R Hio ]pihmc, Tidetp Bitth}, @cwh` T/ Nctaet, B/
Gtco} Ncc}fien, co` Fcth Dclcnth}foco/ Mfit ;
C }mclcdle zeet"pi"zeet liinuz }etwhme git hopet"
oep czzlhmcphio}/ Ho Ztim/ ig ]HAMIBB Mioget"
eome, zcae} 308"37:, ]co @heai, Mclhgitohc, Cu"
au}p 4::3/
^=8R Tiddetp wco Teoe}}e co` Gte` D/ ]mfoeh et/ Mfcho
Tezlhmcphio git ]uzzitphoa Fhaf Pftiuafzup co`
Cwchlcdhlhpx/ Ho Ztim/ ig ]xbzi}hub io Izetcphoa
]x}peb @e}hao co` Hbzlebeopcphio, zcae} 83"3:0,
]co Gtcomh}mi, Mclhgitohc, @emebdet 4::0/
^0:R Mfh [fcoa, Ctwho Nth}focbutpfx, co` Tco`ilzf
X/ Qcoa/ ]nhzho`ev; Piqct`} c ]mclcdle Zeet"
pi"Zeet Ho`ev ]etwhme git Fhaf @hbeo}hiocl @cpc/
Zthomepio, Pemfohmcl Tezitp PT"1:=":0, 4::0/
35