vdcf monitoring

7/29/2019 VDCF Monitoring

1/44

JomaSoft GmbHFalkensteinstr. 54a

9000 St. GallenSwitzerland

VDCF - Virtal Data!enter Clod Framework

for t"e Solaris#$

%&eratin' S(stem

$onitorin'

Version ).0*5. %!tober *0+,

Co&(ri'"t *005-*0+, JomaSoft GmbH

ll ri'"ts reser/ed.

[email protected] VDCF - Monitoring 3.0 1 / 44


2/44



Table of Contents1 Introduction.................................................................................................................................................... 4

1.1!"r!i"#................................................................................................................................................ 41.$%ard#ar" Monitoring.............................................................................................................................. 4

1.$.1&'arming................................................................................................................................................. .......... 41.$.$ (")uir"m"nts...................................................................................................................................................4

1.3%igh &!ai'a*i'it+ ,%& Monitoring............................................................................................................1.3.1 Compon"nts.....................................................................................................................................................1.3.$ od" fai'ur" d"t"ction......................................................................................................................................1.3.3 od" !acuation s")u"nc".............................................................................................................................1.3.4 (")uir"m"nts...................................................................................................................................................2

1.4("sourc" Monitoring.............................................................................................................................. 1.4.1 (")uir"m"nts...................................................................................................................................................

1.p"rating +st"m , Monitoring........................................................................................................51.VDCF Dash*oard #"* app'ication.........................................................................................................5

$ Insta''ation.................................................................................................................................................... 10$.16r"r")uisit"s........................................................................................................................................ 10

$.$Insta''ation............................................................................................................................................ 103 Configuration............................................................................................................................................... 11

3.17ranting 8s"r &cc"ss.......................................................................................................................... 113.$Customi9ing Monitoring "Mai'..............................................................................................................11

3.$.1&'arming................................................................................................................................................ ......... 11

3.3Customi9ing %ard#ar" Monitoring.......................................................................................................1$3.3.1 Ch"c: Int"r!a'.................................................................................................................................................1$3.3.$&'arming................................................................................................................................................ ......... 1$

3.4Customi9ing %igh &!ai'a*i'it+ ,%& Monitoring.....................................................................................133.4.1 ;""p &'i!" Int"r!a'..........................................................................................................................................133.4.$


3/44



4.4.$ 8sag" Co''"ctor..............................................................................................................................................$4.4.3 8sag" &ggr"gator..........................................................................................................................................$4.4.4 Disa*'" r"sourc" monitoring..........................................................................................................................$54.4. 8pdat" od" data manua''+...........................................................................................................................$5

4.4. ho# r"sourc" consumption data..................................................................................................................304. Monitoring...................................................................................................................................... 3$

4..1 na*'ing / Disa*'ing........................................................................................................................................3$4..$ Ch"c: od" manua''+....................................................................................................................................3$4..3 Indi!idua' #arning thr"sho'd for fi'"s+st"ms datas"ts and s#ap usag".......................................................334..4 Indi!idua' ?=arg"t 6ath Count? for a nod".......................................................................................................334.. Disp'a+ Fi'"s+st"m usag"...............................................................................................................................344.. Disp'a+ Datas"t usag"...................................................................................................................................34..2 Disp'a+


4/44



1 Introduction

=his docum"ntation d"scri*"s th" Monitoring f"atur"s of th" Virtua' Datac"nt"r C'oud Fram"#or: ,VDCFfor th" o'aris p"rating +st"m and "Ap'ains ho# to us" this f"atur"s.

See these documents for more information about the related VDCF products:

VDCF Administration Guide for information a*out VDCF usag"

1.1 Overview

VDCF Monitoring is a VDCF nt"rpris" "At"nsion a!ai'a*'" to VDCF tandard/nt"rpris"/%& custom"rs.

=his "At"nsion consists of fi!" s"parat" compon"ntsB

- %ard#ar" Monitoring ,h#mon to d"t"ct hard#ar" fai'ur"s- ("sourc" Monitoring ,rcmon to co''"ct and disp'a+ r"sourc" usag" of g'o*a' and 'oca' o'aris 9on"s- %igh &!ai'a*i'it+ ,%& Monitoring ,hamon to automatica''+ fai'o!"r if a data c"nt"r or s"r!"r fai's- p"rating +st"m Monitoring ,osmon to "na*'" a'"rts #h"n fi'"s+st"ms datas"ts s#ap MF s"r!ic"s and dis: paths r"ach critica' r"sourc" usag" or stat"- VDCF Dash*oard #"* app'ication


5/44



1.3 High Availability HA! Monitoring

=h" VDCF %igh &!ai'a*i'it+ f"atur" is us"d to monitor th" h"a'th of od"s. If a fai'"d od" is disco!"r"dth" od" ma+ *" stopp"d and/or th" od" "!acuation 'ogic is ca''"d to fai'o!"r a'' !"r!"rs to oth"rod"s. =his "!acuation is *as"d on r"sourc" usag" information to a!oid o!"r'oading th" r"mainingod"s.

=his so'ution is position"d *"t#""n manua' fai'o!"r initiat"d *+ a +st"m &dministrator and a fu''-f"atur"dfai'o!"r so'ution using C'ust"r soft#ar". =his VDCF %& f"atur" is a*'" to hand'" th" t+pica' od" fai'ur"s'i:" *oot dis: issu"s n"t#or: outag"s p'atform "rrors 'i:" C68 m"mor+ pro*'"ms or po#"r supp'+fai'ur"s. =h" goa' is to :""p this so'ution as simp'" and usa*'" as possi*'" th"r"for" it do"sn?t r")uir"c'ust"r int"rconn"cts *"t#""n th" od"s and it do"sn?t ch"c: and hand'" issu"s #ith & conn"ctions'i:" a C'ust"r soft#ar" do"s.

1.3.1 "om#onents

=h" %& monitor is *ui't from s"!"ra' compon"ntsB

ach od" participating has a da"mon ,MF s"r!ic" !dcf:""pa'i!" insta''"d that ca''s p"riodica''+ intoth" manag"m"nt s"r!"r. =h"s" :""p-a'i!" m"ssag"s ar" stor"d #ithin th"/var/opt/jomasoft/vdcf/keepalive dir"ctor+.

=h" s"cond compon"nt is th" monitoring da"mon ,hamon#atchd on th" VDCF manag"m"nt s"r!"r.=his da"mon consists of t#o proc"ss"s. n" ,hamonmonitord is us"d to monitor for :""p-a'i!"m"ssag"s at th" int"r!a' of %&M;6&>IVI=(V&> s"conds from a'' participating od"s. =h"s"cond proc"ss ,hamonch"c:d is us"d to ch"c: and act upon a fai'"d od" #as d"t"ct"d.

1.3.2 $ode %ailure detection

& od" is consid"r"d as fai'"d if th" fo''o#ing ru'"s ar" m""t- no :""p-a'i!" m"ssag"s ar" r"c"i!"d #ithin th" d"fin"d thr"sho'd (HAMON_KEEP_ALIVE_ACION_HOL!" - a ssh conn"ction from VDCF to th" od" fai's- od"?s s+st"m contro''"r / conso'" do"s not r"spond or od" is at th" ; prompt or po#"r"d off

&n optiona' n"t#or: pro*ing ru'" ma+ *" acti!at"d *+ s"tting HAMON_CHECK_NE#O$K_P$O%E&'tr)e*If th" od" s+st"m contro''"r is not r"acha*'" th" r"ason ma+ *" n"t#or:-r"'at"d or th" od" has nopo#"r at a''. If this s"tting is tru" VDCF tri"s to conn"ct to configur"d int"rm"diat" n"t#or: ")uipm"nt. Ifth" n"t#or: ")uipm"nt is r"acha*'" VDCF consid"rs its n"t#or: conn"ction as good and th"r"for th"od"s as fai'"d.

For mor" d"tai's a*out this fai'ur" d"t"ction consu't th" &pp"ndiA 4.1 od" fai'ur" d"t"ction d"tai's.

as"d on th" d"scription a*o!" th" VDCF %& monitor is a*'" to d"t"ct th" fo''o#ing fai'ur"sB- comp'"t" hard#ar" fai'ur" of th" od"- accid"nta''+ shutdo#n of od" *+ a +st"m &dministrator- fai'ur" of n"t#or: int"rfac"s of th" od"

=h" fo''o#ing fai'ur"s ar" d"t"ct"d if n"t#or: pro*ing is acti!at"d and prop"r configur"dB- comp'"t" po#"r-fai'ur" of th" od" ,s+st"m contro''"r not r"acha*'"- comp'"t" data c"nt"r fai'ur" as 'ong as th" n"t#or: is sti'' r"acha*'" ,d"p"nds on configuration

=h" fo''o#ing fai'ur"s ar" $O&d"t"ct"dB- fai'ur" or config issu"s of & compon"nts- comp'"t" data c"nt"r fai'ur" if th" n"t#or: is aff"ct"d ,d"p"nds on configuration

- accid"nta''+ n"t#or: int"rfac" miss configuration *+ a +st"m &dministrator

For s"tting up and to configur" +our %& "n!ironm"nt consu'ting s"r!ic"s from Eomaoft ar" a!ai'a*'".

[email protected] VDCF - Monitoring 3.0 / 44


6/44



1.3.3 $ode 'vacuation sequence

If od" !acuation is configur"d a'' !"r!"rs of a fau't"d od" ar" "!acuat"d ,fai'"d o!"r to oth"r acti!"od"s in th" sam" comput"poo'. =h" proc"dur" to d"t"ct th" possi*'" targ"t od"s 'oo:s as fo''o#sB

1. For "ach !"r!"r #" g"t a 'ist of candidat" od"s ,using vserver ,c s-o. cadidates.$. as"d on th" r"sourc" usag" data r"port"d from r"sourc" monitoring #" s"'"ct a possi*'" targ"t od"

for "ach !"r!"r.3. "caus" th" sourc" od" isn?t r"acha*'" an+mor" #" do a !s"r!"r d"tach forc".4. =h"n #" tr+ to attach and *oot th" !"r!"r on th" n"# od".. If attach has fai'"d #" tr+ th" sam" proc"dur" on th" n"At possi*'" targ"t od" unti' a'' !"r!"rs ar""!acuat"d or no mor" targ"t od"s ar" '"ft.

8pgrad" on attach is support"d *+ s"tting th" !a'u" HAMON_EVAC0AE_0P1$A!E to tru" in th"

customi9".cfg fi'".

=h" s")u"nc" of th" !"r!"r migration is ord"r"d *+ th" !"r!"r cat"gor+ and/or priorit+. ""configuration it"ms for mor" d"tai's.

=h" fo''o#ing pictur" i''ustrat"s th" migrations if th" M000 in Data C"nt"r 1 fai's.

=h" od" !acuation can *" start"d manua''+ using th" command ode ,c evac)ate.



7/44



1.3.( Requirements

&s th" %& monitor is monitoring th" conso'" and is tr+ing to shutdo#n a fai'"d od" through th" s+st"mcontro''"r it?s r")uir"d to configur" a ?conso'"? for "ach od" #ithin VDCF.

=h" od" "!acuation 'ogic is *as"d on r"sourc" information from ("sourc" Monitoring.&cti!at"d VDCF ("sourc" Monitoring on a'' participating od"s is th"r"for" r")uir"d.



8/44



1.( Resource Monitoring

("sourc" Monitoring ma+ *" "na*'"d ,and disa*'"d indi!idua''+ for "ach od". & usag" co''"ctor s"r!ic"is th"n start"d on th" od". =his s"r!ic" is r"cording th" r"sourc" usag" ,C68 and m"mor+ of th" od"and a'' insta''"d !"r!"rs. 6"riodica''+ "ach od" is pushing th" r"cord"d data onto th" VDCFManag"m"nt "r!"r.

& cron jo* ca''"d ?8sag" Data Co''"ctor? on th" Manag"m"nt "r!"r is importing th" co''"ct"d datap"riodica''+ into th" VDCF data*as".

& s"cond cron jo* ?8sag" Data &ggr"gator? is us"d to g"n"rat" aggr"gat"d r"sourc" information.=h" aggr"gat"d data can *" disp'a+"d on a dai'+ #"":'+ month'+ or +"ar'+ *as".

& third cron jo* is start"d / stopp"d tog"th"r #ith th" ?8sag" Data Co''"ctor? cron jo*. =his cron jo* is"!a'uating th" curr"nt a!"rag" r"sourc" usag" of od"s and !"r!"rs in th" 'ast $4 hours.

=his information ma+ *" us"d 'at"r *+ th" %& monitor od" "!acuation f"atur".

1.(.1 Requirements

=h" VDCF ("sourc" Monitoring imp'"m"ntation is *as"d on o'aris 10 /02 ,8pdat" 4 f"atur"s. =o us"this f"atur" th" targ"t od"s must run o'aris 10 /02 or 'at"r. It is support"d to us" an o'd"r o'aris 10("'"as" ,8pdat"1$3 #ith ;"rn"' 6atch 1$0011-14 ,sparc or 1$001$-14 ,i3 or 'at"r.



9/44



1.) O#erating *ystem O*! Monitoring

$ew since +,"- Monitoring 2.2

8sing th" Monitoring +ou can monitor th" fi'"s+st"m usag" of !"r!"rs. =his Monitoring can *""na*'"d/disa*'"d g'o*a''+ on th" VDCF manag"m"nt s"r!"r. + "na*'ing th" Monitor a cron jo* for8s"r root is add"d.

If th" fi'"s+st"m usag" "Ac""ds th" d"fin"d


10/44



2 Installation

2.1 0rerequisites

=h" E!dcf-monitor pac:ag" r")uir"s th" fo''o#ing VDCF pac:ag"s to *" insta''"d on th"VDCF Manag"m"nt "r!"rB- E!dcf-*as" 2.0.0 or 'at"r

2.2 Installation

a sparc p'atform

cd 2do.load,dir3pk4add ,d */5&vdcf,moitor_2versio3_sparc*pk4

* i3 p'atform

cd 2do.load,dir3pk4add ,d */5&vdcf,moitor_2versio3_i678*pk4



11/44



3 "on%iguration

3.1 ranting ser Access

=h" VDCF Monitoring pac:ag" introduc"s thr"" n"# (&C 6rofi'"sB- VDCF h#monitor Modu'"G for th" %ard#ar" and ("sourc" Monitoring- VDCF hamonitor Modu'"G for th" %& Monitoring and- VDCF osmonitor Modu'"G for th" Monitoring f"atur".

&ssign th"s" (&C profi'"s to +our admin us"rs.

3.2 "ustomiing Monitoring eMail

3.2.1 Alarming

=h" %ard#ar" Monitoring and Monitoring ar" a*'" to s"nd "-Mai's if a %ard#ar" fau't is d"t"ct"d or a Monitor thr"sho'd is r"ach"d.

=o "na*'" this f"atur" +ou ha!" to s"t th" fo''o#ing !aria*'"s in VDCF?s customi9".cfgB

e9port H#MON_EVEN'tr)ee9port O&MON_EVEN'tr)ee9port MONIO$_EVEN_EMAIL_LI&':)ser;


12/44



3.3 "ustomiing Hardware Monitoring

3.3.1 "hec4 Interval

+ d"fau't th" %ard#ar" Monitoring cronjo* is "A"cut"d onc" an hour to ch"c: th" stat" of a'' od"s.

Hou ma+ disp'a+ th" curr"nt s"tting #ith this commandB

@ -.mo ,c stat)s Cetral Moitor Compoet &tat)s H# Moitor eaBled

Cetral Moitor Compoet imespec CrotaB timespec for H# Moitor ;D

V!C? Cofi4)ratio VariaBles H#MON_EVEN tr)e MONIO$_EVEN_EMAIL_?$OM s)pport


13/44



3.( "ustomiing High Availability HA! Monitoring

3.(.1 5ee# Alive Interval

&t "ach %&M;6&>IVI=(V&> ,d"fau'tB 0 s"conds th" od" is posting a :""p-a'i!"m"ssag" to th" Manag"m"nt "r!"r.

3.(.2 6arning &hreshold

&ft"r a num*"r of missing :""p-a'i!" m"ssag"s ,%&M;6&>IVD ,d"fau't 10 an"-Mai' is s"nt if r")u"st"d. D"fin" +our "-Mai' addr"ss"s as fo''o#sB

e9port HAMON_EVEN_EMAIL_LI&':)ser;IV&C=I=%>D ,d"fau't $0 int"r!a'sno :""p-a'i!" m"ssag" has *""n post"d.

Hou ma+ disp'a+ th" curr"nt s"tting #ith th" status commandB

@ -amo ,c stat)s HA Moitor Iformatio Iterval 8Fs #ari4 -res-old ;F Actio -res-old >F #atc- !aemo disaBled

V!C? Cofi4)ratio VariaBles MONIO$_EVEN_EMAIL_?$OM s)pport


14/44



3.(. v*erver target detection

First of a'' +ou ha!" to cat"gori9"/prioriti9" +our !"r!"r using th" vserver ,c modif=command.Hou ma+ us" cat"gori"s to id"ntif+ important or '"ss important !"r!"rs and th" priorit+ to ord"r #ithin acat"gor+. !"r!"rs #ith 6riorit+ 1 ar" "!acuat"d first th"n 6riorit+ $ ...

=h"n customi9" th" "!acuation !aria*'"s in +our customi9".cfg.8s" VI(=8&>V&C8&=IC&=7(H(D( to id"ntif+ th" most important cat"gori"s to *"migrat"d first. Id"ntif+ cat"gori"s #hich +ou don?t #ant to "!acuat" at a'' inVI(=8&>V&C8&=II7(C&=7(I.

+ d"fau't C68har" r"sourc" d"finitions ar"n?t us"d for targ"t od" d"t"ction. "t th"DV&C8&=I8C68%&( to ?tru"? to "na*'" a ch"c: if th" targ"t od" has "noughfr"" C68har"s a!ai'a*'".

3.(.7 v*erver shutdown on target $odes

$ew since +,"- Monitoring 2.

Hour targ"t od"s ma+ not ha!" "nough fr"" r"sourc"s for th" "!acuat"d !"r!"rs. In such"n!ironm"nts +ou can d"fin"d th" Cat"gori"s for '"ss important !"r!"rs #hich VDCF can shutdo#n tofr"" r"sourc"s. =h" !"r!"rs ar" shutdo#n on'+ #h"n r")uir"d and ord"r"d *+ th" !"r!"r 6riorit+.

D"fin" th" Cat"gori"s in VI(=8&>V&C8&=I%8=D


15/44



3.(.9 Other recommended settings

=h" fo''o#ing ar" r"comm"nd"d s"ttings. 6'"as" s"t th"s" in th" customi9".cfg fi'"B

e9port HAMON_EVEN_EMAIL_LI&':)ser;


16/44



3.) "ustomiing Resource Monitoring

Hou ma+ customi9" som" asp"cts of th" r"sourc" monitoring *+ o!"r#riting this VDCF !aria*'"s using th"customi9".cfg.

3.).1 sage interval

DD :

e9port MONIO$_A11$_INE$VAL':F 8 :e9port C0$$EN_$E&_0&A1E_0P!AE_INE$VAL':F >6 :

If r"sourc" monitoring #as a'r"ad+ "na*'"d *"for" +ou ha!" to r"-"na*'" th" cron jo*s using t"ese!ommands. ?#"e *4" a/era'e !ron @ob is !ontrolled to'et"er wit" t"e !olle!tor !ron @obA2

@ rcmo ,c disaBle a44re4ator@ rcmo ,c eaBle a44re4ator

@ rcmo ,c disaBle collector@ rcmo ,c eaBle collector



17/44



3. "ustomiing O* Monitoring

3..1 "hec4 Interval

+ d"fau't th" Monitoring cronjo* is "A"cut"d onc" an hour to ch"c: th" usag" and stat"s offi'"s+st"ms datas"ts s#ap usag" and MF s"r!ic"s.

Hou ma+ disp'a+ th" curr"nt s"tting #ith this commandB

@ osmo ,c stat)s Cetral Moitor Compoet &tat)s O& Moitor eaBled

Cetral Moitor Compoet imespec CrotaB timespec for O& Moitor 6F

V!C? Cofi4)ratio VariaBles O&MON_EVEN tr)e MONIO$_EVEN_EMAIL_?$OM s)pport


18/44



3..3 Alarming

=h" Monitor #i'' s"nd V(I7G to th" MK6>=&=FI=(=

- MF "r!ic"s r"ach a critica' stat" ,d"grad"d or maint"nanc"

- M6AI dis:s fai' to r"ach th" d"fin"d =arg"t 6ath Count

3..( O* *ecurity "om#liance benchmar4s

o'aris 11.3 inc'ud"s 3 pr"d"fin"d standard *"nchmar:s ?*as"'in"? ?r"comm"nd"d? and ?pci-dss?.VDCF d"'i!"rs additiona' tai'orings nam"d ?d"fau't? and ?cdom? *oth *as"d on th" ?*as"'in"? *"nchmar:.=h"s" tai'orings ar" stor"d in this configuration dir"ctor+B

@ ls ,l /var/opt/jomasoft/vdcf/cof/compliace/*tailor,r.,r,,r,, ; root root ;6; &ep ;; ;D6; cdom*tailor,r.,r,,r,, ; root root ;6>; &ep ;; ;D6; defa)lt*tailor

Custom"rs can d"fin" additiona' *"nchmar:s *+ cop+ing and modif+ing th" tai'or fi'"s.For s+st"m indi!idua' *"nchmar:s th" fi'"s can *" nam"d Lvserver3*tailoror Lode3*tailor.

3..) O* *ecurity hardening #ro%iles

8s" th" ?nod" -c hard"n h"'p? command to g"t a 'ist of a!ai'a*'" hard"ning ru'"s and th" a!ai'a*'"

hard"ning profi'"s. Hou can cr"at" +our o#n hard"ning profi'"s matching +our s"curit+ guid"'in"s.

=h" hard"ning profi'"s must *" stor"d inB

@ ls ,l /var/opt/jomasoft/vdcf/cof/compliace/*-ardei4,r.,r,,r,, ; root ot-er D7 Oct >6 ;>> Baselie*-ardei4



19/44



3.7 "ustomiing +,"- ,ashboard web a##lication

3.7.1 Initial setu#

VDCF dash*oard is a p+thon *as"d #"* app'ication. Int"grat"d into +our &pach" http $.$ s"r!"r.=o s"tup th" &pach" "r!"r config +ou ha!" to run this command onc"B

/opt/jomasoft/vdcf/mods/set)p/set)p_4)i ,p 2apac-e -ttps port3 Creati4 self,si4ed est Certificate QCofi4)ri4 apac-e .eB server QApac-e restarted s)ccessf)ll=* V!C? das-Board is read= o t-is 0$L-ttps//=o)rserver6

=h" #"* app'ication r")uir"s us"r auth"ntication. 8s"rs ar" auth"nticat"d against th"ir 'oca' o'aris 8s"r

&ccount. For s"curit+ r"asons th" #"* app'ication is running >-"na*'"d.

&he setu# scri#t con%igures A#ache with a sel%:signed test server certi%icate; 0lease re#lace it by avalid server certi%icate. &he certi%icate is con%igured in this a#ache %ile/>*>/cof*d/vdcf_dja4o_-ttpd_>>*cof&&LCertificate?ile /var/opt/jomasoft/vdcf/cof/apac-e,cert/das-Board*crt&&LCertificateKe=?ile /var/opt/jomasoft/vdcf/cof/apac-e,cert/das-Board*ke=

3.7.2 +,"- user %or the web a##lication

=h" #"* app'ication is using th" r"ad-on'+ !dcf us"r vdcf4)ito acc"ss th" VDCF r"positor+.

8sing th" VDCF !poo' command +ou can d"fin" #hat data +ou #ant to sho# to !dcfgui us"r and i.".disp'a+ in th" VDCF dash*oard.

3.7.3 -irewall Rules

If +our s+st"m "n!ironm"nt contains fir"#a''s +ou ma+ ha!" to add a fir"#a'' ru'" to acc"ss th" #"*s"r!"ron th" VDCF manag"m"nt "r!"rB

VDCFManag"m"nt "r!"r

Dir"ction ro#s"r C'i"nt Comm"nt


20/44



( sage

(.1 Hardware Monitoring

na*'ing / Disa*'ing

=h" hard#ar" monitoring f"atur" can *" "na*'"d/disa*'"d g'o*a''+.

@ -.mo ,c eaBle@ -.mo ,c disaBle

8s" th" status command to disp'a+ th" curr"nt stat" of hard#ar" monitoringB

@ -.mo ,c stat)s

Cetral Moitor Compoet &tat)s H# Moitor eaBled

Cetral Moitor Compoet imespec CrotaB timespec for H# Moitor ;D

V!C? Cofi4)ratio VariaBles H#MON_EVEN tr)e MONIO$_EVEN_EMAIL_?$OM s)pportocator >D as "ith"r on or offB

@ -.mo ,c s-o._locator ode'2ode ame3Locator led is O??

=urns th" 'ocator >D onB

@ -.mo ,c set_locator ode'2ode ame3

=urns th" 'ocator >D offB

@ -.mo ,c clear_locator ode'2ode ame3

[email protected] VDCF - Monitoring 3.0 $0 / 44


21/44



(.1.3 ,is#lay Hardware state

8sing th" sho# op"ration an o!"r!i"# a*out a'' od"s is disp'a+"d.

@ -.mo ,c s-o.

C)rret Hard.are &tateNode Model Cosole &oft &tate H# &tate Last C-a4e Last 0pdate Mo**sFFF6 &0N#&),?ire,;FFF ALOMCM P#$,O?? OK >F;6,F,>> >F;6,F,>> ONsFF> O$CL&PA$C,,; ILOM O&,$0N OK >F;>,F8,F >F;6,F,>6 ON

8sing th" od" attri*ut" and/or !"r*os" f'ag th" stat" histor+ and d"tai's from th" s+st"m contro''"r issho#n.

@ -.mo ,c s-o. ode'sFFF6

C)rret Hard.are &tateNode Model Cosole &oft &tate H# &tate Last C-a4e Last 0pdate Mo**sFFF6 &0N#&),?ire,;FFF ALOMCM P#$,O?? OK >F;6,F,>> >F;6,F,>> ON

&tate C-a4e Histor= Node &oft &tate H# &tate Evet !ate sFFF6 O&,$0N OK >F;F,F7,;7 FJ;DF; sFFF6 P#$,O?? OK >F;F,FD,>D ;;DF>

@ -.mo ,c s-o. ode'sFFF6 verBose

C)rret Hard.are &tate

Node Model Cosole &oft &tate H# &tate Last C-a4e Last 0pdate Mo**sFFF6 &0N#&),?ire,;FFF ALOMCM P#$,O?? OK >F;6,F,>> >F;6,F,>> ON

&tate C-a4e Histor= Node &oft &tate H# &tate Evet !ate sFFF6 O&,$0N OK >F;F,F7,;7 FJ;DF; sFFF6 P#$,O?? OK >F;F,FD,>D ;;DF>

&=stem Locator &tat)s Locator led is O??

&=stem &pecific &tat)s Iformatios

''''''''''''''' Evirometal &tat)s '''''''''''''''

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

&=stem emperat)res (emperat)res i Celsi)s"

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

&esor &tat)s emp Lo.Hard Lo.&oft Lo.#ar Hi4-#ar Hi4-&oft Hi4-Hard

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

M%/_AM% OK > ,;F ,D F D DF DD

M%/CMPF/_CO$E OK F ,;F ,D F 7D JF JD

M%/CMPF/_%CO$E OK 6J ,;F ,D F 7D JF JD

M%/IO%/_CO$E OK 6 ,;F ,D F JD ;FF ;FD

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

&=stem Idicator &tat)s ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

&G&/LOCAE &G&/&E$VICE &G&/AC

O?? O?? ON



22/44



,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

?as (&peeds $evol)tio Per Mi)te"

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

&esor &tat)s &peed #ar Lo.

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

?F/?F OK J;88 >>F ;J>F

?F/?; OK 78 >>F ;J>F

?F/?> OK 7J8 >>F ;J>F

?F/?6 OK 7J8 >>F ;J>F

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Volta4e sesors (i Volts"

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

&esor &tat)s Volta4e Lo.&oft Lo.#ar Hi4-#ar Hi4-&oft

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

M%/V_VCO$E OK ;*6> ;*>F ;*> ;*68 ;*6J

M%/V_VMEM OK ;*7 ;*8J ;*> ;*7 ;*JF

M%/V_V OK F*7 F*7 F*78 F*J6 F*JD

M%/V_S;V> OK ;*;7 ;*FJ ;*;; ;*>7 ;*6F

M%/V_S;VD OK ;*7 ;*68 ;*6J ;*8F ;*86

M%/V_S>VD OK >*DF >*> >*6> >*8 >*>

M%/V_S6V6 OK 6*>J 6*F8 6*;F 6*J 6*D6

M%/V_SDV OK *JJ *DD *8D D*6D D*D

M%/V_S;>V OK ;>*;7 ;F*J> ;;*;8 ;>*7 ;6*F7

M%/V_S6V6&%G OK 6*6; 6*;6 6*;8 6*D6 6*DJ

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

&=stem Load (i amps"

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

&esor &tat)s Load #ar &-)tdo.

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, M%/I_VCO$E OK >6*68F 7F*FFF 77*FFF

M%/I_VMEM OK 8*>F 8F*FFF 88*FFF

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,,,,

C)rret sesors

,,,,,,,,,,,,,,,,,,,,,,

&esor &tat)s

,,,,,,,,,,,,,,,,,,,,,,

M%/%A/V_%A OK

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Po.er &)pplies ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

&)ppl= &tat)s 0derspeed Overtemp Overvolt 0dervolt Overc)rret

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

P&F OK O?? O?? O?? O?? O??

Last PO& r) #E! A01 ;7 FDD>>F >F;F

PO& stat)s Passed all devices

No fail)res fo)d i &=stem

[email protected] VDCF - Monitoring 3.0 $$ / 44


23/44



(.1.( "lear hardware state history

& histor+ r"cord is g"n"rat"d for "!"r+ hard#ar" stat" chang" disco!"r"d *+ th"p"riodica' ,or manua''+ initiat"d s+st"m ch"c:.

=o c'"ar a'' histor+ r"cords of a od"B

@ -.mo ,c clear_-istor= ode'2ode ame3



24/44



(.2 *erver 0ower sage

$ew since +,"- Monitoring 2.

=h" actua' 8sag" ,ogfi'"B@ tail ,f /var/opt/jomasoft/vdcf/lo4/-.mo_po.er*lo4

;8FJ>F;8 ;;> LO1 Po.er0sa4e c-a4e discovered for ode sFF> old )sa4e 6; #atts e. )sa4e 6; #atts

;8FJ>F;8 ;;>D LO1 Po.er0sa4e c-a4e discovered for ode sFFFJ old )sa4e >;6 #atts e. )sa4e F #atts

;8FJ>F;8 ;;> LO1 Po.er0sa4e c-a4e discovered for ode sFF;6 old )sa4e 8> #atts e. )sa4e 8D #atts



25/44



(.3 High Availability HA! Monitoring

(.3.1 'nabling ? ,isabling

=h" %& monitoring f"atur" can *" "na*'"d/disa*'"d g'o*a''+.

@ -amo ,c eaBle daemo@ -amo ,c disaBle daemo

=h"n "ach participating od" has to *" "na*'"d tooB

@ -amo ,c eaBle ode'2ode ame3@ -amo ,c disaBle ode'2ode ame3

6'"as" notic" that on'+ non-c'ust"r od"s ma+ *" "na*'"d for %& monitoring.

#o dis&la( t"e stats of H monitorin' se t"is !ommand2

@ -amo ,c stat)s

HA Moitor Iformatio Iterval 8Fs #ari4 -res-old ;F Actio -res-old >F #atc- !aemo disaBled

V!C? Cofi4)ratio VariaBles MONIO$_EVEN_EMAIL_?$OM s)pport


26/44



(.3.2 ,is#lay $ode *tate

8sing th" sho# op"ration an o!"r!i"# a*out a'' od"s is disp'a+"d.

@ -amo ,c s-o.

Node Mo &tate Ops &tate !ate !etailssFFF6 ON P$O%IN1 >F;;,F>,;8 ;867 ormal operatiosFFFJ ON P$O%IN1 >F;;,F>,;8 ;86>6 ormal operatiosFF;F ON P$O%IN1 >F;;,F>,;8 ;867;J ormal operatiosFFF ?A0L , >F;;,F>,;8 ;8D>> cosole did ot respod /ot po.ered off

ach od" has a Mon,itoring tat" #hich is inf'u"nc"d *+ th" +st"m &dministrator using hamonop"rations and *+ th" VDCF %& monitor.

=h" fo''o#ing diagram "Ap'ains th" possi*'" stat"s and actionsB

[email protected] VDCF - Monitoring 3.0 $ / 44


27/44



(.3.3 *us#ending $odes

=o a!oid unn"c"ssar+ fai'o!"rs it is r")uir"d to susp"nd th" od" from Monitoring if Maint"nanc" is don"on th" od". usp"nd th" od" *"for" +ou shutdo#n th" od" for "Aamp'" to add mor" M"mor+.

@ -amo ,c s)sped ode'sFFF6HA moitor s)speded o Node sFFF6

@ -amo ,c s-o. ode'sFFF6 Node Mo &tate Ops &tate !ate !etailssFFF6 &0&P , >F;;,F>,;8 ;8D;J ,

@ -amo ,c res)me ode'sFFF6HA moitor res)med for Node sFFF6

@ -amo ,c s-o. ode'sFFF6 Node Mo &tate Ops &tate !ate !etailssFFF6 ON P$O%IN1 >F;;,F>,;8 ;8D66 ormal operatio

(.3.( -allbac4 a%ter 'vacuation

8sing th" VDCF r"comm"nd"d s"ttings if a od" fai's th" !"r!"rs ar" "!acuat"d and th" od" is s"tto stat" I&C=IV. =his is don" to a!oid usag" of that od" for n"# !"r!"rs.

Hou *oot th" od" #h"n th" issu"s that caus"d th" od" to fai' ar" so'!"d =h" %& Monitoring is th"nr"-acti!at"d automatica''+. =o us" th" od" for !"r!"rs again +ou n""d to acti!at" th" od" againB

@ ode ,c activate ame'm=ode

=h" !"r!"rs ar" = automatica''+ migrat"d *ac: to th" od". Hou n""d to migrat" th" !"r!"rsmanua''+ *ac: to +our od" using th" migrat" op"ration.

@ vserver ,c mi4rate ame'm=vserver ode'm=ode s-)tdo.



28/44



(.( Resource Monitoring

(.(.1 'nable resource monitoring

=h" r"cording of r"sourc" usag" information ma+ *" acti!at"d indi!idua''+ for "ach od". + "na*'ing aod" a usag"co''"ct s"r!ic" is start"d on th" od". &ft"r th" d"fin"d int"r!a',MONIO$_ONE_0&A1E_INE$VAL" a usag" r"cord is sa!"d 'oca''+ on th" od". &ft"r a d"fin"dnum*"r of r"cords ,MONIO$_ONE_0&A1E_!ELIVE$G" ar" sa!"d th" usag"co''"ct s"r!ic" transf"rsth" data to th" VDCF manag"m"nt s"r!"r.

=o "na*'" usag" co''"ction on od"s us" this commandB

@ rcmo ,c eaBle ode'2ode ame3 R ode all

=o disp'a+ th" status of r"sourc" monitoring for a'' od"s us" this commandB

@ rcmo ,c stat)s ode Cetral Moitor Compoet &tat)s 0sa4e !ata Collector eaBled 0sa4e !ata >- avera4e eaBled 0sa4e !ata A44re4atio eaBled

Node Moitor Compoet &tat)s 0sa4e !ata Collectio o sFFF> eaBled 0sa4e !ata Collectio o sFFF6 eaBled

(.(.2 sage "ollector

=h" usag" data transf"rr"d from th" od"s is import"d p"riodica''+ into th" VDCF r"positor+ using th"?8sag" Data Co''"ctor? cron jo*.

Hou "na*'" this co''"ctor usingB

@ rcmo ,c eaBle collector

B"en enablin' t"e !olle!tor a frt"er !ron @ob is enabled2 #"e sa'e Data *4" a/era'e !ron @ob is asmmar( fn!tion to !al!late t"e a/era'e resor!e sa'e of all odes and /Ser/ers in t"e last *4 "ors.

#o dis&la( t"at a/era'e data se t"e rcmo ,c s)mmar= !ommand.

(.(.3 sage Aggregator

=o a!oid using up too much spac" on th" VDCF manag"m"nt s"r!"r VDCF off"rs a ?8sag" Data&ggr"gation?. =his cron jo* aggr"gat"s o'd data.

@ rcmo ,c eaBle a44re4ator

8sag" r"cords o'd"r than a #"": ar" aggr"gat"d to a r"cord p"r hour.

8sag" r"cords o'd"r than a month ar" aggr"gat"d to a r"cord p"r da+.

[email protected] VDCF - Monitoring 3.0 $ / 44


29/44



(.(.( ,isable resource monitoring

am" proc"dur" as for "na*'ing th" r"sourc" monitoring compon"nts

Disa*'" co''"ction on od"sB

@ rcmo ,c disaBle ode'2ode ame3 R ode all

Disa*'" 8sag" Data Co''"ctorB

@ rcmo ,c disaBle collector

Disa*'" 8sag" Data &ggr"gationB

@ rcmo ,c disaBle a44re4ator

(.(.) #date $ode data manually

Hou ma+ r")u"st an updat" of th" data*as" #ith th" n"#"st usag" data a!ai'a*'".

=his command r"starts th" usag" co''"ctor s"r!ic" on th" od" and transf"rs *ac: th" curr"nt usag" datafi'" to th" VDCF manag"m"nt s"r!"r. Fo''o#"d *+ an import into th" VDCF r"positor+.

@ rcmo ,c )pdate ode'2ode ame3 R ode all



30/44



(.(. *how resource consum#tion data

=o sho# th" co''"ct"d usag" information for a !"r!"r or a od" us" th" sho# op"ration.

rcmo ,c s-o. cp) R memor= R memor=_e9teded -o)rl= R dail= R mot-l= R =earl= server'2server ame3 verBose

4T_total R 4Tt

rcmo ,c s-o. cp) R memor= R memor=_e9teded from'2time,spec3 server'2server ame3 to'2time,spec3

a44r'2a44r,spec3 verBose 4T_total R 4Tt

For "Ap'anation of th" command f'ags and output p'"as" s"" manpag" ?rcmon -% sho#? for d"tai'"dinformation. om" "Aamp'"sB

=h" fo''o#ing command 'ists th" a!ai'a*'" C68 usag" information of th" 'ast hour #ith no furth"raggr"gationB

@ rcmo ,c s-o. server'sF;7F cp) -o)rl=

,,,,,,,,,, Pool ,,,,,,,,,, ,,, Cp)&-r ,, ,,, Cp)&=s ,, ,,, Cp)0sr ,,

,,, Cp)All ,, ,, Cp)&All ,,

!ateime I!/=pe Ma9 C)r All Mi /Av4 /Ma9 Mi /Av4 /Ma9 Mi /Av4 /Ma9Mi /Av4 /Ma9 Mi /Av4 /Ma9 Name

>F;F,F7,>8 ;77;7 6F/priv ;D > 7*6U , ;FFU , , F*FU , , F*FU ,

, F*FU , , F*FU , sF;7F

>F;F,F7,>8 ;7J;J 6F/priv ;D > 7*6U , ;FFU , , F*FU , , F*FU ,

, F*FU , , F*FU , sF;7F

...

=his command 'ists a od"s m"mor+ consumption during th" 'ast month. It inc'ud"s summ"d up r"sourc"!a'u"s of th" g'o*a' and th" non g'o*a' 9on"sB

@ rcmo ,c s-o. server'sFFF6 memor= mot-l= 4Tt

,,,, $amot ,,,,, ,,,, $amKer ,,,, ,,,, $am?ree ,,,, ,,,, $am0se ,,,,,,,,, $am0til ,,,, ,,,,, Vm0se ,,,,, ,,,,, Vm0til ,,,,

!ateime Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9

Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9 Name

>F;F,F,>8 >6DJF , ;J>FM , , ;8>DM , , >M , , DDM ,

, >U , , 68M , , ;7U , sFFF6

>F;F,F,> >6DJ68 , ;J>FM , , ;8>7M , , >6M , , D8M ,

, >U , , 68M , , ;7U , sFFF6

***



31/44



=h" fo''o#ing command 'ists th" us"d m"mor+ r"sourc"s of a !"r!"r of th" 'ast hoursB

@ rcmo ,c s-o. server'sF;7F memor= from':,D -o)rs: a44r'-o)r

,,,, $amKer ,,,, ,,,, $am0se ,,,,, ,,,, $am0til ,,,, ,,,,, Vm0se ,,,,,

,,,,, Vm0til ,,,,

!ateime Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9

Mi / Av4 / Ma9 Name

>F;F,F7,>8 ;DJD; ;8;M ;8;M ;8;DM , 7M , , ;>U , , >M ,

>*FU >*FU >*FU sF;7F

>F;F,F7,>8 ;DDJ6 ;8;M ;8;DM ;8;DM , 7M , , ;>U , , >M ,


>F;F,F7,>8 ;8DJ>6 ;8;DM ;8;DM ;8;8M 7M 7M 7M ;>U ;>U ;>U , >M ,


>F;F,F7,>8 ;DJ6J ;8;DM ;8;8M ;8;7M 7M JM DDM ;>U ;>U ;U >M 6M JM

>*FU >*FU >*6U sF;7F

>F;F,F7,>8 ;7DJ>D ;8;M ;8;M ;8;7M JM JM JM ;>U ;>U ;>U , >M ,, >*FU , sF;7F

>F;F,F7,>8 ;JF ;8;M ;8;7M ;8;7M , JM , , ;>U , , >M ,

, >*FU , sF;7F

8s" this summar+ op"ration to disp'a+ th" a!"rag" r"sourc" usag" data of th" 'ast $4 hours.("su'ts ma+ *" ord"r"d *+ ram cpu or s"r!"r nam" in asc"nding or d"sc"nding ord"r.D"fau't ord"ring is ram d"sc"ndingB

@ rcmo ,c s)mmar= sortke='cp)

>- reso)rce )sa4e avera4e ordered B= cp)/desc

Node otal $AM ?ree $AM otal CP0 ?ree CP0 Last0pdate Commet

sFFF6 87 F (D*>U" 7FF JD (JJ*U" >F;;,;F,;; >6FF>7 &ol ;;

sFFF8 >F7 ;6D (8*8U" 8D7 8;> (J6*FU" >F;;,;>,F8 >6FF>F &ol ;F

sFFFJ ;F> 8;D (8F*;U" ;J6 ;77 (J*U" >F;;,;>,F8 >6FF; %akF;

v&erver 0sed $AM 0sed CP0 CP0 Pool Last0pdate Commet

vF;F >D ; F >F;;,;;,6F >6FF66 E9kl IP im AccessNet

vF;FF DF ; F >F;;,;>,F >6FF;J ?& v&erver

vF;F; DF ; F >F;;,;>,F8 >6FF>F o !iskset

vF;F6 DF ; F >F;;,;>,F8 >6FF>; Virt)al &erver vF;F6

vF;FD DF ; F >F;;,;>,F8 >6FF>6 )fs to Tfs

vF;F8 DF ; F >F;;,;>,F8 >6FF>8 V!C? oe

=h" data sho#n for fr"" ram and fr"" cpu ar" r"duc"d *+ a p"rc"ntag" r"s"r!"d for th" g'o*a' 9on",od". =his r"s"r!"d p"rc"ntag" of th" tota' ram/cpu can *" configur"d using th"s" fram"#or:!aria*'"sB

, Miim)m $AM re)ired/reserved for NO!E i U

e9port $E&O0$CE_NO!E_$AM_MIN';F

, Miim)m CP0 re)ired/reserved for NO!E i U

e9port $E&O0$CE_NO!E_CP0_MIN'F

=h" data of th" summar+ op"ration is a'so us"d *+ th" od" "!acuation f"atur". =h" configur"dp"rc"ntag" is us"d to pr"!"nt o!"r'oading a od" #ith to man+ !"r!"rs.



32/44



(.) O* Monitoring

tarting #ith V"rsion 3.0 th" Monitor can *" us"d to monitor- !"r!"r fi'"s+st"ms- MF "r!ic"s- Datas"t for od" and !"r!"r ,inc'uding 'oca' 9fs rpoo's- od" D 7,;7 ;,D

V!C? Cofi4)ratio VariaBles O&MON_EVEN tr)e MONIO$_EVEN_EMAIL_?$OM laB


33/44



(.).3 Individual warning threshold %or %ilesystems@ datasets and swa# usage

Hou can s"t an indi!idua' thr"sho'd for a sp"cific fi'"s+st"m datas"t or nod" s#ap.

=o updat" th" thr"sho'd for a fi'"s+st"m issu" th" fo''o#ing commandB

@ osmo ,c modif=_fs vserver'2vserver3 mo)tpoit'2mo)tpoit3 .arover'2percet3

=o updat" th" thr"sho'd for a datas"t issu" th" fo''o#ing commandB

@ osmo ,c modif=_dataset server'2server ame3 dataset'2dataset3 .arover'2percet3

=o updat" th" thr"sho'd for th" s#ap usag" issu" th" fo''o#ing commandB

@ osmo ,c modif=_s.ap ode'2ode ame3 .arover'2percet3

=o r"mo!" an indi!idua' thr"sho'd us" th" ?r"mo!"#arn? f'agB

@ osmo ,c modif=_fs vserver'2vserver3 mo)tpoit'2mo)tpoit3 remove_.ar

@ osmo ,c modif=_dataset server'2server ame3 dataset'2dataset3 remove_.ar

@ osmo ,c modif=_s.ap ode'2ode ame3 remove_.ar

(.).( Individual >&arget 0ath "ount> %or a node

+ d"fau't th" ?=arg"t 6ath Count? is *as"d on th" tota' configur"d path ,'ist"d *+ mpathadm or from th"

!aria*'" DI;DF&8>=6&=%C8=.Hou can s"t an indi!idua' ?=arg"t 6ath Count? for a sp"cific or a'' >8s assign"d to a nod".

=o updat" th" ?=arg"t 6ath Count? for on" >8 assign"d to a nod" issu" th" fo''o#ing commandB

@ osmo ,c modif=_disk ode'2ode ame3 tar4etco)t'2tar4et pat- co)t3 4)ids'24)idlist3

=o updat" th" ?=arg"t 6ath Count? for a'' >8s assign"d to a nod" issu" th" fo''o#ing commandB

@ osmo ,c modif=_disk ode'2ode ame3 tar4etco)t'2tar4et pat- co)t3 all



34/44



(.).) ,is#lay -ilesystem usage

=h" fi'"s+st"m usag" is disp'a+"d on th" !s"r!"r sho# d"tai' command and a 'ist of a'' critica' fi'"s+st"mscan *" disp'a+"d using th" ?osmon -c sho#fs? command.

@ osmo ,c s-o._fs

?iles=stems .it- )sa4e over .ar t-res-old

Node v&erver !ataset Mo)tpoit T$oot =pe &iTe/M% 0sed .ar,over

4FFD; vF;D; vF;D;_root /Toes/vF;D; =es Tfs 2)defied3 ;FFU 7FU (defa)lt"

4FF7F vF;8F vF;8F_root /Toes/vF;8F =es Tfs FJ8 J>U 7FU (defa)lt"

8s" th" summar+ f'ag to disp'a+ additiona''+ a usag" summar+ of th" most uti'i9"d fi'"s+st"ms or th" root

f'ag to on'+ sho# root fi'"s+st"msB

@ osmo ,c s-o._fs s)mmar=

0sed Co)t

;FFU ;

JFU,JJU ;

?iles=stems .it- )sa4e over .ar t-res-old

Node v&erver !ataset Mo)tpoit T$oot =pe &iTe/M% 0sed .ar,over

4FFD; vF;D; vF;D;_root /Toes/vF;D; =es Tfs 2)defied3 ;FFU 7FU (defa)lt"

4FF7F vF;8F vF;8F_root /Toes/vF;8F =es Tfs FJ8 J>U 7FU (defa)lt"

=o !i"# fi'"s+st"ms #ith anoth"r usag" than d"fin"d in ?O&MON_?&_#A$NIN1 ? +ou can gi!" a !a'u"dir"ct'+ on th" command 'in" *+ th" option ?o!"r?.



35/44



(.). ,is#lay ,ataset usage

& 'ist of a'' critica' datas"ts can *" disp'a+"d using th" ?osmon -c sho#datas"t? command.

@ osmo ,c s-o._dataset

!atasets .it- critical state fo)d

&erver =pe !ataset !ataset,=pe &tate &iTe/M% 0sed .ar,over

4FF7; Node rpool Node rpool !E1$A!E! /a DFU 7FU (defa)lt"

!atasets .it- )sa4e over .ar t-res-old


vF;D v&erver vF;D_root POOL ONLINE D;>F J;U 7FU (defa)lt"

sFF6F Node sFF6F_vBo9 POOL ONLINE D;>FF 77U 7FU (defa)lt"

8s" th" summar+ f'ag to disp'a+ additiona''+ a usag" summar+ of th" most uti'i9"d datas"ts or th" rootf'ag to on'+ sho# od" rootpoo'sB

@ osmo ,c s-o._dataset s)mmar= root

&tate Co)t

!E1$A!E! ;

0sed Co)t

DFU,DJU ;

!atasets .it- critical state fo)d


4FF7; Node rpool Node rpool !E1$A!E! /a DFU 7FU (defa)lt"

rpool !atasets .it- )sa4e over .ar t-res-old


4FF7D Node rpool Node rpool ONLINE /a D7U DFU

=o !i"# datas"ts #ith anoth"r usag" than d"fin"d in ?O&MON_!AA&E_#A$NIN1? +ou can gi!" a !a'u"dir"ct'+ on th" command 'in" *+ th" option ?o!"r?.



36/44



(.).7 ,is#lay *6A0 usage

& 'ist of critica' s#ap usag" can *" disp'a+"d using th" ?osmon -c sho#s#ap? command.

@ osmo ,c s-o._s.ap

Node s.ap .it- )sa4e over .ar t-res-old

Node &iTe/1% 0sed .ar,over

4FF7; ;*F 8FU (8FU"

8s" th" summar+ f'ag to disp'a+ additiona''+ a usag" summar+ of th" most uti'i9"d s#ap ar"asB

@ osmo ,c s-o._s.ap s)mmar=

Node s.ap .it- )sa4e over 8FU

0sed Co)t

FU,JU ;

8FU,8JU >

Node &iTe/1% 0sed .ar,over

4FF7; ;*F FU (8FU"

4FF8J ;*F 8>U (8FU"

4FFJ; ;*F 8;U (8FU"

=o !i"# th" s#ap usag" #ith anoth"r usag" than d"fin"d in ?O&MON_AP_#A$NIN1 ? +ou can gi!" a!a'u" dir"ct'+ on th" command 'in" *+ th" option ?o!"r?.



37/44



(.).8 ,is#lay *M- *ervices

& 'ist of a'' critica' MF s"r!ic"s can *" disp'a+"d using th" ?osmon -c sho#smf? command.

@ osmo ,c s-o._smf

&M? .it- state de4radedmaiteace &erver =pe &M?,Name (?M$I" &tate sFF;6 Node svc/s=stem/s=soBjdefa)lt maiteace vF;J v&erver svc/site/vdcf_postistalldefa)lt maiteace

8s" th" summar+ f'ag to additiona''+ disp'a+ a summar+ of th" critica' MF s"r!ic"sB

@ osmo ,c s-o._smf s)mmar=

&M?,&tate Co)t maiteace >

&M? .it- state de4radedmaiteace &erver =pe &M?,Name (?M$I" &tate sFF;6 Node svc/s=stem/s=soBjdefa)lt maiteace vF;J v&erver svc/site/vdcf_postistalldefa)lt maiteace

=o !i"# MF s"r!ic"s oth"r than ?de4radedmaiteace ? +ou can d"fin" stat"s on th" command 'in"*+ th" option ?stat"?.

@ osmo ,c s-o._smf state')iitialiTed

&M? .it- state )iitialiTed &erver =pe &M?,Name (?M$I" &tate vF;> v&erver svc/applicatio/fot/stfsloaderdefa)lt )iitialiTed vF;> v&erver svc/applicatio/prit/rfc;;Jdefa)lt )iitialiTed

It is a'so possi*'" to s"arch s"r!ic"s of int"r"st *+ th" option ?s"arch?.

@ osmo ,c s-o._smf searc-'sedmail

&erver =pe &M?,Name (?M$I" &tate sFF;6 Node svc/et.ork/sedmail,clietdefa)lt disaBled sFF;6 Node svc/et.ork/smtpsedmail disaBled vF;J v&erver svc/et.ork/sedmail,clietdefa)lt olie

vF;J v&erver svc/et.ork/smtpsedmail olie



38/44



(.).9 ,is#lay ,is4 0ath "ount

& 'ist of a'' dis:s #ithout "nough paths on'in" can *" disp'a+"d using th" ?osmon -c sho#dis:? command.

@ osmo ,c s-o._disk

!isk Pat- Co)t .it- critical state Node 10I! C)rret Pat- Co)t ar4et Pat- Co)t sFF> 8FF;67F;>DJJ%8>FFF;;FFF;FCFFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF>J;EFFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF>J>>FFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF;?EFFFF ; >

8s" th" summar+ f'ag to additiona''+ disp'a+ a summar+ of th" curr"nt path countB

@ osmo ,c s-o._disk s)mmar=

C)rretPat-Co)t Co)t ;

!isk Pat- Co)t .it- critical state Node 10I! C)rret Pat- Co)t ar4et Pat- Co)t sFF> 8FF;67F;>DJJ%8>FFF;;FFF;FCFFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF>J;EFFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF>J>>FFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF;?EFFFF ; >

Hou can 'ist th" curr"nt path count for "ach nod" th" dis: is assign"d *+ using th" fo''o#ing commandB

@ diskadm ,c s-o. ame'8FF;67F;>DJJ%8>FFF;;FFF>J>>FFFF

!ataset,Name 0se,=pe !ev,=pe 10I! &iTe/1% ier Locatio, ?$EE MPIO 8FF;6**>J>>FFFF ;D*F /a HPEVA

Nodes coected to t-is disk

Node Model cPool Locatio Pat- Co)t Commet

sFFF6 O$CL&PA$C,&,> sol;; $ &,> &erver sFF> O$CL&PA$C,,; sol;; $ ; ,; &erver



39/44



(. O* *ecurity

(..1 Run *ecurity "om#liance Assessments

"curit+ Comp'ianc" &ss"ssm"nts can *" run against od"s and !"r!"r running on o'aris 11.3.

=h" *"nchmar: to *" us"d can *" d"fin"d indi!idua''+ p"r s+st"m. For s+st"ms #ithout a d"fin"d *"nchmar:th" VDCF ?d"fau't? *"nchmar: is us"d. Hou can configur" +our d"fau't "nchmar: *+ adding th"CM6>I&CDF&8>=C%M&(; !aria*'" to customi9".cfg.

@ vserver ,c modif= ame'm=server Bec-mark'Baselie

@ odecf4 ,c modif= ame'server; Bec-mark'cdom

"" Chapt"r3..4to s"" #h"r" to d"fin" +our o#n *"nchmar:s.

=h" ass"ssm"nts ma+ *" running for s"!"ra' minut"s th"r"for" th"+ ar" not "A"cut"d *+ ?osmon -c updat"?op"ration. 8s" th" ass"ss op"ration to initiat" a "curit+ Comp'ianc" &ss"ssm"ntB

@ osmo ,c assess ode'4FF8> all_vserver

Assessi4 Node ad all v&ervers o Node 4FF8>E9ec)ti4 compliace assess .it- %ec-mark &olaris %aselie o 4FF8> ***E9ec)ti4 compliace assess .it- %ec-mark defa)lt o vF;>6 ***E9ec)ti4 compliace assess .it- %ec-mark defa)lt o vF;6 ***

Compliace $eport for Node 4FF8> from >F;,FJ,;;;866DD&core 7J*7DDF8

otal $)les ;F Passed ;6 ?ailed 8 (Error F / Hi4- ; / Med D / Lo. F / Ifo F"

Compliace $eport for v&erver vF;>6 from >F;,FJ,;;;86D6J&core *J67>7otal $)les ; Passed ;F ?ailed (Error F / Hi4- F / Med / Lo. F / Ifo F"

Compliace $eport for v&erver vF;6 from >F;,FJ,;;;86;J&core *J67>7otal $)les ; Passed ;F ?ailed (Error F / Hi4- F / Med / Lo. F / Ifo F"

!etailed e9t $eport ca Be fo)d i /var/opt/jomasoft/vdcf/compliace_reports#A$N Assess of Node ad all v&ervers o Node 4FF8> .as ot s)ccessf)l

For con!"ni"nc" th" ass"ss op"ration is a'so a!ai'a*'" in th" nod" and !s"r!"r commandsB

@ ode ,c assess ame'4FF8> vserver

@ vserver ,c assess ame'vF;>6 Bec-mark'recommeded



40/44



(..2 ,is#lay "om#liance Re#orts

& Comp'ianc" ("port o!"r!i"# can *" disp'a+"d *+ ?osmon -c sho#comp'ianc"?B

@ osmo ,c s-o._compliace

&erver =pe %ec-mark &core ime Passed ?ailed Error ***vF;>6 v&erver defa)lt *J67>7 >F;,FJ,;; ;F FvF;6 v&erver defa)lt *J67>7 >F;,FJ,;; ;F FsFF> Node cdom 7*8;JF; >F;,FJ,;; ;F 6 F4FF8> Node Baselie 7J*7DDF8 >F;,FJ,;; ;6 8 FsFFF6 Node cdom JD*>67FJ; >F;,FJ,;; ;> ; F

& d"tai'"d r"port in %=M> can *" found in th" comp'ianc" htm' r"port dir"ctor+B/var/opt/jomasoft/vdcf/compliace_reports/-tml

=h"s" r"ports can *" disp'a+"d #ith +our pr"f"rr"d *ro#s"r using th" VDCF Dash*oard."" Chapt"r 4.2 for d"tai's.

(..3 O* Hardening

=his f"atur" is on'+ a!ai'a*'" on o'aris 11.

=o r"so'!" th" s"curit+ findings disco!"r"d *+ th" ass"ss op"ration +ou ma+ us" th" hard"ning op"rationson th" nod" and !s"r!"r commands. =h"s" commands do app'+ hard"ning using a d"dicat"dhard"ning profi'"B

@ ode ,c -arde profile'2-ardei4 profile3

@ vserver ,c -arde profile'2-ardei4 profile3

8s" th" ?nod" -c hard"n h"'p? or ?!s"r!"r -c hard"n h"'p? to g"t a 'ist of a'' a!ai'a*'" hard"ning profi'"s.Hou ma+ d"fin" +our o#n hard"ning profi'"s ,s"" Chapt"r 3..

,Bas-,*@ ode ,c -arde ame'4FFJ7 profile'Baselie

Hardei4 started ***O&C,;>D;F &ervice svc/et.ork/fs/fedfs,clietdefa)lt is i disaBled state , !ONEO&C,;DD;F &ervice svc/et.ork/fi4er is disaBled or ot istalled , !ONEO&C,;D;F &ervice svc/et.ork/ftpdefa)lt is i disaBled state , !ONE

O&C,DDF;F -e r,protocols services are disaBled i PAM , !ONEO&C,86FFD &ervice svc/et.ork/rpc/4ss is eaBled if ad ol= if KerBeros iscofi4)red , !ONEHardei4 of D items o Node 4FFJ7 .as s)ccessf)l



41/44



(.7 +,"- ,ashboard web a##lication

tarting #ith V"rsion 3.0 th" VDCF Monitoring com"s #ith a #"* app'ication to disp'a+ som" informationstor"d in th" VDCF ("positor+. &nd to acc"ss comp'ianc" r"ports g"n"rat"d *+ th" ?osmon -c ass"ss?command.

(.7.1 'nabling ? ,isabling

=h" #"* app'ication is running as a apach" da"mon proc"ss and th"r"for" it can *" contro''"d *+ th"norma' apach" r"start commands. =h" #"* app'ication is d"p'o+"d in a s"parat" !irtua' host.

It?s "na*'"d *+ d"fau't ,aft"r running th" s"tupgui too' s"" Chapt"r 3.2.

=o disa*'" th" #"* app'ication just r"mo!" this fi'" from th" apach" conf.d dir"ctor+B

/etc/apac-e>/>*>/cof*d/vdcf_dja4o_-ttpd_>>*cofand r"start &pach".

(.7.2 =og%iles

&ep ;J ;D6 vdcf4)i_dja4o*lo4,r.,r,,r,, ; root root 8D &ep ;J ;D; vdcf4)i_error*lo4

(.7.3 6eb a##lication screenshots

tart +our pr"f"rr"d *ro#s"r and na!igat" to th" dash*oard ur'B httpsB//L+ours"r!"rOBL+our portO,d"p"nds on +our apach" configuration.

=o auth"nticat" +ou ha!" to us" +our 'oca' uniA account cr"d"ntia's.8s"rs #ithout a o'aris account can?t us" th" VDCF Dash*oard.



42/44



&ft"r auth"ntication +ou g"t r"dir"ct"d to th" front pag" of th" app'icationB

[email protected] VDCF - Monitoring 3.0 4$ / 44


43/44



From h"r" +ou can s"'"ct th" diff"r"nt r"ports. For "Aamp'" th" comp'ianc" o!"r!i"#B

&nd fina''+ disp'a+ a comp'ianc" r"port for a sp"cific s+st"mB



44/44



) A##endies

).1 $ode %ailover detection details

& od" is consid"r"d as fai'"d if for a d"fin"d num*"r of int"r!a's no pro*" m"ssag" has *""n post"dfrom a od". =h" monitor #i'' :ic: off an action aft"r ,%&M;6&>IV&C=I=%>DP1 Q%&M;6&>IVI=(V&> s"conds aft"r a od" is no 'ong"r su*mitting its :""p a'i!"m"ssag"s.

=h" action part of th" hamonch"c: go"s through s"!"ra' st"ps unti' it consid"rs a od" as fai'"dB

1. First of a'' n"t#or: conn"cti!it+ is !"rifi"d *+ tr+ing to ch"c: th" status of th" !dcf:""pa'i!" s"r!ic" onth" susp"ct od". If th" od" can *" r"ach"d and th" ch"c: r"turns a s"r!ic" stat" oth"r th"n "na*'"d

th" monitor tri"s to r""sta*'ish th" !dcf:""pa'i!" s"r!ic". If this succ""ds th" monitor r"turns to norma'op"ration and a#aits th" :""p a'i!" pro*" for this od". If th" s"r!ic" stat" a'r"ad+ #as "na*'"d and th"monitor #as a*'" to )u"r+ its stat" it a'so r"turns to norma' op"ration assuming th" pro*" fai'ur" #as oft"mporar+ natur".

$. If n"t#or: r"acha*i'it+ of th" susp"ct od" is not gi!"n th" monitor tri"s to acc"ss th" od"s s+st"mcontro''"r. If #" succ"ssfu''+ r"ach th" s+st"m contro''"r th" monitor ch"c:s th" od"?s conso'" for arunning op"rating s+st"m. In this cas" th" monitor r"sum"s norma' op"ration assuming a h"a'th+ od"#ith :""p-a'i!" fai'ur"s du" to t"mporar+ n"t#or: pro*'"ms. If th" conso'" ch"c: r"turns no signs of 'i!"th" od" #i'' *" po#"r"d off if configur"d so and its #or:'oad #i'' *" "!acuat"d.

3. If th" monitor is not a*'" to r"ach th" s+st"m contro''"r and %&MC%C;=IV=6(. If *as"d on this ch"c: th" n"t#or: is consid"r"d ash"a'th+ th" susp"ct od" #i'' *" assum"d as fai'"d and th" #or:'oad is "!acuat"d. If th" n"t#or: isconsid"r"d as fai'"d th" monitor r"sum"s norma' op"ration #ithout acting on th" susp"ct od".

vdcf monitoring

Documents