tsm for ve sample architecture - v1.0.pdf
TRANSCRIPT
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
1/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
Tivoli Storage Manager for Virtual Environments
Sample Architecture
Disk to Disk Virtual Machine Backup,
TSM Deduplication on AIX, and XIV Storage
!"
Authors:
Linh Vo, Robert Riordan, Jason Basler
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 1 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
2/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
Document #istor$
Document %ocationThis is a snapshot of an on#line $ocument !aper copies are vali$ onl% on the $a% the% are printe$
&evision #istor$
&evision'um(er
&evisionDate
Summar% of )hanges )hangesmar*e$
10 11/16/12 +nitial version
A'out this document
This $ocument provi$es a sample architecture $escri(ing a $eplo%ment of Tivoli Storage Manager for VirtualEnvironments This information is provi$e$ for reference purposes to provi$e gui$ance $uring the planning ofother $eplo%ments of Tivoli Storage Manager for Virtual Environments The information provi$e$ is (ase$upon configurations use$ an$ test results $erive$ from implementations in the test la(s use$ (% +,M TivoliStorage Manager $evelopment The architectures are not inten$e$ to (e a suita(le configuration for allsituations- an$ $o not replace the nee$ to carefull% plan an$ $esign the elements of %our o.n implementationof Tivoli Storage Manager
Disclaimer
This $ocument contains measurements of Tivoli Storage Manager performance .hich are inten$e$ to (euse$ for reference $uring planning implementations of Tivoli Storage Manager !erformance results reporte$in this $ocument .ere measure$ (% +,M un$er controlle$ test con$itions !erformance results measure$ in
other environments ma% var% from those reporte$ herein- $epen$ing on factors such as s%stem configuration-.or*loa$ characteristics- an$ other environmental con$itions Accor$ingl%- this $ata $oes not constitute aperformance guarantee or .arrant%
The information containe$ in this $ocument is $istri(ute$ on an as is (asis .ithout an% .arrant% eitherepresse$ or implie$ This $ocument has (een ma$e availa(le as part of +,M $eveloperor*s ++- an$ ishere(% governe$ (% the terms of use of the ++ as $efine$ at the follo.ing location:
http://...i(mcom/$eveloper.or*s/tivoli/communit%/$isclaimerhtml
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 2 of 2"
http://www.ibm.com/developerworks/tivoli/community/disclaimer.html%20http://www.ibm.com/developerworks/tivoli/community/disclaimer.html%20 -
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
3/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
(ontentsDocument 3istor%2
Document 4ocation2
&evision 3istor% 2
A(out this $ocument 2
Disclaimer2
)ontents5
1 vervie. of the architecture7
11 vervie. of Data !rotection for VM.are Technologies7
111 +ncremental forever7
112 !arallel sessions7
12 De$uplication technolog%6
15 Architecture summar%6
18 Architecture $etails9
181 De$uplicate$ primar% pool"
2 (serve$ performance
21 Data ingestion
22 !rotecte$ $ata10
25 Data movement10
28 Sample (ac*up statistics11
27 Data(ase $is* +!S measurements12
26 )!; an$ Memor% usage on the vStorage (ac*up server12
5 3ar$.are Details18
51 VM.are components 18
52 vStorage (ac*up server 18
55 TSM server18
551 Server s%stem18
552 Soft.are stac* for the TSM server17
555 Dis* storage for the TSM server 17
58 'et.or* overvie.16
8 S%stem configuration $etails19
81 vStorage (ac*up server configuration19
811 perating s%stem $etails 19
812 TSM soft.are installe$ 19
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 5 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
4/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
815 TSM options file1"
818 Service configuration1
817 Sche$ule configuration20
82 v)enter plugin server configuration20
821 Machine $etails20
822 'o$e configuration20
825 vmcliprofile options file22
828 VM)4+ setup22
85 TSM Server )onfiguration25
851 perating s%stem tuning changes 25
852 D,2 configuration changes25
855 Volume manager an$ file s%stem configuration28
858 TSM server processing options27857 Device class creation26
856 Storage pool creation26
859 !olic% settings26
85" Sche$ules an$ macro $efinitions to control server maintenance tas*s29
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 8 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
5/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
! )vervie* of the architectureThis $ocument provi$es a sample architecture using Tivoli Storage Manager for Virtual Environments < Data!rotection for VM.are to protect a VM.are environment using a $e$uplicate$ $is*#(ase$ storage pool .ith a
TSM server running on +,M !o.er har$.are .ith A+= A single ph%sical vStorage ,ac*up Server runningMicrosoft in$o.s is use$ as the $ata mover for transferring VM.are $ata to the TSM server The storagefor the TSM server is provi$e$ using +,M =+V storage
This $ocument $oes not $escri(e the highest performing environment possi(le &ather- it $escri(es oneeample environment to serve as an ai$ to $eplo%ment
)vervie* of Data +rotection for VM*are TechnologiesTivoli Storage Manager for Virtual Environments >TSM for VE? provi$es off#host (ac*up capa(ilities forVM.are environments using the VM.are vStorage A!+s for Data !rotection >VAD!? A single (ac*up can (euse$ for (oth complete virtual machine recoveries- as .ell as file#level recover% The capa(ilities of TSM forVE are further enhance$ in the 68 release to provi$e a$$itional scala(ilit% .ith ne. capa(ilities to allo. foran incremental#forever (ac*up mo$el- an$ the a(ilit% to use multiple sessions to (ac*up virtual machines inparallel
Incremental foreverA ma@or ne. capa(ilit% provi$e$ (% TSM for VE 68 is incremental#forever (ac*ups- a ne. t%pe of VM (ac*upthat replaces the TSM for VE 65 perio$ic#full (ac*ups +ncremental forever eliminates the nee$ to sche$uleperio$ic full (ac*ups Each incremental#forever (ac*up is represente$ as a self#containe$ (ac*up- similar toa s%nthetic full (ac*up pro$uce$ .ithout movement of previousl% store$ $ata This means that a consistentrestore can (e performe$ even if all prior versions of the VM (ac*up are $elete$ or incremental#forever(ac*ups- epiration polic% is applie$ on a per#(ac*up (asis ,% contrast- for perio$ic#full (ac*ups- epiration
polic% is applie$ to each ;44 (ac*up an$ su(seBuent incremental (ac*ups ith incremental#forever(ac*up- onl% one (ac*up sche$ule is nee$e$ An initial full (ac*up is $one automaticall% if TSM $etects thatthe VM has not %et (een (ac*e$ up- an$ all su(seBuent (ac*ups are incremental (ac*ups
The technolog% also ma*es the transition from the perio$ic#full mo$el >vis#a#vis TSMVE 65? to the ne.incremental#forever mo$el as transparent as possi(le- (% provi$ing a simple migration path fromimplementations using perio$ic#full (ac*ups to the ne. incremental#forever mo$el
2 Parallel sessionsTSM for VE 68 provi$es the a(ilit% to sche$ule (ac*ups of a large collection of VM.are virtual machines-there(% provi$ing an automate$ (ac*up solution that allo.s for the automatic $iscover% of ne.l% create$virtual machines as .ell as provi$ing parallel (ac*up of multiple virtual machines This is a significantenhancement over previous releases .hich offere$ .hat .as essentiall% a serial VE (ac*up solution- .hereparallelism coul$ onl% (e realiCe$ through the use of multiple instances of the (ac*up#archive client The useof parallel sessions optimiCes (ac*up throughput (% loa$ (alancing across multiple threa$s from the entire$omain of virtual machines to (ac*up
The ne. TSM for VE option that $etermines the $egree of parallelism of a VM (ac*up is the vmmaxparalleloption +n a$$ition- there are options that allo. the user to limit the impact of a parallel (ac*up to in$ivi$ualES= hosts an$/or in$ivi$ual $atastores- there(% provi$ing a throttling mechanism across the various ES=hosts an$ $atastores in the VM.are environment
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 7 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
6/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
The com(ination of the ne. incremental#forever an$ multi#session (ac*up capa(ilities provi$es a morescala(le (ac*up solution for protecting VM.are environments- .ith fe.er vStorage ,ac*up Servers- lessimpact to the TSM server- an$ smaller (ac*up .in$o.s
2 Deduplication technolog$De$uplication technolog% provi$es an effective metho$ of re$ucing the amount of $ata .hich TSM for VEnee$s to transfer over a net.or* an$ store in storage pools Detaile$ information $escri(ing the$e$uplication technolog% in TSM is availa(le in the paper Effective !lanning an$ ;se of Tivoli StorageManager V6 De$uplication
3 Architecture summar$The sample TSM for VE architecture provi$es a $is*#(ase$ (ac*up solution that retains $ata in a$e$uplicate$ storage pool for its entire life c%cle Data protection is provi$e$ for hun$re$s of virtual machinesin the $e$uplicate$ storage pool The follo.ing ta(le summariCes some *e% points .hich are $etaile$ in the
remain$er of the $ocument:
e$ point Summar$
!rotecte$ clients
-." virtual machinesare protecte$ .ith a $ail% sche$ule$ (ac*up
,ac*ups ta*e a$vantage of incremental/forever, multi/session'ackup, an$ client/side deduplicationtechnologies availa(le inTSM for VE 68 >these technologies are in$epen$ent from the TSMserver version- (ut (enefit from enhancements provi$e$ in the TSM655 server?
0TBof use$ VM.are storage is (eing protecte$
All of the virtual machines are protecte$ using a single vStorage,ac*up Server an$ a single TSM server
Server polic% is set to retain each $ail% recover% point for .1 da$sin a $e$uplicate$ storage pool!
TSM $ata(ase siCe
1 T, of storage allocate$ for the $ata(ase .ith 101 2B currentl$used '$ the data'ase
3!4 million o'5ectsare trac*e$ in the TSM server $ata(ase torepresent 87 $a%s .orth of recover% points for 580 virtualmachines
TSM log siCes 12" , for the active log
855 , for the archive log
De$uplicate$ storage pool
As much as 3!1TB of ne* data is ingestedinto the server each$a% >siCe (efore client#si$e $e$uplication?
29 T, of $is* storage is allocate$ for the $e$uplicate$ storage poolThis storage is use$ to provi$e:
o 041TBof $ata is protecte$ across 87 (ac*up versions >siCe(efore incremental?
o 00TB of $ata is manage$ in a $e$uplicate$ storage pool
>siCe after incremental- (efore $e$uplication?o 6TB is store$ >siCe after incremental an$ $e$uplication?
'et.or*s 2' %A7for client (ac*up ingestion
.2' SA7for VM.are- vStorage ,ac*up server- an$ TSM serverstorage
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 6 of 2"
https://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/Tivoli%20Storage%20Manager/page/Effective%20Planning%20and%20Use%20of%20IBM%20Tivoli%20Storage%20Manager%20V6%20Deduplicationhttps://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/Tivoli%20Storage%20Manager/page/Effective%20Planning%20and%20Use%20of%20IBM%20Tivoli%20Storage%20Manager%20V6%20Deduplicationhttps://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/Tivoli%20Storage%20Manager/page/Effective%20Planning%20and%20Use%20of%20IBM%20Tivoli%20Storage%20Manager%20V6%20Deduplicationhttps://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/Tivoli%20Storage%20Manager/page/Effective%20Planning%20and%20Use%20of%20IBM%20Tivoli%20Storage%20Manager%20V6%20Deduplication -
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
7/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
4 Architecture details
The $iagram a(ove illustrates the architecture that inclu$es the use of TSM for Virtual Environments toperform incremental#forever virtual machine (ac*ups A ph%sical machine is use$ for the vStorage (ac*upserver- an$ is a(le to ta*e a$vantage of the SA' transport on the rea$s from the VM.are $atastores
,ac*ups are sent to the TSM server across a 4A' using a com(ination of client#si$e $e$uplication an$compression to a $e$uplicate$ file storage pool Data remains in the $e$uplicate$ file storage pool for itsentire retention an$ is never allo.e$ to migrate to another storage pool
The follo.ing summariCes *e% aspects of the architecture:
A ph%sical machine acts as the $ata mover component of the vStorage (ac*up server Thiscapa(ilit% is implemente$ in the TSM (ac*up#archive client portion of the Data !rotection for VM.aresolution
Data is rea$ from VM.are $atastores across the SA' (% the vStorage (ac*up server using theVM.are Virtual Dis* Development it >VDD? for SA' transport
The virtual machine (ac*ups are ingeste$ over the 4A' to the TSM server using client#si$e$e$uplication an$ compression
The TSM for Virtual Environments incremental#forever (ac*up capa(ilit% is use$ to *eep the amountof $ata process to a minimum (efore other $ata re$uction technologies are applie$
The (est practices implementation of separating the activities of $ata ingestion an$ server $atamaintenance tas*s into t.o $istinct .in$o.s each $a% is use$ on the TSM server This inclu$esor$ering the $ata maintenance tas*s optimall% to avoi$ resource contention
Volumes on +,M =+V storage is use$ for (oth the TSM server $ata(ase an$ file storage pool
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 9 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
8/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
4 Deduplicated primary poolThe $e$uplicate$ primar% storage pool retains (ac*up o(@ects for their entire retention A single vStorage(ac*up server ingest (ac*ups $irectl% into this storage pool using the capa(ilit% to use multiple sessions to(ac*up more than one virtual machine simultaneousl% A$$itional $etails are provi$e$ in the section on TSM
server configuration relate$ to configuring the $e$uplicate$ storage pool
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age " of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
9/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
3! )'served performance(serve$ performance results are presente$ in this section (ase$ on measurements ta*en on the samplearchitecture in the test la( This information is provi$e$ to serve as a reference $uring planning a TSM
implementation- an$ is not inten$e$ to (e a guarantee of the performance to (e epecte$ in a $ifferentenvironment
2 Data ingestionData ingestion is performe$ over an eight hour (ac*up .in$o.
Item8metric Variations %imit8&ange 7otes
!rotecte$ virtualmachines
'um(er of VMs 1 580
T%pical num(er ofsessions on TSM server
60 < 0 This range is $ue to a maimum of50 parallel VM (ac*ups Each
parallel VM (ac*up uses 5sessions
T%pical (ac*up elapse$time >incremental?
9 # hours
;nplanne$ full (ac*ups>per $a%?
88 This is an average ta*en across50 $a%s- an$ inclu$es full (ac*upsta*en $ue to VM.are ),T resets-an$ ne. virtual machines ta*ingtheir first full (ac*up
'e. $ata ingeste$>$ail%?
'um(er of o(@ects 90-000 < 200-000 Virtual machines are store$ on theTSM server as a group of smallero(@ects
Volume of $ata (efore$e$up/compression 2
17 < 27 T,
Volume of $ata after$e$up/compression
500 # 600 ,
1Virtual machines range in siCe >use$ capacit%? from ", to 700,- .ith an average use$ capacit% of 70,
2Approimatel% 80 of the virtual machines have a virtual har$.are level of 8 .hich prevents them fromperforming incremental (ac*ups The% ta*e full (ac*ups ever% $a%- an$ account for approimatel% 11T, ofthe $ail% (ac*up ingestion
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
10/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
2 2 +rotected dataItem8metric Variations %imit8&ange 7otes
TSM $ata(ase >use$? 767 ,
'um(er of store$ o(@ects5 29 million
Total protecte$ $ata 4ogical 66 T, Amount of protecte$ $ata inclu$ing allversions after incremental re$uctions- (ut(efore $e$uplication re$uctions
Store$ 1 T, 89 T, eliminate$ (% $e$uplication
2 3 Data movementItem8metric %imit8&ange 7otes
(@ects $elete$ (% epire inventor% >$ail%? 200-000 < 700-000 The epire inventor% processing t%picall%completes in un$er one hour
Throughput of $ata(ase (ac*up "0 < 120 M,/sec
Throughput of reclamation 20 # 27 M,/sec " processes
Throughput of (ac*up ingestion 8 "0 # 0 M,/sec
5TSM for VE stores virtual machine (ac*ups as a group of smaller o(@ects This num(er reflects the num(erof resulting o(@ects trac*e$ in the TSM server $ata(ase for all virtual $is*s across all (ac*up versions for thecollection of virtual machines
8This is the aggregate throughput across 50 parallel (ac*up sessions
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 10 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
11/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
2 4 Sample 'ackup statistics)harts .hich follo. are (ase$ on the follo.ing $a%s (ac*up reflecte$ in the follo.ing summar% statisticsreporte$ in the TSM (ac*up#archive client sche$ule log The negative compression value reflects theran$om nature of the $ata generate$ (% the tools use$ to $rive change activit% .ithin the virtual machineT%picall%- compression .ill provi$e (enefit in space savings
10/16/2012 05:49:36 Total number of objects inspected: 34010/16/2012 05:49:36 Total number of objects backed up: 32810/16/2012 05:49:36 Total number of objects updated: 010/16/2012 05:49:36 Total number of objects rebound: 010/16/2012 05:49:36 Total number of objects deleted: 010/16/2012 05:49:36 Total number of objects epired: 010/16/2012 05:49:36 Total number of objects failed: 1210/16/2012 05:49:36 Total objects deduplicated: 32510/16/2012 05:49:36 Total number of b!tes inspected: 16"61 T#
10/16/2012 05:49:36 Total number of b!tes processed: 2"26 T#10/16/2012 05:49:36 Total b!tes before deduplication: 2"26 T#10/16/2012 05:49:36 Total b!tes after deduplication: 619"$2 %#10/16/2012 05:49:36 Total number of b!tes transferred: 653"$0 %#10/16/2012 05:49:36 &ata transfer time: 335'323"$1 sec10/16/2012 05:49:36 (et)ork data transfer rate: $'248"03 *#/sec10/16/2012 05:49:36 +,,re,ate data transfer rate: 86'340"28 *#/sec10/16/2012 05:49:36 -bjects compressed b!: .510/16/2012 05:49:36 &eduplication reduction: $3"3110/16/2012 05:49:36 Total data reduction ratio: 96"1610/16/2012 05:49:36 lapsed processin, time: 0$:49:09
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 11 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
12/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
2 5 Data'ase disk I)+S measurementsThe follo.ing chart sho.s $ata(ase $is* +!S measurements ta*en throughout one $a% .ith the generaltime ranges of the various TSM server activities la(ele$ The $ata is ta*en from the output of the iostatcomman$ using a 7 secon$ sampling interval The $ata points represent the sum of the reporte$ Ftransfersper secon$G for all four of the $is*s use$ for hol$ing the TSM server $ata(ase volumes
TSM server data'ase volume I)+S
0
2000
8000
6000
"000
10000
12000
18000
16000
1"000
20000
0:00:00 8:8":00 :56:00 18:28:00 1:12:00 0:00:00
+6!S >allD, $is*s?
(ac*up ingestion
$((ac*up
epiration
reclamation
ma
2062"
avg
2271
st$$ev
1697
2 6 (+9 and Memor$ usage on the vStorage 'ackup serverThe follo.ing charts sho. the memor% an$ )!; usage of the vStorage ,ac*up Server $uring a (ac*up thatinclu$es more than 500 virtual machines- using a vmmaxparalleloption setting of 50 The $ata is ta*en fromthe in$o.s !erformance Monitor using a 17 secon$ sampling interval
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 12 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
13/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
The follo.ing chart sho.s memor% usage of the TSM (ac*up#archive sche$uler process performing a (ac*upof the VM.are environment using 50 parallel VM (ac*ups
The follo.ing chart sho.s )!; usage of the TSM (ac*up#archive sche$uler process $uring the same(ac*up The scale is from 0H to "00H- .ith each 100H correspon$ing to one of the eight )!; cores
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 15 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
14/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
-! #ard*are Details
3 VM*are componentsThe VM.are environment consists of a Virtual )enter managing 15 ES=/ES=i servers of $ifferent versions
Virtual )enter 71 running on a ph%sical Microsoft in$o.s 200"&2 68(it server
VM.are ES= 81
VM.are ES=i 71- 70- an$ 81
Virtual machines are primaril% using virtual har$.are levels 9 an$ "- .ith a small su(set using avirtual har$.are level 8
The virtual machines are running a vast assortment of Microsoft in$o.s an$ 4inu operatings%stems- an$ have the most recent version of VM.are tools installe$ for the specific VM.are hostversion the% are running un$er
The VM.are $atastores are (ac*e$ (% local $is*s an$ a variet% of storage su(s%stems inclu$ing:
+,M =+V Storage S%stem >2"10#A18?
+,M S%stem Storage DS8000 an$ DS7020
+,M S%stem Storage DS"100
3 2 vStorage 'ackup server +,M S%stem 5770 M5 >988#A)1?
2 283C 8#core processors
28 , &AM
2#port 8( fi(re channel a$apter
1( Ethernet a$apter
3 3 TSM server
3 3 Server system +,M !o.er 9"0 >19#M3,?
4!A& configure$ .ith:
o 8 5"6 3C !E&9 processor cores in !E&9 compati(ilit% mo$e
o 52 , &AM
o 2#port 8( fi(re channel a$apter
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 18 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
15/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
o Virtual 1( Ethernet a$apter from virtual +/ server
+/ a$apters
Slot: Slot t$pe;eature code ofinstalled adapter
Description
Slot 1 !)+e " 'ot use$ for this test
Slot 2 !)+e " 'ot use$ for this test
Slot 5 !)+e " 'ot use$ for this test
Slot 8 !)+e " 7998 2#port 8( i(re channel a$apter
Slot 7 !)+e " 7969 2#port 1( Ethernet a$apter
Slot 6 !)+e " 'ot use$ for this test
A$$itional s%stem $etails for the p9"0 are availa(le here:http://...re$(oo*si(mcom/re$papers/p$fs/re$p865p$f
3 3 2 Software stack for the TSM server A+= 91 >9100#00#08#1180?- 68(it *ernel
TSM server for A+= Version 65 >6550?
o TSM server 655 inclu$es enhancements to epiration an$ $e$uplication $ereferencing that
(enefit VM (ac*ups to $e$uplicate$ storage pools
3 3 3 Disk storage for the TSM serverThe TSM server $ata(ase an$ storage pools are implemente$ on an +,M =+V Storage S%stem Separatestorage volumes are allocate$ .ithin the =+V for the $ata(ase an$ storage pools as $escri(e$ in the section.hich follo.
+,M =+V Storage S%stem >2"10#A18?
o 1T, SATA 92 $rives
o S%stem soft.are level 1028e
o A single storage pool hol$s all of the volumes for the TSM server
o 2 8(ps fi(re channel connections to the SA' fa(ric
3 3 3 Disk for TSM data'ase 1 70, volume for the TSM server instance $irector%
1 159, volume for the TSM server active log
1 886, volume for the TSM server archive log
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 17 of 2"
http://www.redbooks.ibm.com/redpapers/pdfs/redp4639.pdfhttp://www.redbooks.ibm.com/redpapers/pdfs/redp4639.pdf -
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
16/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
8 279, volumes for the TSM $ata(ase
3 3 3 2 Disk for TSM storage pools 9 8107, volumes for the TSM storage pool
3 4 7et*ork overvie*VM (ac*ups involve t.o $ata paths During (ac*up- the $ata is transferre$ from the $atastores to thevStorage ,ac*up Server- then from the vStorage ,ac*up Server to the TSM server +n this architecture- $atafrom vStorage ,ac*up Server to the TSM server is all 4A'#(ase$ using a 1( connection Data from the$atastores to the vStorage ,ac*up Server is transferre$ using $ifferent transports The SA' transport isuse$ for a ma@orit% of the virtual machines The ',D >4A'? transport is use$ for a small su(set of virtualmachines .hich resi$e on local $atastores
The storage net.or* is a 8( fi(re channel s.itche$ fa(ric The TSM server has a total of t.o fi(re channel
ports .hich are Cone$ to see the +,M =+V $is*s The vStorage ,ac*up Server contains t.o fi(re channelports Cone$ in the SA' .ith access to the VM.are storage
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 16 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
17/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
.! S$stem configuration detailsThe sections .hich follo. provi$e $etaile$ information on ho. the ma@or components of the samplearchitecture .ere configure$
4 vStorage 'ackup server configurationThe vStorage ,ac*up Server is configure$ to use multiple (ac*up sessions- .ith limits to the num(er ofsessions to use for each host an$ $atastore ,oth compression an$ client#si$e $e$uplication are ena(le$ne $atamover no$e (ac*s up VM.are $ata to a $atacenter no$e The incremental#forever (ac*up strateg%is use$- .hich reBuires a single $ail% (ac*up sche$ule on the TSM server
The SA' fa(ric
4 Operating system details Microsoft in$o.s 200" &2 68 (it
I4ogic i(re )hannel A$apter $river 18"
The SA' fa(ric has (een Cone$ an$ $is* su(s%stem volumes assignments ma$e so that thevStorage (ac*up server has access to the volumes hol$ing VM.are $atastores
Important
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
18/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
4 3 TSM options file T serer connection optionsT77+&&7 iossadec"m!compan!"comT-7T 1500+-7&+ ,enerate(-&(+ dmimmortal640
c;edulin, and lo,sTD fullT-7T7+(-7T san:nbd
#ackup scope&-+=("B>?? ET7FT. lusterG&"&=* E)in200864 . medicE E&"&=* E)in200864 . medicE E
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
19/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
$omainvmfullKKVaries $epen$ing onenvironmentKK
Specifies the scope of the (ac*up 'ote:this can also (e specifie$ as part of thesche$ule $efinition on the TSM server
no$ename $mJimmortalJ680
The $atamover no$e use$ forauthentication 'ote: that the asno$e to
.hich (ac*ups are store$ is specifie$ aspart of the sche$ule $efinition on theTSM server
vm(ac*upt%pe fullvm,ac*s up VMs as single entities- reBuire$for incremental forever (ac*ups
vmchost overlor$m%compan%com 3ostname of the Virtual )enter
vmcuser a$ministrator VM.are a$min user name
vmena(letemplate(ac*ups %es Allo. (ac*up of VM.are templates
vmlimitper$atastore 7
Each $atastore has- at most- 7 VMs
(eing (ac*e$ up in parallel
vmlimitperhost 7Each ES= or ES=i server has- at most- 7VMs (eing (ac*e$ up in parallel
vmmaparallel 50VM (ac*ups uses up to 50 parallelsessions
vmprocessvm.ithin$epen$ent %es
,ac*up VMs that contain in$epen$ent$is* volumes 3o.ever- the in$epen$ent$is*s are not inclu$e$ as part of the VM(ac*up
vmprocessvm.ithpr$m %es
,ac*up VMs that contain &DM volumesin ph%sical compati(ilit% mo$e 3o.ever-
the p&DM volumes are not inclu$e$ aspart of the VM (ac*up
vmvstortransport san:n($Attempts to use san transport first +f it$oes not .or*- then fall (ac* to n($>4A'? transport
4 4 Service configurationThe follo.ing comman$s create a )AD#manage$ sche$uler service an$ remote client agent service )hangeinto the TSM client installation $irector%:
set &&=7Fc:Apro,raL1AtioliAtsmAbaclient
dsmcutil install sc;eduler /name:ET c;ed immortalE /optfile:&&=7Adsmimmortal"opt /autostart:no /pass)ord:pass)ord1 /errorlo,:&&=7Adsmerrorimmortal"lo, /sc;edlo,:&&=7Adsmsc;edimmortal"lo, /startno):no /node:dmimmortal640
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 1 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
20/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
dsmcutil install cad /name:ET +& immortalE /cadsc;edname:ET c;ed immortalE/optfile:&&=7Adsmimmortal"opt/autostart:!es /pass)ord:pass)ord1 /startno):no /node:dmimmortal640
dsmcutil install remote /name:ET +,ent immortalE /optfile:&&=7
Adsmimmortal"opt /partnername:ET +& immortalE /pass)ord:pass)ord1 /startno):no /node:dmimmortal640
4 5 Schedule configurationThe follo.ing comman$s on the TSM server creates a $ail% +ncremental orever (ac*up sche$ule that startsat mi$night The AS'DE option $irects the (ac*up $ata into the $atacenter no$e D)J)4+E'TDED;!There is no reBuirement to create a separate sche$ule to perform full (ac*ups The TSM client automaticall%performs the initial full (ac*up for machines .hich have not (een previousl% (ac*e$ up
&B=( ? mdomain &+=?D=&(=% >#+T=-(F -T=-(FM.mfullt!peFstor .mbackupt!peFfull NmodeFifincr NasnodenameFdcclientdedupM
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
21/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
&egister $atamover no$ere,ister node dmimmortal640 pass)ord1 domainFmdomain
rant pro% authorit%,rant pro! tar,etFcoerlord a,entFdcclientdedup'mclioerlord,rant pro! tar,etFdcclientdedup a,entFdmimmortal640'mclioerlord
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 21 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
22/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
4..# vmcliprofile options file
OOO ?=?=T7+ (-T77(+ iossadec"m!compan!"comT77-7T 1500 P .pT?=(-&(+ mclioerlord(T7(-&(+ coerlordPT7+B=? tsmcli"trace P . tsmcli trace filePT7+B?+% api apidetail P .! trace fla,s&+T+(T7(+ +7 ?ab::dcclientdedup?=T+*H=7+T=-(T= 864000 P in seconds' defaultsto 864000s F 10 da!s?=7T-7T+*H=7+T=-(T= 2592000 P in seconds' defaultsto 2592000s F 30 da!s?=%7+7=-& 2592000 P in seconds' defaultsto 2592000s F 30 da!s
?=?7=(T7+? 60 P in seconds' defaultsto 1s?=
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
23/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
4 3TSM Server (onfiguration
The follo.ing sections summariCe configuration changes that .ere ma$e to soft.are components afterinstallation
4 3 Operating system tuning changesThe follo.ing A+= operating s%stem settings .ere change$ on the test s%stem:
Ena(le +/ completion portsc;de .l iocp0 .
Tune har$ $is*s use$ for TSM $ata(ase- logs- an$ storage pool volumes The comman$s (elo. .ererepeate$ for all $is*s use$ for the TSM $ata(ase an$ storage pools
c;de .l ;disk2 .a matransferF0100000c;de .l ;disk2 .a ueuedept;F32
Several configuration choices .ere ma$e relative to the volume manager an$ file s%stems The follo.ingoptions are reflecte$ in comman$s .hich follo. in a later section:
Volume groups are create$ as the ,ig#t%pe
NS2 file s%stems are use$
ile s%stem logs are not create$ as in#line
ile s%stems are mounte$ .ith the release#(ehin$ >r(r.? option for file s%stems use$ (% the
archive log an$ file storage pools
4 3 2 D' configuration changes'o a$$itional configuration changes .ere ma$e to D,2 (e%on$ .hat the TSM installation an$ $ata(aseformatting perform automaticall% The follo.ing TSM comman$ .as use$ to format the $ata(ase:
dsmser .o /tsminst1/dsmser"opt .i /tsminst1 formatdbdirF/tsmdb01'/tsmdb02'/tsmdb03'/tsmdb04 actielo,siJeF122880actielo,dirF/tsmactlo, arc;lo,dirF/tsmarc;lo,arc;failoerlo,dirF/tsmarc;fail
The follo.ing D,2 level is currentl% installe$:
9"$"0"6E' Es120516E' E=23321E' and Bi ack @6C"
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 25 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
24/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
4 3 3 $olume manager and file system configuration1 )reate volume groups for the $ata(ase- $ata(ase logs- an$ storage pools >several a$$itional volumegroups are create$ for file storage pools .hich are not sho.n?
mk, .# .! tsmdb ;disk2 ;disk3 ;disk4 ;disk5mk, .# .! tsmactlo, ;disk6mk, .# .! tsmarc;lo, ;disk$mk, .# .! tsmfile ;disk8 ;disk9 ;disk10 ;disk11 ;disk12 ;disk13 ;disk14
2 )reate logical volumes an$ file s%stems +n some cases repeate$ comman$s have (een omitte$'ote the pp siCe counts use$ in %our environment .ill var% $epen$ing on the ph%sical volume siCe The r(r.mount option has (een sho.n to improve performance for storage pool volumes- archive log volumes- an$file s%stems use$ for TSM $ata(ase (ac*ups to $is* After file s%stems are create$ an$ mounte$- (e sure toassign o.nership to the user i$ .hich .ill (e use$ as the TSM $ata(ase instance i$
D, volumes:mkl .! tsmdb01 .t jfs2 .u 1 . 950 tsmdb 950 ;disk2crfs . jfs2 .d tsmdb01 .p r) .a a,blksiJeF4096 .m /tsmdb01 .+ !esS U Omkl .! tsmdb04 .t jfs2 .u 1 . 950 tsmdb 950 ;disk5crfs . jfs2 .d tsmdb04 .p r) .a a,blksiJeF4096 .m /tsmdb04 .+ !es
Active log:
mkl .! tsmactlo, .t jfs2 .u 1 . 511 tsmactlo, 511 ;disk6crfs . jfs2 .d tsmactlo, .p r) .a a,blksiJeF4096 .m /tsmactlo, .+ !es
Archive log:mkl .! tsmarc;lo, .t jfs2 .u 1 . 831 tsmarc;lo, 831 ;disk$crfs . jfs2 .d tsmarc;lo, .p r) .a optionsFrbr) .a a,blksiJeF4096.m /tsmarc;lo, .+ !es
SeBuential file storage pool:
mkl .! tsmfile1 .t jfs2 .u 1 . 3823 tsmfile 3823crfs . jfs2 .d tsmfile1 .p r) .a optionsFrbr) .a a,blksiJeF4096 .m /tsmfile1.+ !esS U Omkl .! tsmfile$ .t jfs2 .u 1 . 3823 tsmfile 3823crfs . jfs2 .d tsmfile$ .p r) .a optionsFrbr) .a a,blksiJeF4096 .m /tsmfile$
.+ !es
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 28 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
25/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
4 3 4 TSM server processing optionsThe follo.ing ta(le summariCes TSM server options .hich are set in $smservopt- as .ell as- server#.i$eoptions .hich have (een set using various setcomman$s on the TSM server
)ptions >dsmserv!opt? Setting E=planation
activelogsiCe 122""0Slightl% (elo. the maimum allo.e$ activelog siCe
allo.reorgta(le $efault: %es Allo.s on#line D,2 ta(le reorg to run
allo.reorgin$e %es Allo.s on#line D,2 in$e reorg to run
client$e$uptnlimitDefault: 500 4imit o(@ects using client#si$e $e$uplication
to 500,
commtimeout 10000)ertain TD!s (enefit from an increase$setting for this timeout
$e$up$eletionthrea$s "+ncreases the num(er of threa$s performing$eletion of $e$uplicate$ chun*s .hich areno longer reference$
$e$upreBuires(ac*up 'oA secon$ar% cop% is not (eing create$ inthis implementation
$e$uptier2filesiCe Default: 100nl% files smaller than 100, areprocesse$ in tier1
$e$uptier5filesiCe Default: 800iles in the range 100 # 800, .ill (eprocesse$ in tier2 iles 800, an$ larger.ill (e processe$ in tier5
$evconf /tsminst1/DEV)'tt)ontrols .hich file the server $eviceconfiguration information is copie$ to
ena(leauto$((ac*up noA full $ata(ase (ac*up is onl% ta*en once a$a% an$ the% are sche$ule$
epinterval 0This $isa(les automatic inventor%epiration +nstea$- this tas* is sche$ule$to run at a specific time ever% $a%
i$letimeout 280Allo.s i$le client sessions to remainthrough the epecte$ (ac*up .in$o.$uration
masessions 900)lients .hich use client#si$e $e$uplicationuse one a$$itional session
numopenvolsallo.e$ 20 This option controls the num(er of volumesthat a process such as a reclamationprocess or client restore sessions can hol$open at the same time A small increase to
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 27 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
26/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
this option is recommen$e$- an$ some trialan$ error ma% (e nee$e$ The $evice classmount limit parameter .as also increase$(ecause of this change
server$e$uptnlimit 700
4imit o(@ects using server#si$e
$e$uplication to 700,
tngroupma Default: 806 Allo.s more client o(@ects per transaction
volhist /tsminst1/V43+STtt)ontrols .hich file the server volume histor%is .ritten to
Set options (ommand 7otes
Activit% log retention set actlogreten 60
Summar% recor$ retention set summar%reten 87
Ma sche$ule session set masche$sess 0 +ncreases the percentage of allo.e$sessions .hich can (e use$ for sche$ule$(ac*ups
4 3 5 Device class creationA $evice class must (e create$ for the seBuential file $e$uplication storage pool f particular importance isthe mountlimitparameter .hich nee$s to (e set to a large value to account for all of the simultaneousvolumes mounts $rive (% multi#session $e$uplicate$ VM.are (ac*ups
seBuential file
O define declass lar,efile1 detFfile mountlimitF650 macapF102400dirF/tsmfile1'/tsmfile2'/tsmfile3'/tsmfile4'/tsmfile5'/tsmfile6'/tsmfile$
4 3 6 Storage pool creation,elo. is the comman$ use$ to create the $e$uplicate$ file storage pool The options controlling reclamation-migration- an$ $uplicate i$entification are set to $isa(le the automatic launching of these tas*s +nstea$- thetas*s are sche$ule$ to run at specifie$ times as $etaile$ in a later section
$e$uplicate$ seBuential file
O define st,pool mpool lar,efile1 mascratc;F29$ deduplicateF!esidentif!processF0 reclaimF100 reclaimprocessF8 collocateF,roup netst,poolFCC
4 3 7 Policy settingsThe teste$ architecture inclu$es a polic% $omain create$ for VM.are (ac*ups .hich retains 87 $a%s .orth of(ac*ups assuming onl% one (ac*up is ta*en per $a% The verexistsparameter is set to a value of nolimitsothat a$#hoc (ac*ups ta*en .ill no roll off an earlier (ac*up prior to 87 $a%s elapsing
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 26 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
27/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
The vm$om $omain provi$es 87 $a%s of (ac*up retention an$ uses the $e$uplicate$ storage pool targetAlthough it is $efine$- the archive cop% group is not use$
O define domain &-O define polic! &- T+(&+7&O define m,mtclass &- T+(&+7& T+(&+7&
O assi,n defm,mt &- T+(&+7& T+(&+7&O define cop!,roup &- T+(&+7& T+(&+7& t!peFbackup destinationF--?7Fnolimit 7&F1 7TF45 7T-F120O define cop!,roup &- T+(&+7& T+(&+7& t!peFarc;ie destinationF--?7TF1000O actiate pol &- T+(&+7&
4 3 8 Schedules and macro definitions to control server maintenancetasks
The follo.ing section sho.s ho. to configure TSM to sche$ule $ata maintenance tas*s to follo. the (est
practices of separating (ac*up ingestion from $ata maintenance The recommen$e$ or$ering is eplaine$(elo.- along .ith eamples of comman$s to implement these tas*s through sche$uling
3ere is the implemente$ seBuence of tas*s:
1 22:00 # 09:00 )lient $ata ingestion
2 09:00 # 0":00 &emove o(@ects that have ecee$e$ their allo.e$ retention using the E=!+&E+'VE'T&O comman$
5 0":00 # 12:00 !erform server#si$e $uplicate i$entification (% running the +DE'T+O D;!4+)ATEScomman$ This processes $ata that .as not alrea$% $e$uplicate$ on the clients .hich is t%picall%not reBuire$
8 18:00 # 20:00 &eclaim unuse$ space from storage pool volumes that has (een release$ through$e$uplication an$ inventor% epiration using the &E)4A+M ST!4 comman$
7 19:00 # 1":00 )reate a D& cop% of the TSM $ata(ase (% running the ,A);! DATA,ASEcomman$ ollo.ing the completion of the $ata(ase (ac*up- the DE4ETE V43+ST&O comman$is use$ to remove ol$er versions of $ata(ase (ac*ups .hich are no longer reBuire$ At completionof the (ac*up- the volume histor% an$ $evice configuration are (ac*e$ up using the ,A);!V43+ST&O an$ ,A);! DEV)'+ comman$s
4 3 8 Define scripts *hich run each re@uired maintenance taskThe follo.ing scripts are $efine$ to perform the $ata maintenance tas*s- an$ invo*e$ via sche$ule$a$ministrative comman$s
def script &&> E/ 7un identif! duplicate processes /Eupd script &&> Eidentif! duplicates B=?--? numprocessF4 durationF360ElineF010
set dbrecoer! #& numstreamsF1define script #+*> E/ 7un backups /Eupdate script #+*> Ebackup db declassF#& t!peFfull )aitF!esEnumstreamsF1 lineF010
Document: Tivoli Storage Manager for Virtual Environments Sample Architecture Date: 11/16/2012Version: 10
!age 29 of 2"
-
8/22/2019 TSM for VE Sample Architecture - v1.0.pdf
28/28
Tivoli Storage Manager for Virtual Environments Sample Architecture
update script #+*> Ebackup ol;istor!E lineF020update script #+*> Ebackup deconfi,E lineF030update script #+*> Edelete ol;istor! t!peFdbbackup todateFtoda!.$totimeFno)E lineF040
define script 7?+= E/ 7un st, pool reclamation /Eupdate script 7?+= Ereclaim st,pool --? t;res;oldF40 )aitF!esE lineF010
define script H=7 E/ 7un epiration processes" /Eupdate script H=7 Eepire inentor! resourceF8 )aitF!esE lineF010
4 3 8 2 Define schedules to run the data maintenance tasksThe follo.ing comman$s $efine a$ministrative sche$ules .hich eecute the scripts .hich .ere create$ in theprevious section
define sc;edule &&> t!peFadmin cmdFErun &&>E actieF!es AdescFE7un indentif! duplicates"E startdateFtoda! starttimeF08:00:00 A
durationF15 durunitsFminutes periodF1 perunitsFda!
define sc;edule #+*> t!peFadmin cmdFErun #+*>E actieF!es AdescFE7un database backup"E startdateFtoda! starttimeF1$:00:00 AdurationF15 durunitsFminutes periodF1 perunitsFda!
define sc;edule 7?+= t!peFadmin cmdFErun 7?+=E actieF!es AdescFE7eclaim space from stora,e pools"E startdateFtoda! starttimeF14:00 AdurationF15 durunitsFminutes periodF1 perunitsFda!
define sc;edule H=7+T=-( t!peFadmin cmdFErun epireE actieF!es AdescFE7un epiration"E startdateFtoda! starttimeF0$:00:00 AdurationF15 durunitsFminutes periodF1 perunitsFda!
PEn$ of $ocumentQ