upgrade & ndmp

38
Hana Shparber ,Ben-Gurion University Israel [email protected]

Upload: -

Post on 07-Jul-2015

194 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Upgrade & ndmp

Hana Shparber ,Ben-Gurion University [email protected]

Page 2: Upgrade & ndmp

Ben-Gurion University of the Negev was established in 1969 with the aim to bring development to the Negev, a desert area comprising more than sixty percent of the country. The University was inspired by the vision of Israel's first Prime Minister, David Ben-Gurion, who believed that the future of the country lay in this region.

Today, Ben-Gurion University is a major center for teaching and research with campuses in Beer-Sheva, as well as in Eilat and Sede Boqer, where Ben-Gurion lived in his final years and is buried.

Page 3: Upgrade & ndmp
Page 4: Upgrade & ndmp

Upgrade V 5.5.4 to V 6.1.3 to

New server using Replicated server

Server A V 5.5.4

Server CNew 6.1.3

Server BReplica of

A)) V 5.5.4

Page 5: Upgrade & ndmp

Server A:1.Backup Database2.Halt TSM Instance

Server B Replicate and restore a new computer:1.Install Tsm (v 5) And Upgrade tool.2.Copy from A volhist.out , devcnfg.out3.Restore the Database to B:

• Create new DBDsmserv –k ServerX format 1 E:\tsmdata\Libserver\log1.dsm 2048 1 E:\tsmdata\Libserver\db1.dsm 10240• Restore DBDsmserv –k ServerX restore db todate=today ( p=y to preview )ORDsmserv –k ServerX restore db todate=today source=dbs

4. Start the instance and make sure everything is correct

Page 6: Upgrade & ndmp

Server C:1. Install Tsm 6.1.42. Create new instance (With management console , choose minimal configuration)3. Backup the new Instance to check that it works.4. Remove the new (empty) databaseDsmserv –k serverX –o c:\program Files\tivoli\tsm\serverX\dsmserv.optremovedb TSMDB1

Check that the archive dir is empty

5. Create empty DataBaseDsmserv –k serverX –o c:\program Files\tivoli\tsm\serverX\dsmserv.opt loadformat

dbdir=”d:\TSM\TSM_LIBSERVER ACTIVELOGSIZE=4096 ACTIVELOGDIR=”c:\....” ARCHLOGDIR=…..

When creating new DB new file dsmserv.dbid is created in the instance directory.

Page 7: Upgrade & ndmp

Upgrade:1.Server b C:\program Files\Tivoli\TSM\upgrade\dsmupgd –k serverX preparedb 1>>prepare.out 2>&1

Page 8: Upgrade & ndmp

2. Server CDsmserv –k serverX –o c:\program Files\tivoli\tsm\serverX\dsmserv.opt insertdb sesswait=60 1>>insert.out 2>&1

ANR0408I Session 1 started for server $UPGRADESOURCE$ (Windows) (Tcp/Ip) forV6 Database Upgrade. ANR1379I INSERTDB: Read 19,773 bytes and inserted 216 database entries in0:00:00 (0.00 megabytes per hour).ANR1379I INSERTDB: Read 937,620,088 bytes and inserted 6,532,050 databaseentries in 0:05:00 (10728.00 megabytes per hour).ANR1379I INSERTDB: Read 1,315,456,389 bytes and inserted 9,169,137 database….ANR1379I INSERTDB: Read 6,277,318,329 bytes and inserted 43,395,277 databaseentries in 1:00:00 (5986.00 megabytes per hour).ANR0136I Table updating statistics performed successfully for 4 of 4.ANR1524I INSERTDB: Beginning database update phase.ANR1525I INSERTDB: Updated 0 of 13,534,917 database entries in 0:05:18.ANR1525I INSERTDB: Updated 13,534,917 of 13,534,917 database entries in0:14:53.ANR1395I INSERTDB: Process 1, database insert, has completed.ANR1397I INSERTDB: Found 61 database objects.ANR1398I INSERTDB: Processed 61 database objects.ANR1399I INSERTDB: Failed to process 0 database objects.ANR1517I INSERTDB: Processed 43,395,277 database records.ANR1518I INSERTDB: Read 6,277,318,329 bytes.ANR1519I INSERTDB: Elapsed time was 1:29:45.ANR1445I INSERTDB: Throughput was 4001.78 megabytes per hour.ANR1446I RUNSTATS: Table updating statistics started.ANR0136I Table updating statistics performed successfully for 117 of 117.ANR1528I RUNSTATS: Table updating statistics completed in 0:11:37.

ANR0369I Stopping the database manager because of a server shutdown.

Page 9: Upgrade & ndmp

3. Server BC:\Program Files\Tivoli\Tsm\upgrade\dsmupfgrd –k serverX extractdb hladdress=132.72.137.40 lladdress=1600 1>>extract.out 2>&1

ANR1392I EXTRACTDB: Extracted 42,938,965 database entries in 2,552,644 pagesand wrote 6,218,866,238 bytes in 0:50:00 (7116.00 megabytes per hour).ANR0409I Session 2 ended for server $UPGRADETARGET$ (Windows).ANR1382I EXTRACTDB: Process 1, database extract, has completed.ANR1383I EXTRACTDB: Found 120 database objects.ANR1384I EXTRACTDB: Processed 61 database objects.ANR1385I EXTRACTDB: Skipped 59 empty database objects.ANR1386I EXTRACTDB: Failed to process 0 database objects.ANR1387I EXTRACTDB: Processed 43,395,277 database records.ANR1388I EXTRACTDB: Read 2,580,435 database pages.ANR1389I EXTRACTDB: Wrote 6,277,318,261 bytes.ANR1390I EXTRACTDB: Elapsed time was 0:50:20.ANR1391I EXTRACTDB: Throughput was 7135.63 megabytes per hour.

Server C detailes

Page 10: Upgrade & ndmp

4. Server C• Bring up the Instance

Dsmserv –k ServerX• Check that all is well

Page 11: Upgrade & ndmp

Upgrade V 5.5.4 to V 6.1.3 On the production server

Server A V 5.5.4

Page 12: Upgrade & ndmp

Server A:1.Preparing a disk for the upgraded data base and logs2.Backup Database3. Halt TSM Innstance4.Cold backup of Tsm installation and database.5. If you have Mirror take one disk from the mirror and save it6. Install Upgrade tool.

Page 13: Upgrade & ndmp

7. Change the server instance in order to leave server1 instance free to version 6 Example: changing server1 to server4

• Rename the dir from server1 to server4• "c:\Program Files\Tivoli\TSM\upgrade\dsmupgrd" -k

server4 update• Check registry keys with regedit

HKEY_LOCAL_MACHINE -> SOFTWAER -> IBM -> ADSM -> CurrentVersion -> SERVER -> SERVER1rename server1 to server 4

• Check the new instance and then Halt it.Cd c:\Program Files\Tivoli\tsm\server4..\server\dsmserv –k server4 –o C:\Program files\tivoli\tsm\server4\dsmserv.opt

Page 14: Upgrade & ndmp

8. From the server4 directory prepare the databaseC:\program Files\Tivoli\TSM\upgrade\dsmupgd –k server4 preparedb 1>prepare.out 2>&1

check in the output file prepare.out the line Database upgrade completed successfully9. Uninstall tsm 5Uninstall the V5 server, server license, and device driver. Do not remove the database, recovery log, or any other related files or directories, such as the server options file.Do not remove registry entries for the server.Click Start > Control Panel > Add or Remove Programs. Select the Tivoli® Storage Manager component, then click Remove. Repeat for the license and the device driver.

10. Install Tsm 6

Page 15: Upgrade & ndmp

11. Create new instance and database• Create new instance• Backup the new Instance to check that it works.• Remove the new (empty) databaseDsmserv –k serverX –o c:\program Files\tivoli\tsm\serverX\dsmserv.optremovedb TSMDB1

Check that the archive dir is empty

• Create empty DataBaseDsmserv –k serverX –o c:\program Files\tivoli\tsm\serverX\dsmserv.opt

loadformat dbdir=”d:\TSM\TSM_LIBSERVER ACTIVELOGSIZE=4096 ACTIVELOGDIR=”c:\....” ARCHLOGDIR=…..

When creating ne DB ne file dsmserv.dbid is created in the instance directory.

Page 16: Upgrade & ndmp

12. Extract and Insert Database• Dsmserv –k server1 –o c:\program Files\tivoli\tsm\serverX\dsmserv.opt

insertdb sesswait=60 1>insert.out 2>&1• C:\Program Files\Tivoli\Tsm\upgrade\dsmupfgrd –k server4 extractdb

hladdress= 127.0.0.1 lladdress=1600 1>extract.out 2>&1

Insert and Extract lasted 20 hours for 90Gb database

Page 17: Upgrade & ndmp

Upgrade V 6.1.4.3 to V 6.2.2.2 On the production server

Server A V 6.1.4.3

Page 18: Upgrade & ndmp

1. Check the instance user and groupNet user db2user1 */addNet localgroup Administrators db2users1 /addNet localgroup DB2ADMNS db2user1 /addNet localgroup DB2USERS db2user1 /add(You must create a User Id and Group that will be the owner od the TSM server instance)

2. Before starting the upgrade, rename the instance file. The instance file (Instance.dat) is in the Tivoli Storage Manager server installation directory

3. For every instance : db2\bin\db2idrop InstanceName

3. Install with installation wizard 6.2.2.24. Install the license from 6.2.1

Page 19: Upgrade & ndmp

5. For every instance:(If the instances is running whit different users logout and log in with the instance user before starting *5)

• Open cmd cd c:\Program Files\Tivoli\TSM\db2\bin

• Create the instance ( It’s DB2 instance )db2\bin\db2icrt server2 -u user1,********

• Recreate the variables in the instance fileDB2SET -i server2 DB2CODEPAGE=1208db2\bin\db2set -i server2 "DB2_SKIPINSERTED=ON"db2\bin\db2set -i server2 "DB2_KEEPTABLELOCK=ON"db2\bin\db2set -i server2 "DB2_EVALUNCOMMITTED=ON”db2\bin\db2set -i server2

"DB2_VENDOR_INI=c:\PROGRA~1\tivoli\tsm\server2\tsmdbmgr.env"db2\bin\db2set -i server2 "DB2_SKIPDELETED=ON"db2\bin\db2set -i server2 "DB2INSTPROF=C:\Documents and Settings\All

Users\Application Data\IBM\DB2\DB2TSM1"db2\bin\db2set -i server2 "DB2_PARALLEL_IO=*“

Page 20: Upgrade & ndmp

• Upgrade databasedb2cmdset db2instance=server2Db2startdb2 catalog db tsmdb1 db2 upgrade db tsmdb1Db2stop

• Run and checkcmdcd "c:\Program Files\Tivoli\TSM\server2"..\server\dsmserv -k server2

Page 21: Upgrade & ndmp
Page 22: Upgrade & ndmp
Page 23: Upgrade & ndmp

TSM Server & Netapp

Fas3140HA

Computation center in main campus

Fas3050

DRP building

Scalar I500

Tsm 6.2.2.2

TS3500

1Gb Dark fiber

Fiber switch

Network infrastructure is at 128 MByte (1Gbit) per second.

The main task of the Drp filer is to get the volume’s .copies

Page 24: Upgrade & ndmp

• Netapp volume’s become very large: Large size Large number of files

• Want to save as much as possible history• Want to save Backup space• Want the backup duration will be short• Want to backup DATABASES with Downtime

as short as possible

We use / implement Tsm ndmp backup to get as close as possible to our desire

Page 25: Upgrade & ndmp

Backup netapp with NDMP (Network Data Management Protocol)

How to backup ?

1.Filer to attached library OR (and?) Filer to tsm server2.Full + DIFFerential OR (and?) Snapmirror

TSM 6 gives a variety of backup options for NDMP. we have to decide which option best suits us.

Page 26: Upgrade & ndmp

charts from Administrator's Guide 6.2. We need to decide between NDMP: filer to server or NDMP: filer to attached library. This chart show us the filer attached to Library

Page 27: Upgrade & ndmp

With Ndmp backup over the net you can backup remote filer’s. For us it was a significant advantage. The workload is on the backup storage.

Page 28: Upgrade & ndmp

Administrator's Guide 6.2 page 253-254 These are some of the features of NDMP backup.Features that had the most weight are: Migration and Reclamation.Migration and Reclamation Possible only in filer to server.

Page 29: Upgrade & ndmp

Full + DIFFerential Snapmirror

• Full backups are done on a regular basis, for example, weekly

• In between Full backups, Differential backups copy only files that have changed since last Full backup

SnapMirror to tape dumps all current file data and all snapshot file data from the filer to local tape or filer-to-Tivoli Storage Manager Server

TOC (Table of content) No TOC support

Can restore singe file (with or without TOC) Enables the restore of all Snapshot copies back to the destination system

• Backup with TOC have the benefit of restoring single file without knowing the path of the file. But TOC take place in TSM database’s. Volume with many file’s on it take long time and database grow.

• Over timeThe DIFFerential file backup grow in size and backup time

Page 30: Upgrade & ndmp

Example the difference of month backup with full + differential OR snapmirror

Date Full+differntial Snapmirror01.01.2011 Backup full Take snapshot02.01.2011 Backup differential Take snapshot03.01.2011 Backup differential Take snapshot………31.01.2011 Backup differential Backup

type=snapm

Differential File levelSnapshot block level

At the end of the month the last differential file will be larger then the snapshot from the beginning of the month. In one backup operation you get the all month backups and the backup size will be the volume occupancy size.

Page 31: Upgrade & ndmp

In the tsm we see (occ) of the volume+snapshots. When we have to restore we need the volume size on the netapp.

Page 32: Upgrade & ndmp

The backup speed is between 44MB to 30MB per second

Page 33: Upgrade & ndmp
Page 34: Upgrade & ndmp

Snapmirror:•Continuous period backup for history restore. •Large file systems •Large amount of files• You can combine this method other backup methods.

o Ba client for small /medium volumes for the short time backup

o Snapmirror for history backup

Page 35: Upgrade & ndmp

Setting up ndmp filer backup to tsm server•Create storage pool Type = Primary , Format: Native•Create policy domain Copy Destination: NAS-STG Table of Contents Destination: NAS-STG•Reg node Type=nas•Define datamover node_name type=nas hla=filer_name(or ip) user=root password=***** dataformat=netappdump •Backup & Restore

Page 36: Upgrade & ndmp

Backup & Restore ExamplesBackup node node_name /vol/dataBackup node node_name /vol/data type=snapm

tsm: CC1>restore node eon_sm /tbone_data /vol/restore1 filelist="/ready/copy/20101215/07/smtp-23933-5885E75E-C51A-70F7-02CF-753901C9310F.3" pitdate=12/26/2010

tsm: CC1>restore node eon_sm /vol/hawk2_stg5 /vol/hawk2_stgRestore1 PITD=11/30/2010 type=snapm(The target volume has to be in restricted state and the size has to be at least as the source. With “q fil” we can see what was the original size.)

Page 37: Upgrade & ndmp
Page 38: Upgrade & ndmp