backup and recovery best practices - afcea · 2011-08-23 // backup and recovery best practices...
TRANSCRIPT
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Backup and Recovery Best Practices
Session: 3
Track: ELA Services
Skip Farmer
Symantec
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 2
Backup System Infrastructure 1
Isolating Performance Issues 2
Virtual Machine Backups 3
Reporting - Opscenter Analytics 4
Support Tools 5
2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Building solution is “easy”
1. Determine Requirements
2. Do the Math
3. Build the solution to fit the math
4. Baseline
3 Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Basic understanding of the entire backup data path is important in determining maximum obtainable performance
Poor performance can be the result of unrealistic expectations and / or poor planning
Every backup environment has a bottleneck. It may be a very fast bottleneck, but it will determine the maximum performance obtainable with your system
4 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Break down infrastructure into smallest possible segments
Determine exactly where the bottlenecks are in your environment
Understand the limitations your current backup system
5
How can I characterize what performance my environment is capable of?
2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 6
Storage to be tested might be anywhere •Clients
•Server (catalogs)
Understand capabilities of each component
Use the 70% rule to determine throughput
NetBackup client
Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 7
HBA and Connection type (SCSI, FC, iSCSI) important considerations: •Determine what variety is used to
determine throughput
•FC 2Gb/s, FC 4Gb/s, FC 8Gb/s
Use the 70% rule to determine throughput
NetBackup client
Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 8
NetBackup Media server
NetBackup client
• Understand the network infrastructure
• Switches
• Firewalls
• 1 GbE / 10 GbE
• Many components can cause network throughput issues
• Firewall rules
• DNS issues
• Incorrect/outdated network drivers
Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Many sites are looking to replace tape with disk
ATA is a cheap alternative
iSCSI/NAS are additional alternatives
Be sure to understand the performance differences
What is your site considering?
9
Media Server Dedupe Pool
NetBackup Media server
2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
NOT all data de-duplicates at the same rate
Places to de-duplicate: • Source
• Target
• Appliances
Enables advanced features to create a DR copy.
Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 10
Deduplication Plug-in
NetBackup client
PureDisk Pool
NetBackup Media server
Media Server Dedupe Pool
Local Disk
Meta data
Control communication
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Additional Considerations for Disk •To de-duplicate or not to de-duplicate
•Disk Fragmentation
•Anti-Virus settings
•Block-Size
•File Compression
•Disk array configuration RAID type
Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 11
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Total Dataset Size: •How much data will be backed up?
•Approximate amount of data change?
Data Type: •Types of data – text, graphics, database
•How compressible?
•Number of files?
12 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 13
Step Description
1 Calculate the rate of transfer that Backups must achieve to complete a backup of all your data in the allowed time window.
2 Decide what kind of tape drive technology meets your needs by calculating how long it takes to back up to tape.
3 Calculate how many tape drives are needed.
4 Calculate how long it takes to back up to disk.
5 Calculate how long it takes to move data over the network.
6 Calculate how much disk space is needed to store the catalog.
7 Calculate how many tapes are needed to store and retrieve your backups
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Baseline versus Performance Test
To run a performance test:
1. Check and make sure no other jobs are running
2. Submit the job to run now or manual backup
3. Check for non-backup activity on the server during the perf test
4. Re-check activity monitor for other activity that may have occurred during the test (such as Restore)
Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 14
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Master Servers – High CPU requirement, lower I/O As a general guideline, a Master should have multiple physical CPU’s and lots of
RAM
Media Servers – High I/O - Lower CPU requirement As a general guideline, any Media Server should have PCIExpress BUS
“What Master and Media Servers Should I Buy To Run NetBackup?”
15 Backup and Recovery Best Practices
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
How much disk space is needed on the Master? • Assume 120 bytes per backed up file and use 1.5 multiplier for growth and error
Example • 100 systems with 100,000 files on each backed up FULL daily • 100 systems * 100,000 files * 30 backups = 300,000,000 files total • 300,000,000 * 120bytes = 36,000,000,000 bytes = 36GB to store this much in the
catalog Use this with Retention to determine long term catalog needs with the 1.5
multiplier
• Use the 2% rule Total data tracked * 2%
• If you are backing up 3TB of data based on fulls, incrementals, and retention then catalog space needed is 60GB
• Using a disk manager so Catalog can grow on the fly is very important • Typically when catalog hits 1TB it is time to split (or sooner)
16 Backup and Recovery Best Practices
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Determine if you are using appliance versus traditional
If traditional - •Generally more RAM is needed for the media server
•What else is running?
•NetBackup uses shared memory for local backups Buffer tuning is critical
Buffers use shared memory – a finite resource
To determine how much memory is being used use this formula • (buffer_size * number_buffers) * number of drives * MPX
Defaults • Size = 65536 (64 * 1024)
• Number = 30
17 Backup and Recovery Best Practices
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 18
Auto Image Replication for DR readiness
Fiber Transport media server support
New! Cloud Gateway
2. Data Center backups
NetBackup 5220
1. Remote office
backups Integrated tape out
Integrated replication
NetBackup 5220
3. VM backups
ESX
To OST Cloud
If Appliance – Use information from calculations to determine required space and throughput
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 19
FC
Dedupe processing
Standard Data Transfer over IP
Standard Data Transfer over FC
Optimized Transfer over IP
1GigE
•Any or all 1GigE ports can be bonded together to create a larger pipe
10GigE
•10GigE ports may be bonded together to create a larger pipe
8Gb FC
•Use when replacing physical/virtual tape libraries with NetBackup appliances
•Convert application clients configured as SAN media servers to SAN clients, thereby reducing the backup application resource footprint
SAN Clients
LAN Clients (target)
NetBackup 5220
LAN Clients (source)
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
NetBackup Buffers for Disk and Tape •SIZE_DATA_BUFFERS_DISK
•NUMBER_DATA_BUFFERS_DISK
•SIZE_DATA_BUFFERS
•NUMBER_DATA_BUFFERS
NetBackup Network Buffers •NET_BUFFER_SZ
These are only a few buffer settings – use with care and guidance
Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 20
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
NDMP backups
Enterprise Vault backups
SAN Client
Storage LifeCycle Policies
Data De-Duplication
Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 21
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 22
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Determine restore requirements
Determine type of applications in the VM’s
Determine infrastructure •Number of virtual machine hosts
•Number of ESX/Hyper-V systems
Determine data flow •Network
•SAN
•ETC
Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 23
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Enhanced Integration with VMware •Provide the ability to automatically find and select
VM’s. •Provide the ability to throttle backups based on
resources. •Enhance existing manual selection to show clusters
and vApps. Filters can be based on virtual machine attributes •Backup all the machines in Power On state •Backup all the machines where OS type is Windows
2008 •Backup all the virtual machines for which display
name starts with VMprod
24 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
25 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 26 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 27 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 28
Select from over 25 available VMware / vCenter / VM / ESX attributes
2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
29 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
30 30
VMware •Single File Recovery from Full or BLIB backup (vSphere APIs)
•File Level Incremental Backup and Restore (vSphere APIs)
•Do the right type of backup for the right type of recovery
Generate mapping information for Linux VMs for Single File Restore
2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 31
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Dashboards for your environment
Current version – 7.1.0.1
Sizing – •Recommend a separate server or VM
•Memory and CPU for objects being managed
•Disk Space
Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 32
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 33
Example Jobs report
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 34
Have an idea of what you want to report on
Begin with a report template
Edit to customize the report
Schedule reports
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 35
Example of a custom report
Success ratio by day
Can schedule this
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 36
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 37 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 38 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED 39
A standalone tool that diagnoses many common issues found in Backup Exec,
Backup Exec System Recovery and Symantec System Recovery environments
(TECH126539)
2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Best Practices for Backup Exec 2010 – HOWTO21797
Best Practices for Backup Exec 2010 and LiveUpdate – HOWTO21779
Backup Exec 2010 R3 Revision 5204 Hotfix 162820 – TECH162830
40 2011-08-23 // Backup and Recovery Best Practices Session: 3, Track: ELA Services
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED
Late Breaking News - TECH153422
Symantec NetBackup™ 7.0 - 7.1 Backup Planning and Performance Tuning Guide - DOC4483 •http://www.symantec.com/docs/
Put TECH#### or DOC#### to go right to the information
Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 41
LANDWARNET 2011 TRANSFORMING CYBER WHILE AT WAR UNCLASSIFIED
UNCLASSIFIED Session: 3, Track: ELA Services 2011-08-23 // Backup and Recovery Best Practices 42
Skip Farmer
Copyright © 2010 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.
Thank you!