next generation data recovery, tsm6,pcty - ibm · next generation of data recovery with tsm 6 ......

Next Generation of Data Recovery with TSM 6Shawn Jaques, Manager, Tivoli Storage Product Management

© 2009 IBM Corporation

1

Abstract

Tivoli Storage Manager 6 delivers new levels of Scalability, Tiered Recovery, Data Reduction, Windows Recovery, and Server Virtualization support. Add to this Tivoli Storage Manager’s improved time to value and you will see that Tivoli Storage Manager is delivering a new generation of data recovery. This session is a TSM 6 update, going over all the value, solutions and features

2

Agenda

• Leading the way in Storage and Data Management

• Tivoli Storage Manager 6– Improved Scalability, Availability and Performance

– Built in Data Deduplication

– Simplified Management and Deployment

– Improved integration with VMware and NetApp / N series NAS Filers

– Other enhancements

• Conclusion

3

Data Protection and Retention Dynamics

New Data GrowthNew Data Growth

Longer

Retention Periods

Longer

Retention Periods

Cost of DiskCost of Disk

Data Reduction

Technologies

Data Reduction

Technologies

4

Managing Data Through the Lifecycle

Time

Value

Dynamic Data

Persistent Data

Lifecycle of different data types

Protect Delete or ArchiveMove

Protect• Match technology to recovery

objectives and cost

• Consider data in Data Centers, ROBOs, laptops

� TSM cost effectively helps protect

data and manage recovery

across the full environment

Protect• Match technology to recovery

objectives and cost

• Consider data in Data Centers, ROBOs, laptops

� TSM cost effectively helps protect

data and manage recovery

across the full environment

Move• Move data through storage

hierarchy based on policy

• Keep high end disk for high priority applications

� TSM automatically moves

data based on policy to cost

effective tiers

Move• Move data through storage

hierarchy based on policy

• Keep high end disk for high priority applications

� TSM automatically moves

data based on policy to cost

effective tiers

Delete or Archive• Delete unneeded data freeing

capacity

• Archive selected records based on retention policy

� TSM can manage retention of

records to help meet business

and regulatory requirements.

Delete or Archive• Delete unneeded data freeing

capacity

• Archive selected records based on retention policy

� TSM can manage retention of

records to help meet business

and regulatory requirements.

5

Leading the Way in Data Protection and Recovery

Tivoli Storage Manager has been a leader in helping organizations protect, retain and assure availability of their most important asset, their data, for more than 15 years.

Comprehensive Solution

• Backup / Restore

• Archive / Retrieve

• Continuous Data Protection (CDP)

• Disaster Recovery

• HSM / ILM

• Application Protection

• Database Protection

• Bare Machine Recovery

• Robust Remote Office Recovery

• Innovation:

• 1st disk-based backup solution

• optimized over 15 years

• The original data reduction - Progressive Incremental

• Market:

• More than 20,000 loyal customers

• 60% of fortune 500

• Above market growth three consecutive years*

• Unified recovery across:

• The broadest range of OS and HW platforms: from laptop to mainframe

• All storage tiers

* Source: IDC, Jan. 2009 (TBD)

6

Continuing to Lead the Way

Tivoli Storage Manager 6 is designed to address our customers’ most challenging issue: the continuing tidal wave of data growth.

Net Result = Unified Recovery Management

Improved Quality of Service

NewNew Simplified deployment and management

NewNew Improved scalability, availability and performance

NewNew Improved integration with VMware, NetApp and Microsoft

Storage Manager 6

NewNew Built-in Data Deduplication

7

History: Why is TSM’s Internal DB Important?

• From inception Tivoli Storage Manager has managed data with an internal database.– Allows for rapid modification to policies to reflect changes in

regulations or business rules.Example: New requirement that data be retained for 5 years instead of 7.

– Easy policy change in TSM can be applied FORWARD AND BACKWARD

– Helps you easily manage unanticipated changes

• However, there were some costs – More difficult to get reports

– Required some downtime to do periodic database administration

8

What’s New: Integrated DB2 Database

• “Under the covers” in TSM 6– No DB2 admin skills required

• Enables next-generation management, scalability, availability and performance

• Rock solid reliability; industry’s best security, scalability and performance

• DB2 customers include:– 59 of the top 59 banks in the world

– 9 of the top 10 global life & health insurance companies

– 23 of the top 25 U.S. retailers

Powered by

Storage Manager 6

Deployment & ManagementScalability, Availability & Performance

9

• Exploitation of autonomic computing concepts

– A self-tuning database buffer pool

– Online database reorganization enables changes and tuning of thedatabase while the system remains operational

Customer Benefits of DB2 inside:

• More reliable backup and recovery

– Run-time data validity checks

– Errors are immediately detected and corrected

• Improved Availability

– The Tivoli Storage Manager 6 server does not need to be taken "offline" for database repair actions

10

• Can manage twice* as many objects as compared to powerful TSM 5.5– Can double the internal database size (from 512GB to 1TB, minimum)

– Can support 1 billion objects* with a single TSM server

– TSM is ready for the wave of remote office data (from TSM FastBack)

• Run an increased number of concurrent operations*

– 9x increase in the size of the internal Recovery Log enables running more backup jobs from a greater number of clients, and/or an increase in the size of existing backup jobs

– Faster backups = shorter required backup windows

Scalability!

TSM 6 can effectively help

meet the challenges of the

‘tidal wave of data’

Storage Manager 6

* Results will vary depending on user’s environment, systems/processors, type of data, expiration

policies, data change rates, etc.

11

• Can significantly improve backup and restore throughput– Reduces backup windows and/or increases the workload being managed– Reduces recovery times– 400% improvement in backup performance demonstrated in the lab (under optimal

conditions)

• Helps Improve Recovery Point Objectives for DR planning– Addition of Active Data Pools to Disaster Recovery Manager (DRM) in Tivoli

Storage Manager 6 Extended Edition

– Track, manage and recycle active-data pools as required by policies

• Enables faster expiration processing than prior TSM releases– New granular expiration process and parallel process execution

– Fine-tune expiration policies by specific client nodes, node groups, or nodes

belonging to a specified domain

– Over 50% improvement* in expiration processing demonstrated in the lab

Performance!

* Results will vary depending on user’s environment, systems/processors, type of data, expiration

policies, data change rates, etc.

12

Agenda


• Tivoli Storage Manager 6– Enhanced Scalability, Availability and Performance

– Built in Data Deduplication– Simplified Deployment and Management



• Conclusion

13

How Much Can You Save?

0

500

1000

1500

2000

2500

Mon Tue Wed Thu Fri Wkend Mon Tue Wed Thu Fri WkEnd

Week 1 Week 2

Capacity Requirements Comparison

Vendor A: Full+Differential Vendor B: Full+Incremental TSM Progressive Incremental

Backup Capacity Needed for 1 Month:

Vendor A: 26TB

Vendor B: 14TB

IBM TSM: 7TB

Assumes: Full backup completed, 2TB data to start, 26% annual growth rate, 10% new/changed data per day

Gig

abyte

sData Reduction: Progressive Incremental Backup

14

• Tivoli Storage Manager 6 Extended Edition includes data de-duplication for disk storage pools, at no extra charge

• Improves recovery times as many more recovery points can be stored on disk; or reduces the amount of capacity needed

• Operates as a post-process / no impact on backup performance / automatic space reclamation

NewNew Built-in Data De-Duplication

Next Step in Data Reduction…

Tivoli Storage Manager 6, combining progressive incremental data capture with data deduplication, can do a better job of reducingstorage capacity requirements than pure data deduplication solutions

15

• Increase* the amount of data available for recovery from disk (compared to TSM 5.5)

– Adds to the benefits of progressive incremental data capture and data compression technologies

• Effective with data from any source,

– including: API, backup, HSM, archive

• Built into Tivoli Storage Manager 6

– At no additional charge

• Post-process does not impact backup operations

* Results will vary depending on user’s environment, systems/processors, type of data, expiration policies, data change rates, etc.

Customer Benefits of Data De-Duplication

16

When Do I Use ProtecTIER vs TSM 6 Built-in Deduplication?

Complementary Solutions Today!Can be used together but don’t deduplicate the same data twice

Both Solutions Offer the Benefits of Target side Deduplication:• Greatly reduced storage capacity requirements • Lower operational costs, energy usage and TCO• Faster recoveries with more data on disk

Use ProtecTIER When:• Highest performance and capacity scaling are required!

• Up to 500 MB/sec (1GB/s with 2 node) deduplication rates are needed

• Deduplicated capacities up to 25 PB are required• You desire deduplication be done inline during data ingest• A VTL appliance model is desired• Deduplicating across multiple TSM (or other backup) servers

Use TSM 6 Built-in Deduplication When:• Sufficient TSM server resources can be made available and you desire

deduplication operations be completely integrated within TSM• The benefits of deduplication are desired without separate hardware or software

dependencies or licenses (ships with TSM Extended Edition)• You desire end to end data lifecycle management with minimized data store

TSM

IBM ProtecTIER

17

Agenda




– Simplified Management and Deployment– Improved integration with VMware and NetApp / N series NAS

Filers


• Conclusion

18

Simplified Management: Reporting and Monitoring

Powered byPowered by

• Customizable reporting and near real-time monitoring – Wide range of pre-configured ‘out-of-the-box’ reports; reports are fully-

customizable – Near real-time monitoring via a customizable dashboard– Integrates with Tivoli Monitoring data to enable end-to-end performance analytics– Included at no additional charge

19

Redesigned Reporting and Monitoring

Client backup Activity

Server Activity

Client Restore Activity

Help project my future storage requirements

Customizable ReportsCustomizable Reports

Included in TSM – no additional licensingIncluded in TSM – no additional licensing

Customizable dashboardCustomizable dashboard

Storage Manager 6

Deployment & Management

20

Near Real Time Monitoring

Customizable end-user "dashboard“

Delivers graphical representation and monitoring of

trends and current status

� Scheduled Client Activity

� Scheduled Server Activity

� Client Current Activity

� Server Current Activity

� Current Errors

� TSM Database Status

� Tape Device Status

� Storage Pool Status

� Client Backup Status

Server Operation byte count

– DB Backup

– Expiration

– Migration

– Reclamation

Server Operation duration

– DB Backup

– Expiration

– Migration

– Reclamation

Storage Manager 6


21

‘Out of the Box’ Historical Reporting - Server

Server ReportsServer Reports

� Server Job status

� Server Throughput

� Server Resource Usage

� Database Details

� Disk & File Usage

� Tape Usage

� Other Storage Usage

� Tape Volume Usage Analysis

� Tape Capacity Analysis

� Tape Device Errors

� Device Usage History

� Server Machine Utilization

Storage Manager 6


22

‘Out of the Box’ Historical Reporting - Client

Client ReportsClient Reports

� Client Job status

� Client Backup Currency

� Storage Capacity Projection

� Backup Details

� Top 10 Backups

� Backup Missed files

� Backup History

� Restore Details

� Top 10 Restores

� Restore History

� Archive details

� Top 10 Archives

� Archive History

� Retrieve Details

� Top 10 Retrieves

� Retrieve History

Storage Manager 6


23

Leveraging Proven IBM Components

• IBM Tivoli Monitoring • IBM Tivoli Enterprise Portal

• IBM Tivoli Enterprise Management Server• Tivoli Data Warehouse

• IBM DB2 • Stores historical data

obtained from TSM servers that are monitored using IBM Tivoli Monitoring.

• TSM monitoring agent• Queries and formats data

to be presented reports and monitors

• Tivoli Common Reporting– Uses Business Intelligence and

Reporting Tools (BIRT) to create custom reports

Storage Manager 6


24

Administration Center

New, lighter-weight version of Integrated

Solutions Console (ISC) infrastructure

• Improved Performance– Reduced time for initial page load and

page switches

– Enhanced processing of large queries– Progress indicators– Provides response time enhancements

• Easy UI navigation of backup sets, client nodes, and client node groups

• Easy configuration of server actions with a consolidated, central local location for managing server actions

• ISC is a key technology component for IBM's strategic management portal

Reduced Footprint by 30%Reduced Footprint by 30%

Faster Installation < 30 MinFaster Installation < 30 Min

Storage Manager 6


25

Ease of Upgrade to TSM6

• Prepare

– Install the V6 server

– Install the upgrade utilities on the original server

• Upgrade, using one of the following methods:

– Upgrade wizard

– Manually using utilities

• Restart the server once upgrade is complete

– Register licenses

– Verify the upgraded server

– Update automation

* The process is highly dependant on the system it runs on, in particular the disk subsystem.

Storage Manager 6

26

Agenda




– Simplified Deployment and Management



• Conclusion

27

Enhanced support for VMware

• Provides enhanced business continuity and disaster recovery

• New VM-friendly, virtualization pricing model

• Builds on TSM 5.5 support

NewNew Full image backup of Virtual Machines

- VCB support

- Single agent on proxy

server vs. agent on

every VM- Reduced load on ESX

server

- Faster recovery

- Eliminates LAN traffic

Storage Manager 6

RTO, RPO & Business Continuity

28

VMware Consolidated Backup Full Image Backup

‘Near Zero Impact Backup’ on

ESX Servers by using proxy

backup server

• Builds on TSM 5.5 Support– VCB support– Single agent on proxy server vs. agent

on every VM– Can reduce load on ESX server– Fast recovery

– Helps eliminate LAN traffic

Full image backup of virtual

machines for enhanced

business continuity and

disaster recovery Integrated approach that

significantly reduces impact of

backup on ESX Servers which

can allow it to run more virtual

machines

Image level virtual machine

backups are OS neutral

Storage Manager 6


29

• Extremely fast incremental backup– IBM’s ‘First-to-Market’ integration with NetApp that

helps eliminate the need to scan the file system looking for changed files

– Enables fast and more frequent backups

Enhanced support for IBM nSeries and NetApp Filers

IBM System

Storage N6000

• Fast full image backup with new Network Data Management Protocol (NDMP) integration– SnapMirror to Tape integration enables

backup of large NetApp filesystems to secondary media for disaster recovery

Storage Manager 6

PerformanceRTO, RPO & Business Continuity

30

SnapMirror to Tape Support

Fast storage system image creation for IBM N series / NetApp

Disaster Recovery

• TSM integrates to issue the NDMP commands to move the SnapMirror image from the NetApp filer to a TSM server managed storage target for fast creation of a DR image

Storage Manager 6


Storage Manager 6

31

Enhanced Incremental Backup File Selection

Fast incremental Backup of

IBM N series / NetApp filers

• TSM BA client to use NetApp API to identify new, changed, deleted files

• Eliminates the traditional TSM incremental backup file scan

• Provides provide progressive incremental backup with file level recovery

Avoid time consuming scan of

filer to determine backup

candidates

File level recoverability

Storage Manager 6


TSM Client

Storage Manager 6

TSM Server

32

Agenda




– Simplified Deployment and Management


– Other enhancements• MS Exchange and Active Directory Item Level Recovery

• Advanced Copy Services

• IBM General Parallel File System and IBM XIV support

• DR Planner enhancements

• Conclusion

33

Item Level Recovery for Microsoft Exchange

Fast, easier way to recover

individual mail items:Entire inbox, deleted items, email drafts,

journal, calendar, notes, tasks, and user

folders

• TSM 6 supports restore of a user’s mailbox that may have been accidentally deleted as well as restoration of the mailbox as it existed at a previous point in time

Leverages the Microsoft

Exchange Recovery Storage

Group and standard Microsoft

interfaces

Microsoft Exchange

2003 and 2007 support

Storage Manager 6


TSM for Mail

34

• Individual object recovery from System State backups of user andgroup objects

– For Windows Server 2008 Active Directory environments.

– An example is the restoration of an individual or group that may have been deleted from the Active Directory

• Support for un-deletion (reanimation) of objects from the Active Directory's tombstone

Granular Support for Windows Active Directory

– Assists in manual recovery of individual objects

– Recovery and reanimation is accomplished without having to shut down or restart the Active Directory server

• Leverages standard Microsoft programming interfaces

• Fully integrated into the Client Restore Tree View

Storage Manager 6


35

Advanced Replication TechnologiesSnapshot Exploitation Topology

Application

SystemApplication

Data

Local Snapshot Versions Backup System

Snapshot Creation

Policy-based snapshot

management

TSM Server

Disk

Copy Disk

On-site Tape

DVD/CD

Optical

Copied to

Offsite Tape

Other

Storage Hierarchy

Restore from

TSM Server

• Fast non-disruptive Backups

– Perform on-line backups of database applications at snapshot speed with virtually zero impact to the application.

– Transfer data to the TSM Server storage pools from a secondary machine.

• Super Fast Recovery

– Restore from local disk avoiding media mounts

– Restore through volume snapshot

• Integrated Management of Backups

– Support multiple persistent snapshots

– Integrate snapshot operations and legacy backup API operations

– Manage both through TSM server policy

TSM for Advanced Copy Services

TSM for Copy Services

NewNew IBM XIV storage system snapshot support

IBM XIV storage system snapshot support

Storage Manager 6


36

• Tivoli CDP for Files: Continuous data protection for desktops & mobile users

• TSM FastBack: Block Level CDP protection for critical Windows servers

– Robust remote office data protection & replication

– Near-instant recovery of any data, anywhere

Data Center

Tivoli Storage Manager 6 is the core component of an integrated, end-to-end data protection and unified recovery

management solution

37

IBM Tivoli Storage Manager 6 can help clients:

+ Reduce infrastructure costs – servers, storage,

bandwidth

+ Reduce operational expenses

+ Improve application availability and reduce downtime

+ Reduce risk associated with data loss

+ Achieve regulatory and corporate compliance

+ Manage data throughout its lifecycle

= Future-proof data management processesStorage Manager 6

Tivoli Storage Manager 6 keeps IBM on the leading edge of

enterprise-class data protection and recovery management, staying

ahead of the ever-increasing growth in digital information, no matter

where it resides.

38

Thank You!Mange Tak

39

Trademarks and disclaimers

Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries./ Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others. Information is provided "AS IS" without warranty of any kind.

The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Photographs shown may be engineering prototypes. Changes may be incorporated in production models.

© IBM Corporation 1994-2009. All rights reserved.References in this document to IBM products or services do not imply that IBM intends to make them available in every country.

Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml.

40

Enhanced Disaster Recovery Manager support for active-data pools

Disaster Recovery Manager

can systematically rebuild the

TSM server environment

• Specify the names of active-data pools to be managed by disaster recovery manager

• Recycle on-site and off-site active-data pool volumes according to server policies and processes

• Include active-data pool volumes in the scripts, macros, and documentation that are part of the recovery plan file

• Track and manage active-data pool media as required by your operations

• DRM is included with TSM Extended Edition

Helps ensure that current

application data for the entire

enterprise, including active

data pools, is available for

recovery.

Storage Manager 6


41

Tivoli Storage Manager 6 for Advanced Copy ServicesEnhanced Oracle application snapshot support

• Enhanced Oracle application snapshot support when used in conjunction with:– IBM System Storage SAN Volume Controller (SVC)

– IBM System Storage DS6000

– IBM System Storage DS8000

– IBM N series Network Attached Storage (NAS), and NetApp Network Attached Storage

– IBM XIV Storage System

• Enhancements include: – Support for multiple snapshot versions

– Support for FlashCopy of a single mirror set in LVM mirrored environments

Storage Manager 6


42

Tivoli Storage Manager 6 for Advanced Copy Services

• Supports FlashCopy restore onto a Peer to Peer Remote Copy (PPRC) source volume.

– PPRC is a continuous disk-based mirroring function typically used for environments requiring high availability disaster recovery

• Enhanced snapshot support for SAP environments

– Through integration with the Backint interface, integration of Tivoli Storage Manager snapshot functionality into conventional backup procedures in SAP is simplified

• Can improve backup performance via incremental FlashCopy support for the IBM SAN Volume Controller

– Can eliminate the need to perform a full background copy of the source data for each FlashCopy image that is created. After the initial FlashCopy image is created, only the changed blocks will be copied to the same set of target volumes improving backup performance

• Support for IBM XIV snapshots

Storage Manager 6


43

• Support added for the IBM General Parallel File System (GPFS) for storage pool usage and LAN-free access

General Parallel File System Support

• Takes backup traffic off of the LAN and moved to a SAN environment, which helps to:

– Reduce backup windows

– Improve both RPO and RTO

– Reduce CPU utilization on the server

– Allow for more concurrent operations by spreading them across multiple storage agents

• TSM for Space Management integrates with GPFS to expedite identification of migration candidates without file scanning

GPFS Storage Pool

FILE Deviceclass

Storage Manager 6


44

Enhanced Disaster Recovery Manager support for active-data pools

Disaster Recovery Manager

can systematically rebuild the

TSM server environment

• Specify the names of active-data pools to be managed by disaster recovery manager

• Recycle on-site and off-site active-data pool volumes according to server policies and processes

• Include active-data pool volumes in the scripts, macros, and documentation that are part of the recovery plan file

• Track and manage active-data pool media as required by your operations

• DRM is included with TSM Extended Edition

Helps ensure that current

application data for the entire

enterprise, including active

data pools, is available for

recovery.

Storage Manager 6


next generation data recovery, tsm6,pcty - ibm · next generation of data recovery with tsm 6 ......

Documents