virtualisation, tiered storage, space management … · virtualisation as migration tool no caching...

IBM System Storage

Virtualisation, tiered storage, space managementHow does it all fit together?

Dr Axel KoesterSenior Consultant, Enterprise Storageaxel.koester@de.ibm.com

Luxembourg Storage Seminar, 09.05.2007

IBM System Storage

50505050 Years of Disk Storage: 1956 First Disk System

IBM System 350 + RAMAC 305 Disk IBM System 350 + RAMAC 305 Disk StorageStorage

5 MB, 50.000 US$5 MB, 50.000 US$

RAMAC: Random Access Method for Accounting and Control

IBM System Storage

Magnetic Drum 13“diam,42 ft. 5MB =

940 pages single-spaced5MB =

2000 ft. tape (200 char/“)5MB =

60K 80-column punched cards5MB =

RAMAC capacity compared

Average 500ms, max. 750msAccess time

Max. 100 bits/inch, min. 55 bits/inchRecording density

100, with 500 8bit-charactersTracks/disk-surface

61cmDiameter

50Number of Disks

5MB ("Mega-Characters")Capacity

RAMAC Storage: For Accounting and Control – only!

IBM System Storage

33 Years of tiered Storage: Speed versus Capacity

IBM 3420

IBM 3850 Mass Storage System (1974)

472 Billion472 BillionCharactersCharacters

IBM 3850 Cartridges (19,5m)with Staging-Disk IBM 3336

IBM 3420 Tape

IBM System Storage

Information Management Software since ~20 years

� Data Facility Systems Managed Storage (DFSMS) since 1988

� Tivoli Storage Manager (TSM / ADSM) since 1993

� Content management & discovery software ContentMgr, Commonstore, Filenet, Productivity Center, …

IBM System Storage

The Landscape Today

VirtualisationVirtualisation

Tiered StorageTiered Storage

Space ManagementSpace ManagementServer Virtualisation

SAN Virtualisation - SVC

File Virtualisation - GPFS

Tape Virtualisation

Tivoli Storage Manager

HSM Space Manager

Productivity Center

FC / SATA / Tape

Policy-based Migration

IBM System Storage

Goals of Virtualization

� Server Virtualization:– Efficient usage of resources

– Less hardware / floorspace

– Still: Administrative effort per partition/OS

� Storage Virtualization:– Efficient usage of resources

– (Somewhat) less hardware

– Reduce admin effort: Manage pools, not racks

SystemP5

SystemZ9

IBM System Storage

Goals of Tiered Storage

1. Provide storage at the appropriate cost level per application

2. Provide recovery capabilities as required per application

� Enablers for tiered storage:– Online application migration capabilities (SVC)

– Pool management

– Resource usage monitoring (TPC)

IBM System Storage

Goals of Space Management

1. Minimize highest storage tier costs

2. Automate placement of application data, reduce admin effort

3. Optimize application restore capabilities

� Enablers for space management:– Policy-based automation (HSM, FS)

– Transparent resource usage (TPC)

IBM System Storage

Space Management

IBM System Storage

Space Management with Tivoli HSM

� For Windows, Unix, or Linux

� Inactive data is transparently migrated by process rules, while remaining accessible

IBM System Storage

Tivoli Hierarchical Storage Management

85% fill grade: Delete

50% fill grade: Pre-migrate

Migration rule (s)

for inactive data

Disk cache Tape

Recall rules & quotas

TSM Repository

IBM System Storage

Fast Application Restore with Tivoli HSM

Logical disk size unchanged but physical disk size reduced to size of one disk cluster

After a disaster, only 4kB have to be restored to make this application startable

IBM System Storage

Elements required with Tivoli HSM

� TSM server (the one used for standard backup/restore/archive)

� TSM client software ( " )

� Enable client-side HSMMigrate

Recall

TSM Client HSM

TSM Server

IBM System Storage

Resource Management

IBM System Storage

Administrator's Swiss Army Knife

� One application for:

– Data and storage management (cross-vendor)

– Performance statistics

– Analysis, reporting, quota violations

– Prediction

– Avoiding out-of-space conditions (e.g. trigger provisioning)

– Error detection & correlation

– Topology browsing

– Chargeback/billing …

IBM System Storage

� Storage Resource Management Tool

� Relates the application view with the system view on data

� Correlation Engine

� Storage Esperanto: SMI-S / GS3

TotalStorage Productivity Center TPC

Applikation? User? Share? LUN? WWN? Path? Container?

IBM System Storage

TotalStorage Productivity Center TPC

IBM TotalStorage Productivity Center

Standard Edition

Limited Edition (limit = 2TB)

Productivity Center For Data

Productivity Center For Fabric

Productivity Center For Disk

Productivity Center For Replication

Limited Edition ships for free with every IBM storage Elements can be ordered separately

IBM System Storage

Resource Virtualisation

IBM System Storage

Block-based Storage Virtualisation

� Benefits:– Homogeneous administration

– Migrate while online

– Increased storage fill grade

– Balanced performance

– Isolate non-interoperable systems

– Less specialized staff required

– Heterogeneous distant replication

– Substantial software licenses economies

SANVolume Controller

IBM System Storage

Why did we chose in-band Storage Virtualisation?

Storage

Zone Storage

Storage

In-band Appliance Array Based Intelligent Switch

SAN Volume Controller HDS TagmaStore EMC Invista

Control

MetaDataFast Path

Intelligent

Blades

IBM System Storage

Why did we chose in-band Storage Virtualisation?

Storage

Zone Storage

Storage

In-band Appliance Array Based Intelligent Switch

SAN Volume Controller HDS TagmaStore EMC Invista

Control

MetaDataFast Path

Intelligent

Blades

No storage poolNo storage poolconcept. No stripingconcept. No striping

ImageImage --mode mode pass throughpass throughaccess only.access only.

VirtualisationVirtualisationas migration toolas migration tool

No cachingNo cachingconcept. Reliesconcept. Relieson subsystemon subsystemfunctions forfunctions for

Replication etcReplication etc

ExpensiveExpensiveswitchswitch

hardwarehardware

PerformancePerformance ……??SPC benchmark?SPC benchmark?

IBM System Storage

SAN Volume Controller: #1 in official SPC benchmarks

� SPC = official benchmark for storage, compare to "TPC" for servers

� SPC-1™ measures random access performance in database environments whereas SPC-2™ measures sequential throughput

� SPC-2 focuses on file serving in a real-word environment– Not the ideal 100%-cache-hit peak number

– Benefits of read prefetch mechanism

– Benefits of sequential IO detection

�All numbers circa +20% for current SVC 4.1

To-be-announced SVC 4.2 is expected to exceed 6000 MB/s in SPC-2 benchmark.

http://www.storageperformance.org

IBM System Storage

File Virtualisation

IBM System Storage

IBM Storage Tank Technology

� Goal: Let the system assign resources (DFSMS-like)

1. Define classes of IT projects with policies & rules

2. Associate new projects with a class of policies

3. See how everything finds its most-suitable place by itself, over time, without human interaction

IBM System Storage

IBM Storage Tank Technology

� Examples of policy-driven data placement:

Storage Pool

Storage Tank Policies

Place new files on fast reliable storage, migrate as they age

Place temp files on non-mirrored non-backed storage

Keep related files together�

IBM System Storage

IBM Storage Tank Technology now in GPFS 3.1

1. Policy driven data movement between all storage classes including full box migration.

2. Single point management across all storage classes including snapshot.

3. Isolation of storage configuration and effective application used storage.

4. Scalability from ThinkPad to BlueGene.

5. SAP certified with DB2 and Oracle Databases.

GPFS 2.x: thousands of satisfied customers worldwide

GPFS 3.1 + Policies

IBM System Storage

How they fit together:

VirtualisationVirtualisation

Tiered StorageTiered Storage

Space ManagementSpace ManagementServer Virtualisation

SAN Virtualisation - SVC

File Virtualisation - GPFS

Tape Virtualisation

HSM Space Manager

Productivity Center

FC / SATA / Tape

Policy-based Migration

IBM System Storage

DisclaimersNo part of this document may be reproduced or trans mitted in any form without written permission from I BM Corporation.

Product data has been reviewed for accuracy as of t he date of initial publication. Product data is su bject to change without notice. This information c ould include technical inaccuracies or typographical err ors. IBM may make improvements and/or changes in th e product(s) and/or program(s) at any time without notice. Any statements regarding IBM's fut ure direction and intent are subject to change or wi thdrawal without notice, and represent goals and objectives only.

The performance data contained herein was obtained in a controlled, isolated environment. Actual resu lts that may be obtained in other operating environments may vary significantly. While IBM has reviewed each item for accuracy in a specific situ ation, there is no guarantee that the same or simil ar results will be obtained elsewhere. Customer exper iences described herein are based upon information and opinions provided by the customer. The same results may not be obtained by every user.

Reference in this document to IBM products, program s, or services does not imply that IBM intends to m ake such products, programs or services available i n all countries in which IBM operates or does busines s. Any reference to an IBM Program Product in this document is not intended to state or imply that only that program product may be used. Any functio nally equivalent program, that does not infringe IB M's intellectual property rights, may be used instead. It is the user's responsibility to evalua te and verify the operation on any non-IBM product, program or service.

THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS O R IMPLIED. IBM EXPRESSLYDISCLAIMS ANY WARRANTIES OF MERCHANTABILITY, FITNES S FOR A PARTICULAR PURPOSE OR INFRINGEMENT. IBM sh all have no responsibilityto update this information. IBM products are warra nted according to the terms and conditions of the a greements (e.g. IBM Customer Agreement, Statement of Limited Warranty, International Progra m License Agreement, etc.) under which they are pro vided. IBM is not responsible for the performance or interoperability of any non-IBM prod ucts discussed herein.

Information concerning non-IBM products was obtaine d from the suppliers of those products, their publi shed announcements or other publicly available sources. IBM has not tested those products in conn ection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Question s on the capabilities of non-IBM products should b e addressed to the suppliers of those products.

The providing of the information contained herein i s not intended to, and does not, grant any right or license under any IBM patents or copyrights. Inqu iries regarding patent or copyright licenses should be ma de, in writing, to:

IBM Director of LicensingIBM CorporationNorth Castle DriveArmonk, NY 10504-1785USA

IBM System Storage

TrademarksThe following terms are trademarks or registered trademarks of the IBM Corporation in either the United States, other countries or both.

Linear Tape-Open, LTO, LTO Logo, Ultrium logo, Ultrium 2 Logo and Ultrium 3 logo are trademarks in the United States and other countries of Certance, Hewlett-Packard, and IBM.

Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States and/or other countries.

Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States and/or other countries.

Intel, Intel Inside (logos), MMX and Pentium are trademarks of Intel Corporation in the United States and/or other countries.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Linux is a trademark of Linus Torvalds in the United States and other countries.

Other company, product, or service names may be trademarks or service marks of others.

�ServerProven�System z9�System p5�System Storage�Tivoli�TotalStorage�TotalStorage Proven�TPF�Virtualization Engine�X-Architecture�xSeries�z/OS�z/VM�zSeries

�ON (button device)�On demand business�OnForever�OpenPower�OS/390�OS/400�Parallel Sysplex�POWER�POWER5�Predictive Failure Analysis�pSeries�S/390�Seascape

�eServer�FICON�FlashCopy�GDPS�Geographically Dispersed Parallel Sysplex

�HiperSockets�i5/OS�IBM�IBM eServer�IBM logo�iSeries�Lotus

�AIX�AIX 5L�BladeCenter�Chipkill�DB2�DB2 Universal Database�DFSMSdss�DFSMShsm�DFSMSrmm�Domino�e-business logo�Enterprise Storage Server�ESCON

IBM System Storage

virtualisation, tiered storage, space management … · virtualisation as migration tool no caching...

Documents

technology trends ilm tiered storage optical replacement

tiered storage presentation -storage decisions

hitachi tiered storage manager for mainframe messages

tiered storage architecture demystified understand tiered...

tiered storage economics -...

advantages of compellent tiered storage wp

detailed product description exagrid tiered backup storage

tiered storage design guide - pacific grids · tiered...

whitepaper : emc federated tiered storage (fts)

tiered storage architecture: taking advantage of new classes...

a 1 minute intro to storage made easy and cloud storage...

virtualization and tiered storage

storage virtualisation and vmware

combining storage and server virtualisation to integrate...

emc federated tiered storage (fts) allows … · emc...

hitachi tiered storage manager for mainframe user guide

end-to-end choices in tiered storage...

a-imex-sss key to efficient tiered storage...

hp xp7 device manager software, hp xp7 tiered storage...

planning and building tiered storage