ds8700 architecture guide

Front coverDraft Document for Review November 16, 2012 9:25 am SG24-8085-00

IBM System Storage DS8870Architecture and Implementation

Dual IBM POWER7 based controllers with up to 1 TB of cache 400 GB SSDs with Full Disk Encryption support Improved Power Supplies and extended Power Line Disturbance

Bertrand Dufrasne Peter Kimmel Pere Alcaide Istvan Paloczi Akin Sakarcan Roland Wolf

ibm.com/redbooks

Draft Document for Review November 16, 2012 9:25 am

8085edno.fm

International Technical Support Organization IBM System Storage DS8870 Architecture and Implementation October 2012

SG24-8085-00

8085edno.fm


Note: Before using this information and the product it supports, read the information in Notices on page iii.

First Edition (October 2012) This edition applies to Version ???, Release ???, Modification ??? of ???insert-product-name??? (product number ????-???). This document was created or updated on November 16, 2012.

Copyright International Business Machines Corporation 2012. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.


8085spec.fm

NoticesThis information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service. IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not grant you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A. The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice. Any references in this information to non-IBM websites are provided for convenience only and do not in any manner serve as an endorsement of those websites. The materials at those websites are not part of the materials for this IBM product and use of those websites is at your own risk. IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurements may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment. Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental. COPYRIGHT LICENSE: This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs.

Copyright IBM Corp. 2012. All rights reserved.

iii

8085spec.fm


TrademarksIBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol ( or ), indicating US registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both:AIX CICS Cognos DB2 DS4000 DS6000 DS8000 Enterprise Storage Server ESCON FICON FlashCopy GDPS HACMP HyperSwap i5/OS IBM IMS iSeries NetView Power Architecture POWER Hypervisor Power Systems POWER6+ POWER6 POWER7 PowerHA PowerPC POWER ProtecTIER pSeries Redbooks Redpaper Redpapers Redbooks (logo) RMF S/390 System i System p System Storage DS System Storage System x System z10 System z TDMF Tivoli TotalStorage XIV z/OS z/VM z10 z9 zSeries

The following terms are trademarks of other companies: Intel, Intel logo, Intel Inside logo, and Intel Centrino logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Disk Magic, IntelliMagic, and the IntelliMagic logo are trademarks of IntelliMagic BV in the United States, other countries, or both. Microsoft, Windows, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Novell, SUSE, the Novell logo, and the N logo are registered trademarks of Novell, Inc. in the United States and other countries. Java, and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. QLogic, and the QLogic logo are registered trademarks of QLogic Corporation. SANblade is a registered trademark in the United States. SAP, and SAP logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Other company, product, or service names may be trademarks or service marks of others.

iv

IBM System Storage DS8870 Architecture and Implementation


8085TOC.fm

ContentsNotices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii The team who wrote this book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv Now you can become a published author, too! . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv Comments welcome. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv Stay connected to IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvi Part 1. Concepts and architecture. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 Chapter 1. Introduction to the IBM System Storage DS8870 . . . . . . . . . . . . . . . . . . . . . 3 1.1 Introduction to the DS8870 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.1.1 Features of the DS8870 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.2 The DS8870 controller options and frames. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 1.3 DS8870 architecture and functions overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 1.3.1 Overall architecture and components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 1.3.2 Storage capacity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 1.3.3 Supported environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 1.3.4 Configuration flexibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 1.3.5 Copy Services functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 1.3.6 Resource Groups for copy services scope limiting . . . . . . . . . . . . . . . . . . . . . . . . 17 1.3.7 Service and setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 1.3.8 IBM Certified Secure Data Overwrite . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 1.4 Performance features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 1.4.1 Sophisticated caching algorithms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 1.4.2 Solid State Drives (SSDs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 1.4.3 Multipath Subsystem Device Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 1.4.4 Performance for System z. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 1.4.5 Performance enhancements for IBM Power Systems . . . . . . . . . . . . . . . . . . . . . 21 Chapter 2. IBM System Storage DS8870 models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.1 The System Storage DS8870 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.2 Model overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.3 DS8870 Disk drive options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.4 Additional licenses needed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 3. DS8870 hardware components and architecture. . . . . . . . . . . . . . . . . . . . . 3.1 Frames: DS8870 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.1.1 Base frame: DS8870. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.1.2 Expansion frames . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.1.3 Rack operator panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.2 DS8870 architecture overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.2.1 The IBM POWER7 server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.2.2 Peripheral Component Interconnect Express adapters . . . . . . . . . . . . . . . . . . . . 3.2.3 Storage facility processor complex (CEC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.2.4 Processor memory and cache management . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.2.5 Flexible service processor and system power control network . . . . . . . . . . . . . . . 3.3 I/O enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 24 24 28 31 33 34 34 35 36 38 38 40 41 42 43 44


v

8085TOC.fm


3.3.1 DS8870 I/O enclosure. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.3.2 Host adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.3.3 Device adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.4 Disk subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.4.1 Disk enclosures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.4.2 Disk drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.5 Power and cooling. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.6 Management console network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.6.1 Ethernet switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 4. RAS on IBM System Storage DS8870 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.1 Names and terms for the DS8870 storage system . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.2 RAS features of DS8870 Central Electronics Complex. . . . . . . . . . . . . . . . . . . . . . . . . 4.2.1 POWER7 Hypervisor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.2.2 POWER7 processor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.2.3 AIX operating system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.2.4 Central Electronics Complex dual hard drive rebuild . . . . . . . . . . . . . . . . . . . . . . 4.2.5 Cross Cluster communication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.2.6 Environmental monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.2.7 Resource deallocation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.3 Central Electronics Complex failover and failback . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.3.1 Dual operational . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.3.2 Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.3.3 Failback. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.3.4 NVS and power outages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.4 Data flow in DS8870 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.4.1 I/O enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.4.2 Host connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.4.3 Metadata checks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.5 RAS on the HMC. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.5.1 Microcode updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.5.2 Call Home and Remote Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6 RAS on the disk system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.1 RAID configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.2 Disk path redundancy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.3 Predictive Failure Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.4 Disk scrubbing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.5 Smart Rebuild . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.6 RAID 5 overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.7 RAID 6 overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.8 RAID 10 overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.6.9 Spare creation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.7 RAS on the power subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.7.1 Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.7.2 Line power loss . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.7.3 Line power fluctuation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.7.4 Power control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.7.5 Emergency power off . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.8 RAS and Full Disk Encryption . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.8.1 Deadlock recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.8.2 Dual platform TKLM servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.9 Other features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.9.1 Internal network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

44 45 47 48 48 52 53 57 57 59 60 61 61 62 65 65 66 67 67 68 68 69 71 71 72 72 73 76 78 78 79 80 81 82 82 83 83 84 85 86 87 89 89 92 92 93 94 95 95 96 97 97

vi



8085TOC.fm

4.9.2 Remote support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 4.9.3 Earthquake resistance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 Chapter 5. Virtualization concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99 5.1 Virtualization definition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100 5.2 The abstraction layers for disk virtualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100 5.2.1 Array sites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101 5.2.2 Arrays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102 5.2.3 Ranks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103 5.2.4 Extent Pools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104 5.2.5 Logical volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107 5.2.6 Space Efficient volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111 5.2.7 Allocation, deletion, and modification of LUNs/CKD volumes. . . . . . . . . . . . . . . 114 5.2.8 Logical subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 5.2.9 Volume access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121 5.2.10 Virtualization hierarchy summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123 5.3 Benefits of virtualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124 5.4 zDAC - z/OS FICON discovery and Auto-Configuration . . . . . . . . . . . . . . . . . . . . . . . 125 5.5 EAV V2 - Extended Address Volumes (CKD) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127 Chapter 6. IBM System Storage DS8000 Copy Services overview. . . . . . . . . . . . . . . 6.1 Copy Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2 FlashCopy and FlashCopy SE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2.1 Basic concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2.2 Benefits and use . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2.3 FlashCopy options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2.4 FlashCopy SE-specific options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2.5 Remote Pair FlashCopy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3 Remote Mirror and Copy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.1 Metro Mirror . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.2 Global Copy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.3 Global Mirror . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.4 Metro/Global Mirror . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.5 Multiple Global Mirror sessions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.6 Thin provisioning enhancements on open environments . . . . . . . . . . . . . . . . . . 6.3.7 GM and MGM improvement due to collision avoidance . . . . . . . . . . . . . . . . . . . 6.3.8 z/OS Global Mirror . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.9 z/OS Metro/Global Mirror . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.10 Summary of Remote Mirror and Copy function characteristics. . . . . . . . . . . . . 6.3.11 Consistency group considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.12 GDPS on zOS environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.3.13 TPC-R functionality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.4 Resource Groups for copy services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 7. Architectured for Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.1 DS8870 hardware: Performance characteristics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.1.1 Vertical growth and scalability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.1.2 DS8870 Fibre Channel switched interconnection at the back-end . . . . . . . . . . . 7.1.3 Fibre Channel device adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.1.4 Eight-port and four-port host adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.2 Software performance: Synergy items . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.2.1 Synergy on System p . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.2.2 Synergy on System z . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.3 Performance considerations for disk drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .Contents

133 134 135 135 137 137 139 139 141 142 143 143 145 146 149 150 151 151 152 153 153 154 154 157 158 158 159 161 163 164 164 165 167 vii

8085TOC.fm


7.4 DS8000 superior caching algorithms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.4.1 Sequential Adaptive Replacement Cache. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.4.2 Adaptive Multi-stream Prefetching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.4.3 Intelligent Write Caching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.5 Performance considerations for logical configuration . . . . . . . . . . . . . . . . . . . . . . . . . 7.5.1 Workload characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.5.2 Data placement in the DS8000 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.5.3 Data placement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.6 I/O Priority Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.6.1 Performance policies for open systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.6.2 Performance policies for System z . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.7 IBM Easy Tier . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.7.1 IBM Easy Tier operating modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.7.2 IBM Easy Tier Statement of Direction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.8 Performance and sizing considerations for open systems . . . . . . . . . . . . . . . . . . . . . 7.8.1 Determining the number of paths to a LUN. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.8.2 Dynamic I/O load-balancing: SDD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.8.3 Automatic port queues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.8.4 Determining where to attach the host . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9 Performance and sizing considerations for System z . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.1 Host connections to System z servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.2 Parallel Access Volume . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.3 z/OS Workload Manager: Dynamic PAV tuning . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.4 HyperPAV . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.5 PAV in z/VM environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.6 Multiple Allegiance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.7 I/O priority queuing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.9.8 Performance considerations on Extended Distance FICON . . . . . . . . . . . . . . . . 7.9.9 High Performance FICON for z . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7.10 Performance Improvements for Epic. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

170 170 172 173 174 174 174 175 181 182 182 183 185 188 188 188 188 189 189 190 190 191 193 194 196 197 198 200 201 203

Part 2. Planning and installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205 Chapter 8. DS8870 Physical planning and installation . . . . . . . . . . . . . . . . . . . . . . . . 8.1 Considerations prior to installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.1.1 Who should be involved . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.1.2 What information is required . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2 Planning for the physical installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2.1 Delivery and staging area . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2.2 Floor type and loading . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2.3 Overhead cabling features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2.4 Room space and service clearance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2.5 Power requirements and operating environment . . . . . . . . . . . . . . . . . . . . . . . . 8.2.6 Host interface and cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2.7 Host adapter Fiber Channel specifics for Open environments.. . . . . . . . . . . . . . 8.2.8 FICON specifics on zOS environment. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2.9 Best practice for host adapter (HA) cards. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.2.10 WWNN and WWPN determination . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.3 Network connectivity planning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.3.1 Hardware Management Console and network access . . . . . . . . . . . . . . . . . . . . 8.3.2 IBM Tivoli Storage Productivity Center . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.3.3 DS command-line interface DSCLI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.3.4 Remote support connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 207 208 209 209 210 210 210 212 213 214 216 217 217 217 218 221 221 222 222 223

viii



8085TOC.fm

8.3.5 Remote power control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.3.6 Storage Area Network connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.3.7 Tivoli Key Lifecycle Manager server for encryption. . . . . . . . . . . . . . . . . . . . . . . 8.3.8 Lightweight Directory Access Protocol server for single sign-on . . . . . . . . . . . . 8.4 Remote mirror and copy connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.5 Disk capacity considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.5.1 Disk sparing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.5.2 Disk capacity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.5.3 DS8000 Solid State Drive (SSD) considerations . . . . . . . . . . . . . . . . . . . . . . . . 8.6 Planning for growth . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 9. DS8870 HMC planning and setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.1 Hardware Management Console overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.1.1 Storage Hardware Management Console hardware. . . . . . . . . . . . . . . . . . . . . . 9.1.2 Private Ethernet networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.2 Hardware Management Console software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.2.1 DS Storage Manager GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.2.2 Command-line interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.2.3 DS Open Application Programming Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.2.4 Web-based user interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.3 HMC activities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.3.1 HMC planning tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.3.2 Planning for microcode upgrades . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.3.3 Time synchronization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.3.4 Monitoring DS8870 with the HMC. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.3.5 Call Home and remote support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.4 HMC and IPv6 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.5 HMC user management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.6 External HMC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.6.1 External HMC benefits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.7 Configuration worksheets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.8 Configuration flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 10. IBM System Storage DS8000 features and license keys . . . . . . . . . . . . 10.1 IBM System Storage DS8000 licensed functions . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.1.1 Licensing additional content background . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.1.2 Licensing cost structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.2 Activation of licensed functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.2.1 Obtaining DS8000 machine information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.2.2 Obtaining activation codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.2.3 Applying activation codes using the GUI. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.2.4 Applying activation codes using the DS CLI . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.3 Licensed scope considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.3.1 Why you get a choice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.3.2 Using a feature for which you are not licensed . . . . . . . . . . . . . . . . . . . . . . . . . 10.3.3 Changing the scope to All . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.3.4 Changing the scope from All to FB . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.3.5 Applying an insufficient license feature key . . . . . . . . . . . . . . . . . . . . . . . . . . . 10.3.6 Calculating how much capacity is used for CKD or FB. . . . . . . . . . . . . . . . . . .

224 224 225 226 226 226 227 227 229 230 231 232 232 233 234 234 235 235 236 237 237 238 239 239 240 240 242 244 244 245 246 249 250 251 253 255 255 258 262 265 267 267 268 268 269 270 270

Part 3. Storage configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 273 Chapter 11. Configuration flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275 11.1 Configuration worksheets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276Contents

ix

8085TOC.fm


11.2 Configuration flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276 Chapter 12. Configuring IBM Tivoli Storage Productivity Center 5.1 for DS8000 . . . 12.1 Introducing IBM Tivoli Storage Productivity Center 5.1. . . . . . . . . . . . . . . . . . . . . . . 12.2 IBM Tivoli Storage Productivity Center Architecture . . . . . . . . . . . . . . . . . . . . . . . . . 12.3 Adding a DS8000 storage system with TPC 5.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12.4 Exploring DS8870 with TPC 5.1 Web-based GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 13. Configuration using the DS Storage Manager GUI . . . . . . . . . . . . . . . . . 13.1 DS Storage Manager GUI overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.1.1 Accessing the DS GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.1.2 DS GUI Overview window. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.2 User management using the DS GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.3 Logical configuration process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4 Examples of configuring DS8000 storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.1 Defining a storage complex . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.2 Creating arrays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.3 Creating ranks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.4 Creating Extent Pools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.5 Configuring I/O ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.6 Configuring logical host systems. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.7 Creating fixed block volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.8 Creating volume groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.9 Creating LCUs and CKD volumes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.4.10 Additional actions on LCUs and CKD volumes . . . . . . . . . . . . . . . . . . . . . . . . 13.5 Other DS GUl functions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.5.1 Easy Tier . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.5.2 I/O Priority Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.5.3 Checking the status of the DS8000 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13.5.4 Exploring the DS8000 hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 14. Configuration with the DS Command-Line Interface . . . . . . . . . . . . . . . 14.1 DS Command-Line Interface overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.1 Supported operating systems for the DS CLI . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.2 User accounts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.3 User management using the DS CLI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.4 DS CLI profile . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.5 Configuring DS CLI to use a second HMC . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.6 Command structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.7 Using the DS CLI application . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.8 Return codes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.1.9 User assistance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.2 Configuring the I/O ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.3 Configuring the DS8000 storage for FB volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.3.1 Creating arrays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.3.2 Creating ranks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.3.3 Creating Extent Pools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.3.4 Creating FB volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.3.5 Creating volume groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.3.6 Creating host connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.3.7 Mapping open systems host disks to storage unit volumes . . . . . . . . . . . . . . . 14.4 Configuring DS8000 storage for CKD volumes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.4.1 Create arrays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.4.2 Ranks and Extent Pool creation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xIBM System Storage DS8870 Architecture and Implementation

279 280 280 282 287 293 294 294 298 301 305 306 306 309 314 317 322 323 328 332 337 343 345 345 346 347 349 353 354 354 355 355 357 359 360 360 363 363 365 366 366 367 367 370 375 377 379 381 381 381


8085TOC.fm

14.4.3 Logical control unit creation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.4.4 Creating CKD volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.4.5 Resource Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.4.6 Performance I/O Priority Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.4.7 Easy Tier . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.5 Metrics with DS CLI. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.6 Private network security commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14.7 Copy Services commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

383 384 390 390 390 390 394 395

Part 4. Maintenance and upgrades . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 397 Chapter 15. Licensed machine code . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15.1 How new microcode is released . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15.2 Bundle installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15.3 Concurrent and non-concurrent updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15.4 Code updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15.5 Host adapter firmware updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15.6 Loading the code bundle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15.7 Post-installation activities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15.8 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 16. Monitoring with Simple Network Management Protocol . . . . . . . . . . . . 16.1 Simple Network Management Protocol overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.1 SNMP agent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.2 SNMP manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.3 SNMP trap . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.4 SNMP communication. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.5 SNMP Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.6 Generic SNMP security. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.7 Message Information Base . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.8 SNMP trap request . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.1.9 DS8000 SNMP configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.2 SNMP notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.2.1 Serviceable event using specific trap 3. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.2.2 Copy Services event traps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.2.3 I/O Priority Manager SNMP. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.2.4 Thin Provisioning SNMP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.3 SNMP configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.3.1 SNMP preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.3.2 SNMP configuration from the HMC. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16.3.3 SNMP configuration with the DS CLI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 17. Remote support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.1 Introduction to remote support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.1.1 Suggested reading . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.1.2 Organization of this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.1.3 Terminology and definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.2 IBM policies for remote support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.3 VPN rationale and advantages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.4 Remote connection types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.4.1 Asynchronous modem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.4.2 IP network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.4.3 IP network with traditional VPN. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.4.4 AOS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .Contents

399 400 402 404 404 405 406 406 406 407 408 408 409 409 409 410 410 411 411 411 412 412 412 419 420 421 421 421 424 425 426 426 426 427 428 428 429 429 431 432 432 xi

8085TOC.fm


17.5 DS8870 support tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.5.1 Call Home and heartbeat (outbound) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.5.2 Data offload (outbound) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.5.3 Code download (inbound) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.5.4 Remote support (inbound and two-way) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.6 Remote connection scenarios . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.6.1 No connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.6.2 Modem only . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.6.3 VPN only . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.6.4 Modem and network with no VPN. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.6.5 Modem and traditional VPN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.7 ASSIST ON-SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.7.1 AOS components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.7.2 AOS Security . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.7.3 Support Session modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.7.4 Port Forwarding and AOS Gateway for the DS8870. . . . . . . . . . . . . . . . . . . . . 17.7.5 AOS Best Practices for DS8870 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.7.6 AOS with VPN vs Modem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.8 Further Remote Support Enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17.9 Audit logging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 18. DS8870 Capacity upgrades and CoD . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18.1 Installing capacity upgrades . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18.1.1 Installation order of upgrades . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18.1.2 Checking how much total capacity is installed . . . . . . . . . . . . . . . . . . . . . . . . . 18.2 Using Capacity on Demand (CoD) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18.2.1 What is Capacity on Demand . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18.2.2 Determining if a DS8870 has CoD disks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18.2.3 Using the CoD storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Appendix A. Tools and service offerings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Planning and administration tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Capacity Magic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Disk Magic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Storage Tier Advisor Tool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . IBM Tivoli Storage FlashCopy Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . IBM Service offerings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . IBM Global Technology Services: Service offerings . . . . . . . . . . . . . . . . . . . . . . . . . . . IBM STG Lab Services: Service offerings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

432 433 433 436 437 437 437 438 439 439 440 441 442 443 444 445 447 453 454 457 459 460 461 462 464 464 464 469 471 472 472 474 476 479 480 480 480

Abbreviations and acronyms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 483 Related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . IBM Redbooks publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Other publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Online resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . How to get IBM Redbooks publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Help from IBM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 487 487 488 488 488 489

xii



8085pref.fm

PrefaceThis IBM Redbooks publication describes the concepts, architecture, and implementation of the IBM System Storage DS8870 storage system. The book provides reference information to assist readers who need to plan for, install, and configure the DS8870. The IBM System Storage DS8870 is the most advanced model in the IBM DS8000 lineup and is equipped with IBM POWER7 based controllers. Various configuration options are available that scale from dual 2-core systems up to dual 16-core systems with up to 1 TB of cache. The DS8870 also features enhanced 8 Gpbs device adapters and host adapters. Connectivity options, with up to 128 Fibre Channel/FICON ports for host connections, make the DS8870 suitable for multiple server environments in both open systems and IBM System z environments. The DS8870 supports advanced disaster recovery solutions and business continuity solutions and also supports thin provisioning. All disk drives in the DS8870 storage system have the Full Disk Encryption (FDE) feature. If desired, the DS8870 can be integrated in an LDAP infrastructure. The DS8870 is equipped with high-density storage enclosures populated with 24 small-formfactor SAS-2 drives or storage enclosures for 12 large-form-factor nearline SAS drives. The DS8870 storage subsystems can also be equipped with Solid-State Drives (SSDs). The DS8870 can automatically optimize the use of each storage tier, particularly SSD drives through the IBM Easy Tier feature, which is available for no extra fee. For details about Easy Tier, refer to IBM System Storage DS8000: Easy Tier Concepts and Usage, REDP-4667. Host attachment and interoperability topics for the DS8000 series including are now covered in IBM System Storage DS8000: Host Attachment and Interoperability, SG24-8887. For information related to specific features, refer to IBM System Storage DS8000: Easy Tier Concepts and Usage, REDP-4667, IBM System Storage DS8000: Priority Manager, REDP-4760, IBM System Storage DS8000: Copy Services Resource Groups, REDP-4758, IBM System Storage DS8700 Disk Encryption Implementation and Usage Guidelines, REDP-4500, and IBM System Storage DS8000: LDAP Authentication, REDP-4505. To read about DS8000 Copy Services functions, refer to IBM System Storage DS8000: Copy Services for Open Environments, SG24-6788, and IBM System Storage DS8000: Copy Services for IBM System z, SG24-6787.


xiii

8085pref.fm


The team who wrote this bookThis book was produced by a team of specialists from around the world working for the International Technical Support Organization (ITSO), at the European Storage Competence Center (ESCC) in San Jose. Bertrand Dufrasne is an IBM Certified IT Specialist and Project Leader for System Storage disk products at the International Technical Support Organization, San Jose Center. He has worked at IBM in various IT areas. He has written many IBM Redbooks publications and has also developed and taught technical workshops. Before joining the ITSO, he worked for IBM Global Services as an Application Architect. He holds a Masters degree in Electrical Engineering. Pere Alcaide joined IBM in 1996 and is working as a Support Center Representative after a long experience as a Sales Support Representative. He holds a degree in Technical Telecommunications Engineering from the Universitat Politcnica de Catalunya, Barcelona. Since 2005 his main focus has been IBM DS8000 Family Series hardware. Collaborations with the IBM testing team and DS8K DA Development team are part of his experience. Peter Kimmel is an IT Specialist and ATS team lead of the Enterprise Disk Solutions team at the European Storage Competence Center (ESCC) in Mainz, Germany. He joined IBM Storage in 1999 and since then worked with all the various ESS (Enterprise Storage Server) and System Storage DS8000 generations, with a focus on architecture and performance. He has co-authored several DS8000 IBM Redbooks publications. Peter holds a Diploma (MSc) degree in Physics from the University of Kaiserslautern. lstvan Paloczi is a Test Engineer working for the DS8000 manufacturing in Vac, Hungary. He has three years of experience in high-end disk testing, test process optimization, and new product implementation. He holds a degree in Electrical Engineering, with a specialization in Telecommunication, from the University of Pecs, Hungary. His focus is hardware and software qualification for all the supported DS8000 releases in the manufacturing environment. Akin Sakarcan is working as a Storage CTS (Client Technical Specialist) for Systems & Technology Group in IBM Turkey. He has 10 years of experience in the server/storage field. He has been working at IBM for 3 years as the subject matter expert and systems software blackbelt for IBM storage solutions. His areas of expertise include planning, design and analysis of IBM storage solutions. lRoland Wolf is a Certified IT Specialist in Germany. He has worked at IBM for 26 years and has extensive experience with high-end disk-storage hardware in System z and Open Systems. He works in Technical Sales Support and his areas of expertise include performance analysis and disaster recovery solutions in enterprises using the unique capabilities and features of the IBM disk storage servers, DS8000, and IBM XIV. He has contributed to various IBM Redbooks publications including, ESS, DS8000 Architecture, and DS8000 Copy Services. He holds a Ph.D. in Theoretical Physics.

xiv



8085pref.fm

Many thanks to the following people who helped with equipment provisioning and preparation: Mike Schneider, Dietmar Schniering, Gnter Schmitt, Uwe Heinrich Mller, Uwe Schweikhard, Jrg Zahn, Hans-Joachim Sachs, Edwin Weinheimer, Roland Beisele, Stephan Schorn, Stephan Weyrich, Seven Bittlingmayer IBM Systems Lab Europe, Mainz, Germany Special thanks to the Enterprise Disk team manager, Bernd Mller, and the ESCC director, Klaus-Jrgen Rnger, for their continuous interest and support regarding the ITSO Redbooks projects. Thanks to the following people for their contributions to this project: John Bynum, Allen Wright, John Cherbini, Allen Marin, Stephen Manthorpe, Craig Gordon, John Elliott, Brian Rinaldi, Dale H Anderson, Chip Jarvis, Jared Minch, Jeff Steffan, David Whitworth. Kavita Shah, Jason Piepelman, Thomas Fiege, Bjoern Wesselbaum, Hubertus Wegel, Volker Kiemes, Juan Brandenburg, Kai Jehnen IBM

Now you can become a published author, too!Here's an opportunity to spotlight your skills, grow your career, and become a published authorall at the same time! Join an ITSO residency project and help write a book in your area of expertise, while honing your experience using leading-edge technologies. Your efforts will help to increase product acceptance and customer satisfaction, as you expand your network of technical contacts and relationships. Residencies run from two to six weeks in length, and you can participate either in person or as a remote resident working from your home base. Find out more about the residency program, browse the residency index, and apply online at: ibm.com/redbooks/residencies.html

Comments welcomeYour comments are important to us! We want our books to be as helpful as possible. Send us your comments about this book or other IBM Redbooks publications in one of the following ways: Use the online Contact us review Redbooks form found at: ibm.com/redbooks Send your comments in an email to: [email protected] Mail your comments to: IBM Corporation, International Technical Support Organization Dept. HYTD Mail Station P099 2455 South Road Poughkeepsie, NY 12601-5400

Preface

xv

8085pref.fm


Stay connected to IBM RedbooksFind us on Facebook: http://www.facebook.com/IBMRedbooks Follow us on Twitter: http://twitter.com/ibmredbooks Look for us on LinkedIn: http://www.linkedin.com/groups?home=&gid=2130806 Explore new Redbooks publications, residencies, and workshops with the IBM Redbooks weekly newsletter: https://www.redbooks.ibm.com/Redbooks.nsf/subscribe?OpenForm Stay current on recent Redbooks publications with RSS Feeds: http://www.redbooks.ibm.com/rss.html

xvi



8085p01.fm

Part 1

Part

1

Concepts and architectureThis part gives an overview of the IBM System Storage DS8000 concepts and architecture. The topics covered include: Introduction to the IBM System Storage DS8870, the latest member of the DS8000 series Overview of the IBM System Storage DS8870 models Detailed information about the DS8870 hardware components and architecture Presentation of the RAS features of the IBM System Storage DS8870 A review of the DS8000 virtualization concepts An overview of the IBM System Storage DS8000 Copy Services A discussion of the DS8870 performance features.


1

8085p01.fm


2



8085ch_Introduction.fm

1

Chapter 1.

Introduction to the IBM System Storage DS8870This chapter introduces the features and functions of the IBM System Storage DS8000 series and its newest member, the DS8870 storage system. More detailed information about functions and features is provided in subsequent chapters. The topics presented here are: The advantages of a POWER7 based storage system DS8870 architecture and functions overview Performance features Previous models like the DS8700 and DS8800 are described in the IBM Redbooks publication, IBM System Storage DS8000 Architecture and Implementation, SG24-8886.


3



1.1 Introduction to the DS8870IBM has a wide range of product offerings based on open standards and share a common set of tools, interfaces, and innovative features. The System Storage DS8000 family is designed as a high performance, high capacity, and resilient series of disk storage systems. The DS8870 offers high availability, multiplatform support including System z, and simplified management tools to help provide a cost-effective path to an on-demand world. Customers expect from a high end storage subsystem that it is: High performance Highly available Cost efficient Energy efficient Scalable Has Business Continuity and Data Protection functions The DS8870 (Figure 1-1 on page 5) is IBMs fifth-generation high-end disk system in the DS8000 series. It is designed to support the most demanding business applications with its exceptional all-around performance and data throughput. The DS8000 architecture is server based. Powerful POWER7 servers manage the cache to minimize disk I/Os to maximize performance and throughput. Combined with the world-class business resiliency and encryption features, the storage server, provides a unique combination of high availability, performance, and security. The DS8870 is equipped with encryption capable disk drives or SSDs. You just need to pair it with an IBM Tivoli Key Lifecycle Manager (TKLM) to encrypt data on the DS8870. The DS8870 is tremendously scalable, has broad server support, and virtualization capabilities. These features can help simplify the storage environment by consolidating multiple storage systems. High density storage enclosures offer a considerable reduction in footprint and energy consumption. A new power supply system based on direct current uninterruptible power supply DC-UPS is much more energy-efficient than the Power Distribution System of previous models making the DS8870 the most energy-efficient model in the DS8000 series. The DS8870 is designed to comply with the emerging ENERGY STAR specifications. ENERGY STAR is a joint program of the U.S. Environmental Protection Agency and the U.S. Department of Energy helping us all to save money and protect the environment through energy efficient products and practices (see http://www.energystar.gov).

4




Figure 1-1 DS8870 Base Frame

1.1.1 Features of the DS8870The DS8870 offers the following features: Storage virtualization offered by the DS8000 series allows organizations to allocate system resources more effectively and better control application quality of service. The DS8000 series improves the cost structure of operations and lowers energy consumption through a tiered storage environment. The DS8870 is available with different processor options ranging from dual 2-core systems up to dual 16-cores covering a wide range of performance needs. The DS8870 supports a broad range of disk drives starting from very fast 400 GB SSDs, fast 146 GB 15K RPM SAS disk drives, to high-capacity nearline-SAS 3 TB drives. Cache configurations are available that range from 16 GB up to 1 TB cache. The server architecture of the DS8870 with its powerful POWER7 processors makes it possible to manage large caches with small cache segments of 4 KB (and hence large segment tables) without the need to partition the cache. The POWER7 processors have enough power to implement sophisticated caching algorithms. These algorithms and the small cache segment size optimize cache hits. Therefore the DS8870 provides excellent I/O response times. Write data is always protected by maintaining a copy of write-data in Non-volatile Storage until the data is destaged to disks. Adaptive Multi-stream Prefetching (AMP) caching algorithm can dramatically improve sequential performance, thereby reducing times for backup, processing for business intelligence, and streaming media. Sequential Adaptive Replacement Cache is a caching algorithm that allows you to run different workloads like sequential and random workloads without negatively impacting each other. For example, sequential workload does not fill upChapter 1. Introduction to the IBM System Storage DS8870

5



the cache and does not impact cache hits for random workload. Intelligent Write Caching (IWC) improves the Cache Algorithm for random writes. IBM proves the performance of its storage systems by publishing standardized benchmark results. See http://www.storageperformance.org for benchmark results of the DS8870. 8 Gbps host adapters (HAs): The DS8870 model offers enhanced connectivity with 4 and 8-port Fibre Channel/FICON host adapters located in the I/O enclosures that are directly connected to the internal processor complexes. The 8 Gbps Fibre Channel/FICON host adapter also supports FICON attachment to IBM System zEC12, IBM zEnterprise 196 (z196), IBM System z114, and IBM System z10. Each port can be configured by the user to operate as a Fibre Channel Port, a FICON port or a Fibre Channel port used for mirroring. High Performance FICON for System z (zHPF): zHPF is z/OSs new I/O architecture. Step by step z/OSs access methods have been converted to use the new I/O commands. zHPF is an optional feature of the DS8870. The DS8870 is at the most up-to-date support level for zHPF. Recent enhancements to zHPF include Extended Distance capability, zHPF List Pre-fetch support for IBM DB2 and utility operations, and zHPF support for sequential access methods. All DB2 I/O is now zHPF capable. Peripheral Component Interconnect Express (PCI Express Generation 2) I/O enclosures: To improve I/O Operations Per Second (IOPS) and sequential read/write throughput, the I/O enclosures are directly connected to the internal servers with point-to-point PCI Express cables. Storage Pool Striping (rotate extents) provides a mechanism to distribute a volumes or LUNs data across many RAID arrays and hence across many disk drives. Storage Pool Striping helps maximize performance without special tuning and greatly reduces hot spots in arrays. Easy Tier: This free of charge feature enables automatic dynamic data relocation capabilities. Data areas that are accessed frequently are moved to higher tier disks, for example to SSDs while infrequently accessed data areas are moved to lower tiers, for example nearline-SAS drives. Easy Tier optimizes the usage of each tier, especially the utilization of SSDs. It supports a combination of three classes or storage tiers (nearline, Solid State Drives, and Enterprise Disks). No manual tuning is required. Configuration flexibility and overall storage cost-performance can greatly benefit from the exploitation of this feature. The auto-balancing algorithms also provide benefits when homogeneous disk pools are used to eliminate hot spots on disk arrays. Easy Tier also allows several manual data relocation capabilities (extent pools merge, rank depopulation, volume migration). Easy Tier can also be used when encryption support is turned on. Please refer to the Chapter 7.7, IBM Easy Tier on page 183 for more information. Storage Tier Advisor Tool: This tool is used in conjunction with the Easy Tier facility to help clients understand their current disk system workloads and provides guidance on how much of their existing data would be better suited for the various drive types (Spinning disk or Solid-State Drives). I/O Priority Manager: This is an optional feature that provides application-level Quality of Service (QoS) for workloads that share a storage pool. This feature provides a way to manage quality of service for I/O operations associated with critical workloads and gives them priority over other I/O operations associated with non-critical workloads. For z/OS the I/O Priority Manager allows increased interaction with the host side. Refer to Chapter 1.4.4, Performance for System z on page 20 and Chapter 7.6, I/O Priority Manager on page 181 for more information.

6




Large volume support: The DS8870 supports LUN sizes up to 16 TB. This helps to simplify storage management tasks. In a z/OS environment Extended Address Volumes (EAVs) with sizes up to 1 TB are supported. Active Volume Protection: This is a feature that prevents the deletion of volumes still in use. T10 DIF support. The Data Integrity Field standard of SCSI T10 enables end-to-end data protection from the application or host HBA down to the disk drives. The DS8870 supports the T10 DIF standard. The Dynamic Volume Expansion simplifies management by enabling easier, online volume expansion (for Open Systems and System z) to support application data growth, and to support data center migration and consolidation to larger volumes to ease addressing constraints. Thin Provisioning: This feature allows the creation of over-provisioned devices for more efficient usage of the storage capacity for Open Systems. Copy Services is now available for Thin Provisioning. Refer to Chapter 6, IBM System Storage DS8000 Copy Services overview on page 133 for further information. Quick Initialization: This feature provides very fast volume initialization (for Open Systems LUNs and CKD volumes) and therefore allows the creation of devices, making them available as soon as the command completes. The Full Disk Encryption (FDE) can protect business-sensitive data by providing disk-based hardware encryption combined with a sophisticated key management software (IBM Tivoli Key Lifecycle Manager). The Full Disk Encryption is available for all disk and drives, including SSDs. Since encryption is done by the disk drive it is completely transparent to host systems and can be used in any environment including z/OS. To find out more about this feature refer to IBM System Storage DS8700 Disk Encryption Implementation and Usage Guidelines, REDP-4500. Disk encryption key management that helps address Payment Card Industry Data Security Standard (PCI-DSS) requirements: Encryption deadlock recovery key option: When enabled, this option allows the user to restore access to a DS8000 when the encryption key for the storage is unavailable due to an encryption deadlock scenario. Dual platform key server support: This is important if key servers on z/OS share keys with key servers on Open Systems. The DS8000 requires an isolated key server in encryption configurations. The isolated key server currently defined is an IBM System x server. Dual platform key server support allows two server platforms to host the key manager with either platform operating in either clear key or secure key mode. Recovery key Enabling/Disabling and Rekey data key option for the Full Disk Encryption (FDE) feature: Both of these enhancements can help clients satisfy Payment Card Industry (PCI) security standards Resource Groups: This feature is a policy-based resource scope limiting function that enables the secure use of Copy Services functions by multiple users on a DS8000 series storage subsystem. Resource Groups are used to define an aggregation of resources and policies for configuration and management of those resources. The scope of the aggregated resources can be tailored to meet each hosted customers Copy Services requirements for any given operating system platform supported by the DS8000 series. Refer to IBM System Storage DS8000 Resource Groups, REDP-4758 for more information. FlashCopy: FlashCopy is an optional feature that allows the creation of volume copies (and dataset copies for z/OS) nearly instantaneously. Different options are available to create full copies, incremental copies or copy-on-write copies. The concept of Consistency

Chapter 1. Introduction to the IBM System Storage DS8870

7



Groups provide a means to copy several volumes consistently even across several DS8000 systems. FlashCopy can be used to do backup operations parallel to production or to create test systems. FlashCopy can be managed with the help of IBMs FlashCopy Manager product from within certain applications like DB2, Oracle, SAP, or Microsoft Exchange. FlashCopy is also supported by z/OS backup functions like DFSMS and DB2 BACKUP SYSTEM. The IBM FlashCopy SE capability enables more space efficient utilization of capacity for copies, enabling improved cost effectiveness. Remote Mirroring options: The DS8870 provides the same remote mirroring options as previous models of the DS8000 family. Synchronous remote mirroring (Metro Mirror) is supported up to 300 km. Asynchronous copy (Global Mirror) is supported for unlimited distances. Three-site options are available by combining Metro Mirror and Global Mirror. In co-operation with z/OSs Data Mover another option is available for z/OS: Global Mirror for z/OS. Another important feature for z/OS Global Mirror (2-site) and z/OS Metro/Global Mirror (3-site) is Extended Distance FICON, which can help reduce the need for channel extenders configurations by increasing the number of read commands in flight. Metro Mirror, Global Copy, Global Mirror, Metro/Global Mirror, z/OS Global Mirror, and z/OS Metro/Global Mirror business continuity solutions are designed to provide the advanced functionality and flexibility needed to tailor a business continuity environment for almost any recovery point or recovery time objective. The Copy Services can be managed and automated with IBM Tivoli Storage Productivity Center for Replication (TPC-R). For z/OS environments, IBMs GDPS provides an automated disaster recovery solution. Remote Pair FlashCopy: Allows you to establish a FlashCopy relationship where the target is a remote mirror Metro Mirror primary volume keeping the pair in the full duplex state. The DS8870 provides an improved DS GUI management interface to configure the DS8870 or query status information. The DS8870 DS GUI has the same look-and-feel as the GUIs of other IBM storage products making it easier for a storage administrator to work with different IBM storage products. Consult Chapter 13, Configuration using the DS Storage Manager GUI on page 295 for additional information. LDAP authentication support, which allows single sign-on functionality, can simplify user management by allowing both the DS8000 to rely on a centralized LDAP directory rather than a local user repository. Refer to IBM System Storage DS8000: LDAP Authentication, REDP-4505 for more information The DS8000 series has been certified as meeting the requirements of the IPv6 Read Logo program, indicating its implementation of IPv6 mandatory core protocols and the ability to interoperate with other IPv6 implementations. The IBM DS8000 can be configured in native IPv6 environments. The logo program provides conformance and interoperability test specifications based on open standards to support IPv6 deployment globally. Furthermore, the US National Institute of Standards and Technology has tested IPv6 with the DS8000 thus granting it support form the USGV6 profile and testing program.

8




1.2 The DS8870 controller options and framesThe IBM System Storage DS8870 adds Models 961 (base frame) and 96E (expansion unit) to the 242x machine type family. Compared with its predecessors, IBM System Storage DS8100, DS8300, DS8700, and DS8800, the DS8870 is designed to provide capabilities for the combination of price and efficiency. The DS8870 features: IBM POWER7 processor technology: The DS8870 features the IBM POWER7 server technology for high performance. Compared to the POWER6 processor in the DS8800, the POWER7 processor can deliver up to three times more throughput in I/O operations per second (IOPS) in transaction processing workload environments. The DS8870 utilizes the simultaneous multithreading (SMT) capabilities of the POWER7 architecture. Additionally, sequential workloads can receive as much as 60% bandwidth improvement. The DS8700 offers either a dual 2-core processor complex, a dual 4-core processor complex, a dual 8-core processor complex, and a dual 16-core processor complex. A non-disruptive upgrade path for the DS8870 configurations and additional Model 96E expansion frames allows processor, cache, and storage enhancement to be performed concurrently, that is without disrupting applications. The air-flow system allows optimal horizontal cool down of the storage system. The DS8870 is designed for hot and cold aisle data center design, drawing air for cooling from the front of the system and exhausting hot air at the rear. Refer to Chapter 3.5, Power and cooling on page 53 for additional information. Improved configuration options The DS8870 also provides a Business Class configuration option. The Business Class option offers an entry level configuration cost. The Business Class model can be upgraded nondisruptively to a standard configuration. High density storage enclosures The DS8870 provides storage enclosure support for 24 small form factor (SFF, 2.5-inch) drives in 2U of rack space. This option helps improve the storage density for disk drive modules (DDMs) as compared to previous enclosures. Improved high-density frame design The DS8870 can support a total of 1536 drives in a small footprint (three frames) supporting high density and helping to preserve valuable raised floor space in data center environments. Coupled with this improved cooling implementation and small form factor SAS-2.0 Enterprise drives, a fully configured DS8870 consumes up to 20% less power than its predecessor model DS8800. The DS8870 base frame supports up to 240 drives, with the first expansion frame supporting up to 576 drives, the second expansion frame supporting up to 1,056 drives and the third expansion supporting up to 1536 drives in the size of 2.5?. As an alternative, the DS8870 also supports 3.5? disk drives with up to 120 drives with the base frame, with the first expansion frame supporting up to 288 drives, the second expansion frame supporting 528 drives, and the third expansion frame supporting 768 drives in the size of 3.5?.

Chapter 1. Introduction to the IBM System Storage DS8870

9



1.3 DS8870 architecture and functions overviewFrom an architectural point of view, the DS8870 offers continuity with respect to the fundamental architecture of their predecessors the DS8100, DS8300, DS8700, and DS8800 models. This ensures that the DS8870 can use a stable and well-proven operating environment, offering optimal availability. The hardware is optimized to provide higher performance, connectivity, and reliability.

1.3.1 Overall architecture and componentsThe DS8870 is available with separate configurations, which are discussed in detail in Chapter 2, IBM System Storage DS8870 models on page 23.

IBM POWER 7 processor technologyThe DS8870 uses IBM POWER7 processor technology. The POWER7 processor chip is fabricated using the IBM 45 nm Silicon-On-Insulator (SOI) technology using copper interconnect and implements an on-chip L3 cache using eDRAM. The DS8870s P7 processor runs at 3.55 GHz. An enhancement with the POWER7 processor is the addition of the Simultaneous Multi-Threading SMT4 mode. SMT4 enables four instruction threads to execute simultaneously in each POWER7 processor core. It maximizes the throughput of the processor core by offering an increase in core efficiency. These multithreading capabilities help to improve the I/O throughput of the DS8870 storage server. The DS8870 offers either a dual 2-core processor complex, a dual 4-core processor complex, a dual 8-core processor complex, or a dual 16-core processor complex. A processor complex is also referred to as a storage server or Central Electronics Complex (CEC). For more information, see Chapter 4, RAS on IBM System Storage DS8870 on page 59.

Internal PCIe-based fabricThe DS8870 uses direct point-to-point high-speed PCI Express (PCIe) connections to the I/O enclosures to communicate with the device adaptors and host adapters. Each single PCIe connection operates at a speed of 2 GBps in each direction. There are up to 16 PCIe connections from the processor complexes to the I/O enclosures. For more information, see Chapter 3, DS8870 hardware components and architecture on page 33.

Device adaptersThe DS8870 offers4-port Fibre Channel Arbitrated Loop (FC-AL) Device Adapters (DA). All adapters provide improved IOPS, throughput, and scalability over previous DS8000s. They are optimized for SSD technology and architected for long-term support for scalability growth. These capabilities complement the POWER server family to provide significant performance enhancements allowing up to a 400% improvement in performance over previous generations (DS8700). For more information, see Chapter 3, DS8870 hardware components and architecture on page 33.

Switched Fibre Channel arbitrated loopThe DS8870 uses a switched Fibre Channel arbitrated loop (FC-AL) architecture as the backend for its disk interconnection. The DAs connect to the controller cards in the storage enclosures using FC-AL with optical short wave multi-mode interconnection. The Fibre Channel Interface Controller cards (FCIC) offer a point-to-point connection to each drive and device adapter, so that there are four paths available from the DS8000 processor complexes

10




to each disk drive. For more information, see Chapter 3, DS8870 hardware components and architecture on page 33.

Disk drivesThe DS8870 offers a variety of disk drives to meet the requirements of various workload and configurations. For more information, see Chapter 8, DS8870 Physical planning and installation on page 207. 146, and 300 GB (15K RPM) Enterprise disk drives can be installed in the DS8870 if high performance is required. The DS8870 also supports 600 GB, and 900 GB (10K RPM) disk drives for standard performance requirements. Additionally, 3 TB (7200K RPM) Nearline-SAS disk drives are supported for large capacity requirements. The DS8870 also supports 400 GB Solid-State Drives (SSDs) for highest performance demands. All drives in the DS8870 are now Full Disk Encryption (FDE) capable drives. You do not need to use encryption, but if you want to encrypt your data you need at least two key servers like the Tivoli Key Lifecycle Manager or IBM Security Key Lifecycle Manager for z/OS. Solid-State Drives are the best choice for I/O-intensive workloads. They provide up to 100 times the throughput and 10 times lower response time than 15K rpm spinning disks. They also consume less power than traditional spinning disks. For more information, see Chapter 8, DS8870 Physical planning and installation on page 207.

Easy TierEasy Tier enables the DS8870 to automatically balance I/O access to disk drives to avoid hot spots on disk arrays. Easy Tier can place data in the storage tier that best suits the access frequency of the data. Highly-accessed data can be moved nondisruptively to a higher tier, for example to SSD disks while cold data or data that is primarily accessed sequentially can be moved to a lower tier, for example to Nearline disks. However, Easy Tie

ds8700 architecture guide

Documents