ibm z capacity planning tools (zbna focus) apr pres...ibm z capacity planning tools (zbna focus) for...

Jim Elliott – Mainframe ConsultantGlassHouse Systems Inc.

IBM Z Capacity Planning Tools (zBNA Focus)

2018-04-25

GlassHouse Systems

The following are trademarks of the International Business Machines Corporation in the United States and/or other countries.

Db2*DFSMSdssDFSMShsmECKD

FICON*Flash SystemsGDPS*HiperSockets

HyperSwap*IBM*IBM (logo)*ibm.com

IBM Z*LinuxONELinuxONE Emperor IILinuxONE Rockhopper II

Power SystemsPR/SMStorwize*System Storage*

WebSphere*z13*z13sz14

zEnterprise*zHyperLink

z/OS*z/VM*z/VSE*

* Registered trademarks of IBM CorporationLinux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. UNIX is a registered trademark of The Open Group in the United States and other countries. Other product and service names might be trademarks of IBM or other companies.

Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.This information provides only general descriptions of the types and portions of workloads that are eligible for execution on Specialty Engines (e.g, zIIPs, zAAPs, and IFLs) ("SEs"). IBM authorizes customers to use IBM SE only to execute the processing of Eligible Workloads of specific Programs expressly authorized by IBM as specified in the “Authorized Use Table for IBM Machines” provided at www.ibm.com/systems/support/machine_warranties/machine_code/aut.html (“AUT”). No other workload processing is authorized for execution on an SE. IBM offers SE at a lower price than General Processors/Central Processors because customers are authorized to use SEs only to process certain types and/or amounts of workloads as specified by IBM in the AUT.

Trademarks and notices

IBM Z Capacity Planning Tools (zBNA Focus) for CMG 2018-04-25

GlassHouse Systems

▪This presentation would not have been possible without the work of those in the IBM Washington Systems Center in creating the tools‒John Burg, John Campbell, John Fitch, Gretchen Frye, Bernice

Gleaton, Tom Harper, Shawn Lundvall, Alex Patterson, Valerie Spencer, and others

▪ I would especially like to thank John Burg from whom I copied the structure (and some content) for the zBNA part of this presentation

Acknowledgements


GlassHouse Systems

IBM Z Capacity Planning Tools


GlassHouse Systems

▪ There are many documents and tools available to assist in IBM Z capacity planning‒LSPR – Large Systems Performance Reference‒CPU MF – CPU Measurement Facility‒zSoftCap – Software Migration Capacity Planning Aid for IBM Z‒Data extraction tools: CP3KEXTR for z/OS, CP3KVMXT for z/VM,

CPUMON for z/VSE‒zPCR – IBM Z Processor Capacity Reference‒zCP3000 – Performance Analysis and Capacity Planning Tool‒zBNA – IBM Z Batch Network Analyzer

▪ The customer versions of these tools to support the 3907 (z14 ZR1 and LinuxONE Rockhopper II) are planned to be available on May 31, 2018

IBM Z capacity planning tools


GlassHouse Systems

▪Per thread (engine) speed improvements for CMOS CPs is slowing dramatically‒Every CMOS platform is facing this issue‒Future capacity gains will be by adding more CPs rather than much

faster CPs‒Enhances need for parallel operation and more reliance on parallel

sysplex▪Availability of subcapacity models continues to grow

‒Provide capacity as more, slower processors increasing parallelism‒Especially useful in environment with large number of LPARs‒Additional capacity can be acquired in smaller increments‒Receive benefit since Specialty CPs run at full n-way speed

IBM Z capacity planning opportunities


GlassHouse Systems

▪ Fewer Faster CPs‒ High priority workloads see great benefits‒ Have the ability to monopolize a CP‒ A high priority workload with lots of ready thread

can dominate the logical CPs in a partition‒ On a migration a previously limited workload can

now use more capacity• High Priority work performs better

‒ Control with WLM resource groups▪ LPAR Weight Issues – more LPARs with logical CPs

with smaller per CP share

▪ More, Slower CPs‒ More work units are active‒ Can limit a task’s throughput‒ Increased parallelism‒ Limits the impact of a workload

which monopolizes a CP‒ Can trade-off slower CP speeds

with a reduction in CPU queue delay

‒ Can build LPARs with greater CP share

Fewer, faster CPs vs. more, slower CPs


MIPS LPAR 1 LPAR 2 LPAR 3 LPAR 4 LPAR 5 LPAR 6Weight 30 30 10 10 10 10

2964-704 6041 1.2 CPs 1.2 CPs 0.4 CPs 0.4 CPs 0.4 CPs 0.4 CPs2964-510 6145 3 CPs 3 CPs 1 CP 1 CP 1 CP 1 CP

Impact of these trends will most likely be seen first in the Batch Window

GlassHouse Systems

▪ IBM Z provides capacity comparisons among processors based on a variety of measured workloads which are published in the Large System Performance Reference (LSPR)‒ https://ibm.com/servers/resourcelink/lib03060.nsf/pages/lsprindex‒ Now based on z/OS 2.2, Db2 11, CICS 5.3, IMS 14, Cobol 6.1, WAS 8.5.5.9

Note: Capacity ratios may vary if using older versions of these subsystems‒ Minor tweaks to the three workload categories based on customers’ CPU MF data for zEC12

to z13 migrations▪ Old and new processors are measured in the same environment with the same workloads at

high utilizations▪ Over time, workloads and environment are updated to stay current with customer profiles

‒ Old processors measured with new workloads/environment may have different average capacity ratios compared to when they were originally measured

▪ LSPR presents capacity ratios among processors▪ Single number metrics include PCI/MIPS, MSUs, and SRM Constants

‒ MIPS is based on the ratios for the “Average” workload category with a median customer LPAR configuration

Large Systems Performance Reference


https://www.ibm.com/servers/resourcelink/lib03060.nsf/pages/lsprindex

GlassHouse Systems

▪ Before and after CPU MF counters data will be critical to determine the source of variation for workloads that do encounter it ‒ Ensure the CPU MF data is captured and kept for analysis‒ For z/VM “Before” and “After” peak hour data must be written to disk

▪ Critical migration action for every new / upgrade processor candidate (z/OS and z/VM)‒ CPU MF counters must be enabled on your current processor‒ CPU MF counters must be enabled on your new processor

▪ Take action to validate CPU MF is implemented or get a plan started to implement CPU MF‒ CPU MF Webinar Replays and Presentations

• http://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4922

‒ z/OS CPU MF - “Detailed Instructions” Step by Step Guide• http://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/TC000066

‒ z/VM Using CPU Measurement Facility Host Counters• http://ibm.com/vm/perf/tips/cpumf.html

‒ Minimal overhead – customers should run continuously

CPU Measurement Facility


http://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4922

http://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/TC000066

http://vm.ibm.com/perf/tips/cpumf.html

GlassHouse Systems

▪ The Extract program, CP3KEXTR, runs on a z/OS system where it reads and summarizes one or more SMF datasets for subsequent analysis by one of the CPS Tools Applications (zCP3000, zBNA, or zPCR)

▪ The program performs these functions:‒Parses the complex structure of the SMF data‒Extracts selected fields needed by the Tools applications‒Combines the data into a series of Extract “reporting periods” ‒Produces an Enterprise Data File (EDF) that is read by the analysis

applications‒Optionally writes a separate file for zBNA with selected SMF fields‒Generates and/or uses several supplemental mapping files

▪ IBM Customers can obtain CP3KEXTR via the Internet at: http://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4229

CP3KEXTR z/OS Data Extraction Program


http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4229

GlassHouse Systems

▪ SMF record types/subtypes required (depending on the tool):‒Type 14 Input dataset activity‒Type 15 Output dataset activity‒Type 30 Common Address Space Work (Subtypes 2, 3, 4, and 5)‒Type 42 DFP Statistics (Subtype 6)‒Type 70 CPU activity record (Subtypes 1 and 2)‒Type 71 Paging Activity (Subtype 1)‒Type 72 Workload Activity (Subtypes 1 and 3)‒Type 73 Channel Path Activity (Subtype 1)‒Type 74 Device Activity (Subtypes 1, 4, and 5)‒Type 75 Page/Swap Data Set Activity (Subtype 1)‒Type 78 I/O Queuing Activity (Subtypes 1, 2, and 3)‒Type 113 Records hardware capacity, reporting, and statistics

CP3KEXTR Additional notes


GlassHouse Systems

▪ The zCP3000 VM Extract Utility (CP3KVMXT) summarizes VM monitor data into a structured but readable file

▪ The intended use is to create an input file to the IBM zCP3000 Capacity Planning tool

▪ The CP3KVMXT utility‒ Accepts as input either real-time monitor data or saved monitor data‒ Accumulates CP intervals into longer, user-defined measurement periods.‒ Supports the use of a “UCLASS file” for grouping users into workloads

▪ The accumulation of CP intervals into longer “durations” makes it easier to deal with the longer time periods of performance data needed for capacity planning

▪ It can be used to model interactive CMS workloads or workloads under guest operating systems such as Linux on Z

▪ IBM Customers can obtain CP3KVMXT via the Internet at: https://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS718

CP3KVMXT z/VM Extract Utility


https://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS718

GlassHouse Systems

▪ The z/VSE CPU Monitor Tool is intended to help customers to measure the CPU utilization of their z/VSE system over a period of time

▪ Especially when you plan for a processor upgrade it is very important to know the CPU utilization of your z/VSE system over a day or a week

▪ This helps you to estimate the size of the new processor▪ The z/VSE CPU Monitor Tool is not intended to replace any existing monitoring

product provided by partners‒ It provides only very basic monitoring capabilities on an overall z/VSE system

level‒ No details about CPU usage of certain applications are provided

▪ zCP3000 can use the XML output from CPUMON to model z/VSE▪ IBM Customers can obtain CPUMON via the Internet at:

https://ibm.com/systems/z/os/zvse/downloads/tools.html#cpumontool

CPUMONz/VSE CPU Monitor Tool


https://www-03.ibm.com/systems/z/os/zvse/downloads/tools.html#cpumontool

GlassHouse Systems

▪ zSoftCap is a Windows-based productivity tool, designed to assess the effect on IBM Z processor capacity, when planning to upgrade to a more current operating system version and/or major subsystems versions

▪ zSoftCap assumes that the hardware configuration remains constant while the software version or release changes▪ The capacity implication of an upgrade for the software components can be assessed independently or in any

combination▪ z/OS Environments Supported

‒ z/OS: z/OS V1R5 through z/OS V2R3; CICS: CICS/TS 1.1 through CICS/TS 5.4; IMS: IMS V4 through IMS V14 ▪ z/VSE Environments Supported

‒ z/VSE: VSE/ESA 2.3 through z/VSE 6.2; CICS: CICS/VSE, CICS/TS 1.1 through CICS/TS 2.2 (dependent on z/VSE version) ▪ Information Provided

‒ Results show the effective change in processor utilization and the net benefit or cost in capacity that can be expected when moving to newer software versions

‒ For z/OS environments, if upgrading multiple components, a report is available showing the effect of each as well as their combined effect on capacity

▪ IBM Customers can obtain zSoftCap via the Internet at: http://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS268

zSoftCapSoftware Migration Capacity Planning Aid for IBM Z


http://www.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS268

GlassHouse Systems

▪ zPCR is a Windows-based productivity tool▪ It is designed to provide capacity planning insight for IBM Z and

LinuxONE processors running LPAR configurations with various workload environments under z/OS, z/VM, z/VSE, KVM on Z, Linux on Z, SSC, and CFCC

▪ Capacity results are based on IBM’s LSPR data supporting all IBM Z and LinuxONE processors including the new IBM z14 Model ZR1 and LinuxONE Rockhopper II processor families

▪ IBM Customers can obtain zPCR via the Internet at: https://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS1381

zPCRProcessor Capacity Reference for IBM Z


https://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS1381

GlassHouse Systems

▪ zAAPs are not supported on z13, z13s, and z14‒ If changing host to z14, zAAP partitions will be invalid and excluded‒ Replace zAAP partitions with zIIP partitions using Partition Definition window

▪ Absolute Capping (zEC12, zBC12, z13, z13s, and z14)‒ User can specify an absolute capping limit in 1/100th of a processor

▪ SMT support (z13, z13s and z14)‒ z/OS 2.1 or later on zIIPs‒ z/VM 6.4 or later, the KVM hypervisor, and Linux on Z running on IFLs‒ Default capacity benefit for zIIPs and IFLs is now 25% (20% for z13/z13s IFLs)‒ User can set estimated capacity benefit for IFL and zIIP partitions from 0% to 60% (1% increments)‒ Measured capacity benefit read from EDF (z/OS or z/VM) or RMF CPU Activity Report (z/OS)

• Increase measured benefit by 5% for z/VM when changing LPAR host from z13s to z14 ZR1, otherwise use the same measured benefit for z14 ZR1

‒ Margin-of-error using default SMT capacity benefit can be significantly higher‒ Margin-of-error is indeterminate if user overrides default SMT capacity benefit‒ New extract program versions (CP3KEXTR, CP3KVMXT) will be necessary to assess z14 ZR1 upgrade

zPCRAdditional notes


GlassHouse Systems

▪There are multiple variations of MIPS, and all can be misleading‒Pricing MIPS – these are set at announce time and never change,

used for pricing out GCP capacity and OOCoD GCP capacity‒Planning MIPS – the LSPR-based MIPS which are based on the

LSPR workloads ONLY on GCPs and may change as LSPR workloads change

‒Configuration MIPS – based on a specific configuration including GCPs, zIIPs, IFLs, and ICFs

MIPS – A misleading indicator of processor speed


GlassHouse Systems

A real world example using zPCR


zBC12 W03

zBC12 W03 is 1,966 planning MIPS, actual GCP MIPS are 1,808

CP PoolReal

LPsDED SHR Sum of Capacity

CPs LCPs LCPs LCP:RCP Weights Totals

GP 3 7 12 4 1,130 1,808

zIIP 2 7 10 5 1,200 1,737

IFL 2 3 6 3 1,200 2,024

ICF 1 2 2 2 1,000 925

Totals 8 19 0 30 6,494

z14 S03

z14 S03 is 2,038 planning MIPS, actual GCP MIPS are 1,887

CP PoolReal

LPsDED SHR Sum of SMT Capacity

CPs LCPs LCPs LCP:RCP Weights Benefit Totals

GP 3 7 12 4 1,130 1,887

zIIP 2 7 10 5 1,200 est. 25% 3,372

IFL 2 3 6 3 1,200 est. 25% 3,739

ICF 1 2 2 2 1,000 1,255

Totals 8 19 0 30 10,253

For significant configuration changes such as upgrading the processor family, consider capacity comparisons to have a +/-5% margin-of-errorWhen the default estimated SMT Benefit is assigned to a partition, margin-of-error is +/-10%; For larger estimates, margin-of-error will be greater

GlassHouse Systems

▪ zCP3000 is a Windows-based productivity tool and is designed to provide performance analysis and capacity planning for IBM Z processors running various SCP/workload environments

▪ zCP3000 can also be used to analyze logically partitioned processors and DASD configurations

▪Data sources:‒z/OS: (usually RMF data from the processors considered for

replacement) collected using a separate tool, CP3KEXTR‒z/VM: monitor data collected using a separate tool, CPVMEXTR‒z/VSE: performance data collected using a separate tool, CPUMON

▪ zCP3000 is NOT available for use by customers, but your IBM or BP mainframe tech specialist can do the analysis for you

zCP3000 Performance Analysis & Capacity Planning Tool


GlassHouse Systems

A real world example using zCP3000


GlassHouse Systems

IBM Z Batch Network Analyzer


GlassHouse Systems

▪ zBNA is a Windows-based application that accepts SMF Type 14, 15, 30, 42, 70, 72, 74, and 113 data extracted using the CP3KEXTR program to analyze a single batch window of user defined length

▪ The program is focused on Batch Jobs and will ignore records which are not batch jobs‒ If a task originated as a started task or as a TSO user, these are not included in the analysis even though

they have generated Type 30 data▪ zBNA provides powerful, graphic demonstration of the z/OS batch window▪ New in zBNA Version 1.3, dated December 31, 2013, is the zEnterprise Data Compression (zEDC) function

‒ zBNA provides a means of estimating the amount of data which may be eligible for compression using the IBM zEDC Express PCIe card available on either a zEC12/zBC12 or newer

‒ The intention is to give the customer a starting point for identifying how much zEDC Express capacity they may need to support their workloads

▪ New in zBNA Version 1.8.1, dated August 25, 2017, is support for Data Set and Coupling Facility Encryption‒ The performance APARs OA53718 and OA53664 must be applied to the system for z14 estimations

▪ New in zBNA Version 1.8.2, dated April 10, 2018, is support for zHyperLink‒ There are both IBM Z hardware and z/OS requirements, which must be met along with SMF 42.6

enhancements▪ IBM Customers can obtain zBNA via the Internet at:

https://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS5132

zBNA overview


https://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS5132

GlassHouse Systems

zBNA overview


▪ zBNA is used to:‒ Identify job time sequences based on a graphical view‒ Filter jobs by attributes like CPU time / intensity, job class, service class, etc.‒ Review the resource consumption of all the batch jobs‒ Drill down to the individual steps to see the resource usage‒ Identify candidate jobs for running on different processors‒ Identify jobs with speed of engine concerns (top program %)‒ Identify data sets used in a job and the set of jobs that use a data set (Life of A Data Set)‒ Identify jobs and BSAM/QSAM data sets that are zEDC compression candidates across a specified time window‒ Estimate the amount of data which may be eligible for encryption‒ Estimate the amount of data which may be eligible for zHyperLink

▪ zBNA allows “what if” analysis to be performed to see how the specified batch window would run in a different environment and generates output in the form of:‒ Saved studies that can be loaded another time‒ Gantt charts of the jobs and filters applied in the study‒ A multiple system graph for the zEDC, Data Set/Encryption, zHyperLink applications‒ A CSV file of “interesting” data‒ A report saved in HTML format that can be displayed in a browser or a word processor for further manipulation

GlassHouse Systems

▪SMF record types/subtypes required:‒Type 14 Input dataset activity‒Type 15 Output dataset activity‒Type 30 Common Address Space Work (Subtypes 4 and 5)‒Type 42 DFP Statistics (Subtype 6)‒Type 70 CPU activity record (Subtypes 1 and 2)‒Type 72 Workload Activity (Subtypes 1 and 3)‒Type 74 Device Activity (Subtypes 1, 4, and 5)‒Type 113 Records hardware capacity, reporting, and statistics

zBNA multiple data sources


GlassHouse Systems

▪ Identify Batch Resource Usage‒ Filter jobs by attributes like CPU time / intensity, job class, service class, etc.‒ Review the resource consumption of batch jobs‒ Drill down to the individual Steps to see resource usage and DASD data sets used‒ Identify job time sequences based on a graphical view

▪ Analyze the “Batch Window”‒ Identify candidate jobs for running on different processors‒ Identify jobs with speed of engine concerns (top tasks %)

▪ Identify DASD data sets used by jobs, and Top DASD data sets overall▪ Project Current Batch Environment to a new Processor

‒ Perform “what if” analysis and estimate the CPU upgrade effect on batch window▪ Evaluate benefits of zEDC BSAM/QSAM Compression

‒ Identify BSAM/QSAM Compression candidates‒ Estimate number of zEDCExpress cards and potential CPU and IO savings

▪ Evaluate candidates for DFSMS Data Set and CF Encryption▪ Evaluate candidates for zHyperLink

What can you do with zBNA?


GlassHouse Systems

Loading CP3KEXTR data into zBNA


GlassHouse Systems

zBNA main panel


GlassHouse Systems

zBNA filtering capability


GlassHouse Systems

1825

118

GCP > 10 seconds

Excluded jobs Remaining jobs

105

13

GCP > 10 seconds AND top program % > 10%

Excluded jobs Remaining jobs

Filtering rationale


GlassHouse Systems

Display graph for filtered jobs


GlassHouse Systems

GCP utilization graph


GlassHouse Systems

Rolling 4 hour average graph


GlassHouse Systems

Job details for filtered jobs Elapsed time descending


GlassHouse Systems

Step details for job JPNCI034


GlassHouse Systems

Life of a program


GlassHouse Systems

Job data set report


GlassHouse Systems

Life of a data set report


GlassHouse Systems

Alternate processor analysiszBC12 W03 vs. z14 S03


GlassHouse Systems

Top data sets report


GlassHouse Systems

zEDC top data set candidates


GlassHouse Systems

zEDC charts


GlassHouse Systems

▪ DFSMS Data Set Encryption Support‒ Top Candidate List for data set Encryption selectable by Service Class and Job Name filters‒ Able to filter the data by time‒ Ability to estimate the CPU cost of encrypt / decrypt activities for candidate data sets

▪ z/OS Coupling Facility Structure Encryption Support‒ Top Candidate List for CF cache and CF list structure selectable by CF, structure name,

structure type filters‒ Able to filter the data by time‒ Ability to estimate the CPU cost of encrypt / decrypt activities for candidate structures

▪ Generate customer reports with text and graphs to show encryption potential across time▪ Export the zBNA Encryption data to CSVs for additional off-line analysis▪ Provide support to aggregate zBNA LPAR results into CEC level views▪ Requires SMF data (42.6, 74.4 records) created from a system with the PTFs for these APARs:

zBNA encryption support


z/OS 2.1 or 2.2 z/OS 2.3 FunctionDFSMS OA52132 OA52734 SMF 42.6 for data set encryption

XES OA51879 Base SMF 74.4 for coupling data encryptionRMF OA52003 Base SMF 74.4 for coupling data encryption

GlassHouse Systems

Data set encryption top candidates


GlassHouse Systems

Data set encryption MIPS with pervasive encryption on z14


GlassHouse Systems

Coupling Facility encryption top structure candidates


GlassHouse Systems

▪Top Data Set Candidate List for zHyperLink▪Data filtering capability▪Ability to estimate the benefit of zHyperLink I/O activity▪Generate customer reports with text and graphs to show

zHyperLink benefit▪Provide support to aggregate zBNA LPAR

results into CEC level views▪The PTF for APAR OA52133 is required to

get the required data in the SMF 42.6 records

zHyperLink support


GlassHouse Systems 2018-04-25IBM Z Capacity Planning Tools (zBNA Focus) for CMG

ibm z capacity planning tools (zbna focus) apr pres...ibm z capacity planning tools (zbna focus) for...

Documents