jobo 5 im_stools_update_2012_q2

© 2012 IBM Corporation

IMS Tools from IBMLatest NewsJune 2012

Helene Lyon

[email protected]

DE, European IMS Architecture Team Technical Executive

© 2012 IBM Corporation

DB2 and IMS Data Management Tools

2000: Reduce your TCO

2007+Reduce your TCO & Increase your value

2004 Autonomic Computing and End to End Monitoring

Reducing TCO is our first focus

�Provide autonomic features to add capability

and simplify operations

�Avoid tedious tasks and reduce errors

�Preserve your investment in z/OS applications

and databases

2003: Integration of products, new capabilities, better performance

2001-2002 Product replacements

2003-Day 1 Support

© 2012 IBM Corporation3

IMS Tools Modernization and Autonomics

IMS Fast Path Solution Pack for z/OS

IMS HP Fast Path UtilitiesIMS DB Repair FacilityIMS HP Image CopyIMS Library Integrity Utilities

IMS Recovery Solution Pack for z/OS

IMS HP Image CopyIMS Database Recovery FacilityIMS HP Change AccumulationIMS Index BuilderIMS DRF Extended Functions

IMS Performance Solution Pack for z/OS

IMS Connect ExtensionsIMS Performance AnalyzerIMS Problem Investigator

IMS Database Solution Pack for z/OS

IMS DB Reorganization Expert- Unload, Load, Index Build, Prefix Resolution/UpdateIMS HP Image CopyIMS HP Pointer CheckerIMS Library Integrity Utilities

�IMS HALDB Toolkit�IMS Sequential Randomizer Generator

Data Base Administration

�IMS Online Reorganization Facility�IMS Cloning Tool�IMS Database Control Suite

Utility Management

�IMS HP Image Copy�IMS DEDB Fast Recovery�IMS Recovery Expert V2

Backup and Recovery �Batch Terminal Simulator

�Batch Backout Manager�Program Restart Facility

Application Management

Performance Management

�IBM Transaction Analysis Workbench�IMS Buffer Pool Analyzer�IMS Network Compression Facility

System / TMAdministration

System�IMS Command Control Facility�IMS ETO Support�IMS HP Sysgen Tools�IMS Queue Control Facility�IMS Workload RouterTM�IMS Configuration Manager�IMS Sysplex Manager

RegulatoryCompliance

�Guardium S-TAP for IMS�IBM Infosphere Guardium Data Encryption for DB2 and IMS Databases

IBM Tools Base for z/OS


IMS Tools Solution Packs

� High performance IMS Tools help you perform your IMS database management tasks – providing full end-to-end solutions

� A full suite of IMS Tools to help with:– Full-function database maintenance– Fast Path database maintenance– Recovery– Performance and tuning

� Built on our vision, built for you– Easier to install– Easier to maintain– Increased integration– Automated– Modern– Built to fit any size shop

IMS Recovery IMS Recovery

Solution PackSolution Pack

IMS Database IMS Database


IMS Performance IMS Performance


IMS Fast Path IMS Fast Path


IBM Tools Base


Agenda

� The Path to Autonomics

� IMS Performance & Debugging Solutions Update

� IMS Database Utilities Update

� IMS Backup & Recovery Update


Why Autonomics and Modernization

� Unanticipated problems may result in downtime and loss of revenue

� Increased burden of system management and maintenance

� Problem determination is time and resource intensive

– Expert skills are often spent ascertaining when a problem took place rather than figuring

out how to fix it

� DBA resources are expensive and dwindling – Expert skills are wasted on repetitive tasks

� Time and resources are not available for developing new applications, pursuing new technologies, and growing business

Now more than ever, business challenges demand it!


Internet

Extranet

Intranet

Load

Balancer

Internet

ServersE-commerce

Applications

Databases Databases

Mainframe

Enterprise Server

Applications

ERP

Messaging

Middleware

When problems do occur, the impact can be extensive

IT

Operations DB

Specialist

Business

Analyst

Business

Executive

The database server is in trouble. I’ll create an incident as soon as I can

and work on it. I hope no one is affected.

Why am Ihaving these database

events? Everything seems ok.

Why are these applicationtransactions taking

so long?

We are behind inorder processing.

Why?

Help

Desk

So many calls,so many incidents.I don’t know what to tell customers.

Executives are upset with orders not

being processed. I need to tell

them why.

IT

Manager


Modern Graphical User Interfaces are critical

� Modern Graphical User Interfaces– Provide a richer user experience, can convey more information

– Reduce the need for IMS or Z specific knowledge

– Shorten the IMS learning curve for new DBAs

– Enable deeper integration between tools and across platforms

– Customers expect it!!

� Leap ahead to Graphical interfaces for IMS

– Focus on Web-based interfaces for administration• Allow access from anywhere

– Focus on Eclipse-based interfaces for development

AdministratorsDevelopers

Eclipse(development)

Web Browser(administration)


IBM Tools Base for z/OS

� A pre-requisite for all IMS Tools Solution Packs

� Contains all the necessary common infrastructure components for enabling

autonomics and next generation UIs

� No charge PID

– Program number: 5655-V93

– IBM Tools Base for z/OS 1.3

9

IMS Tools Knowledge Base

Policy Services

Autonomics Director

Administration ConsoleDynamic

Application Infrastructure

Reports

Sensor

Policie

s

Discovery

Autonom

ics

AutoDiscovery


IMS Tools Distributed Access Infrastructure

Tool

Tool

Tool

z/OSISPF

IMS

Tool

Tool

Terminal Emulator

DAITCP/IPApplication

ServerHTTP

TCP/IP

…

Browser

Eclipse

BTS

Many IMS Tools


IMS Administration Console Goals

� Provide a holistic view of your IMS system from a single, easy-to-use web

interface– Dynamic, interactive graphs and charts provide you with a visual

representation of your sensor data– Integration with the Autonomics Director provides a list of policy exceptions

and recommended resolutions for all of your monitored databases

– All IMS Tools reports stored in the IMS Tools Knowledge Base can be

searched, retrieved, and viewed effortlessly

� Prepare for the next generation of IMS DBAs– Uses the latest web technologies for a rich user experience

– Access from anywhere via the Internet using the most popular web browsers– Includes a robust help system that serves as a learning aid for new IMS DBAs.


Overview of IMS Resources with Drill-down

Resource status,

errors, and

recommendations

can be aggregated

with an ability to

drill down


Holistic View of IMS Resources

…from Sensors

…from Auto Discovery

…from Autonomics Director

…from Various HP Tools


Prepare the next generation of IMS DBAs

Integrated help

educates new and

experienced DBAs

on database

concepts and how

to interpret charts


Administration Console Benefits

� Install once, access anywhere via the Internet– Single, server-based installation

– Access through popular web browsers

� Safety and security features are built in

– Uses SSL and RACF authentication

� Works “out of the box”

– Immediately view your databases using your existing DBRC groups or Autonomics

Director monitor list

� Easily customized– Define your own groups of databases to view

� Consolidated information at your fingertips– Summary pages provide total counts of warning, severe, and critical exceptions for a

database group – drill down to the individual database level from there


Policy Services - Using Sensor Data to Help Make Decisions

� Policy definitions to evaluate specific database states– E.g. the state of space utilization at a specific instance in time– Threshold values are compared against sensor data for a given database or group of databases– When thresholds are met or exceeded, exceptions occur

� Statistical point-in-time sensor data– Stored in IMS Tools Knowledge Base repository– Historically maintained per user specifications– Over 60 separate data elements related to space usage, optimization, and fragmentation

• E.g. data set extents, DASD volume usage, data set free space, roots distribution, RAP usage, CI/CA splits, and IMS free space

� Two methods to collect sensor data– Standalone database sensor utilities for Full-Function and Fast Path databases– Integrated with existing IMS Tools

• High Performance Image Copy, High Performance Pointer Checker• Fast Path Analyzer, Fast Path Online Pointer Checker

� Works “out of the box”– Ships with predefined policies and threshold values

� Customizable to fit your shop– You can define your own sets of threshold values– Customize the messages sent when exceptions do occur– Specify who receives which messages and how

• WTO, e-mail, or text


Autonomics Director Overview

� Automatic collection of Sensor data

� On Demand collection/ evaluation for immediate issues

– “I have a problem and need the information now!”

� Automatic analysis and evaluation of database status

– Based on user-defined policies and thresholds

� Recommendation for reorganization– Easy to understand: simple “yes” or “no”

� E-mail or text notification when a reorganization is recommended

– Alert DBA to consider taking action

� Flexible scheduling around peak workloads– Doesn’t interfere with production throughput

or response

� Works with existing job schedulers

� Exploits the power of IMS sysplex– Redundant servers for highest levels of

availability– Spreads data collection/tools workload based

on system capacity and status

� Easily customized for groups or individual databases

– Auto-discovery of databases and existing database groups

– User-defined groupings: “These are the databases that I’m responsible for”

– Group-assigned defaults propagate to individual databases

� Intuitive user interfaces for all users– Full ISPF interface– Integrates with new IMS Administration

Console for viewing database status on the web


Autonomics Director Configuration

AD Master Server

AD Failover Server

AD Active Server

AD Active Server

ITKB

Server

SensorsSensors

SensorsSensors

MVS1MVS1

MVS2MVS2

MVS3MVS3

MVS4MVS4SensorsSensors

SensorsSensors


Autonomics Director Process Flow

Autonomics Director Master Server

ITKB

RepositoryServer

Tools Input Repository

AD Repository

Sensor Data

Repository

Policy Repository

DBDLIBs

DBRCRECONs

Policy/SensorEvaluationServices

SchedulerServices

AutoDiscovery

RouterServices

MonitorServices

DB Sensor

ICPC

DB SensorJCL Lib(s)

Internal Reader

Customization Recommendations

USDB1 HDAM Sensor=8

hrs

Eval

=8 hrs

USDB2 DEDB Sensor=12 hrs

Eval

=12 hrs

User Interface Services


Agenda






IMS Performance Analysis & Debugging

ONLINEJJ-1J-n

M o n i t o r i n gM e t r o l o g y / C a p a c i t y P l a n n i n g

A n

a l y

s i s

d e

p t h

Omegamon

IT CAM

LOG

IMS/CICS Performance Analyser

Transaction Analysis Workbench

DB2 Performance Expert

IMS Problem Investigator

Transaction Analysis Workbench

DB2 Log analysis

Tivoli Decision Support


z/OS

OPERLOG SMF / RMF 30,64,88 … /7x

IMS

DL/1

DB2

IMS TM

CICS

DDF

DB2 SP

IMS Connect

CTG

OTMA

WAS/z

MQ

IMS Connect

CE

XC

EXCEX

journal

CEX

journal

IMS log

DB/DC Monitor

SMF

114/115

120/111 ATF/TRF

SMF

100/101/102

SMF

110

CQS LGSTRM

CQS

OM

EG

AM

ON

DB2 log

MQ log

IMS Performance Analysis & Debugging …


IBM Transaction Analysis Workbench for z/OS

� A transaction analysis framework for System z– Not transaction manager specific

– Leverages current IBM tools for transaction analysis

� Not IMS or CICS specific, but first release provides more synergy with the existing

tools for those transaction managers– Synergy with IMS and CICS Performance Analyzer, with IMS Problem Investigator

– No prereq for CICS PA, IMS PA or IMS PI

� Automates collection of data needed for problem analysis

� Provides a session manager to manage problem analysis through its lifecycle

� Goal

– Enable higher productivity by lower skilled staff, reduce problem analysis time, and serve

as a training tool for new support staff

– Allow the ‘First Responder’ to determine the most likely source of the problem so that the

right subject matter expert can work on the problem

– Allow for ‘Deep dive’ problem determination via synergy with other IBM tools• Subject matter experts may also use tools not supported by the Workbench


IBM Transaction Analysis Workbench for z/OS (5697-P37) …

� Integrated CICS and IMS performance management and problem determination

� System and subsystem performance that directly affects CICS and IMS

� Integrated CICS-DBCTL performance reporting using both CICS and IMS performance data

CICS

Performance

Analyzer

CMF

IMS

Performance

Analyzer

IMS log

IMS

Problem

Investigator

DB2/MQ log

TransactionAnalysis

Workbench

SMF, OPERLOG,

other data sources


Rules Based Routing

DB Integrity Check

Custom FORMsbased reports

Dashboard

IMS Connect Event Collection

IMS Performance AnalyzerIMS Performance Analyzer

IMS Transaction Index

Log data:IMSDB2

Websphere MQIMS ConnectOMEGAMON

ISPF

dialog

Extracts

Reports

IMS Problem InvestigatorIMS Problem Investigator

IMS Performance Solution Pack Transit Reports

IMS Performance Solution PackIMS Performance Solution Pack

IMS Connect ExtensionsIMS Connect Extensions

IMS Performance Solution Pack for z/OS


IMS Connect Extensions

� Enhances IMS Connect performance, availability & security– Streamlines operational management of IMS Connect and its clients

– Flexible access control to Improve system security

� Enhances IMS Connect availability with dynamic workload management

– Management of customer user exits and control of input message traffic

� Event recording & performance monitoring features

– Examine the details and timing of internal IMS Connect events

– Collects performance and accounting information for IMS Connect

– IMS Connect internal and external transit times and latency times

– Exception reporting showing failures and timeouts

� Provides instrumentation and performance reporting for IMS Connect

– Creates detailed IMS Connect reports in conjunction with IMS Performance Analyzer

– Solves IMS Connect problems in conjunction with IMS Problem Investigator

– Displays IMS Connect activity and utilization in real time

– Enables reporting for Omegamon XE, IMS Performance Analyzer,

and IMS Problem Investigator


Single consolidated view of sessions running on all systems

(or view activity for individual systems or user-defined groups)

Extensive details on

individual sessions

The

system view

shows the

status of

all

systems

Cancel sessions


IMS Performance Analyzer

� The premier IMS tools for…– Maintaining service levels and capacity planning– Response time analysis– Monitoring enterprise-wide indicators that can adversely affect IMS performance

� Analysis of data from the IMS logs, IMS monitor, and IMS Connect– Shared Queue support - merge logs to produce end to end transaction response times– 100’s of fields can be summarized and analysed

� Forms-based reporting to identify specific processing deficiencies– Reporting on IMS through ISPF dialogs or batch commands

� Generation of “Transaction accounting index” to be used to intelligently navigate log files with IMS Problem Investigator based on filters

� Cold start analysis– Analyses what would happen after an emergency cold start of IMS at some point in time

(for example, now or at end of log)• Identifies what messages would be lost• What in flight transactions with external subsystems be lost

� Gap analysis– Identifies periods of time where log records are not being cut– Can highlight an external system event that may have caused IMS to slow down


Batch job:

report/extract

request

JCL

Specifiedinput files

Generates& submits

SLDS (or OLDS)

Disk or tape:

IMS Log records

IMS Connect Extensions

journal data sets

IMS Connect records

IMS PA

ISPF dialog

IMS Monitor data sets

OMEGAMON

TRF Extractor data sets

IMS Monitor records

Report/extract

request

with input file

ddnames

Extracts

TransactionIndex

Reports

IMS Performance Analyzer …


IMS Performance Analyzer 4.1

Combined IMS and Connect Summary

COMBSUMM Printed at 11:15:00 04May2006 Data from 11.16.33 18Apr2006 to 12.04.17 18Apr2006

Avg Avg Avg Avg Avg Avg Avg

Tran CON Resp Input ReadSock ReadExit SAF Call OTMAproc IMS Resp

Trancode Count Time Time In Time Time Time Time Time . . .

BALANCE 14 57 0 0 0 0 51 28

DEPOSIT 432 540 0 0 0 0 539 522

ORDER 1458 202 5 5 0 0 17 16

WITHDRAW 16 3035 214 214 0 0 605 332

Avg Avg Avg Avg Avg Avg

InputQ Process OutputQ Total CPU DB Call

. . . Time Time Time Time Time Count . . .

5 54 0 60 3 2

6 7 4203 4216 2 1

8 213 17528 17749 1 1

8 291 2251 2549 3 1

Avg Avg Avg

Confirm Output XmitExit

. . . Time Time Time

6 0 0

0 1 0

179 0 0

249 1967 0

IMS Connect

response time

IMS internal response time

IMS transit breakdown and resource usage

Connect Output

Connect InputOTMA response time

• Combined IMS Connect and IMS log metrics

• Design a Form to include required information only

• No restriction on report page width

• Export to CSV or DB2 as an alternative to reporting

IMS Performance Analyzer

Combined Transit analysis report



� Analysis of IMS event data can help identify problematic applications and identify system performance issues.

� IMS Problem Investigator complements IMS Performance Analyzer for enhanced log analysis and reporting.

� IMS Problem Investigator provides an ISPF interface and batch reporting capabilities that enable the investigator to interactively navigate, investigate, and analyze:

– IMS log, IMS Monitor records, IMS Common Queue Server (CQS) log records,

– IMS Connect event data,

– SMF records

– Omegamon TRF log and extract,

– DB2 log,

– Websphere MQ log extract.

� Key Features include:

– Browse, analyze, and interpret logs

– Gain an end-to-end picture of transactions in the Sysplex.

– Understand IMS log record with detailed field description and global fields.

� The TX line action will connect records associated with the same transaction across

all logs.


� Modern IMS transactions affect multiple subsystems

� Information about these transactions is recorded in even more sources

� IMS PI provides a unified logical view of transactions spanning all these systems

IMS log

IMS transaction


Data sources

Transaction activity merged into a single view

IMS-related subsystems

Transaction activity logged in multiple locations

IMS monitor

TRF Extractordata set

Extracts

CQS logDB2 log

DB2 CQSIMS DB/TMIMS ConnectWebSphere

MQ

WebSphere MQlog extract

IMS ConnectExtensions

journal

SMF

ISPF

dialogReports

OMEGAMONTRF records

IRLM long-lockrecords

User records

IMS ConnectExtensions

IMS PATransaction

Index


IMS Problem InvestigatorFormat and navigate log files quickly and easily

� IMS PI allows you to interactively browse and analyze log records

� Instantaneous view of the logs

� Navigate by the time of day

� Select records to drill down right to the values of individual flag bits


Tracks DRDAflow

Reports separateresponse timesfor IMS Connect

and IMS

WebSphereApplicationServer (WAS)

IMSConnect

IMSConnectExtensions

IMSPerformance

Analyzer

IMSProblemInvestigator

ODBM IMS

WASsupport staff

The problem is somewhere in here:a reporting "black hole" betweenthe two product support teams IMS

support staff

Response times over 2 seconds!

"WebSphere Application Server waits 2 secondsfor a response from IMS. Contact IMS support."

"IMS respondsin a millisecond."

Event journal

IMS log


Agenda






Utilities Management

� IMS Database Solution Pack for z/OS– IMS Database Reorganization Expert– IMS High Performance Unload– IMS High Performance Load– IMS Index Builder– IMS High Performance Prefix Resolution– IMS High Performance Pointer Checker– IMS High Performance Image Copy– IMS Library Integrity Utilities

� IMS Fast Path Solution Pack for z/OS– IMS Fast Path Advanced Tools– IMS Fast Path Basic Tools– IMS Fast Path Online Tools– IMS Database Repair Facility

� IMS Cloning Tool

� IMS Database Control Suite

� IMS Online Reorganization Facility


IMS DB Solution Pack

� DB Solution Pack provides a complete set of high performance tools to unload, load, reorganize, build indexes for, backup, verify, and report on full-function databases

UnloadLoad

Reorganization

DB Integrity CheckDB Repair

BackupImage Copy

IndexBuild/Recovery

IMS Definition Libraries Management

DB Space Utilization Analysis

DB Repair FacilityDB Repair Facility

IMS Database Reorganization Expert

IMS Index BuilderIMS Index Builder IMS High Performance Image Copy

IMS High Performance Image Copy

IMS High Performance Prefix Resolution

IMS High Performance Prefix Resolution

IMS Library Integrity Utilities


IMS High Performance Load

IMS High Performance Load

IMS High Performance Pointer Checker

IMS High Performance Pointer Checker

IMS High Performance Unload

IMS High Performance Unload


IMS Database Reorganization Expert

� Follow-on product of IMS Parallel Reorganization (IPR) V3R2

� IMS Parallel Reorg Driver renamed to “Smart Reorg” features:

– Collecting statistics data for database space management• We will call this data the sensor data!

– Defining and managing the reorganization policy for detecting space management

exceptions

– Utilizing the policy for conditional reorganization

– Utilizing the policy for exception notification and reporting

– Tracking detected exceptions and effectiveness of reorganization

� IPR Unload, IPR Reload, and IPR DB Scan utilities are also included and are fully compatible with those in IPR


Sep. 21 AnnouncementSingle Step ExecutionSingle Step Execution

- IMS DB Reorganization Expert

- IMS High Performance Unload

- IMS High Performance Load

- IMS Index Builder

- IMS High Performance Image Copy

- IMS High Performance Pointer Checker

- IMS High Performance Prefix Resolution

- IMS Tools Base Pack

“Smart Reorg”

DB

(Shadow)

Sec. Index(Shadow)

DB

SecondaryIndex

Reports andDB Statistics

DBAdmin

IndexImage Copies

Database Image Copy

OnlineRead Access

Database“Health Check”

ConcurrentDatabaseBackup

Automated DBRC

Processing

IMS Database Reorganization Expert …


Smart Reorg utility scans and analyses database, collects sensor data, judges reorganization requirement based on policy, and takes reorganization automatically in one job step!

SmartReorgDriver

IMS Tools Knowledge BaseReport Service

Parallel ReorganizationService

Conditional ReorgSupport Service

IMS ToolsKnowledge

BaseServer

Sensor

Data

Smart Reorg utility job stepRepositories

Reports

Policy

Database

ShadowDatabase

Reload

Unload

Scanning Online DB

IMSOnline Subsystems

IMS Tools Online System Interface

DBAnalyzer

DB Sensor

Policy ServicesPolicy Evaluation

Exception Notification

Sensor Data Store

Sensor Data Read

Smart Reorg utility in Reorg Expert



� Productivity aid for managing IMS Definition Libraries

Providing High-speed generation process for processing large volumes of IMS ACBs

Consistency Checker ensure all the necessary definitions have been created for a database

MFS Reversal

Advanced ACBGenConsistency Checking Utility

�MFS Reversal - Convert MFS MID/MOD/DIF/DOF control blocks back into IMS MFS utility control statements

�MFS Compare - is designed to compare two sets of MFS source libraries

Integrity Checker help prevent system outages caused by databases corrupted by using wrong DBD

�Mapper

�Reversal

�Compare

Integrity Checking FacilityDBD/PSB/ACB


IMS Fast Path Solution Pack

� “An All-In-One Fast Path full maintenance solution”– IMS High Performance Fast Path Utilities (HPFPU)

– IMS High Performance Image Copy for z/OS (HPIC)

– IMS Library Integrity Utilities for z/OS (LIU)

– IMS Database Repair Facility (DB Repair)

– Prereq: IBM Tools Base for z/OS

Unload

ReloadReorganization

DB Integrity Check

BackupImage Copy

IMS Definition Libraries Management

DB Repair

DB Space Utilization Analysis

IMS HP FP UtilitiesIMS HP FP Utilities DB Repair FacilityDB Repair Facility

IMS HP Image CopyIMS HP Image Copy

IMS Library Integrity UtilitiesIMS Library Integrity Utilities

IMS Fast Path Solution Pack


20112009 2010 20122008200720062005

History of IMS FP Tools

Day 1 support for each new IMS release

IMS 9

HPFPU V2.2

� FPA ANALYZE

� FPA CHANGE

HPFPU V3

� Online Expert Reorg

� Online DMACPRINT

� FPA EXTRACT

� FPA DMACPRINT

HPFPU V2

� FPA UNLOAD

� FPA RELOAD

� FPB

� FPO

HPFPU V3.2Enhancements

� ITKB support

� DB rec. length report

� Multi areas

� HPIC HASH enh.

IMS 10 QPP GA IMS 11 QPP GA IMS 12 QPP GA

FP Solution Pack V1

� HPFPU

� HPIC

� LIU

� DB Repair

All in a single package

HPFPU V3.2

� FPA REORG

FPSP V1.2� Enhancementsin FPSP V1components

� DB SensorCapability

Ease of Use

Online Tooling

Tools integrated solutions

Common Infrastructure

Simplification &Modernization

Simplification &Modernization

HPIC V4 Enhancements

� ITKB support

� Fast Recovery IC

IMS Tools Base V1.1/V1.2(added Policy Services)IMS Tools Knowledge Base

LIU V2

� MFS Reversal& Compare

� Integrationwith DRF/HPIC

HPIC V4

LIU V1� Consistency Checker, DBD/PSB/ACB Compare/Mapper/Reversal, Adv. ACB Generator

� Integrity Checker

LIU V2Enh.

� FPA support

HPIC V4.2

� Fast Dump

� DB Quiesce

� HPIC Image Copy under FPO

Tools Base V1.3(added AD & AC)

FPSI Support


IMS Fast Path Solution Pack V1.2

� Strategic– From individual tools to solution packs

– Product simplification and modernization

� Provides complete tool set

– Reorganization and restructure• Unload/reload with/without structure change• Direct free space reorganization

– Pointer check and space analysis

– High performance/function Image Copy

– Library consistency verification

� Added DB Sensor capability – Supports sensor data collection

• Built on Tools Base V1.3 services

– A core component for Autonomic Director (AD) /

Administration Console (AC) solutions

IBM Tools Base for z/OS V1.3

IMS FP Solution Pack for z/OS V1.2

• Fast Path Advanced Tool• Fast Path Online Tool

• Fast Path Basic Tools

• IMS High Performance Image Copy

• IMS Library Integrity Utilities

• IMS Database Repair Facility

• Fast Path Stand-alone DB Sensor

SensorSensor

SensorSensor

SensorSensor

SensorSensor

• IMS Versions supported:

V10, V11, V12

• Autonomics Director• Administration Console• Policy Services• IMS Tools Knowledge Base

• …


Agenda






IMS Backup and Recovery

Index Builder

Tools

Pointer Checker Tool

Database

Recovery Utility or Tools

Database Image Copy

Utility or Tool

IMS Batch Logging

Online Log Archive

DBRC RECONs

Image Copy

Databases

Recovered Databases

CA (+)CA (-)

Batch Backout Utility or Tool

Change

Accumulation Utility or Tool

Incremental Image Copy

Rebuild Index

Database Unload / Reload

Utility or Tool

Unload Dataset

OLDS to SLDS/RLDS

IMS Logging

System Level Backup


How to identify available resources ?

� Manually : DBRC commands are great !

� Asking for help ? Use RRR Recovery ReadinessReporter

� What is the image copy frequency in production? Is this automated?

� Are the jobs scheduled on a regular basis?

� How often do image copy jobs fail? Is it lack of space or objects not in correct state?

� What types of backups are being used? – DB2 DSN1COPY, FDR, HSM?– IMS batch image copy (SHRLEVEL reference),

concurrent image copy (SHRLEVEL change),SMS image copies?

� Is storage team already making volume copies of DB2/IMS data?

� Are you image copying the same object/database many times during a night without you knowing it?

� Do you have control over your backups?

� Are incremental copies made?– How many between full copies?– DB2 Merge copy run?– IMS Change Accums?

� Are these copied to disk or tape? Stacked on tape?

� Is everything in sync with the ICF catalog?

� Do you verify recovery on a scheduled basis?

� Are you taking copies of application spaces – test and production?


Resource Readiness Reporter

� RRR is an informative tool that will providesites with the help they need in the following:

– Risk• Reduce risk of data loss by reporting missed backups

– Exposure• Reduce exposure for application outage

– Costs• Reveal the price of image copies – by examining their resource usage.

� Analyzes all recovery resources for DB2 and IMS subsystems over a specified period

of time.– Note: Resource usage is valid for only DSNUTILB (DB2 image copies). RRR does not

report on CPU/IO for vendor utilities. Same for IMS IC for now.

� Simple installable “Load and Go” program downloadable from– https://www14.software.ibm.com/webapp/iwm/web/reg/download.do?source=swg-

ibmrrrdi&S_PKG=dl&lang=en_US&cp=UTF-8

0 Rand


How does it work ?

� RRR will produce a report on– Which tsnames/dbnames do not have a valid image copies within a given time period.

– Which tsnames/dbnames have valid image copies within the same time period•And whether or not these “registered” image copies datasets still exist on the z/OS system

– The CPU and I/O resources required to create these image copies

– It shows IMS Change Accum consumption

SMF

DB2 CatalogOr IMS RECON

ICF Catalog

RRR


51

START-TIMESTAMP/END-TIMESTAMP INFO

Image Copy consumption of resources

Change Accumresource consumption summary

This information is for the LPAR –break down on how often ICs are done and which day

Sample Report- SMF Report for IMS


Sample Reports – DB2

Without ICs

Recovery Readiness Image Copy Report

Subsystem EA1A

Start Timestamp 2011-05-04-00.01.00.000000

End Timestamp 2011-05-04-23.59.00.999999

Objects without Image Copies

DBNAME TSNAME Part Type IC Dataset IC Dataset Check

________ ________ ____ ____ __________________________ ________________

PARTDB01 PARTTS01 0001 TS Not Checked



With IC data sets checked

….

…

Objects with Image Copies

DBNAME TSNAME Part Type IC Dataset IC Dataset Check

________ ________ ____ ____ __________________________ ________________

PARTDB02 PARTTS02 0001 TS PDBOB.DB02.TS02.P01.COPY Checked




IMS « Local » Recovery

� Using IMS standard utilities– Use DBRC GENJCL.RECOVER command

to generate the correct JCL

– Utilities for indexes

� Using IMS Tools for increased availability, simplification and productivity

� IMS Recovery Expert (IMS RE)

– To facilitate, automate and create easy recovery procedures, and to « power » the use of

storage-based fast replication solutions.

� IMS Recovery Solution Pack– Including DRF to do PITR, to speed up IC processing and build index

� DB2 Recovery Expert with IMS RE to coordinate recovery between DB2 and IMS

•Prepare and test jobs before

•Take time to educate yourself and test different possibilities

•Organize cross team procedures for DB2 and IMS


IMS Recovery Expert for z/OS

� Database and Storage-aware backup and recovery tool

� Backup Functions for IMS databases, IMS systems and application libraries

– IMS System Level Backup• IMS Databases, IMS Systems, Recovery Structures, and Application Libraries in one backup at

same point in time

– Automated offloading and encryption of data

– Meta-data repository to maintain information on system level backups

� Intelligent “local” Recovery Manager

– Performs efficient local recoveries using available recovery resources and tools

– IBM IMS backup and recovery utilities look like a single product from the end-users

perspective

� Intelligent “Disaster” Recovery Manager

– Simplifies and automates traditional disaster recovery process • Restore system level backup and restart DBMS • Restore system level backup, restore RECON, run recovery to point in time, restart DBMS

54


IMS Recovery Expert for z/OS - Intelligent Recovery Manager (IRM)

� Single interface for recovery processes, ISPF or GUI

� Recovers application, individual database, or indexes

– Even if the SLB contains other databases than the ones we want to recover

– Using Current, Timestamp, or PITR

� Application profile is created in advance – Single database or group of databases

– Logically related databases and indexes can be included automatically

� Determines best recovery method

– Restores from either IC or SLB

– Indexes that can not be restored are rebuilt

– Recovery using log apply needs one pass of the logs

– Access to DBs is automatically stopped and restarted at end of recovery

– Drives the IMS Recovery Solution Pack if needed• Runtime analysis determines utilities to run (and their order)• Spawns recovery jobs as needed

� Storage-based fast-replication performs restore

– Performs an instantaneous data set restore process


IMS Recovery Expert / DB2 Recovery Expert

� Reduce backup, recovery, and administration costs

� Provide a sophisticated infrastructure and metadata to manage the DBMS and storage processor coordination

– DBMS and storage-based fast-replication integration

� Perform backups instantly

� Fast restore and parallel recovery reduces recovery time

� Used for both DR and Local Application Recovery

� Used for IMS and DB2

DB2 & IMS RE

Source DB Volumes

Storage Processor APIs

TargetVolumes DB System

Backup

DB2 & IMS


Incremental

Image Oopy

DB Integrity Check

Backup

Image Copy

Database Recovery

Database Recovery FacilityDatabase Recovery Facility IMS HP Change Accum

IMS HP Change Accum

IMS HP Image CopyIMS HP Image Copy

IMS Recovery Solution Pack IMS Recovery Solution Pack

Recovery Health Check

Recovery ExpertRecovery Expert

IMS Recovery Solution Pack

Recovery Health Check

Change Accumulation

IMS Recovery Solution Pack for z/OS


IMS Recovery Solution Pack for z/OS – Recovery engine

� Based on DRF functions

� High Performance IMS Database Recovery Solution

– Parallel Input/Output

– Parallel Processing / Sorting

– Single archived Log and CA Data Set Pass

– Single pass DB write

– DBRC Controlled

� Recovery of Multiple DBDS or Areas in one step– Runs in Parallel with IMS Transaction Processing

� Recovery Time Options– Recover to End of Logs

– Time Stamp Recovery (Recovery Point)

– Point-In-Time Recovery (Arbitrary Point)• "Image Copy Needed" state is set in RECON for recovered databases after PITR• List of Open UOW


IBDFSPREC0

DRF Master

Address Space

Subordinate

Address Spaces

DRF

Log and CA

Reader

SORT

DBDS / Area

Restore

Control

Function

Sub A/S

Sub A/S

Sub A/S ...

JCL

Report

RECON

FP Area

DBDS

Logs

CAsICs

DupliDS

HPPC

DEDB PC

Auxiliary

Process

HPIC

ICs

IMS Recovery Solution Pack for z/OS – Recovery engine …


� Based on IMS Recovery Expert Version 1

� Aid to ensure that the IMS database environment is recoverable – Does not perform the actual database recovery

– IMS Database Recovery Facility (DRF) is the recommended tool for performing IMS

database recoveries

� Functions– Create clean recovery points

– Locate existing recovery points

– Identify problems which may affect recoveries

– Verify needed recovery assets

– Condition RECON data sets for disaster recovery

– Issue IMS commands via batch

6 separate featuresRecovery Point Creation (RPCR)Recovery Point Identification (RPID)Verify Recovery Assets (VERIFY)RECON Data Set Cleanup (RCU)IMS Command Interface (IMSCMD)Health Checker (HCHECK)

And in additionRECON Copy (RECONCOPY)Database List (DBLIST)

IMS Recovery Solution Pack for z/OS – Recovery Expert functions

© 2012 IBM Corporation61 61

IMS and DB2 Disaster Recovery Tutorials

� IBM developerWorks– www.ibm.com/developerworks

• External IBM website with articles, tutorials and demonstrations

� IMS Disaster Recovery Tutorials– Four parts:

• Part 1: Overview of all solutions• Part 2: IMS Base and IMS Tool solutions• Part 3: IMS Recovery Expert Disaster and Local Recovery• Part 4: Coordinated IMS and DB2 Disaster Recovery

– Downloadable demonstration file• Demos are installed on hard disk and viewed with internet browser

© 2012 IBM Corporation62 62

DeveloperWorks URL for Tutorials

• http://www.ibm.com/developerworks/views/data/libraryview.jsp?search_by=IMS+disaster+recovery+solutions


Agenda

Questions






Summary

� IMS Tools from IBM provide, integrated, easy-to-use solutions that fit your company’s needs

� IBM is dedicated to the continued success and support of IMS and the mainframe.

We’re invested for the long term, right beside you.

� We are continuing to invest in our IMS Tools technology and have a vision for our IMS Tools that centers

around autonomic computing

Greater Greater

functionfunction

Even better Even better

value for value for

MoneyMoney

Better Better

performanceperformance


IMS Resources On-line

� IMS on the web– http://www.ibm.com/ims/

� IMS Tools on the Web

– http://www.ibm.com/software/data/db2imstools/products/ims-tools.html

� IMS Tools Support for IMS V12– http://www-01.ibm.com/support/docview.wss?uid=swg21419734

� IMS Tools Users Guides and Documentation

– http://www.ibm.com/software/data/db2imstools/imstools-library.html

jobo 5 im_stools_update_2012_q2

Technology