using ims performance analyzer with ims logs

Information Management

Using IMS Performance Analyzer with IMS Logs

2010 – Information Management Tech Conference - Brazil

Jeff MaddixIMS Worldwide Technical Support

maddix@us.ibm.com

Using IMS Performance Analyzer with IMS Logs - Agenda

� This presentation will share an approach to quickly learn how to navigate through

the IMS Problem Analyzer’s online ISPF environment to enable you to see reports

based on IMS log record flows related to IMS applications and their contents.

� Section 1– IMS PA Overview

� Section 2 – Starting the IMS PA Dialog Panels

� Section 3– IMS PA Setup

� Section 4– Defining Systems, Log Files, and IMSPlexes in IMS PA

� Section 5– Creating IMS PA Reports

� Section 6– IMS PA Summary

Section 1:

IMS Problem Analyzer Overview

IMS PA Overview

� IMS Performance Analyzer provides a comprehensive suite of reports to help you understand the performance and resource utilization of your IMS systems.

� IMS Performance Analyzer processes IMS Log files, IMS Monitor files, IMS Connect event data, and OMEGAMON TRF data

IMS Problem Analyzer Overview, ISPF Dialog Features

� IMS PA has been designed to follow CUA® conventions, while also

accommodating established ISPF conventions. The dialog contains these features

for enhanced usability.

� Prompt (F4)

– Some entry fields have a Prompt action that allows you to fill in the field by selecting a

value from a pop-up list of valid values.

– Prompt fields are indicated by a + (plus sign) to the right of the field or column heading

– To display the pop-up list, move the cursor to the field and press the Prompt (F4) key. A

list of available values is displayed

IMS Problem Analyzer Overview, ISPF Dialog Features, Continued

� Action bar– An action bar is available at the top of panels to assist with navigation and function.

– To select an option in the action bar, position the cursor on it and press Enter.

– A pull-down menu of choices is displayed.

– To choose one, either position the cursor on it or type the number of your choice, then

press Enter.

� Function keys– IMS PA uses function keys extensively and displays the settings at the bottom of each

panel.

– To display function key labels, enter the ISPF command PFSHOW ON. To hide labels,

enter PFSHOW OFF

� F1 function key– Function key F1 is the default key to request Help.

– Extended Help is available from the command line of every panel. Position the cursor in

the command line and press F1 or enter the HELP command. The line actions and

primary commands that apply to the current panel are always listed in the Extended Help.

– Field Help is available on every input field and some output fields. Position the cursor in

the field and press F1

– Message Help is available. When a short message is displayed at the top right, press F1 to see the long message in a pop-up window.

• This occurs if, in ISPF Settings, you have selected Long message in

IMS Problem Analyzer Overview, 56FA Transaction-level Statistics Record

� IMS PA reports will contain more accurate data if the new IMS V10 performance metrics type 56FA transaction-level statistics record are enabled

– More accurate and reliable statistics for CPU time, DLI call, database I/O and ESAF usage

– No longer an approximation derived from the type 07 application termination record

– Always available even in a WFI environment (where the type 07 record is not available)

� To enable transaction-level statistics logging for all transactions and application programs at

IMS cold start, specify TRANSTAT=Y in the DIAGNOSTICS_STATISTICS section of the

new DFSDFxxx PROCLIB member or in the TRANSACT and APPLCTN macros.

� Transaction-level accounting may also be enabled/disabled or dynamically using new type-2

commands for specific transactions and application programs

� To disable this logging globally at IMS cold start, specify TRANSTAT=N or dynamically via

the type-2 command sfor specific transactions and application programs

� IMPACT: One additional IMS TYPE56FA created for each UOR (Unit of Recovery) – I/O, Logging volume, etc

Section 2:

Starting the IMS PA Dialog Panels

IMS Problem Analyzer Setup, Installation Libraries

� IMS Problem Analyzer libraries– The components of the IMS Problem Analyzer dialog are delivered in the following

libraries:• SIPIEXEC REXX EXECs

• SIPILINK Link/Load modules

• SIPIMENU ISPF messages

• SIPIPENU ISPF panels

• SIPISENU ISPF skeletons

• SIPITENU ISPF input tables

• SIPISAMP Sample JCL for running batch reports and extracts

– These libraries will be installed on your MVS system under a specific high level qualifier

prefix• Once installed, note the HLQ prefix that was used

IMS Problem Analyzer Setup, Starting IMS PA

� IMS PA runs on your MVS system as an ISPF panel dialog.

– You can start IMS PA by • Installing IMS PA libraries statically within your ISPF library setup • Add IMS PA to an ISPF menu• Start IMS PA dynamically

� The simplest way to start IMS PA is dynamically.– We’ll walk through the steps to dynamically start IMS PA in the following

IMS Problem Analyzer Setup, Starting IMS PA

� Starting IMS PA dynamically – From your TSO session READY prompt, start your ISPF panel environment

• Example: READY• ISPF

IMS Problem Analyzer Overview, Starting IMS PA , Continued

– Navigate to your TSO command processor panel • From the ISPF Primary Option Menu select (option 6),

– From the ISPF Command Shell, enter the following command to start the IMS PA dialog• EXEC ‘hlq.prefix.SIPIEXEC(IPIOREXX)' ‘hlq.prefix‘• Where hlq.prefix is the MVS dataset name High Level Qualifier and prefix assigned to the IMS

PA libraries

– Example:

� The IMS PA Dialog should appear as follows:

Section 3:

IMS PA Setup

� The IMS PA setup of the dataset definitions is an important first step towards the

success of your IMS PA experience. – In this section, we will walk you through proven successful allocation parameters which

IMS PA will use to fulfill your ISPF panel report requests.

– Select Option 0 (IMS PA Profile) from the ISPF Primary Option Menu

IMS PA Setup, Define Your IMS PA Settings

� Select option 1 (IMS PA Settings) from the IMS PA Profile Options Menu

IMS PA Setup, Define IMS PA Settings

� Define your Permanent ISPF Table Library and IMS PA Load Library– IMS PA uses the Permanent ISPF Table Library (IPITABL) to save your System

Definitions and Groups which will be used to define your input log files

– IPITABL is the library that contains the IMS PA link/load modules

Substitute your personal HLQ for all “yourhlq”

Substitute your local IMS PA HLQ for

“IMSTOOL.IPS11“

Replace “identify” with any unique identifier to represent your current

investigation

IMS PA Setup, Define Your Dialog Profile

� Define your JOB card used by the IMS PA dialog when building the JCL for executing Report Sets, extract datasets, transaction indexes, etc.

– Large region size and time values are good to accommodate today’s large systems

IMS PA Setup, Reporting Allocation Settings

� Hit PF3 to return to the “IMS PA Profile Options Menu”– Select option 2, (Reporting Allocation Settings) from the IMS PA Profile Options Menu

� Enter the following values for your Reporting Allocation Settings

IMS PA Setup, Shared Queue Settings

� Hit PF3 to return to the “IMS PA Profile Options Menu”– Select option 3, (Shared Queue Settings) from the IMS PA Profile Options Menu

IMS PA Setup, Shared Queue Settings

� Enter the following Shared Queue Merge Work File Allocation

IMS PA Setup, IMS PA Control Data Sets

� Hit PF3 to return to the “IMS PA Profile Options Menu”– Select option 4, (IMS PA Control Data Sets) from the IMS PA Profile Options Menu

IMS PA Setup, IMS PA Control Data Sets

� Enter the following control dataset names for allocations– IMS PA will allocate these with adequate settings

IMS PA Setup, IMS Connect Extensions Definitions Data Set

� Hit PF3 to return to the “IMS PA Profile Options Menu”– Select option 5, (IMS Connect Extensions Definitions DS) from the IMS PA Profile Options Menu

IMS PA Setup, IMS Connect Extensions Definitions Data Set

� Enter the following IMS Connect Extensions Definitions Data Set Allocation

IMS PA Setup, Key User Datasets

� Permanent ISPF Table Library:– IMS PA keeps your list of IMS system definitions and log file data set names in this

library - Defined in option 0.1 IMS PA Settings. • Consider creating a new dataset for each problem analysis• Example: ‘yourhlq.IMSPA.Dyymmdd.imsprod1.IPITABL'

� Report Forms Dataset and Report Sets Datasets– IMS PA keeps your Form and Report set definitions in these VSAM KSDS.

• Defined on the IMS PA panel option 0.4 (IMS PA Control Data Sets) • ‘yourhlq.IMSPA.FORM

Permanent ISPF Table Library

System/Group Definitions

and Input Log Files

Report Forms DatasetReport Form Definitions

Report Sets DatasetReport Set Definitions

Section 4:

Defining Systems, Log Files, and IMSPlexes in

IMS PA

Defining Systems, Log Files, and IMSPlex Groups

� In this section, we will discuss defining to IMS PA, the IMS Systems, the log

record files produced by those systems and the IMSPlex grouping of those

systems, to enable IMS PA’s report capability

– IMS PA supports IMS systems with Log, Monitor, and TRF files, Connect systems with

active or archive journal data sets, and groups of these systems.

– For log reporting on shared queues or data sharing, you can specify groups of IMS

subsystems.

– For combined IMS and Connect reporting, you can specify groups of IMS subsystems

and Connect systems.

� Define your IMS systems and log files to IMS PA – From the IMS PA Primary

Option Menu– Select option 1 (System Definitions) Select option 1 (System

Definitions)

� Define your IMS systems and input log files to IMS PA in the “System Definitions” panel

– Initially, this panel will be empty. – Enter “NEW” on the command line to get started

Creat a NEW system definition

� Specify the IMS Subsystem ID name, IMS Version, Description and specify “View 2” – Log Files

– Press <ENTER> to change the view to the log file view

Subsystem ID, IMS Version, and Description

Specify Log Files view

� Specify the IMS System ID name, IMS Version, Description and specify “View 2” – Log Files, Continued

– Enter your IMS log dataset file name, hit enter and then hit the PF3 key twice

to return to System Definitions panel

Specify IMS Log File(s)

� Define a new IMS system and input log file to IMS PA in the “System Definitions” panel

– Enter “NEW” on the System Definitions command line

� Specify the another IMS System ID name, IMS Version, Description and specify “View 2” – Log Files

– Press <ENTER> to change the view to the log file view

Subsystem ID, IMS Version, and Description

Specify Log Files view

� Specify the IMS System ID name, IMS Version, Description and specify “View 2” – Log Files , Continued

– Enter your IMS log dataset file name, hit enter and then hit the PF3 key twice

to return to System Definitions panel

Specify IMS Log File(s)

� We now see the summary lines created for each of the IMS Systems that we have defined to IMS PA.

� Hit PF3 to exit back to the IMS PA Primary Option Menu

� Select option 2 (Groups) to group the IMS systems that we’ve just defined since they are a member of the same IMSPlex

– Groups is a facility that allows you to group IMS subsystems and IMS Connect systems for reporting purposes. All IMS subsystems participating in a shared queues sysplexenvironment must be defined in a Group. This enables IMS PA to report end-to-end response time for your shared queues transactions.

� Enter a name and description for the group – A Group name is an arbitrary name used to identify a group of related IMS subsystems

for reporting purposes

� Select the group for editing with line command “S”

Specify group name

Enter group description

Select the group for editing

� To select a system from a selection list, press Prompt (F4) from the System field

in the Group of IMS Systems panel.– This is a list of IMS subsystems and Connect systems that are available for inclusion in

this Group. It only shows those Systems that have not already been defined in the

Group. It is a subset of the systems maintained in System Definitions

Place cursor in the System field and hit PF4 for a system PROMPT

� Enter a “S” in the line command field to select the system definition members that belong to the group you are defining and then press PF3 to exit the Select Systems panel

You may select as many systems as required at a

� The selected systems now appear as members of the group being defined

– Exit to the Groups primary menu via PF3 Both selected systems appear in your list

� The Groups list now shows your newest group – These group and system definitions have been stored in your Permanent ISPF Table

Library (IPITABL) as discussed earlier in the presentation– Hit PF3 to exit to the IMS PA Primary Option Menu

Two IMS systems have been added to the group

Section 5:

Creating IMS PA Reports

� Reports can be specified and run from the IMS PA Primary Option Menu, option 3

(Report Sets)

Specify Reports using option 3 (Report Sets)

� IMS PA ships two general sample report sets – SAMPLOG for IMS log dataset based reports

– SAMPMON for IMS Monitor dataset based reports• This dataset created by IMS command TRACE SET ON MONITOR ALL

IMS Monitor Reports

IMS log reports

� By placing the cursor under the “Type” field label, you can see the other input datasets from which you can generate reports

Place cusorunder label

“Type” - Press <ENTER>

� Use the NEW primary command to create new report sets

Enter “NEW”command

� Example to create a new report set that accepts OmegMon TRF dataset– Use a new unique report set 1-8 character name in ISPF member name format

– Model could have been used to copy attributes from an existing report set including inheriting its type (LOG, MON, CEX, TRF) and contents

Enter new report set name

Example for TRF dataset

� Your will be brought to the report selection menu from which you can choose any of the reports which can be created from an OmegaMonTRF dataset

Type in a meaningful description

Creating IMS PA Reports – Report Selection Panel

� The report selection panel for any input type (LOG, Monitor, TRF, etc.) allows you to:

– Select (S) processing “Options” for a given report category• Number of lines per page, intervals, selection criteria, etc

– For some reports, select (S) report fields to be included and field criteria • Some reports are flexible and others more rigid with definitions

– Control which reports are to be active for this report set • Activate (A, AA) Deactivate (D, DD)

– Choose to RUN individual reports, an entire report category, or the entire report set Global Report Options

Report Category

Individual Reports

Commands here apply to entire report set

Expand/collapsecategory

Creating IMS PA Reports – Running a Report

� Return to the “Report Sets” panel (PF3).

� Notice that the TRF report set has been added to the report sets list

� Select the SAMPLOG report to see what reports have been activated for this report set

Select SAMPLOG

� Notice which reports have been activated (A or AA) for this report set– Use PF3 to return to the “Report Sets” panel

Yes=Active

� Type “RUN” next to the SAMPLOG report set

Run the SAMPLOG Report Set

Creating IMS PA Reports – Run Report Set Panel

� The “Run Report Set” menu appears for the selected SAMPLOG report set

� Select the desired optionsWe’ll discuss the Report

Interval further…

Creating IMS PA Reports – Specify a Report Interval

� Report Interval– This allows you to specify a time period for selecting a subset of the input file data for

passing to the report processors. Records with time stamps on or after the From

Date/Time and before the To Date/Time are selected for processing. Reducing the time

period can significantly reduce processing time and virtual storage requirements for

generating the reports.

– Default: Not specified. All records are included.

Navigating Through a Log File in IMS PI, Merging Log Files

� Specify the time slice– Make sure the time slice is complete for all files, if possible

Enter time duration (5 minutes in this case)

Coverage complete for both log files

Creating IMS PA Reports – Specify a Report Interval� Specify a Report Interval with overlapping log times and a duration to keep report

output size reasonable for your environment– Hit <ENTER> to enter execution mode

Enter the Report Interval in local time

Creating IMS PA Reports – Submit the Report Set Job

� Here is an opportunity to examine the JCL used to create the reports– Hit <ENTER> to enter submit the job

Submit the job

Creating IMS PA Reports – Viewing or printing report output

� Viewing or printing report output– To view or print the generated reports, use standard facilities such as SDSF or ISPF

option 3.8 Outlist Utility– To use SDSF:

• 1. Press the Split (F2) key to split your dialog• 2. Select SDSF from the ISPF Primary Option Menu• 3. Enter ST on the command line• 4. Enter ? next to your JobID• 5. Enter S next to the reports you wish to view

Check status of job

� Viewing or printing report output– To view or print the generated reports, use standard facilities such as SDSF or ISPF

option 3.8 Outlist Utility– To use SDSF:

• 1. Press the Split (F2) key to split your dialog• 2. Select SDSF from the ISPF Primary Option Menu• 3. Enter ST on the command line• 4. Enter ? next to your JobID• 5. Enter S next to the reports you wish to view

View job by sections

� Viewing or printing report output– To use SDSF:

• 5. Enter S next to the reports you wish to viewView any of the reports

Creating IMS PA Reports – Viewing or printing report output� The IMS PA SAMPLOG report set definition provides a good example of

grouping various IMS PA reports– Below is the Transaction Exception” by Trancode report

Creating IMS PA Reports – Creating Your Own Reports

� IMS PA report forms allow you to personalize the format and content of Transaction Transit reports

– You can select fields from all the IMS and Connect fields available to IMS PA

– List and Summary Form-based reporting is available from both Log and Connect Report Sets Select Option 10 (Report

Forms)

– Initially the Report Forms list will be empty

– Place your cursor under the “Samples” action menu at the top of your screen and hit

enter Place cursor here, then hit <enter>

– Select option 1 to populate your report forms list with predefined sample forms and hit

<ENTER>

Populate with sample forms

– Find the TRANLIST LIST form and select with an “S” and press PF3 to exit

Select a sample form

– The TRANLIST form will now appear in your Report Forms list• Enter / in the line command field to see available line command functions

/ to see line command options

� Line actions for List Report Form– PF3 to exit back to the list

� H (Help) line command shows you extended field definitions

� H (Help) line command shows you extended field– Hit PF3 when finished to return to the form definition

� You may choose to keep this form as is, change the order of fields, remove fields, add fields, etc.

– PF4 in the “Field Name” field will provide you with a list of all available List Report field

options

PF4 (Prompt)

Creating IMS PA Reports – Creating Your Own Reports � The PF4 Prompt for “Field Name” lists all available fields to include in your list

report. – Use an “S” in one or more field line command areas to include it in your report– Use an “H” in any field line command area to for extended field definitions– PF3 to exit

� From the Report Forms panel, use the “NEW” command to build your own report from scratch or to model it after an existing form

Create new form with “NEW”

Name of new form

Type of new form

Model form if desired

Use a colleague’s form Dataset if desired

New form with all fields available

Creating IMS PA Reports – Running Your New Report

� Go to the IMS PA Primary Menu and choose option 3 (Report Sets)

Go to the Report Sets function

� Creating your own customized reports using IMS PA report – Type “NEW” on the command line and press <ENTER> to create a new report

Use the “NEW” command to create a new report set

� Creating your own customized reports using IMS PA form-based reports – Type the name for the report set and choose type 1 (Log)

Type the name you’d like for the new report set

� Creating your own customized reports using IMS PA form-based reports – Type in a report description and type “S” to select a list based report

Select List to create a list form-based report

Report description

Creating IMS PA Reports – Creating Your Own Reports � Sample report forms are supplied with IMS Performance Analyzer to provide a

broad selection of functional reports or you my create your own – Hit PF4 in the Form field to see a list of predefined report forms

Press PF4 for list

Creating IMS PA Reports – Creating Your Own Reports � Select the sample form to generate a custom forms-based report

Select your desired form

Creating IMS PA Reports – Creating Your Own Reports � Your selected form now appears.

– Add more forms or return to define further reports, run your reports, etc

Selected form

Creating IMS PA Reports – Form Based Reporting � There are many options available at this point, for example

– Define more form based reports – Activate other standard reports– Run reports,– Exit to the prior panel– Etc….

Form-based List report activated

Creating IMS PA Reports – Form Based Reporting � Run your newly defined form-based report

Run your form-based List report

Creating IMS PA Reports – Form Based Reporting � Run your newly defined form-based report

Creating IMS PA Reports – Form Based Reporting � Select your report job to see your report output

Creating IMS PA Reports – Form Based Reporting � Select your list report

Creating IMS PA Reports – Form Based Reporting � View your report

– If there is something you’d like to change about the report, go back to the form definitions

and adjust as necessary.

– If the report is just the way you like it, continue to use our same form on a routine basis

Section 6:

IMS PA Summary

Uncovering the Hidden Information in Your IMS Application Using IMS Problem Analyzer - Summary

� We’ve shared key techniques to get you up and running in the IMS Problem Analyzer ISPF environment. You will now be able to start using the IMS PA panel dialog to create report and interpret processing flows within IMS

� Section 1– IMS PA Overview

� Section 2 – Starting the IMS PA Dialog Panels

� Section 3– IMS PA Setup

� Section 4– Defining Systems, Log Files, and IMSPlexes in IMS PA

� Section 5– Creating IMS PA Reports

• Traditional predefined reports• New form-based reports

� Section 6– IMS PA Summary

using ims performance analyzer with ims logs

ims systems

ims pasection

ims applications

ims problem analyzer

ims pa summary

ims pa setupsection

ims pa reportssection

ims pa overviewsection

Documents

manageengine eventlog analyzer :: help … eventlog analyzer...

accessing ims databases with ims explorer - ims ug singapore...

trend micro deep discovery analyzer 5.5 syslog content...

ims diagnosis via logs - ims ug may 2013 omaha

06 resistivity logs induction logs

logs – solve using logs method

ims sterilisationsvlies after ims...

ims 12 migration workshop.07 ims to ims tcpip connectivity

ims performance analyzer for z/os ims problem investigator...

4.4 resistivity logs and induction logs

evolution of message analyzer and windows …...what is...

logs, logs, logs - what you need to know to catch a thief

ims diagnosis via logs - ims ug march 2013 dc_jax_pa

imsva 9.1 bgp of virtual analyzer integration ·...

ims problem analyzer problem investigation cex update

ibm ims performance analyzer for z/os

ims part5 ims session control

why ims still matters…………....agenda • why ims...

chemistry analyzer hematology analyzer urine analyzer

logs, logs, logs, from natural element homes