ca idms performance and tuning

1 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

World®’16

CAIDMS™PerformanceandTuning

JohnSiraco,Director,SoftwareEngineeringCATechnologies

MFX69E

MAINFRAMEANDWORKLOADAUTOMATION


Abstract

AftercompletingthiscourseyouwillbeabletoidentifythecomponentswithinanIDMSsystem,identifyandtakecorrectiveactionstodealwithperformanceissues.Youwillalsobefamiliarwiththetoolsavailableformonitoringandtuningaswellasdevelopmonitoringprocedures.

JohnSiraco

CATechnologiesDirector,SoftwareEngineering


Agenda

IDENTIFYTHECOMPONENTSWITHINANIDMSCENTRALVERSION

DEALWITHPERFORMANCEISSUES

TAKECORRECTIVEACTIONS

IDENTIFYAVAILABLETOOLSFORMONITORINGANDTUNING

IDENTIFYPOTENTIALSCARCERESOURCES

ESTABLISHMONITORINGPROCEDURES

1

2

3

4

5

6


FunctionsofMonitoringandTuning

§ Systemmonitoringistheprocessofmeasuringsystemperformanceandresourceconsumption

§ Systemtuningshouldbeundertakenonlywhen:– Systemmonitoringindicatesthatperformancegoalsarenotbeingmet– Achangeinthesystemworkloadforexistingapplicationsisanticipated– Achangetothetotalsystemworkloadisanticipated– Hardwaremodificationsarebeingintroduced


StepsintheMonitoringandTuningProcess

1. IdentifythecomponentswithinanIDMSCentralVersion

2. DealwithPerformanceIssues

3. IdentifytheavailabletoolsforMonitoringandTuning

4. Identifypotentialscarceresources

5. Establishmonitoringprocedures

6. Takecorrectiveaction

IdentifytheComponentswithinanIDMSCentralVersion


ComponentswithinanIDMSCentralVersion

§ AnIDMSCentralVersion(“Region”/“DC/UCFSystem”)consistsof:– System-relatedentities– Database-relatedentities


System-RelatedEntities

§ StartupModuleandIDMSNucleusModules

§ StoragePools

§ ProgramPools

§ Storageformaintaining(database)lockrelatedinformation

§ SystemAreas(Log– Scratch– Queue)

§ DataCommunication(DC)Components:– LineDrivers– CommunicationsLineswithLogicalandPhysicalterminals


System-RelatedEntitiesContinued

§ SystemRunUnittasks

§ ExternalRunUnittasks

§ UserTasks(applications)


Database-RelatedEntities

§ DictionariesandDatabases

§ DatabaseBuffers

§ Journals

DealwithPerformanceIssues


TypesofPerformanceIssues

WithinanIDMSCentralVersion,twotypesofperformanceissuescanarise:

§ SystemPerformanceissues

§ DatabasePerformanceissues


IntroductiontoSystemPerformanceIssues

§ Identifycriticalresourcesthataffectsystemperformance

§ Identifyfactorsthatcontrolandlimittheavailabilityofthoseresources


SystemPerformanceIssuesStoragePools

§ StoragePoolsarefound– Belowtheline/24-bitstorage/nonXAstorage(numbers0– 127)– Abovetheline/31-bitstorage/XAstorage(numbers128– 255)

§ Twotypesofstorage– SYSTEMtype:System,Terminal,Database– USERtype:User,UserKept,Shared,SharedKept

§ StoragePools0and255arerequired

§ StoragePool255containsSYSTEMtypestorageonly

§ StoragePool0containsSYSTEMtypeandeventuallyothertypes


SystemPerformanceIssuesStoragePoolsContinued

§ DefinedinSYSGEN

§ Storagepools0and255definedinSYSTEMstatement:– ADDSYSTEMnnn

STORAGEPOOLXASTORAGEPOOL



§ Otherstoragepoolsthataredefinedinindividualstatements:– Belowtheline:

§ ADDSTORAGEPOOLnn(01<=nn<=127)– Abovetheline:

§ ADDXASTORAGEPOOLnn(128<=nn<=254)



§ Ifarequest(GetStorage)forXAstorageisdone,but:– NoXAstoragepoolforthattypeexists,or– XAstoragepoolforthattypeexists,butnospaceisavailableinit,then– Storageisallocatedoutof:

§ anonXApoolwhichcontainsthattype,or§ Ifnotexisting,outofstoragepool0§ ThisappliesforanonXA storagerequesttoo



§ DefineextrapoolstoseparateSYSTEMfromUSERstorage.(requiredforStorageProtection)

§ Optionflag193canbeusedtoreduceCPUusage



§ ExampleofSYSGENdefinitionstatements:



§ ShortonStorage(SOS)Conditionscanhaveamajorimpactonperformance.Twotypescanoccur:– Shortonstoragecondition(condition0)– Storagenotavailablecondition(condition1)

§ MessageDC015007iswrittentotheOperatorConsole:



§ IncaseofShortOnStorageconditions– Determinewhetherneedlessorexcessivestorageallocationsaremade– UseStorageLimitstolimitstorageutilizationpertask– Ifanon-XAstoragepoolisSOS,checkfortaskswithLOC=BELOWandif

possible,changeintoLOC=ANY– IfanXAstoragepoolisSOS,mayneedtoincreasethatpool– EventuallyreduceMAXTASKS



§ MonitorStorageutilizationwith:– DCMTDISALLSTORAGEPOOLS

§ Secondpool255containsruntimeDMCL,andisnota“real”storagepool

Anon-zerovalueinTimesSOSisaredflag



§ DCMTDISACTIVESTORAGE



§ OPERWATCHSP

Anon-zerovalueisaredflag


SystemPerformanceIssuesStorageforDatabaseLocks

§ Shortonstorageofteniscausedbylockoverflow

§ Atstartup,storagefordatabaselocksispreallocatedinakindof“storagepool”outsideofthe“numbered”storagepools

§ SizeisbasedontheSYSLOCKSparameter(SYSGEN,SYSTEMstatement)


SystemPerformanceIssuesStorageforDatabaseLocks

§ Incaseoflockoverflow,databaselocks“overflow”instoragepool255,whichincreasesthepossibilityforSOSconditions

§ Lockoverflowcandegradesystemperformance

§ MostoftencausedbylongrunningprogramswithoutCOMMITs(batchprogramsrunninginCentralMode)


SystemPerformanceIssuesStorageforDatabaseLocksContinued

§ MonitorLockingstoragewith:– TheLOCKMONtask(STATUScommand)

Non-zerooverflowvaluesarearedflag


SystemPerformanceIssuesStorageforDatabaseLocksContinued

§ DCMTDISPLAYLOCKSTATISTICS


SystemPerformanceIssuesProgramPools

§ Areaofstoragethatis usedtoloadprogramsthatmustbeexecutedwithintheCentralVersion:– CAADSdialogs– Maps– Subschemas– Edit/CodeTables– AccessModules– Cobol,Assembler,Pl/Iprograms– Databaseprocedures


SystemPerformanceIssuesProgramPoolsContinued

§ TypesofProgramPools:– 24-bitprogrampool– 24-bitreentrantprogrampool– 31-bitprogrampool– 31-bitreentrantprogrampool

§ MakeProgramPoolslargeenoughsothateachprogramisonlyloadedonce



§ ExampleofSYSGENdefinitionstatements:



§ IncreasesizeofProgramPoolsif:– Activeprogramsareoverlaidbyotherprograms– Youexperiencewaitsforprogrampoolspace



§ MonitorProgramPoolutilizationwith:– DCMTDISALLPROGRAMPOOLS



§ DCMTDISACTIVEXAREENTRANTPROGRAM

Values>1arean

indicationofapotentialpoolsizeproblem

Checkforvalues>0



§ OPERWATCHPR


SystemPerformanceIssuesScratchArea

§ Containstemporarydatathatare usedbyonlinetasks

§ CanbeallocatedonDASDormemory

§ Recommendedtousememory– SizeequalstoSYSGENdefinitionorsizeofscratcharea

§ DefinedinSYSGEN– SYSTEMstatement“SCRATCHInSTOrageisYES”

§ CanbelocatedinXAor64-bitstorageifavailable

§ Significantlyimprovesruntimeperformance


SystemPerformanceIssuesScratchAreaContinued

§ CheckscratchallocationswithDCMTDISPLAYSCRATCH


SystemPerformanceIssuesTasks

§ ATASKisthebasicunitofworkwithinaCentralVersion

§ Consistsofexecutionofoneormoreprograms

§ Maximumnumberoftasksthatare determinedby:– MAXIMUMTASKS/MAXIMUMERUSinSYSTEMstatement– NumberofpredefinedSYSTEMRUNUNITS– Numberoflines– DeadlockDetectionTask– PrinterTask– Othermiscellaneoussystemfunctions


SystemPerformanceIssuesTasksContinued

§ Monitorthenumberofactivetaskswith:– DCMTDISPLAYACTIVETASK



§ OPERWATCHACTIVETASK



§ Maximumnumberofconcurrenttaskshasadirectinfluenceonsystemperformance

§ Strategy:– InSYSGEN,specifyhighMAXIMUMTASKand/orMAXIMUMERUS– Immediatelyafterstartup,useDCMTVARYMAXTASKtosetvaluetoa

relativelylownumber– Observesystemperformance– UseDCMTtoincrease/decreaseMAXTASKSvalue



§ IndicatorstodecreaseMAXTASK– Systemexperiencesshortonresources– PMRM(Real-TimePerformanceMonitor)showslong/excessivewait

times– Frequentdeadlocksforasystemresourceareexperienced

§ IndicatorstoincreaseMAXTASK– IftheCentralVersionencountersaMAXTASKconditionandno

shortageonresourcesnorlongwaittimesareexperienced



§ UseDCMTDISPLAYSTATISTICSSYSTEMtocheckMAXTASK


SystemPerformanceIssuesSystemRunUnits

§ Arepredefinedrununitstoprovidestandardservicesfor:– Signonprocessing– Messageprocessing– ProgramLoadingprocessing– Queueprocessing– Securityprocessing

§ DefinedinSYSGEN(SYSTEMstatement,viaRUNUNITSFORxxxclauses)


SystemPerformanceIssuesSystemRunUnits

§ Startedduringstartupprocessing

§ Remainactiveuntilshutdown


SystemPerformanceIssuesSystemRunUnitsContinued

§ Monitorsystemrununitswith:– DCMTDISPLAYRUNUNIT



§ PMRM– SystemRunUnitSummary



§ Adjustingthenumberofpredefinedrununitscanimprovesystemperformance

§ Considerations:– Insufficientpredefinedrununitscausesoverflowrununits– Eachoverflowrununitcausesextra overhead


SystemPerformanceIssuesExternalRunUnits

§ OnlinetaskthatisinitiatedwithinaCentralVersiontoservicedatabaserequestsfromanexternalusersession(ERUs)

§ Originatesfrom:– Abatchapplication– AnotherCentralVersion– AnotherTPmonitorsuchasCICS


SystemPerformanceIssuesExternalRunUnits

§ Canhavefollowingruntimecharacteristics:– LimitsforI/Os,recordlocks,storage– Inactiveandexternalwaittimes– Dispatchpriority– Areaacquisitionthresholdandretrycounts


SystemPerformanceIssuesExternalRunUnitsContinued

§ NeedstohaveacorrespondingTASKdefinitiontoapplythesecharacteristics

§ Ifnotaskisfound,RHDCNP3Sisused


SystemPerformanceIssuesResourceManagement

§ Fine-tuninghowaCentralVersioncontrolsresourcescanimprovetaskexecution

§ Taskresourcesaremanagedby:– Resourcecontrolelements(RCEs)– Resourcelinkelements(RLEs)– Deadlockpreventionelements(DPEs)

§ IfTIMESTHRESHOLDEXCEEDEDishigh,improveperformancebyallocatingmoreoftheindicatedelements


SystemPerformanceIssuesResourceManagementContinued

§ DCMTDISPLAYSTATISTICSSYSTEM


SystemPerformanceIssuesResourceManagement– DeadlockDetection

§ Adeadlockisanunresolvablecontentionforaresource

§ Aresourceiseithera:• Systemresource• Databaseresource


SystemPerformanceIssuesResourceManagement– DeadlockDetection

§ Detectedbythedeadlockdetector(RHDCDEAD)

§ DEADLOCKDETECTIONINTERVALdefinesthefrequencywithwhichthesystemchecksfordeadlocks

§ Optionflag189canbeusedtospecifyasubsecondinterval


SystemPerformanceIssuesResourceManagement– DeadlockDetectionContinued

§ Checkthisintervalwith:– DCMTDISPLAYDEADLOCK

– Theintervalisexpressedinseconds


SystemPerformanceIssuesResourceManagement– Limits

§ Resourcelimitsspecifythemaximumamountofspecificresourcesagiventaskcanuseatruntime

§ Resourcesthatcanbelimitedpertaskare:– CALL(numberofservicecalls)– DBIO(numberofI/Os)– Locks(numberoflocks)– Storage(sizeofstorage)


SystemPerformanceIssuesResourceManagement– Limits

§ LimitscanbedefinedatSYSTEMlevelforOnlineand/orERUStasks(global)and/orTASKlevel(individual)


SystemPerformanceIssuesResourceManagement– LimitsContinued

§ Monitorgloballimitswith:– DCMTDISPLAYLIMIT


SystemPerformanceIssuesResourceManagement– LimitsContinued

§ Monitorindividuallimitswith:– DCMTDISPLAYTASKtaskcode


SystemPerformanceIssuesAbend DetectionandTimedFunctions

§ Systemperformancecanbeimprovedifabended tasks,loopingtasksandotherabnormalprocessingconditionsaredetectedpromptly

§ Thesoonerdetected,thesoonerresourcesthatare heldbythesetaskscanbefreedandmadeavailableforothertasks


SystemPerformanceIssuesAbend DetectionandTimedFunctions

§ FollowingparametersandtimerscanbedefinedinSYSGEN,SYSTEMstatement:– CHKUSERtasks– DEADLOCKDETECTIONINTERVAL– EXTERNALWAIT– INACTIVEINTERVAL– RESOURCETIMEOUTINTERVAL– RUNAWAYINTERVAL– TICKERINTERVAL


SystemPerformanceIssuesAbend DetectionandTimedFunctionsContinued

§ TickerIntervalisthemostimportantonebecauseitspecifieshowoftenaCentralVersionchecksforoccurrencesoftimer-relatedevents(defaultis1second)§ IftheTickerIntervalissetto60thenDeadlockDetectionrunsat60

seconds,settimestarttaskcannotstartataskinlessthen60seconds.Manyimplications.


SystemPerformanceIssuesMultitasking

§ RunningaCentralVersioninmultitaskingcanbeconsideredif:– LparhasfreeCPUcycles– Lparconsistsofmultipleprocessors

§ Easytoactivate– MT=Y,SUBT=nandMTQDEPTH=nparametersinPARMstringofEXEC

card


SystemPerformanceIssuesMultitasking

§ Increasedthroughputandreducedresponsetime

§ ThecostisaCPUincreasethatvariesfromsitetosite


SystemPerformanceIssuesMultitaskingContinued

§ MonitorMultitaskingwithfollowingDCMTcommands:– DCMTDISPLAYSUBTASK– DCMTDISPLAYSUBTASKEFFECTIVENESS– DCMTDISPLAYMPMODE– DCMTDISPLAYMTQUEUEDEPTH



§ DCMTDISPLAYSUBTASK



§ DCMTDISPLAYSUBTASKEFFECTIVENESS


SystemPerformanceIssueszIIP Exploitation

§ AnIDMSCentralVersioncanexploitzIIP processorsonthez9seriesandaboveforthez/OSoperatingsystem

§ EnablesoffloadingcomputingcyclestozIIPs,therebyincreasingoverallCPUthroughputatloweroperationalcosts


SystemPerformanceIssueszIIP Exploitation

§ ApplyPTFsRO63129(18.0)andRO63736(18.5)

§ MostCAIDMSsystemcodeiseligibletorunonzIIP


SystemPerformanceIssueszIIP ExploitationContinued

§ zIIPsupportisimplementedasfollows:– z/OSsoftwarefeatureHBB7709isrequiredtousezIIP– AddZIIP=YasstartupparameterinCentralVersionstartupjcl



§ Followingrulesforloadmodulesneedtobemet:– Startupmodule(RHDCOMVS)mustbeinanauthorizedSTEPLIBlibrary– CAIDMSNucleusmodules(includingalllinedriversandservicedrivers)

mustbeinanauthorizedlibraryintheCDMSLIBconcatenation– TheIBMlanguagelibrary(CEE.SCEERUN)mustbeauthorizedifincluded

inCDMSLIBconcatenation– z/OSCallableServiceslibrary(SYS1.CSSLIB)mustbeinlinklistormustbe

authorizedifintheSTEPLIBconcatenation



§ CheckifCentralVersionrunswithzIIP withDCPROFILtask



§ MonitortheCPUtimeoffloadedtozIIP with:– DCMTDISPLAYSUBTASKEFFECTIVENESS


SystemPerformanceIssuesExceptionResponse

§ ReduceterminalI/OoverheadbyassigningVTAMExceptionresponseprotocoltocertaintasksorlines

§ ReducesCPUtimebecauseterminalsarenotrequiredtorespondwithcompletionstatus

§ DefinedintheLINEandTASKdefinitionsinSYSGEN


SystemPerformanceIssuesOperatingSystemRecommendations

§ Foroptimumperformance,anIDMSCentralVersionshouldalwaysberunnon-swappable

§ AwardanIDMSCentralVersionthehighestreasonabledispatchingpriority

§ Avoidthattheoperatingsystemwouldneedtodopaging


IntroductiontoDatabasePerformanceIssues

§ Identifythemajortypesofresourcesbottlenecksthatarerelatedtoaccessingadatabasethataffectssystemperformanceandperformenvironmentaltuning

§ Pro-activetuningstartswithdatabaseandapplicationdesign

§ Poorperformancecanbecausedby:– ExcessiveI/Oactivity– Toomuchworkbeingrequired(CPU)– ResourceContention


DatabasePerformanceIssuesInformationGathering

§ Whatapplicationsareinvolved?– Onlineapplications– BatchprogramsrunninginCentralMode

§ Howdotheyaccessthedatabase?– Areasweeps– Randomaccess– Walkingchains– Indexprocessing– RetrievalorUpdate


DatabasePerformanceIssuesInformationGatheringContinued

§ TheDBMScollectsanumberofstatisticsonarununitorSQLtransactionlevel

§ Arecategorizedasbasicandextendedstatistics– Basicstatistics



§ Extendedstatistics



§ DatabaseStatisticsareaccumulatedonrununitlevel

§ Canbeaccessedthrough:– JREPORTS– ACCEPTSTATISTICSDML/GETSTATISTICSSQLcommands– SREPORTS– PMARPTs– DCMTDISPLAYTRANSACTION



§ FieldsinDatabaseStatisticstowatch:– PAGESREAD– PAGESWRITTEN– PAGESREQUESTED– OVERFLOW– NOOVERFLOW– RECORDSREQUESTED– RECORDSCURRENT



§ Oftenused“ratios”basedondatabasestatistics:– PAGES-REQUESTED/PAGES-READ– RECORDS-REQUESTED/PAGES-READ– RECORDS-REQUESTED/RECORDS-CURRENT– NOOVERFLOW/(OVERFLOW+NOOVERFLOW)



§ DCMTDISPLAYTRANSACTION



§ JREPORT8forsametransaction/run-unit


DatabasePerformanceIssuesExcessiveI/OActivity

§ OverallperformancecandegradeduetoexcessiveI/O– OnDatabasefiles(DatabaseI/O)– OnJournalfiles(JournalI/O)


DatabasePerformanceIssuesDatabaseI/O

§ FactorsinfluencingDatabaseI/Oare:– NumberofPagesaccessed

§ DatabasePagesover70%full§ CalcandViaoverflow§ Fragmentationofcompressed/variablelengthrecords§ Indexlevels/orphansincreasing§ Increaseoflogicallydeletedand/orrelocatedrecords

– Buffercontention– UseofPrefetch– UseofFileCaching– DASDcharacteristicsandDataSetPlacement


DatabasePerformanceIssuesDatabaseI/OContinued

§ ToolstomonitorDatabaseconditions:– PRINTSPACEutility(runsinbatchandonline)– PRINTINDEXutility(runsinbatchandonline)– IDMSDBANutility(batchonly)



§ PRINTSPACEutility



§ PRINTINDEXutility:SUMMARYreport



§ IDMSDBANutility:Report3– SetAnalysis



§ IDMSDBANutility:Report5– SetAnalysis– ChainLength



§ IDMSDBANutility:Report5– SetAnalysis– PageChange


DatabasePerformanceIssuesBufferContention

§ Buffercontentioncanexistiftherearefewerbufferpagesthandatabasepagesmappingtothebuffer

§ CanincreasenumberofI/Osbecause:– TheDBMSmustre-usebufferpages– Itmayforceredundantreadsandwrites


DatabasePerformanceIssuesBufferContention

§ Recommendationstoreducebuffercontention– assignfrequentlyusedfilesandsequentiallyaccessedfilestoseparate

buffers– Defineonelargebufferforrandomlyaccessedareas


DatabasePerformanceIssuesBufferContentionContinued

§ MonitorBufferutilizationtocheck:– Thebufferutilizationratio– Bufferwaits– Whichfilesareaccessedmostoften

§ Bymeansof:– DCMTDISPLAYSTATISTICSBUFFER– RealTimePerformanceMonitor(PMRM)– JREPORTs03– SREPORTs03– 07- 09


DatabasePerformanceIssuesBufferUtilizationRatio

§ IstheNumberofPagesrequested/NumberofPagesread

§ Ratioof2orhighermeanseffectivebuffer

§ Ratiolowerthan2indicatestoofewpagesinbuffer


DatabasePerformanceIssuesBufferInfoExamples

§ DCMTDISPLAYSTATISTICSBUFFER


DatabasePerformanceIssuesBufferInfoExamplesContinued

§ PMRMBufferI/OSummary


DatabasePerformanceIssuesBufferInfoExamplesContinued

§ PMRMBufferI/OSummaryContinued


DatabasePerformanceIssuesPrefetch

§ Prefetch(orchainedreads):readmultipleblocksfromdiskwithasingleI/Orequest

§ Enabledbydefault,canbedisabled

§ WithinaCentralVersion:two tracksarereadwith1I/O


DatabasePerformanceIssuesPrefetch

§ Reduces:– I/Osifnearbypagesarealsoaccessed– I/OWaitsforbenefitingapplications

§ Increases:– DurationofanI/O– Buffercontention


DatabasePerformanceIssuesPrefetch Continued

§ ImpactofPrefetchdependsuponbuffersize



§ Prefetchcanbecontrolledwith:– ThePREFETCHparameterinSYSIDMS(defaultisON)– ThePREFETCHoptioninDCMTVARYDMCL,AREA,FILE,

BUFFER

§ Thedefaultprefetchlimitof500pagescanbeoverriddenby:– PREFETCH_BUFSYSIDMSparameter– DCMTVARYBUFFERnamePREFETCHlimit



§ UseDCMTDISPLAYBUFFERtocheckifprefetchisenabled



§ MonitorPrefetcheffectivenesswithOPERWATCHDBIO

107 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD 107

DatabasePerformanceIssuesFileCaching

§ Howitworks

AdvantageCAIDMSCV/Local

Buffer

Cache

Onaread:– lookincache– iffound,moveto

buffer– ifnotfound,read

fromfile,copytocache

Onawrite:– copytocache– writetofile


DatabasePerformanceIssuesDataSetPlacement

§ GuidelinestoestablishaDASDconfigurationforanIDMSCentralVersion:– Isolatehigh-activitydatasetsasmuchaspossible– DatasetsaccessedbyIDMSCentralVersionsmustbeisolatedfrom

thoseaccessedbybatchjobs– Thegoalistoachievepathisolation– Onlinedatasetsshouldbeisolatedbypathandshouldbestoredonthe

fastestdevicespossible– PlacefilesonParallelAccessDevices(PAV)toallowconcurrentI/Os

againstthesamediskunit


DatabasePerformanceIssuesDataSetPlacementContinued

§ Isolatejournalfiles

§ DonotplaceCAIDMSfileswiththefollowing:– Paging,spool,orSYSRESdatasets– Heavilyusedpartitioneddatasets– Non-CAIDMSVSAMfilesofcatalogs

§ Isolatethelog,scratch,andqueuefilesifheavyCA-ADSdevelopmentorhighOLQusageoccurs

§ Isolatedictionaryareasfordevelopmentsystems


DatabasePerformanceIssuesJournalI/O

§ Factorsinfluencingperformance:– Journalpagesize– Journalbuffersize– Journaltransactionlevel


DatabasePerformanceIssuesJournalI/O- PageSize

§ IfJournalpagesizeistoosmall– Morepagesthatareneededtoholdimages– Morejournalwritesissued

§ Ifjournalpagesizetoolarge– Maywastejournalspace


DatabasePerformanceIssuesJournalI/O- PageSize

§ Recommendedminimumpagesize– 2*largest-record-size(upto32K)

§ MonitorARCHIVEJOURNALreport– Lowerpagesizeifmostjournalblocksnearempty– Increaseifmostjournalblocksarefull


DatabasePerformanceIssuesJournalI/O- BufferSize

§ Multiplejournalbufferpages– Enableoverlappedfillingandwritingofjournalblocks

§ Reducedwaittimesforjournaling– MayavoidjournalI/Oduringrecovery

§ Fasterrecovery§ Lessinterferencewithnormalactivity


DatabasePerformanceIssuesJournalI/O- BufferSize

§ Minimumfivepages

§ Systemswithlotsofabends…muchlargernumberofpages


DatabasePerformanceIssuesJournalI/O- BufferSize Continued

§ DCMTDISPLAYBUFFER

#ofbufferwaits.If>0,increaseBuffersize #recoveryI/Os

Iflarge,increaseBuffersize


DatabasePerformanceIssuesJournalI/O- JournalTransactionLevel

§ Enablesdeferringjournalwriteuntilblockisfull– Fewerjournalblockswritten– FewerjournalI/Os– Betterjournalfileutilization

§ While#ofupdatetransactionexceedsjournaltransactionlevel– CVdeferswriteofjournalblockuntilitfills


DatabasePerformanceIssuesJournalI/O- JournalTransactionLevelContinued

§ Journaltransactionlevelshouldbe:– 0(nodeferraloccurs)– Greaterthan3– Iftoolarge...nobenefit

§ DefinedinSYSGEN- SYSTEMstatement

§ CanbechangedatruntimewithDCMTVARYJOURNALTRANSACTIONLEVELn

§ MonitorARCHIVEJOURNALreport


0

5000

10000

15000

20000

25000

# of Journal Blocks

JTL=4 JTL=5 JTL=0 or 10

Journal Block Utilization

DatabasePerformanceIssuesJournalI/O- JournalTransactionLevelContinued

IdentifytheAvailableToolsforMonitoringandTuning


CAIDMSMonitoringTools

§ Interactive(real-time)tools– DCMTandOPERtasks,PerformanceMonitor(PMRM,PMAM,PMRM)

§ Postprocessingtools


CAIDMSMonitoringToolsContinued

§ CAIDMStoolstoaidmonitoringandtuningprocess:– DC/UCFstatistics– DC/UCFlogmessages– DC/UCFjournals– Onlinefacilities– Reports– CAIDMS/DBPerformanceMonitor– CAIDMS/VisualDBA


CAIDMSMonitoringToolsDC/UCFStatistics

§ System(-wide)statistics- alwayscollected

§ Taskandexternalrequestunitstatistics- optional

§ Transactionstatistics- optional

§ CA-ADSdialogstatistics- optional

§ Histograms- optional

§ User-writtenstatistics- optional


CAIDMSMonitoringToolsSystemStatistics

§ System-widestatisticsarewrittentotheDC/UCFsystemlog:– Automaticallyatnormalsystemshutdown– Atthestatisticsintervalthatisspecifiedinthesystemgeneration

SYSTEMstatement,parameterSTATISTICSINTERVALtime– Atthestatisticsintervalrollthatisspecifiedinthesystemgeneration

SYSTEMstatement,parameterSTATISTICS ROLL TIME interval-roll-time FREQUENCY day-frequency

– OnexplicitrequestwithaDCMTWRITESTATISTICSorDCMTWRITESTATISTICSROLLcommand


CAIDMSMonitoringToolsSystemStatisticsContinued

§ ExampleofSystemStatisticsasfoundinaPRINTLOGoutput


CAIDMSMonitoringToolsOtherStatistics

§ Taskandexternalrequeststatistics

§ Transactionstatistics

§ CA-ADSdialogstatistics


CAIDMSMonitoringToolsHistograms

§ Histogramstrackthefrequencyofspecificevents

§ Accumulatedinsystemcontrolblocksatruntime,andwrittentotheDC/UCFLogatthefollowingtimes:– Normalsystemshutdown– Thestatisticsintervalthatis establishedbytheSTATISTICS

parameter(SYSGEN)– ExplicitrequestwithDCMTWRITESTATISTICS


CAIDMSMonitoringToolsHistograms

§ Threetypesofhistograms:– System-widehistograms(alwayscollected)– Taskhistograms(optional)– Linehistograms(optional)


CAIDMSMonitoringToolsUser-WrittenStatistics

§ Implementedviauserexits

§ Allowstogaincontrolatselectedpointsinthestatistics-writingprocess

§ Examples:– IDMSSVCX(SVCexit)– Exit5(Taskterminationexit1)– Exit9(Systemstatisticsexit)– Exit15(VIBstatisticsexit)


CAIDMSMonitoringToolsDC/UCFLog

§ DC/UCFLogmessages– Usefulindetectingabends


CAIDMSMonitoringToolsDC/UCFLogContinued

§ ExampleofTaskPhotointheDC/UCFafterataskabend


CAIDMSMonitoringToolsJournals

§ DC/UCFJournals– Vitalcomponentfordatabaserecovery– Sourceofdatabaseactivitystatistics– ThearchivedjournalscanbeusedasinputforourJREPORTs

CentralVersion

ArchiveJournal

DiskJournals

ArchivedJournal

ReportTool

Jreport


CAIDMSMonitoringToolsJournalReports

§ ExampleofJournalReport1– TransactionSummary


CAIDMSMonitoringToolsJournalReportsContinued

§ ExampleofJournalReport2– ProgramTerminationstatistics



§ ExampleofJournalReport4– ProgramSummary



§ ExampleofJournalReport8– Formatteddump



§ ExampleofJournalReport8– Formatteddump(part2)


CAIDMSMonitoringToolsOnlineFacilities

§ OnlinePrintLogutility(OLP)

§ MasterTerminalfacility(DCMT)

§ Operatorfacility(OPER)

§ DCProfile(DCPROFIL)

§ Lookfacility(LOOK)

§ LockMonitor(LOCKMON)

§ CAIDMSPerformanceMonitor(optional)


CAIDMSMonitoringToolsOnlineFacilitiesContinued

§ OnlinePrintLogutility(OLP)



§ DCMTcommandtoshowallofitssub-commands



§ DCMTHELPSEGMENTcommand



§ OPERTask



§ OPERTaskwithWATCHCPUsub-command



§ OPERTaskwithWATCHCRITICALRESOURCESsub-command



§ DCPROFILTask



§ DCPROFILTaskContinued



§ LOOKtask



§ LOOKtaskContinued



§ LOCKMONtask



§ LOCKMONtaskContinued


CAIDMSMonitoringToolsReports

§ DatabaseUtilities– PRINTSPACE– PRINTINDEX– IDMSDBAN

§ DatabaseActivity– JREPORTs

§ SystemActivity– SREPORTs

§ CAIDMSPerformanceMonitor


CAIDMSMonitoringToolsCAIDMS/PerformanceMonitor

§ Overview– PerformanceMonitorisaperformanceandtuningtoolthatyoucan

usetomonitorhardwareandsoftwareresourcesthatareusedinanIDMSCentralVersion

§ BenefitsofusingCAIDMSPerformanceMonitorinclude:– Easeofuse– Windowingfacility– Applicationanddatabasemonitoring– Onlineandbatchreportingtools


CAIDMSMonitoringToolsCAIDMS/PerformanceMonitorContinued

§ Perfmonstatisticsarewrittento– TheDC/UCFlog(DDLDCLOGareaofthesystemdictionary)– TheSMFjobaccountingfile(z/OSonly)

§ OnlinecomponentsofCAIDMS/PerformanceMonitor:– TheReal-timeMonitor– TheIntervalMonitor– TheApplicationMonitor

§ Batchcomponents(reports)areaddedasmodulesintheSYSDIRLdictionaryduringinstallationoftheproduct



§ TheReal-timeMonitorinitialscreen



§ TheReal-timeMonitorSystemRunUnitSummaryscreen



§ TheReal-timeMonitorActiveUser TaskDetailscreen



§ TheReal-timeMonitorExampleofonlinehelpfacility



§ TheIntervalMonitorinitialscreen



§ TheIntervalMonitorStorageDetailscreen



§ TheApplicationMonitorinitialscreen



§ TheApplication Monitor EntitySelectionscreen



§ TheApplication Monitor EntityListscreen



§ TheApplication Monitor GeneralStasticsscreen



§ TheApplication Monitor DCStatisticsscreen



§ TheApplication Monitor DBandWaitStatisticsscreens


CAIDMSMonitoringToolsBatchComponentsofCAIDMSPerformanceMonitor

§ IntervalMonitorReports

§ ApplicationMonitorReports

§ ConsistofanumberofstandardCACulpritmodulesthatare deliveredduringinstallation

§ Canberunusingthestatisticsthatare foundin– Anarchivedlog(ifloggingtotheDC/UCFlog)– AnextractionfromtheSMFjobaccountfile(usingPMSMFEX)


CAIDMSMonitoringToolsBatchComponentsofCAIDMSPerformanceMonitorContinued

§ ExampleofPMIRPT04– SummaryWaitDetailReport



§ ExampleofPMIRPT11– I/OByAreaSummaryReport



§ ExampleofPMIRPT13– BufferSummaryReport



§ ExampleofPMIRPT18– StoragePoolSummaryReport



§ ExampleofPMARPT02– TaskSummaryReport



§ ExampleofPMARPT17– DatabaseDetailReport



§ ExampleofPMARPT18– DatabaseSummaryReport


CAIDMSMonitoringToolsCAIDMS/VisualDBA

§ Overview– Easytousegraphicaluserinterface(GUI)toolforperforming:

§ Databaseadministrationandmonitoring§ Systemadministrationandmonitoring


CAIDMSMonitoringToolsCAIDMS/VisualDBA

§ BenefitsofusingCAIDMS/VisualDBAinclude:– Easeofuse

§ NoJCLorsyntaxknowledgerequired§ Containsextensivehelpsystem

– ReducesthelearningcurveforanewDBA– IncreasestheproductivityofanexperiencedDBA

§ AvailabletoallCAIDMSclientsatnocharge


CAIDMSMonitoringToolsCAIDMS/VisualDBAContinued

§ UsesCAIDMS/ServertocommunicatewithoneormoreCentralVersions

§ ConnectionswithCentralVersionsaremadebasedonODBCDatasources

§ AllowstoconnecttomultipleCentralVersionssimultaneously



§ UsesmanyWindowsfeaturessuchas:– Drill-downandpop-upmenus– Tear-outWindowstocustomizeaview– Drag-and-dropandcut-and-pasteability– Tabbartoquicklyaccessawindowandothers



§ ManagesalmostallknownCentralVersionentitiesasobjects



§ InitialviewafterbeingconnectedwithaCentralVersion



§ ExampleofDatabaseSpaceMonitoring(classicchart)



§ ExampleofDatabaseSpaceMonitoring(piechart)



§ ExampleofDatabaseBufferMonitoring(barchart)



§ ExampleofStoragePoolMonitoring(piechart)



§ ExampleofProgramPoolMonitoring(piechart)

IdentifyPotentialScarceResources


IdentifyPotentialScarceResources

§ Identifyscarceresources– Reducedemandforthoseresources– Increasetheamountofthoseresourcesinthesystem


Resources

§ Categoriesofsystemresources:– CPU– DASD

§ Storagespace§ Accesstostoreddata(I/O)

– Memory§ Realstorage§ Virtualstorage


ResourcesContinued

§ Database-relatedresources:– DB-keylocks– Arealocks– Buffers– Journals

EstablishMonitoringProcedures


GuidelinesforEstablishingMonitoringProcedures

§ Threeareasofperformancemonitoring:– Routinemonitoringprocedures– Monitoringforperformancetroubleshooting– Applicationtestingandmonitoring


RoutineMonitoringProcedures

§ Operatingsystemstatistics

§ Onlinemonitoring

§ Shutdownorintervalstatistics

§ Journalreports

§ PRINTSPACEUtilityreport


RoutineMonitoringProcedures

§ PRINTSPACEUtilityreport

§ PRINTINDEXSUMMARYreport

§ DatabaseAnalysisUtilityreports(IDMSDBAN)

§ PerformanceMonitorreports


MonitoringforPerformanceTroubleshooting

§ OPERWCRITLOGRCA

§ DCMTDisplaySTATistics SYSTEM

§ DCMTDisplayACTive TASK

§ DCMTDisplayTRansaction

§ OPERWatchDB

§ OPERWatchTIme

§ OLP


GuidelinesforAnalyzingCPUUsageChanges

§ Themajorareastobeexaminedare:– ChangestotheDC/UCFsystemconfiguration– Changestoexistingapplications– Additionofnewapplications– DMCLchanges– Increaseintaskabends– Changestohardwareorsoftwareenvironment– Databasebottlenecksorincreaseinotherresourcecontention


AnalyzingDC/UCFSystemConfigurationChanges

§ ThefollowingtypesofchangesaremostlikelytocauseanincreaseinCPUusage:– Increaseinstatisticscollection– Storageprotection– JOURNALRETRIEVAL– Increaseinnumberofterminals– IncreaseinMAXERUS/MAXTASK– Additionofsecurityresourceschecked– Compressionroutines(RBBs,LINES,andDBPROCs)


AnalyzingApplicationChanges

1. ApplicationchangescoincidentalwithincreaseinCPUusage

2. Frequencywithwhichapplicationsareexecuted

3. Determinewhetherthechangesinvolveadditionalwork

4. Continuetheexaminationusingapplicationmonitoringandtuningtechniques


NewApplications

§ IdentifyallnewapplicationswhoseadditiontosystemcoincideswithincreaseinCPU

§ Examineprogramstatistics

§ Examinethesystem-impacttestingresults

§ Followupwithapplication-levelmonitoringandtuningtechniques


DMCLChanges

§ TypesofchangesmostlikelytoincreaseCPUusage:– Decreasethenumberofbuffersforheavy-usepool– Assignextrafilestoexistingpool

§ Totunebufferpools,youcanadopteitherofthefollowingstrategies:– Increasenumberofbufferswithinexistingpools– Changefiletobuffermappingconfiguration

TakeCorrectiveActions


ExpandingtheDatabase

§ Expansionchoices:– EXPANDPAGE(increasepagesize)– EXTENDSPACE(addpagestoendofarea)– Unloadingandreloading(pagesizeandnumberofpages)

§ UNLOAD/RELOAD§ REORG


IntegratedIndexes

§ PRINTINDEXwithSUMMARYoption

§ ChecktheOrphanCountsandindexlevels

§ TUNEINDEX

§ MAINTAININDEX


ProactivePerformanceandTuning

§ StayCurrentonGENLEVEL– Maintenancelevel:

§ AggregateMaintenance(endedDecember2013)§ CARecommendedServices(CARS)

§ UtilizeCASupportOnline– CheckCAIDMSProductPage– Keywordsearcheswith‘PERFORMANCE’‘CPU‘‘STORAGE’and

operatingsystemidslike‘MVS’‘OS’‘z/OS’‘VSE’‘z/VSE’


ProactivePerformanceandTuning

§ PeriodicMonitoringandTuningCheckups

§ NewHardware/OpSysexploitation


CAIDMSOptionalProductPerformanceConsiderations

§ CAIDMS-DC

§ CAIDMSSQLOPTION

§ CAIDMSServer


CAIDMS/DCPerformanceConsiderations

§ VTAM-typelinesbestoptionsare:– Compacting– PermanentReadBuffers– ExceptionProtocol– RPLCOUNT=20%ofphysicalterminals+1perprinter


CAIDMSSQLOptionPerformanceConsiderations

§ Singledatabasestrategy

§ Optimizer

§ NON-SQLaccess

§ EXPLAINfacility

§ UPDATESTATISTICS


CAIDMSServerPerformanceConsiderations

§ ODBC/JDBCAPI

§ TCP/IPVersusCAICCI

§ IDMS/Serverr17providesODBCWireprotocolforODBC-typeConnections(ImprovedPerformance)


ReferenceMaterials(allfromRelease18.5.00,exceptwhenmentionedotherwise)

§ CAIDMSDatabaseDesignGuide

§ CAIDMSDatabaseAdministrationGuide

§ CAIDMSBestPracticesGuide

§ CAIDMSSystemOperationsGuide

§ CAIDMSSystemGenerationGuide

§ CAIDMSUtilitiesGuide


ReferenceMaterials(allfromRelease18.5.00,exceptwhenmentionedotherwise)

§ CAIDMSServerr17UserGuide

§ CAIDMSVisualDBAVersion18.0.00UserGuide

§ CAIDMSPerformanceMonitorAdministrationGuide

§ CAIDMSPerformanceMonitorUserGuide


CourseSummary

§ Youshouldnowbeableto:– IdentifythecomponentswithinanIDMSCentralVersion– Dealwithperformanceissues– Identifytheavailabletoolsformonitoringandtuning– Identifypotentialscarceresources– Establishmonitoringprocedures– Takecorrectiveactions

@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.212 @CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.212

MainframeandWorkloadAutomation

FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI


RecommendedSessionsSESSION# TITLE DATE/TIME

MFX100S StrategyandVisionforCAIDMS 11/16/2016at12:45pm

MFX101S LegacyisnotaDirtyWord 11/16/2016at1:45pm

MFX102S CAIDMS19.0WebServicesforModernization 11/16/2016at3:00pm

MFX103S CAIDMS19.0SQLEnhancementsforModernization 11/16/2016at3:30pm

MFX104S JavaAccesstoCA-IDMSDataatBT(BritishTelecom) 11/16/2016at4:45pm

MFX105SImplementationandUseofGenericVTAMResourceswithParallelSYSPLEXFeatures(CA andCAXIA)

11/17/2016at12:45pm

MFX106S CAIDMSBufferTuning 11/17/2016at1:45pm

MFX107S M3AServicesMonitor,Measure,ManageandAlert 11/17/2016at3:00pm

MFX108S BirdsofaFeather/StumptheTechie! 11/17/2016at3:45pm


MustSeeDemos

DemoNameProductXTheater#location

DemoNameServicesYTheater#location

DemoNameSolutionYTheater#location

DemoNameProductXTheater#location


Questions?


Thankyou.

Stayconnectedatcommunities.ca.com


©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation

ca idms performance and tuning

Technology