risk & performance assurance (rpa) & performance assurance (rpa): ... 99 1459 2138 2801 3162...

Risk&PerformanceAssurance(RPA):DrivingQualityAssuranceandOpera?onsExcellence

October9,2015enova2onpartners.com

PRIVILEGEDANDCONFIDENTIAL 1

Construc?onrisksandcostsareincreasingbutqualityandopera?onsperformanceremainsasignificantchallengeRisingcapitalbudgetsdrivingsignificantworkforceexpansion•  Newconstruc2ongrowingrapidly•  Acceleratedreplacementofleakpronepipe•  75%ofgascompaniesincreasingO&M•  30%reportturnoverincreasesabove10%

Accelera?ngworkforcere?rementserodingskills,knowledgeandexperience

Inspec?onprogramsheavilydependentonexpertopinionsandtradi?on•  Complexconstruc2onprac2cesrequiresignificantexperienceandjudgment

•  “Ins2tu2onalknowledge”ofhowtoeffec2velyinspectislimitedanddeclining

•  Objec2ve,datadrivenstandardsforhowandhowmuchtoinspectincreasinglycri2cal

Newregula?onsandincreasingoversightandfines,increaseinspec?onneeds

6.640

1.2890.853

1.303

1.9891.8511.957

3.164

6.081

2000sUNK&Pre-1940s

1960s 2010s1970s1940s 1990s1980s1950s

Averagenumberofannualincidentsover2005-2013per10,000milesofonshoregastransmissionpipeby

decadeofpipeinstalla?on

Source:U.S.PHMSAdata,PipelineSafetyTrustanalysisasofMarch2015

Companiesmustnotonlydriveconstruc?onquality,complianceandopera?onsexcellence-butbeabletoproveit!


•  Structuredinspec?onprocessensuresfocusonkeyriskandqualityareas

•  Provensta?s?csmethodsdriveinspec?onac?vityandfrequency

•  Automatedinspec?ondocumenta?on,monitoringandrepor?ng–internal&external

•  Tabletbasedinspec?onaids,referencesandconstruc?onmanuals

•  Capturesgeocodeloca?on,photos,handwriTennotesandac?onitems

•  Iden?fiesqualityandperformancechallengestoguidetraininganddevelopment

•  Providescrewandcontractormanagementtools,analy?csandperformancedata

•  Inspec?onprocessandstructureconfiguredtoeachcompany

•  RequiresminimalITintegra?on,butenablesITintegra?onwhenandasdesired

•  Rapidimplementa?onprocess–6weekstofielddeployment,10to12weekstotal

Enova?on,GTI,LocusViewand8gasu?li?esdevelopedRPAtoaddressconstruc?onquality,inspec?onandperformancechallenges


RPAusestablet-basedfieldsoZwaretocollectdata,documentfindings/observa?onsandsupporttheinspec?onprocess

MobilefieldsoZware

WMSorscheduling

tool

RPA

Historicaldata

SMEinput

Cloud-based

collec?onandstorage

Compliancereports,trendsandanalysis

Samplingcalcula?ons

Sta?s?calanalysis

Inspec?onRequirements

Repor?ng&monitoring

Riskhistory,samplingalgorithmsandperformanceanaly?csdriveinspec?onac?vi?es,trendsandissueiden?fica?on,andrepor?ng


Sta?s?callyvalidobserva?onsdriveinspec?onac?vity,frequencyandfocus,andenablequalitymonitoringandrepor?ng

Whattoobserve?

Howmanytosample?

Howareweperforming?

Whatcanweimprove?

•  Priori2zekeyac2vi2estoobserve

• U2lizetechnology(mobilesoeware)toensureinspec2onprocessanddocumentresults

• Analyzecompliancefrequencyacrossmul2pledimensions

• Assesslevelofnon-compliance

• Detectpagernsinnon-complianceanddrilldownintospecificissues

•  Testefficacyoftrainingandnewprocedures

• Applypreferredprobabilitydistribu2on(givenunderlyingprocess,jobpopula2onandcompliancelevels,etc.)

•  Setconfidenceinterval,givendatasources’quality,andriskpolicy


RPAisimplementedinthreephasestoaccelerate“?metovalue”

Configuration and Process Design

Software Tailoring Testing

Reporting and Analytics

Refinement

•  Refine inspection process and requirements

•  Configure inspection tasks and activities

•  Define quality assurance targets and structure

•  Format tablet data fields and inspector interface

•  Define data model •  Validate inspection fields

structure and tablet tools •  Develop tablet

navigation framework •  Train inspectors and

supervisors on tablet and revised processes

•  Deploy tablet solution in the field

•  Evaluate ease of use and statistical progress

•  Customize reports to each audience

•  Configure analytics and data tools

•  Track performance and identify improvement actions

•  Identify field documentation and support needs


RPATabletdatacollec?on–ini?alinspec?onscreen


Installa?onac?vityexample–acceptablemeterloca0ontask


RPA’sfieldapplica?oncapturesphotos,geocodeloca?on,handwriTennotes/diagramsandac?onitems

RPAalsoprovidesaccesstoinspec?ontools,checklistsandopera?ngmanuals


Inspec?onsamplesizeisdrivenbythenumberofjobs,non-compliancerate,andtargetedlevelofriskassurance

ActualClientExample–Construc0on95%confidencefor7kinstalla0ons

•  Sta2s2csdefinesrequiredsamplesizeneededtoachievedesiredconfidencelevelincompliance

•  Asoverallcomplianceratesincrease,thesamplesizemustalsoincrease

•  Asthedesiredlevelofcomplianceassuranceincreases,therequiredsamplesizeincreases

•  Asitturnsoutthenon-compliancerateismuchlower,andthustheconfidenceleveliscorrespondinglyhigher

•  ThisexampleshowsthataConfidenceIntervalof95%assuringatleast85%compliancewouldrequireasamplesizeof207;observe207ofthetotalpopula2onof7,000jobs

RequiredSampleSize

DesiredConfidence

PercentCompliant

95 90 85 80 75 70

99 1459 2138 2801 3162 3493 3675

98 459 779 1051 1239 1428 1547

97 248 380 515 619 724 789

96 140 231 320 382 443 488

95 95 155 207 252 291 319

94 71 116 151 184 209 230

93 61 87 115 134 154 170

92 48 71 90 105 119 133

91 36 55 74 84 96 105

90 32 46 58 71 79 86

Observa?ons


Sta?s?caltestsandanaly?csarealsousedtoensuredataintegrityandcomparabilityacrossinspec?onac?vi?es

Byobserver,foreman,geography,andcompany/contractor•  Dosomeobserversgradeharder/more

lenientlythantheirpeers?•  Dosomeforemen/contractorsperform

consistentlybelowtheirpeersononeormoreskillsortasks?

•  Arethereregionalorseasonalpagerns?

Eliminate“outliers”orbiasByobserversandforemanorcontractor/company•  Dosomeobserverstendtoinspectthe

sameforemen/contractorsmorethanwouldbe“expected”(i.e.,random)?

•  Aretheresta2s2callysignificantpagernsinhowsomeobserversassessforemen/contractorsperformance?

Ensurerandomsample

•  Sampleinspec2onsoncrewsshowingconsistentlydeficientperformancerela2vetopeersareisolatedtopreserveindependenceandsta2s2calvalidity

•  Inisolatedareas,temporaryassignmentofalterna2veinspectorsanduseofdatafromconstruc2onsupervisorscanbeuseddetectandavoidbias

•  Biasdetectedinobservergradingquicklyiden2fiedandcorrectedthroughmanagementinterven2on,training,etc.

Ifbiasisdetected,ac?onsaretakentopreservesta?s?calvalidity


RPAReportsenablesmanagerstounderstandtherootcauseofqualityandnon-complianceissues,andtaketargetedac?on


RPArepor?ngandanaly?csaretailoredtousers’needsandfocusesonqualityimprovementandopera?onsexcellence

Regulators&Execu?ves

•  System-levelperformancemetricsforcri2caltasks,byImpactArea

•  Progresstowardsamplesizes

Overallsystemperformance•  PerformanceonkeytaskswithinSystemIntegrity•  Assessmentofskillsaddressedthroughtraining

Audi?ngDivision

•  Overalljobscores•  Taskperformancebyauditor,contractor,crew

memberandforeman

Regulatorycomplianceandjob-levelperformance•  Samplesizerequirementandprogress•  PerformanceoftasksassociatedwithSystemIntegrity•  Assessmentofskillstobeaddressedthroughtraining

Construc?onDivision

•  Skill/taskproficiencybycontractor,company,foreman,andcrewmember

•  Performancebyconstruc2on/ac2vitytype

Assessmentsofconstruc0onperformance•  Comparisonofassessmentsperformedbyconstruc2on

supervisorsvs.auditorsvs.foremen•  Testimpactofprograms,training,toolsmaterials


Oct5 Oct12 Oct19 Oct26 Nov2 Nov9 Nov16 Nov23 Nov30 Dec7

1.Projectlaunch

2.BuildRequirementsdocument

3.Defineworkflowandsystemsinterac?ons

4.Buildtabletapplica?onanddatabase

5.Fieldtraining,rolloutandtes?ng

6.Definesta?s?calapproachandavailablehistoricdata

7.Definerepor?ngbyusergroup

8.Buildrepor?ngengine

9.FinalizePilotanddiscussnextsteps

Milestones

RPApilotscantypicallybeimplementedin10to12weeks,withtabletsdeployedwithin6weeks

Weekbeginning…

Inspec(onRequirements

Test,train&rollouttablets

Reviewpilotresults

Implementstandardrepor(ng


RPAdrivesimprovedconstruc?onquality&produc?vity,increasesinspec?onperformance,andlowerssystemrisk;atlowercost

Opera?onsExcellence

Inspec?oneffec?veness

Riskmanagement

Qualityassurance

•  Sta2s2calvalida2onofperformancelevelsandtrends•  Automateddocumenta2onofdata,processes,findingsandanalysis•  Sta2s2callysupportedevidenceofcompliance–regulators/insurers•  Supportsimprovedcommunica2onwithregulators

• Structured,consistent,sta2s2callydriveninspec2onmanagement• Leverageinspec2ondataacrossorganiza2onalsilos•  Improvesfieldinspec2oneffec2venessandproduc2vity• Providesrootcauseanalysisonqualitydeficiencies

•  Inspec2oneffortsdrivenbyriskandperformanceissues• Systema2ctrackingandrapidtarge2ngofissues,problemsandgaps• Effec2veandefficientcontractor/crewperformancemonitoring• Real-2meinspec2onresultsprovidesvisibilityonissuesastheyoccur

• Robustmanagementofcontractorperformance• Rapiddevelopmentandtes2ngoftrainingeffec2veness• Transi2ons“tribalknowledge”into“ins2tu2onalknowledge”• Drivesculturalchangeacrossconstruc2onandqualityassurance


Construc?on

LeakSurvey

Corrosion

CustomerService

LineLocate&DamagePreven?on

Regula?on

ValveInspec?on

RPAishighlyconfigurabletoeachcompany’sopera?onsandcanaddressesabroadrangeofinspec?onneedsbeyondconstruc?on

Applica?onAreas Benefits

•  Riskandsta2s2csdriveinspec2onac2vity•  Automatedinspec2onresultsdocumenta2on

•  Detailedtrendandperformanceanalysis

•  Timelycompliancemonitoringandrepor2ng

•  Focusonkeyriskandperformancechallenges

•  Datadrivencontractormanagementsupport

•  Increasedinspectorproduc2vity(inspec2on2me)

•  Improvedcrewqualityandproduc2vity

•  Accelerateson-boardinganddevelopment

RPAwasdevelopedbythegasindustryforthegasindustrytodrivequalityandperformanceimprovementacrossopera?ons


Foraddi?onalinforma?on:

EileenSiTeNortheastGasAssocia?onPhone:[email protected]:404-229-7601Email:[email protected]:630-862-4940Email:[email protected]


Energy+Innova2on=Results

Enovation Partners

risk & performance assurance (rpa) & performance assurance (rpa): ... 99 1459 2138 2801 3162...

Documents