sample - building business capability sample repot is based on the accompanying excel-based sample...

53
Richmond, VA | Charlotte, NC | Washington, D.C. | Philadelphia, PA BA Performance Measurement Plan SAMPLE This sample repot is based on the accompanying Excel-based sample framework. The intended audience for this report is IT management (PMO or BA Group). Its purpose is to provide a high-level overview of the measurement effort, its approach, methodology, summary results, recommendations and next steps. Accompanying this report should be the detailed results and analysis of collected data. This is intended to be a flexible measurement model, so the Excel matrix and this report template should be adapted as appropriate to fit the needs and culture of your organization. This measurement approach is especially useful for addressing known challenges of BA performance, efficiency, or agility. It can be used as a baseline and benchmarking but this is not the primary intent. Summary Overview of the problem, intended outcome and overall measurement effort Going into the eCommerce Replatforming Project, IT Management recognized the project’s potential impact to further disrupt the overall performance quality of the BA Group, which is already under a directive to make a variety of efficiency gains in 2011. This effort considered measures associated with 7 opportunities for performance improvement and was broadly intended to assess the impact of a large enterprise project on BA performance in regard to both on- and off-project activities. This intended outcome of this measurement effort had 2 areas of focus: 1. To identify recommendations leading to improved BA performance and efficiency within a large capital project (eCommerce Replatforming, a $5.2M effort involving 40 stakeholders and engaging an offshore professional services firm who assigned a core team of onsite participants) 2. To identify recommendations leading to a reduction in negative performance impact that large projects have on off-project BA activities Seven areas of opportunity were considered - 4 off-project and 3 on-project. Slightly more than 50% of the measures were qualitative, with the remainder being quantitative with broader context via additional qualitative inputs. Nearly 30 individuals participated in the data collection and analysis effort taking approximately 34 hours to complete. A large majority of of participants (89%) agreed that the results-driven recommendations below would successfully address the challenges and opportunities for performance improvement that this effort considered. Most of the recommendations are modifications to existing processes and would provide incremental improvement with virtually no cost. In two instances, new procedures would be developed and integrated into the existing BA and PM methodologies; Cost is low and limited to resource time at their standard billable rate None of the recommendations require capital outlay for investment in additional resources or technology

Upload: phamhanh

Post on 23-Apr-2018

220 views

Category:

Documents


4 download

TRANSCRIPT

Richmond,*VA*|*Charlotte,*NC*|*Washington,*D.C.*|*Philadelphia,*PA*

BA Performance Measurement Plan SAMPLE

This sample repot is based on the accompanying Excel-based sample framework. The intended audience for this report is IT management (PMO or BA Group). Its purpose is to provide a high-level overview of the measurement effort, its approach, methodology, summary results, recommendations and next steps. Accompanying this report should be the detailed results and analysis of collected data. This is intended to be a flexible measurement model, so the Excel matrix and this report template should be adapted as appropriate to fit the needs and culture of your organization. This measurement approach is especially useful for addressing known challenges of BA performance, efficiency, or agility. It can be used as a baseline and benchmarking but this is not the primary intent.

Summary Overview of the problem, intended outcome and overall measurement effort Going into the eCommerce Replatforming Project, IT Management recognized the project’s potential impact to further disrupt the overall performance quality of the BA Group, which is already under a directive to make a variety of efficiency gains in 2011. This effort considered measures associated with 7 opportunities for performance improvement and was broadly intended to assess the impact of a large enterprise project on BA performance in regard to both on- and off-project activities. This intended outcome of this measurement effort had 2 areas of focus:

1. To identify recommendations leading to improved BA performance and efficiency within a large capital project (eCommerce Replatforming, a $5.2M effort involving 40 stakeholders and engaging an offshore professional services firm who assigned a core team of onsite participants)

2. To identify recommendations leading to a reduction in negative performance impact that large projects have on off-project BA activities

Seven areas of opportunity were considered - 4 off-project and 3 on-project. Slightly more than 50% of the measures were qualitative, with the remainder being quantitative with broader context via additional qualitative inputs. Nearly 30 individuals participated in the data collection and analysis effort taking approximately 34 hours to complete. A large majority of of participants (89%) agreed that the results-driven recommendations below would successfully address the challenges and opportunities for performance improvement that this effort considered.

• Most of the recommendations are modifications to existing processes and would provide incremental improvement with virtually no cost.

• In two instances, new procedures would be developed and integrated into the existing BA and PM methodologies; Cost is low and limited to resource time at their standard billable rate

• None of the recommendations require capital outlay for investment in additional resources or technology

Richmond,*VA*|*Charlotte,*NC*|*Washington,*D.C.*|*Philadelphia,*PA*

Approach Going-in assumptions and why the given measures and methodologies were selected The opportunities and measures were drawn from two sources:

1. The 2011 Enterprise IT Management Assessment, which contains a range of goals for overall performance improvement of the company’s BA Group

2. Lessons Learned outputs from the most recent 3 capital projects of similar size and scope and following a hybrid off/onshore engagement model with a professional services firm

The seven areas of measurement focus were selected on the following criteria and assumptions:

1. Measures analysts whose are simultaneously responsible for on and off-project deliverables

2. Measures analyst activities that are heavily dependent on other groups or stakeholder participation

3. Current inefficiency is generally assumed to be rooted in poor resource allocation

4. Collectively, the overall measurement should target opportunities for strategic, operational, and individual improvement

5. Assume improvement could be achieved with very little cost

Richmond,*VA*|*Charlotte,*NC*|*Washington,*D.C.*|*Philadelphia,*PA*

Methodology How data was collected, analyzed and by home This effort represented a 50-50 split between quantitative and qualitative measures. Data was collected using the following tools and techniques:

• Quantitative o MS Project o PULSE time/resource tracking o Quality Center o Sharepoint trackers and checklists o Survey Monkey

• Qualitative o Survey Monkey (survey/questionnaire) o Interviews (phone, in-person) o Sharepoint (document analysis)

Data was collected and analyzed by resources from the Analyst and PM groups. Predominant analysis techniques used in deriving the recommendations were:

• Cost-benefit analysis • SWOT analysis • Root Cause analysis • Decision analysis • Lessons learned processes

The resulting recommendations were verified by participants in the data collection effort through interviews and surveys, the results of which suggest 89% confidence that they would lead to performance and efficiency gains.

Richmond,*VA*|*Charlotte,*NC*|*Washington,*D.C.*|*Philadelphia,*PA*

Results Summary-level findings of each measurement Problem Measurement Results

Sox audit compliance 92% of documents were in compliance at project close. Checklists led to significant improvement in completing all compliance tasks related to documentation.

Inaccurate change request estimates

100% compliance among analysts with CR tasks including sufficient peer review, however estimates were still inaccurate due to plug numbers used in absence of actual cost estimates provided by assessment participants

Missed deadlines by vendor

90% improvement in timely completion of key deliverables (vs. previous professional services engagement) 84% of key vendor analyst deliverables were completed on time; Remaining 16% were delayed by late-changing requirements that prompted unplanned revisions

Stakeholders frustrated with analysts

97% of all requirements provided by offsite enterprise stakeholders were correctly traced and accepted as correct Interviewees indicate that onsite BA elicitation was very effective in eliminating missed requirements in comparison to previous projects. However, 75% of survey respondents reported there were still issues with inadequate prioritization and solution scoping due to analysts being offsite.

Inadequate production support planning

100% of survey respondents agree the production planning effort succeeded because it was led and separately managed by the analyst. PM suggested using off-project analysts if support planning is expected to take significant time; In this project, these activities delayed test planning due to QA team waiting on analyst availability

Unqualified analysts 100% of budgeted hours were spent supporting the employee interview process. PM reports no negative impact by having analysts carve out time for interviews; Sees no need for explicitly budgeting time in the project plan as this activity is of minimal impact.

Lack of analyst participation in product development

95% of budgeted hours were spent supporting the product development team; PM reports no negative impact to the project Consensus among product development interviewees that allocating time for analysts to support marketing research and Enterprise Analysis decreased the duration of early-stage analysis as desired and increased overall productivity of the team. Participating analysts suggested developing a template to frame up the scope of work and expected deliverables ahead of product development efforts

Richmond,*VA*|*Charlotte,*NC*|*Washington,*D.C.*|*Philadelphia,*PA*

Recommendations What should be done to improve BA performance going forward Problem Outcome Recommendation

Sox audit compliance • Recommend adding a peer review of the compliance checklists that are completed by the analysts to ensure 100% completeness.

Inaccurate change request estimates

• Recommend that all assessment participants whose input feeds into the analysts work be held to planned deadlines for providing cost/hours; Consider implementing a specific WBS for large CR assessments; Participants should also be required by management to attend any assessment-related meetings scheduled by the analyst.

Missed deadlines by vendor

• The project’s lead analyst should be responsible for creating a separate WBS for vendor analyst documentation tasks and managing those tasks on behalf of the PM.

• Recommend providing vendors a BA methodology document immediately following SOW/contract signing to set expectations for oversight and performance of their analysts at the outset of the project.

Stakeholders frustrated with analysts

• Although more time-consuming and costly, longer onsite visits may lead to greater success by allowing sufficient time not only for requirements elicitation, but for requirements communication and confirmation as well.

Inadequate production support planning

• Consider making production support planning a responsibility of the Analyst Group formally, although with execution by an off-project analyst if possible. Input from project-assigned analysts is expected, but the planning effort is a small project in itself that can negatively impact project delivery if using a project-assigned analyst.

Unqualified analysts • Analysts should participate in interviews as SME knowledge needed, as this does improve the quality of the interview process

• No need for specific allocation of hours designation at the project outset; Sufficient for PM to know analysts may be needed to participate in occasional interviews

Lack of analyst participation in product development

• Product team should work with Analyst Group to request and assign resources, which should include duration (hours) and an estimate scope of work.

• If the analyst is project-assigned, this should include input from the PM to set expectations. Duration of off-project enterprise analysis activities should be noted in the project plan as soon as it is scheduled.

Richmond,*VA*|*Charlotte,*NC*|*Washington,*D.C.*|*Philadelphia,*PA*

Next Steps Any predecessor tasks or actions to implementing the recommendations Problem Next Steps

Sox audit compliance • Kelly T. to draft peer review for eventual inclusion in standard BA Methodology

Inaccurate change request estimates

• Meet with IT team leads to discuss solution for requiring participation of their resources in CR assessment requests

Missed deadlines by vendor

• Meet with PMO to discuss changes to their methodology for BA-management assistance

• Meet with Satish W. to discuss viability of adding new documentation to the vendor selection and engagement process

Stakeholders frustrated with analysts

• Alan R. to estimate average cost for longer-duration engagement with enterprise stakeholders. Use requirements for the last 3 enterprise projects as a basis for scope and assume standard BA hourly

Inadequate production support planning

• Meet with Jack P. to discuss concerns over impact of BA Group formally owning production support planning efforts

Unqualified analysts • No action necessary; Accepting recommendation as stated

Lack of analyst participation in product development

• Meet with Mike W. to discuss creating a template for his product team to use for requesting support from the Analyst Group. Template would frame up the scope of work and expected analyst deliverables

Simple'statement'of'the'existing'problem'or'opportunity'at'the'outset'of'a'given'project'or'off8project'effort

Fine8grained,'tangible'instance'of'the'high8level'outcome.'The'objective'for'this'specific'measurement'effort.

Data'that'must'be'captured'to'adequately'inform'outcome8oriented'decision'making.

What'decision'to'correct'the'problem'will'the'collected'data'allow'you'to'make?'The''So'What?''factor.

The'means'or'process'by'which'data'will'be'collected

Where'does'the'data'come'from?'(Person,'group,'repository,'etc.)

Individuals'responsible'for'data'collection

Timing'and'frequency'of'the'information'gathering'process.'Includes'target'completion'date.

Qualitative'or'quantitative

Strategic,'operational,'individual

On8project,off8project

Problem Objective Measure Outcome Channel Source Who When Type Category Segment Notes

Failed>internal>audit>for>SOX>compliance>during>last>offshore>engagement.

Meet$all$SOX$tollgate$requirements$for$project$documentation

All$document$approvals;$Complete$all$compliance$verification$tasks$for$each$deliverable

What$activities$and$processes$are$needed$to$bring$SOX$compliance$to$within$96%?

PULSE$(time$and$resource$tracking$system)Checklists

PULSE(time$,$resource,$and$compliance$tracking);Sharepoint$(checklists)

Kelly$Smith$(BA)Ryan$Peters$(BSA)

At$completion$of$each$requirement$document

Quantitative Operational OnQProject

Agilent$is$responsible$for$6$SRS$documents,$each$of$which$must$be$$audited,$reviewed,$stored,$and$maintained$to$be$in$SOX$compliance.

Cost>oferruns>on>capital>projects>due>to>inaccurate>Change>Request>estimation

Complete$all$requirements$of$the$CR$process$by$the$CRB$meeting$as$relevant.

Completed$assessment$checklist$for$each$CR;$PeerQreview$approval$entered$in$Pulse

What$activites$and$processes$are$needed$to$improve$the$quality,$accuracy,$and$timeliness$of$project$CRs?

Assessment$ChecklistInterviews

Sharepoint;Todd$Schmidt(CBR$Chair)Peer$reviewer(as$assigned)

Katherine$Saunders$(PM)

Following$each$CRB$meeting Quantitative Operational OnQProject Peer$reviewers$TBD$following$

assignement$$for$each$CR

Downstream>financial>and>operational>impact>on>capital>projects>due>to>missed>deadlines>by>vendor>analysts.

Ensure$that$vendor$analysts$complete$their$requirements$documents$on$time,$confirm$them$via$JAD$sessions,$and$acquire$adequate$signoff

Requirements$documents$complete,$confirmed,$and$approved$as$scheduled$with$each$step$and$reporting$attribute$of$the$process$entered$in$Pulse$and$Sharepoint$as$required.

What$is$the$most$costQeffective,$productive,$and$timeQsensitive$means$of$managing$critical$vendor$BA$activities?

PULSEChecklists

PULSE(time$,$resource,$and$compliance$tracking);Sharepoint$(checklists)

Kelly$Smith$(BA)Ryan$Peters$(BSA)

Following$completion$of$each$requirements$document

Quallitative Operational OnQProjectMeasures$must$be$captured$for$each$of$6$requirements$documents$to$be$complete$by$Agilent

Strained>relationship>and>skepcisim>from>the>Call>Center>Reporting>Group>due>to>inadequate>engagement>on>previous>projects.

Engage$reporting$stakeholders$at$project$kickoff$and$conduct$onsite$elicitation/confirmation$to$reduce$total$missed$or$inadequately$implemented$requirements;$Restore$trust$and$confidence$among$the$reporting$and$analyst$groups

Positive$feedback$from$reporting$stakeholders;$Better,$more$thorough$requirements$documentation;$FullyQtraced$reporting$requirements

How$do$we$ensure$sufficient$involvement$from$offsite$stakeholders$to$mitiage$the$risk$of$missed$requirements,$production$defects,$and$negative$relational$capital?

Surveys,$interviews,$document$approvals,$tracability$matrices,$QA$results;$UAT$signoff

PULSEMS$ProjectSharepointQualityCenterSurvey$Monkey

Lyle$EcholsVadi$R.Kevin$Elmer

Stacey$Ganderson$(BA)

Following$UAT$signoff$of$reports Qualitative Individual OnQProject

Lengthy>and>confused>process>of>service>restoration>when>production>outages>occur>due>to>inadequate>support>plans>and>processes

Analysts$to$manage$and$coordinate$project$tasks$related$to$producing$$a$comprehensive$production$support$and$notification$plan

PMQapproved$WBS$for$creating$a$production$support$plan;$Completed$RACI$of$relevant$stakeholders;$Plan$approved$and$centrally$stored$by$start$of$UAT

How$do$we$reduce$overall$downtime,$improve$client$notification$when$production$issues$arrive,$and$achieve$contracted$Service$Levels$for$SaaS$platforms?

Surveys,$interviews,$PULSE,$Checklists

MS$Project,$Survey$Monkey,$Sharepoint

Steve$Kaiers,$Melanie$Twiddle

Ryan$Peters$(PM)Following$singoff$of$production$support$plan

Qualitative Strategic OffQProject

Declining>confidence>with>the>Analyst>Group>due>to>insufficient>SME>and>technologyKspecific>expertise

Hire$suffuciently$qualified$analysts$to$support$the$eCommerce$platform;$including$relevant$analys$skills$and$previous$technology$knowledge.

Project$analysts$to$spend$up$to$10$hours$each$participating$in$analyst$interviews

How$do$we$ensure$the$Analyst$Group$is$providing$highestQquality$service$to$the$busines$through$adequate$technology$and$SME$experience$for$a$given$product$or$solution?

PULSEInterviews PULSE,$Sella$Ramirez Kelly$Smith$(BA)

RealQtime$notification$from$PULSE$when$thresshold$hit

Quantitative Strategic OffQProject

Lack>of>available>resources>to>participate>in>earlyKstage>product>development>cycles

Reduce$the$overall$duration$of$product$development$and$market$research$efforts$by$allocating$analyst$SMEs$to$provide$enterprise$analysis$support.

Project$analysts$to$spend$up$to$30$hours$(total)$participating$in$product$development,$market$research$and$enterprise$analysis;$Collect$feedback$from$product$development$team

How$can$the$Analyst$Group$assist$in$helping$the$organization$maintain$its$competitive$advantage$in$the$marketplace$as$regards$development$of$new$products$and$services?

PULSESurveys

PULSESurvey$MonkeyProduct$Dev$team$(TBD)

Katherine$Saunders$(PM)Ryan$Peters$(BSA)

RealQtime$notification$from$PULSE$when$thresshold$hit

Quantitative Strategic OffQProject

BA>Performance>Measurement>Plan>SAMPLEProblem'of'the'Painted'Dashboard

This$matrix$is$used$in$documenting$the$highQlevel$requirements$of$a$particular$measurement$effort.$When$complete,$it$presents$a$summarized$framework$that$sets$the$direction$of$your$work.$It$feeds$into$the$measurement$project$plan$(if$a$plan$is$developed)$and$points$toward$the$decisions$that$the$collected$data$will$allow$you$to$make$in$presenting$recommendations$to$management.$You$will$need$to$create$your$own$tools$and$templates$for$detailing$the$measures$more$specifically$(if$needed),$tracking$progress$in$the$measurement$effort,$recording$collected$data,$analyzing$the$results,$and$documenting$recommendations.$Samples$of$these$additional$tools$and$templates$are$not$provided,$as$they$should$be$developed$to$meet$the$specific$needs$of$your$organization$or$the$measurement$effort.

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

1118%West%Main%Street%Richmond,%Virginia%23230%804.355.0511%%©2012%CapTech%Ventures,%Inc.%%%www.captechventures.com%%

IT%Management%ConsulGng%Systems%IntegraGon%Data%Management%

The$Problem$of$the$Painted$Dashboard$Mark$Mountan,[email protected]%804.301.6877%

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

30$second$response$…$

What%can%you%learn%from%this%dashboard?%

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

What%can%you%learn%from%this$dashboard?%

30$second$response$…$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

Simple,$elegant$measurement$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

…%and%in%exchange%I%offer%1.  An%insightPdriven%approach%to%measuring%BA%

performance%2.   A$framework$for$BA$measurement$that$you$

can$begin$using$tomorrow)3.  A%tacGcal%method%for%overcoming%objecGons%4.  Fun,%excitement%and%…%5.  A%parGng%giV%

Give$up$an$hour$of$your$life$…$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

Disclaimers$•  No%more%automoGve%references%•  Nothing%new;%It’s%all%in%BABOK%2.0%•  “A”%model,%not%“The”%model%•  Focused%on%easy%wins%

Agenda$(and$disclaimers)$

1.  Why%measure%2.  A%model%for%measurement%3.  Ge_ng%to%“yes”%4.  Wrap%up%

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

Business$Analysis$Planning$&$Monitoring$ElicitaJon%Requirements%Management%&%CommunicaGon%Enterprise%Analysis%Requirements%Analysis%SoluGon%Assessment%&%ValidaGon%

IIBA/BABOK$2.0$tag$cloud$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

Why%doesn’t%measurement%of%BA%ac8vi8es%occur%in%your%organiza8on?%

One$minute$response$…$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  When%would%I%do%that?%(8me)%

•  What%for?%(no%compelling%reason)%

•  I%don’t%know%what%or%how!%(lack%of%knowledge)%•  It’s%all%good,%I%got%this!%(overconfidence)%•  Status%quo%is%good%

(resistant%to%change)%

Why$no$BA$measurement?$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

1.  Very%few%quanGtaGve%BA%measures%are%truly%acGonable;%Why%collect%data%for%collecGon%sake?%

2.  BAs%are%condiGoned%not%to%think%of%data%collecGon%(ironically).%

3.  Measuring%things%sucks!%

Top$3$reasons$(IMO)$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

“To%manage%the%performance%of%business%analysis%acGviGes%to%ensure%that%they%are%executed%as%effecGvely%as%possible.”%BB%BABOK%2.0%sec8on%2.6%pg.%29%%•  Improve%efficiency,%agility%and%overall%quality%of%work%•  Take%steps%to%correct%any%problems%–%quick%tacGcal%wins%•  Inform%management/updates%to%process%assets%and%

governance%•  Incremental%improvements%to%the%organiza8on%(strategy,%

opera8ons,%and%individual%BA)%

Why$measure$anyway?$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

FoundaGonal%AssumpGons%

Structural%Components%

Key%Akributes%

A$model$for$measurement$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Company$Overview$Offers%ecommerce%SaaS%soluGon,%dropPship%merchandise%fulfillment%and%call%center%services%for%banks%and%credit%card%companies%%

•  Project$Replace%an%aging%ecommerce%plamorm%with%bestPinPclass%commercial%package%soluGon;%hybrid%on/offshore%engagement;%Waterfall%$

•  BA$ResponsibiliJes$EsGmaGon,%vendor%selecGon,%soluGon%scope,%BI%reporGng%requirements,%oversight%of%vendor%analysts%

Demo,$Inc.$–$the$company$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

1.  SOX%documentaGon%compliance%2.  EsGmaGon%of%change%requests%3.  Oversight%of%offshore%BAs%4.  Stakeholder%analysis%for%reporGng%5.  ReporGng%requirements%communicaGon%6.  Defining%a%support%model%and%process%7.  Interviewing%BA%candidates%8.  ParGcipaGng%in%new%products%assessment%

Demo,$Inc.$–$the$measures$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

FoundaGonal%AssumpGons%

A$model$for$measurement$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

Business%Analysts%Are%…%•  Knowledge%workers%•  Provide%a%service%within%the%organizaGon%•  BAs%create%no%durable,%lasGng%work%product%•  BAs%have%limited%organizaGonal%power%•  Analysis%is%a%discipline%as%oVen%as%it%is%a%role%

So$…$

FoundaJonal$assumpJons$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

Measuring%analysts%(analysis)%is%about%…%•  Gauging%efficiency%•  ProducGvity%•  Quality%and%conGnuity%of%work%•  Driving%toward%conGnuous%improvement%of:%

– Domain%knowledge%–  Service%delivery%– Underlying%competencies%and%soV%skills%– ApplicaGon%of%KAs%and%best%pracGces%and%methods%

FoundaJonal$assumpJons$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

FoundaGonal%AssumpGons%

Structural%Components%

A$model$for$measurement$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Strategic$•  OperaGonal%•  Individual%

Methods,%governance,%structure,%and%organizaGon%of%the%BA%group,%PMO,%or%project%plan%(execuGon%and%control)%

3$categories$of$measurement$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Strategic%•  OperaJonal$•  Individual%

Tools,%technologies,%tasks,%sequences%and%acGviGes%involved%in%outpu_ng%analysis%deliverables%or%creaGng%value%for%the%organizaGon%or%project%

3$categories$of$measurement$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Strategic%•  OperaGonal%•  Individual$

Individual%analyst’s%underlying%competencies,%soV%skills,%technical%capabiliGes,%criGcal%thinking,%decision%making,%and%ability%to%successfully%execute%techniques%required%in%performing%business%and%systems%analysis%

3$categories$of$measurement$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Strategic%•  OperaGonal%•  Individual%

OnVProject$

OffVProject$

Categories$and$segments$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  OnVProject$•  OffPProject%

Tasks%and%acGviGes%which%are:%•  Scheduled%•  Require%signoff%•  For%regulatory%compliance%•  Predecessors%to%subsequent%project%tasks%not%executed%by%the%analyst%

$

2$segments$of$measurement$

Strategic%|%OperaGonal%|%Individual%

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  OnVProject$•  OffPProject%

•  Requirements%Management%•  Requirements%Packaging%

–  DocumentaGon%–  Modeling%

•  Requirements%PrioriGzaGon%•  Requirements%VerificaGon%•  Requirements%AllocaGon%•  ElicitaGon%Processes%•  Enterprise%Analysis%AcGviGes%•  …$PotenJally,$any$element$of$the$6$

BABOK$Knowledge$Areas$

2$segments$of$measurement$

Strategic%|%OperaGonal%|%Individual%

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  OnPProject%•  OffVProject$

•  FuncGon%as%SME%•  ProducGon%support%(onPcall)%•  Managing%tools,%templates,%resources%

•  EsGmaGon%and%scoping%•  Vendor%selecGon%•  BD%and%sales%support%•  Interviewing%•  Mentoring/training,%etc.%…%%

2$segments$of$measurement$

Strategic%|%OperaGonal%|%Individual%

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

%

OnVproject$measurement$Strategic$ •  BA%Approach%(BABOK%2.2)%

•  CommunicaGon%Plan%(BABOK%2.4)%•  BA%Performance%(BABOK%2.6)%

QuanGtaGve%and%somewhat%QualitaGve%

OperaJonal$ •  BA%AcGviGes%(BABOK%2.3)%•  Requirements%Management%Process%

(BABOK%2.5)%•  Requirements%communicaGon%and%verificaGon%•  SoluGon%Scope%Management%

Predominantly%QuanGtaGve%

Individual$ •  DocumentaGon%Quality,%accuracy,%completeness,%appropriate,%level%of%detail%

•  CommunicaGon%Timeliness,%clarity,%effecGveness,%amount%

•  Analysis%Techniques%appropriate,%knowledge,%quality%

•  Underlying%competencies%

QualitaGve%and%QuanGtaGve%

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

%

OffVproject$measurement$Strategic$ •  BA%and%PM%methodology%and%governance%

•  Decay%of%SME%knowledge%over%Gme%•  Accuracy%in%esGmaGon%and%scoping%

(Enterprise%Analysis,%BABOK%5)%•  ContribuGon%to%BD%and%sales%support%

QuanGtaGve%and%somewhat%QualitaGve%

OperaJonal$ •  BA%processes%•  BA%tools,%templates,%resources%•  Knowledge%management%•  OperaGonal%support%•  Mentorship%and%development%of%others%

Predominantly%QuanGtaGve%

Individual$ •  Progress%against%the%Capability%Maturity%Model%•  InteracGon%with%other%groups%and%individuals%(IT,%

business,%operaGons)%DocumentaGon%•  ContribuGon%to%and%leadership%of%internal%

projects%•  Quality%of%360%feedback%

QualitaGve%and%QuanGtaGve%

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

Which%is%more%important%to%you?%OnBproject%or%offBproject%measurement?%Why?%

OneVminute$response$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

FoundaGonal%AssumpGons%

Structural%Components%

Key%Akributes%

A$model$for$measurement$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Problem%

•  ObjecGve%

Brief,%clear%statement%of%what%needs%to%be%fixed%

Define%“fixed.”%What%is%a%%Return%to%Eden%for%this%measurement%effort?%

What%is%the%outcome%oriented%measure?%•  Measure%

Key$aYributes$to$capture$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Outcome%

•  Channel%The%means%or%process%by%which%informaGon%will%be%collected%

•  Source%

So%what?%What%key%insight%is%gained,%what%decision%does%this%drive?%

Where%does%the%data%come%from?%Person,%group,%repository,%dB…%

Key$aYributes$to$capture$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

What?$ Why?$ So$What?$

Informed$AcJon$

Performance$Focus$KPI)Only)

Force$MulJplier$Insight2driven)(Key)Insight)Analysis))Qualita<ve,)Voice)of)the)Customer)

Low$ Medium$ High$ Success$Decision%Momentum%Con8nuum%

OutcomeVOriented$Measures$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Who%

•  When%

Individual%responsible%for%informaGon%collecGon%

Timing%and%frequency%of%the%informaGon%gathering%process.%Includes%target%compleGon%date.%

Key$aYributes$to$capture$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Type%

•  Category%

QualitaGve%or%QuanGtaGve%

Strategic,%OperaGonal,%Individual%

OnPProject,%OffPProject%•  Segment%

Key$aYributes$to$capture$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

1.  Summary%2.  Approach%3.  Methodology%4.  Results%5.  RecommendaGons%6.  Next%Steps%

Demo,$Inc.$–$the$report$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  (2%measures%x3%categories)%x%2%segments%=%12%max!%•  OutcomePoriented,%insightPdriven%•  Easy%collecGon,%easier%analysis%•  Input%from%varied%audience%(360%perspecGve)%•  Broad%and%repeatable%(offPproject)%•  70/30$split$favoring$qualitaJve$measures$

Choosing$the$right$measures$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Comes%in%at%best%price%•  Has%great%referrals%•  Shows%up%on%Gme%•  Uses%topPrated%equipment%

•  Finishes%job%early%•  Invoices%under%budget%

But$…$

QuanJtaJve$dream$come$true!$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Only%paints%three%%%sides%of%the%house%

•  Uses%different%colors%•  Applies%indoor%latex%instead%of%outdoor%oilPbased%paint%

It’s)primarily)about)key)insights)that)lead)to)ac<on)–)not)simply)tallying)up)the)completed)tasks)and)deliverables)(KPI)!)

QualitaJve$nightmare$outcome!$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  No%felt%pain%(lack%of%compelling%purpose)%•  We%don’t%have%resources%(capacity)%•  It%takes%too%long%(duraGon/Gme)%•  Effort%>%Value%(payoff,%WIIFM)%•  Other%human%psychological%factors%•  Hidden%organizaGonal%root%causes%

Why$people$object$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  Diagnose%the%root%cause%of%pain%–  If%no%felt%pain%exists,%find%the%undiagnosed%condiGon%

•  Present%an%anGdote%– Create%a%measurement%pilot/prototype%– Simple%– Focused%on%easy%wins%– Demonstrates%value%by%reducing%pain%

Overcoming$objecJons$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

Pain%is%in%products%and%processes%that%•  Have%a%negaGve%impact%on%revenue%•  Are%creaGng%substanGal%producGon%issues%•  Increase%customer%dissaGsfacGon%•  Cloud%visibility%into%enterprise%data%•  Blow%up%the%PM%triple%constraint%•  Make%someone%important%

look%stupid%•  Drive%vision%into%the%weeds%

Diagnosing$pain$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

What%analystBrelated%pain%is%your%organiza8on%currently%experiencing?%

One$minute$response$…$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  2%areas%of%KIA%•  Measure%and%improve%within%your%control%•  Involve%others%in%the%process%•  80/20%focus%(Pareto%Principle)%•  Present%results%to%who%hurts%most%•  Must)target)an)area)of)present)pain)

The$anJdote$–$a$pilot$program$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

•  OutcomePoriented%approach%•  Focused%on%quality%over%quanGty%•  Measures%onP%and%offPproject%BA%acGviGes%•  Creates%momentum%by%involving%others%•  80/20%rules!%

Wrap$up$key$points$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

An%insightPdriven%approach%to%measuring%BA%performance%A%readyPmade%model%for%BA%measurement%that%you%can%begin%using%tomorrow%A%tacGcal%method%for%overcoming%objecGons%Fun,%excitement%and%…%A%parGng%giV%

One$hour$later$you$have$…$

©2012%CapTech%Ventures,%Inc.%%All%rights%reserved.%

“Life)is)about)taking)ac<on,)and)if)your)work)is)not)driving)ac<on,)

you)need)to)stop)and)reboot.”)

A$parJng$gi`$

Avinash)Kaushik,)Web)Analy<cs)2.0)B%kaushik.net%