a new model for building business process quality
TRANSCRIPT
© 2015 Worksoft, Inc.www.worksoft.com
A New Model for Building Business Process Quality
Mark Summers
www.worksoft.com 2
Develop and institutionalize a world class Structured Software Testing and Quality Assurance
Framework leveraging a “Assess > Improve > Transform” methodology, resulting in a more
efficient and effective IT organization capable of delivering high quality and high availability systems.
A Framework for Advancing Competency
Assess
Maturity Assessments based on TMMI are the foundation for maturing your quality framework and overall IT.
Improve
Maximize your ability to eliminate defects early and concurrently lower the defect discovery costs.
Transform
Achieve “world-class" quality and efficiencies by streamlining your IT organization with the introduction of a formal test competency or COE.
Assess Improve Transform
www.worksoft.com 3
Why strive for “High Maturity”?
www.worksoft.com 4
Typical Federated “Low Maturity” Test Teams
Assess Improve Transform
BU #1 -
eComm
BU #3 –
Financial Sys
BU #2 –
Logistics
= Standards
= Tools
= Expertise
= Compliance
o Inconsistent levels of quality
o Inconsistent execution and
levels of success
o Higher cost of development
and test
o Expensive duplication testing
tools
o Inability to sustain or reuse
testing assets
o Inability to leverage and reuse
best practices of other BU’s
o Duplicate specialty resource
o High levels of staffing
o Low Defect Removal Efficiency
Characterizations
www.worksoft.com 5
Typical Federated “Low Maturity” Test Teams
Assess Improve Transform
BU #1 -
eComm
BU #3 –
Financial Sys
BU #2 –
Logistics
= Standards
= Tools
= Expertise
= Compliance
o Inconsistent levels of quality
o Inconsistent execution and
levels of success
o Higher cost of development
and test
o Expensive duplication testing
tools
o Inability to sustain or reuse
testing assets
o Inability to leverage and reuse
best practices of other BU’s
o Duplicate specialty resource
o High levels of staffing
o Low Defect Removal Efficiency
Characterizations
?
www.worksoft.com 6
Optimized “High Maturity” Test Organization – TCOE
Characterizations Quality Standards
* Enterprise wide standards
Standard Tools
* One set of testing tools
Education
* Subject matter experts
Process
Governance & Continuous
Improvement
* Process governance &
predictable outcomes
Business
Unit #1
Business
Unit #2
Business
Unit #3
* Maximize resource
utilization and balancing
QCOE Shared Service
Test
Automation
Performance
Tuning
SDLC
Governance
Specialized
Test Services
* Specialized resources
sharing* High defect removal
rate
* More efficient IT
department
* Lower defect discovery
costs
www.worksoft.com 7
Get there faster!
Assess Improve Transform
How can Worksoft’s maturity model of
“Assess>Improve>Transform”
get you there faster?
www.worksoft.com 8
Assess>Improve>Transform
Assess Improve Transform
Assess
Maturity Assessments based on TMMI are the foundation for maturing your quality framework and overall IT.
o Select an expert to perform deep assessmento Understand objectives and IT driverso Select appropriate assessment based on objectives and
industry standardso Worksoft Health Checko Test Maturity Baselineo Test Maturity Assessment
o Compare results to industry standards and best practiceso Present findings and recommendationso Assist with maturity roadmapo Help prioritize & select process improvement initiatives
www.worksoft.com 9
Assess>Test Assessment Overview
Assessment Findings Report
Maturity Level Report
Action Plan & Basic Roadmap
Continuous Improvement
Assess Improve Transform
Input Analysis Output
Stakeholder Interviews
Questionnaires
Project Samples & Work Products
Worksoft
Assessment Framework
TMMiModel
Worksoft Platform
Model
www.worksoft.com 10
Evidence collected for “Baseline” Assessment
IT Participants:
• Developers
• Infrastructure
• Technology
experts
• Quality assurance
• Program managers
• More…
Business
Participants:
• Jim Siegel
• Toby Cappello
• Business SMEs
• Business Analysts
Evidence Collected:
• Interview notes from
Participants
• Test Policy
• 2x Test Strategy
Document
• 2x Master Test Plan
• 12x Test Status Reports
• 10x Defect Reports
• Performance Test Plan
• QA Metric Report
• Test Execution
Schedule
• Test Technique
worksheets
• Test Lifecycle Website
• Templates Website
Process Area Coverage:
10 of 17 PA’s
• Test Policy & Strategy
• Test Planning
• Test Monitoring & Control
• Test Design & Execution
• Test Organization
• Test Lifecycle & Int
• Non-Functional Testing
• Test Measurement
• Advanced Reviews
• Defect Prevention
60+ Goals
- See below
200+ Practices
- See below
Deliverables:
• Strength & Weakness
Report
• Detailed Findings Report
• Evidence Coverage
Report
• Executive Summary
Report
• 4 Month RoadMap
• Workshop (depending on
assessment type)
• Project Plans (depending
on assessment type)
Other Sources:
• Worksoft Cerify
• HP Quality Center
• Remedy
• Service Now
• PMO Process
• EA Process
• LoadRunner
• McCabe Team Test
• Solman
• ST03
• Metics
• DRE
• Coverage
• Project Variance
www.worksoft.com 11
Assess>Sample Assessment detail
• Deep Assessment
• 17 Process Area’s
• 100 Goals
• 500 Practices
www.worksoft.com 12
Assess>Sample Assessment detail
• Wide Sampling
• # of Business
Units
• # of Projects
• Type of SDLC
www.worksoft.com 13
Assess>Sample Assessment detail
• Meaningful findings
• Detailed opportunities for
improvement
• Evidence collection
www.worksoft.com 14
Assess>Improve>Transform
Assess Improve Transform
Improve
Maximize your ability to eliminate defects early and concurrently lower the defect
discovery costs by leveraging Worksoft solutions
o Assist in prioritization of initiatives from the assessmento Leverage experts for the process improvement initiativeso Acceleration packages based on industry best practices
o world-class test competency & COE frameworks that can be quickly tailoredo includes process, templates, work products, tools, metrics, reporting and
governance.o Worksoft testing platform enablement serviceso Professional education and certifications
o Outsourcing and Test Factorieso Onsite, near-shore and offshore
www.worksoft.com 15
Results>Process Area
www.worksoft.com 16
Results>Specific Practices (1 of 17)
2.1 Test Policy and Strategy
Aggregated Strength:
• SP1.1> The test policy document exists and very clear QA Goals
• SP1.2> Great Test Policy
• SP2.3> Project manager confirms that there was a discussion about the test strategy document and has signed off in the document. Strong evidence.
Aggregated Opportunity:
• SP1.2> more education with the Project Managers would be valuable
• SP1.3> Add a link in the Test Plan to the policy
• SP2.1> Risk section needs more detail, basic risk identified but needs the risk mitigation completed.no risks identified
• SP2.2> The entry/exit criteria should contain precise measures and need to be captured.
• SP3.1> The only metrics captured is production defects, this not an adequate measure for development and can't be used until after the project is complete. The SDLC document does not reference and KPI's to measured during project
• SP3.2> only production defects are captured only production defects are captured
Recommendations:
• 1. Implement a Formal M&A capability which will help make the entry/exit criteria something that will be enforceable.
• 2. Create mitigation plans if the identified risks in case they occur. Then you will be prepared to take immediate action.
www.worksoft.com 17
Top 4 Recommendations
www.worksoft.com 18
Assess>Improve>Transform
Assess Improve Transform
Transform
Achieve “world-class" quality and efficiencies by streamlining your IT
organization with the introduction of a formal test competency or COE
o Testing competency improvements o Testing Center Of Excellenceo Quality Center of Excellenceo Governance frameworkso Measurement and analysis programso Continuous improvement frameworko Test outsourcing and test factories
www.worksoft.com 19
The Journey for an Emerging Test Team
Time
Ma
turi
ty/A
do
pti
on
Sample Initiatives
• Establish a Test Policy
communicated by Executive
Leadership
• Document organizational
testing standards
• Educate everyone in IT on the
standards and expectations.
• Implement Test Automation
• Begin measuring Defect
Removal Efficiency rate
Sample Initiatives
• Establish TCOE
• Implement FAGAN inspection
model
• Develop a performance testing
strategy and tool
• Improve non-production
environments
• Service Virtualization
• Data Mgt
Assess>Improve Transform
Initial
Managed
Defined
Measured
Optimization
Sample Optimization Initiatives
• Implement a QA Metric Data Warehouse
• Implement a SDLC Governance
Framework
• Evolve TCOE to QCOE
• Implement CMMI
OPF and OPD
Continuous Improvement
• CMMI CAR & DAR
• Lean SixSigma
• Causal Analysis
Improvement Continuous
www.worksoft.com 20
Evolving from a Testing COE to Quality COE
Causal
Analysis &
Trending
Predictive
Analytics
Advanced
Measurement,
Analysis &
Governance
Process
Engineering
and CMMI
OPF and OPD
www.worksoft.com 21
Next Steps
1. Assessment
• Have an independent, unbiased, professional assessment performed
2. Tackle Quick Wins!
• Take action on the items from the “general recommendations” from the process area slides
2. Process Improvement Workshop
• Prioritize process improvement initiatives
• Develop detailed project plans for each initiative
• Develop integration and implementation plans
• Determine how to fully institutionalize and govern the new process.
3. Projects Execution, Monitoring and Measurement
• Identify project you have time or skillset to manage yourself
• Identify the initiatives that you need expert support to drive
• Implement the projects
• Measure ROI
4. Re-Assess or Full Assessment
© 2015 Worksoft, Inc.www.worksoft.com
Questions?
Thank you
Mark Summers
+1 414-704-7326