geoff thompson experimentus test management summit 30 th january 2008 test process improvement and...
TRANSCRIPT
Geoff ThompsonExperimentus
www.experimentus.com
Test Management Summit30th January 2008
Test Process Improvementand the Test Manager
(An uncomfortable marriage?)
Agenda
1. Introduction
2. What is Test Process Improvement?
3. The issue
4. Discuss
Introduction
Experimentus
Is a leading specialist in Software Quality Management
Provides strategic consulting solutions aimed at optimising software quality
processes and help organisation’s properly manage the integration, installation and
performance of new and existing software applications
Has developed industry recognised Test Maturity Model (TMM) assessment method
Has delivery capabilities in:
Project Management
Requirements Management
Testing (both Non-Functional and Functional)
Configuration Management
Product Selection
Management Information and Training
Client base predominantly represents ‘blue chip’ corporations operating in the
Finance, Professional Services, Media, Telecommunications and Technology sectors
What is Test Process Improvement?
“Continuous improvement of the quality, and the efficiency of the testing process, in the context of the total software process”
“Continuous improvement of the quality, and the efficiency of the testing process, in the context of the total software process”
InsightInsightCoverageCoverageProduct qualityProduct qualityControlControlPredictabilityPredictability……....
CostsCostsEffortEffortThroughput timeThroughput timeEarly defectsEarly defects……....
TestabilityTestabilityRequirementsRequirementsProject planningProject planning......
Examples of Test Process Improvement models
TMMi (Test Maturity Model)
CMMi (Capability Maturity Model)
TPI (Test Process Improvement)
CTP (Critical Test Process)
STEP (Systematic Test and Evaluation Process)
How many of you has managed or
been
involved in Test Process
Improvement?
The Issue
There is a stigma attached to Test Process Improvement
Its easy, isn't it, doesn’t need good project management skills!
Most seem to focus on detection rather than prevention activities
Focus on revolution rather than evolution – which delivers long
term results
No metrics are recorded so no real value identified
Career limiting?
However it is one of the most effective solutions
when an organisation does ‘poor testing’ isn’t it?
Case Study 1
Very experienced contract Test Manager – managed many multi million
pound test projects to successful delivery for many blue chip companies
– during the 90’s and early 2000’s
Identified many issues in that time that could have been resolved by
implementing better and more repeatable processes
Decided in early 2003 to specialise in Test Process Improvement
Between 2003 and mid 2007 he implemented better process models
into 3 major companies with over 200 test resources each
In 2007 decided he wanted to go back to Test Management
January 2008 still not employed, why…
TPI is seen as easier than delivery so with TPI on it, his CV is unusable
for ‘real’ testing jobs
Do you agree it is a worthwhile exercise?
Do you agree it is career limiting?
What do you think?
The good news
It is the first planned ISTQB (International Software Testing
Qualification Board) Expert level syllabus
It is no longer the activity that gets stopped first when the
pennies get short it is seen to add real value in mature
organisations
