revolution, evolution and lean - nordic testing days...nordic testing days 2012 – tapani aaltio:...
TRANSCRIPT
Revolution, Evolution and Lean -
Experiences on Test Process
Improvement
Tapani Aaltio, Sogeti Finland
June 5, 2012
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Revolution a drastic and far-reaching change in ways of thinking and behaving
R
2
Eugène Delacroix - La liberté guidant le peuple, 1833. ( Liberty Leading the People)
Source: wordnetweb.princeton.edu
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Agile Test Process?
Plan Prep Spec Exec Comp
Infra
Ctrl
development tests
acceptance tests
system tests
functional
Design
realisation
operation &
management
wish, legislation, policy,
technical
design
opportunity , problem
requirements
input for
Scrum Cycles
TMap Test Process
V-Model
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
The Project
The system
Identity management: register, sign-in, sign-out, profile management, sso
Used by around 50 services with 150 million users
No downtime, response times under 1 sec
People
Pool of 25 people, three scrum teams
Developer:tester -ratio 1:1
Testing
”Manual testing is our worst enemy”
3000 automated unit and integration tests
1000 automated black box tests
Test automation framework based on Ruby/Watir, built by the team
Manual integration testing and acceptance testing with customers
Scrum
Sprint cycle two weeks, release cycle 4-6 weeks
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
The Seven Wastes of Lean Management
Overproduction
Waiting
Unnecessary inventory
Transporting
Inappropriate processing
Excess motion
Defects
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
How to Estimate Effort Without Creating Waste?
Planning poker
Estimate complexity of
backlog items
Fast way to create a
common understanding
among the team
Used to measure the
velocity of the team
Testers participate on day
one
Overproduction Inappropriate
processing
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Applying Good Practices “Just in Case” Is Waste
Prioritizing test cases
Linking requirements
to test cases
Linking test cases to
defects
Overproduction Inappropriate
processing
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Manual Testing and Manual Reporting Are Waste
Manual testing is our worst
enemy
Test levels are concurrent,
not back-to-back
Instant, continuous
feedback and reporting
Creating test reports
manually is waste
Inventory Overproduction
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Tester Developer
Create a test case to demonstrate
a failure, work together!
Defect Management is Waste!
Nieuw
BO
Afgewezen
Onderzoek
Toegewezen Uitgesteld
Oplosser
In hertest
TM
Hertest ok
Tester Hertest niet ok
Niet opgelost
Tester
= Status
= Person/ meeting who adjusts the status
TM = Test manager
Andere oplossing
New
DC
Rejected
Analysis
Assigned Postponed
Solved
Solver
In re test
TM
Re test ok
Tester Re test not ok
Not solved
Tester
= Status
Other solution
Throw it in
the cloud!
Overproduction Waiting Inventory Transporting
Excess motion
Inappropriate
processing
Defects
Instead of this…
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
Evolution A process in which something passes by degrees to a different
stage (especially a more advanced or mature stage) Source: wordnetweb.princeton.edu
Evolution of scrum teams Evolution of species
Nordic Testing Days 2012 – Tapani Aaltio: Revolution, Evolution and Lean
How to Apply Revolution and Evolution?
Have the courage to change, don’t be blown away by the revolution.
Don’t be afraid of bad ideas - you might block fantastic ideas!
Overproduction
Waiting
Unnecessary inventory
Transporting
Inappropriate processing
Excess motion
Defects