test improvement for agile/scrum
TRANSCRIPT
![Page 1: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/1.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
Test Improvement for Agile
Jeroen Mengerink [email protected]
&
Edze Knol [email protected]
![Page 2: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/2.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
2
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
![Page 3: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/3.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
3
What is Agile?
agile /’æd3aIl; NAmE ’æd3l/ adj.
1 able to move quickly and easily SYN nimble: a strong and agile athlete 2 able to think quickly and in an intelligent way: an agile mind / brain
(source: Oxford Advanced Learner’s dictionary)
![Page 4: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/4.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
4
Agile Manifesto
• Individuals and interactions over processes and tools
• Working software over comprehensive documentation
• Customer collaboration over contract negotiation
• Responding to change over following a plan
That is, while there is value in the items on the right,
we value the items on the left more.
(source: http://www.agilemanifesto.org/)
![Page 5: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/5.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
5
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
![Page 6: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/6.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
6
Scrum
Goals:
• Raise the effectiveness of the team
• Guard the progress of the team
• Solve impediments
• Guard the project progress
• Minimizing of project risks
Scrum is an iterative and incremental method for managing software
projects and product or application development
![Page 7: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/7.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
7
Scrum
![Page 8: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/8.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
8
Agile/Scrum
Agile
• Set of basic ideas
• Little overhead
• Focussed on people
Scrum
• Process management
• Short iterations
• Multidisciplinairy teams
![Page 9: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/9.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
9
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
![Page 10: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/10.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
10
Test Improvement Roadmap
Awareness & Commitment & Buy-in
Goal, scope and approach
Assessment
Implement improvement
actions Plan
Define improvement
actions Evaluation
![Page 11: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/11.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
11
Assessment
“If you don’t know where you are, a map won’t help.” (Watts Humphrey)
![Page 12: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/12.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
12
Improvement suggestions
• Improvement suggestions describe “How to improve”
– From testing perspective
– From Agile perspective
– For each key area
• Provide related information
• Based on practice and current setting
![Page 13: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/13.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
13
Agile Scrum Structured
Evolution of testing
Pioneering
Structured
Agile
Time
Str
uctu
red
N
ot
str
uctu
red
![Page 14: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/14.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
14
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
![Page 15: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/15.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
15
Assessment model
Key Area Structured Scrum Agile
Stakeholder commitment
Planning & Estimation
People
Interaction
Teamwork
Test process
Test management
Test profession
Test automation
Regression & E2E testing
Defect management
Test environment
![Page 16: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/16.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
16
Assessment model
• First level is not just initial like in other models
• Each key area has a number of checkpoints
• Checkpoints are continuous
– Next maturity level builds on previous level
![Page 17: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/17.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
17
Agenda
• Agile
• Scrum
• Test improvement roadmap
• Assessment model
• Key areas
![Page 18: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/18.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
18
Teamwork
expertise
verbreding
T
![Page 19: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/19.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
19
Teamwork
expertise
verbreding
T
![Page 20: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/20.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
20
Traditional teams A
nal
ysis
an
d d
esig
n
• Business analyst 1
• Business analyst 2
• Business analyst 3
• Business analyst 4
Dev
elo
pm
ent • Developer 1
• Developer 2
• Developer 3
• Developer 4
Test
ing • Tester 1
• Tester 2
• Tester 3
• Tester 4
![Page 21: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/21.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
21
Agile teams A
nal
ysis
an
d d
esig
n
• Business analyst 1
• Business analyst 2
• Business analyst 3
• Business analyst 4
Dev
elo
pm
ent • Developer 1
• Developer 2
• Developer 3
• Developer 4
Test
ing • Tester 1
• Tester 2
• Tester 3
• Tester 4
Team 1
Team 2
Team 3
Team 4
![Page 22: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/22.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
22
Teamwork
Divided by specialisation
Structured
Multi- disciplinairy
Working together
Scrum
Agile
![Page 23: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/23.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
23
Structured Scrum
Agile
Teamwork
QA = Test QA = Team
QA = Whole team effort
![Page 24: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/24.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
24
Teamwork
• Respect and trust each other
• Commitment as a team
– Work towards a team goal
• Help each other where possible
• Evaluate and improve often
![Page 25: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/25.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
25
Test management
What to manage?
![Page 26: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/26.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
26
Structured Scrum
Agile
Test management
Rigid management by the test manager
Some level of direction
Test manager?
Self-managing teams &
Agile test manager
![Page 27: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/27.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
27
Structured Scrum
Agile
Test management
Project view Sprint view Multilevel view
![Page 28: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/28.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
28
Test management
• People management
– Provide people for the teams
– Coach and train the people
• Agile and the used method (mostly Scrum)
• Testing
– Facilitate knowledge sharing
![Page 29: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/29.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
29
Test management
• People management
– Provide people for the teams
– Coach and train the people
• Agile and the used method (mostly Scrum)
• Testing
– Facilitate knowledge sharing
• Generic test approach / strategy
• Release planning
• Keep the big picture (helicopter view)
![Page 30: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/30.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
30
Generic test approach / strategy
• Training and coaching
• Defect management
• Risk analysis
• Non-functionals
• E2E testing
• Tooling and automation
• Environment management
• Metrics and reporting
• …
![Page 31: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/31.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
31
Generic test approach / strategy
Generic test approach / strategy
Risks Maturity
Skills Product
Size Time
Culture
Bandw
idth
![Page 32: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/32.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
32
Defect management
“Defect tracking is a form of waste … ”
![Page 33: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/33.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
33
Structured Scrum
Agile
Defect management
Log to communicate
Less logging, more
face-to-face
communi-cation
Log when needed
![Page 34: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/34.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
34
Defect management
• Factors that influence whether a defect is recorded and if so, the amount of information that needs to be recorded:
– Co-location
– Maturity of team
– Number of defects
– Organisational influence
– Drive for metrics
– Size of development
– Complexity of development
![Page 35: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/35.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
35
Example assessment result
Key Area Structured Scrum Agile
Stakeholder commitment
Planning & Estimation
People
Interaction
Teamwork
Test process
Test management
Test profession
Test automation
Regression & E2E testing
Defect management
Test environment
![Page 36: Test improvement for Agile/Scrum](https://reader034.vdocuments.mx/reader034/viewer/2022052606/5859ed541a28ab6e3290c1e5/html5/thumbnails/36.jpg)
logo van Flair 17-12-2010
Polteq logo_RGB.png
R G B
35 30 96 Blauw
232 62 38 Rood
108 174 68 Groen
36
Questions
Key Area Structured Scrum Agile
Stakeholder commitment
Planning & Estimation
People
Interaction
Teamwork
Test process
Test management
Test profession
Test automation
Regression & E2E testing
Defect management
Test environment