implementing an organisation wide testing approach graham thomas independent software testing...
TRANSCRIPT
![Page 1: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/1.jpg)
Implementing anOrganisation WideTesting Approach
Graham ThomasIndependent Software
Testing Consultant
TESTNETNieuwegein, NBC
16th September 2008
![Page 2: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/2.jpg)
ABSTRACTOver the last seven years I have been involved in several Test Improvement Programs. They have varied in size and
nature but all have had the same aims. To improve testing, increase efficiency and effectiveness, and better support the overall development lifecycle.
There is no doubt that Testers want to do better testing. We all want to do a better job. If not for personal pride and
satisfaction then because we want to improve, in order to get a better job and ultimately earn more money. And Test Improvement Programs will help us do that. But only up to a point. Eventually, and sometimes sooner rather
than later, you reach the point where to continue to improve the testing process you are going to have to change some practices, process and behaviours outside the testing team.
You need the business to set realistic timeframes. Project managers to create realistic plans. The development
process to provide adequate and timely; requirements, design and build information. Least of all you need better quality code, and when it isn’t good quality, you at least need it fixed in the order that your testing demands. And so on . . . .
You find yourself in the situation where you need to improve the other aspects of the development lifecycle to gain
further benefits from your Test Improvement Program. And to be successful, this level of organisational change can’t be imposed or mandated. You are going to have to work
with the other members of the development team to successfully bring about this change. As the old joke goes “How many Change Managers does it take to change a light bulb?
Just one, but the light bulb has got to want to change!”
2
![Page 3: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/3.jpg)
AGENDA
Introduction
Approach to change
A model
Selling the change
Implementing the change
Summarise
3
![Page 4: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/4.jpg)
Video 1
4
![Page 5: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/5.jpg)
WHERE TO START? You probably know that things aren’t quite right
o Testing seems to be taking too longo There are too many production problemso Testing seems hard – environments, resources, inputso It is difficult to explain to people how well the testing is goingo Pesky vendors keep on calling saying; “Buy our tools, buy our services”o Conference presentations sound wonderful – but how?
So you initiate a review to get a better view of Testingo Not just within the testing areao But also including up and downstream activitieso Across the development lifecycleo Including; Stakeholders, Sponsors, Customers and Suppliers
5
![Page 6: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/6.jpg)
THE REVIEW Execution
o Be impartial, objective, analyticalo Get a representative view, you don’t need to see everyoneo Get an independent view – external experto Look inwards as well as outwards with the reviewo Don’t accept anything as ‘Given’o Respect that people are busy, be accommodating
Presentation of Findingso Test your findings out before publicationo Present your findings without emotiono Get good sponsorship and support
• No budget or No resource = NO GO!
6
![Page 7: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/7.jpg)
APPROACH TO CHANGE
Time
Denial
Testing
Acceptance
Active
Passive
Em
oti
on
al R
esp
on
se
Depression
Bargaining
Anger
Bad News
Kubler-Ross model - 5 Stages of Grief 7
![Page 8: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/8.jpg)
APPROACH TO CHANGE
Hype Cycle(Gartner)
Vis
ibilit
y
Maturity
TechnologyTrigger
Peak of inflatedexpectation
Trough ofDisillusionment
Slope ofEnlightenment
Plateau ofProductivity
8
![Page 9: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/9.jpg)
A MODEL FOR CHANGEOrganisation
People
Process
Tooling
Measurement
QualityAssurance
TESTING APPROACH
9
![Page 11: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/11.jpg)
ORGANISATION Independent reporting lines Break out of the delivery line Matrix managed world
o Deliveryo Portfolioo Business
Report the same information Rolled up view
o Systemo Projecto Programo Portfolio
CubeModel
Syst
em
Syst
em
Syst
em
11
![Page 12: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/12.jpg)
PEOPLE Change / Transform the people Ownership & Empowerment Awareness
o Lifecycles, models, approaches Development
o Training, seminars, conferences Reward
o Equality with developmento Grades structureso Recognition
12
![Page 13: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/13.jpg)
PROCESS Fix the broken stuff
o Quick Winso Value Add from the review process
Identify key processeso Testing strategyo Testing lifecycleo Reviews (& Inspections)o Align with development lifecycleo Risk Basedo Alternative lifecycleso Regression testing
13
![Page 14: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/14.jpg)
TOOLING Target tools that will give biggest benefit
o Look at Fault Management firsto Test Planningo Static & Dynamic Analysiso Data Creation & Manipulationo Comparatorso Loado Schedulerso Test Execution– when the test process is reliable
The benefits from Group Working will be as large if not larger than those from Test Execution
14
![Page 15: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/15.jpg)
MEASUREMENT Measures & Metrics www.badgerscroft.como Progresso Planningo Risk – Profile, Mitigationo S-Curveo Environment Availabilityo Coverage
Development Measureso Quality, Coverage, Complexity
Portfolio Levelo Rolled up; Progress, Risk, Efficiency, Effectiveness
Benefits Management Integrated with Organisational Metrics Program
15
![Page 16: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/16.jpg)
MEASUREMENT (2)
Capability Matrix Assessment Levels
16
![Page 17: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/17.jpg)
QUALITY ASSURANCE Quality is the responsibility of all Embedded within processes Avoid Quality Police
o Policing, Enforcing, Mandating, Imposition Quality Assurance
o Ensuring that the processes are working correctlyand not just checking (QC) that the products produced by those processes are correct
Across the lifecycle, not just Testingo Requirements, Analysis, Development, Project / Program Management
Regulatory, Audit and Compliance obligations Quality Assurance Strategy
17
![Page 18: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/18.jpg)
18
Video 2
![Page 19: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/19.jpg)
SELLING THE CHANGE Communicate, Communicate, Communicate
Feedback to all involved in the Review Regular and on-going progress briefings
o Sponsors, Stakeholders, Customers, Suppliers Align your benefits with organisational goals Gain buy-in to external change
o Make them want it, then they will do it
Tell them; What is going to happen, What is happening, and What has happened
Publicise your successeso Be honest about your failures
19
![Page 20: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/20.jpg)
IMPLEMENTING THE CHANGE
Thin Threads Modelo Change process to work at new levelo Ensure process still works with old
Holistic view of changeo Can’t make this level of change in isolationo Testing change needs to be integrated into an overall change program
Dependencies and Prioritieso Understand dependencies across whole change programo Apply Testing Change that brings best Organisational benefit
20
![Page 21: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/21.jpg)
RESISTANCE TO CHANGE
What you will seeo Alternative change initiativeso Full support – with anything but; resource, budget, commitmento Yes, but it doesn’t apply to meo Exemptions – IPS (Important Project Syndrome)o A thousand reasons why not – each one has to be defended against
• Yet no-one has to justify continuing to operate inefficient processes!o Active spinning against your worko Management failure to support the message and permission given
not to take parto We have failed before, why will this time be different
21
![Page 22: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/22.jpg)
22
Video 3
![Page 23: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/23.jpg)
SUMMARY Undertake a review and feedback to all Develop a model for the way forward Gain real buy-in before proceeding Ensure you have sponsorship You can’t undertake this level of change in isolation You are dependent upon change outside your control Influence, Stakeholder Management and Communication People will resist change for many different reasons
“That to be successful with any form of organisational or process change, whether that be testing or not, you have first got to get the organisation to want to make that change.“
Graham Thomas
23
![Page 24: Implementing an Organisation Wide Testing Approach Graham Thomas Independent Software Testing Consultant TESTNET Nieuwegein, NBC 16 th September 2008](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f385503460f94c54b64/html5/thumbnails/24.jpg)
CONTACT DETAILS
Graham Thomas
Independent SoftwareTesting Consultant
[email protected] +44 7973 387 853 www.badgerscroft.com
24