change the conversation keynote starwest 2015
TRANSCRIPT
![Page 1: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/1.jpg)
Janet Gregory, DragonFire Inc.Copyright 2015
I Don’t Want to Talk about Bugs, Let’s Change the Conversation
StarWest 2015
Twitter id: janetgregoryca
![Page 2: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/2.jpg)
WHAT CONVERSATIONDO WE NEED TO CHANGE?
It’s usually about bugs
the conversation about quality
![Page 3: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/3.jpg)
![Page 4: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/4.jpg)
Or perhaps it’s about traceability – Did we test all the requirements -- What is our code coverage?
![Page 5: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/5.jpg)
“Managers who don’t know how to measure what they want, settle for wanting what they
can measure.”
Russell Ackoff
![Page 6: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/6.jpg)
What does all that information really tell
you?
![Page 7: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/7.jpg)
• Value • Uncertainty • Risk • How might we really measure product quality?
Instead, let’s talk about:
• Whose job is it anyway?• The mindset of the team
And perhaps a bit about:
7
![Page 8: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/8.jpg)
VALUE TO THE BUSINESS
![Page 9: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/9.jpg)
For your value, which is better?
Which is right?
![Page 10: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/10.jpg)
Can something be right? But not meet a customer’s needs?
![Page 11: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/11.jpg)
Understand the value to the business!
![Page 12: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/12.jpg)
![Page 13: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/13.jpg)
How to You Measure Value
Validate Your Learning
![Page 14: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/14.jpg)
Risk and Uncertainty
14Copyright 2015 : Janet Gregory – DragonFire Inc.
![Page 15: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/15.jpg)
Uncertainty ◦not known or definite◦not completely confident or sure of something
![Page 16: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/16.jpg)
Cynefin Framework (pronounced Ki neh’ vin) -------a sense making model (Dave Snowden)
Complicated
Simple
Complex
Chaotic
![Page 17: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/17.jpg)
17
How can we use this model to address our feature development?
Liz Keogh – lizkeogh.com/embracing-uncertainty/
![Page 18: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/18.jpg)
Risk
• a situation involving exposure to danger• expose someone (or something valued) to danger• possibility of something unpleasant happening
![Page 19: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/19.jpg)
There are 2 kinds of risks
1. Project risk
2. Product risk
![Page 20: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/20.jpg)
With permission from Dan North - a Software Faster pattern
![Page 21: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/21.jpg)
With permission from Dan North - a Software Faster pattern
![Page 22: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/22.jpg)
Also consider context
With permission from Dan North - a Software Faster pattern
![Page 23: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/23.jpg)
• Project, product, organization, reputation, contractual, regulatory, legal (ex. privacy), ethical …..
In Reality – There are many risks
• ASK – Why do your customers want you to test for them?
![Page 24: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/24.jpg)
Visualize
![Page 25: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/25.jpg)
Involve your whole team including customers,
in the talk about risks & testing
![Page 26: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/26.jpg)
But don’t forget the big picture
Look at the details
![Page 27: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/27.jpg)
Risk and Uncertainty
![Page 28: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/28.jpg)
Is it your job?
What about the Who???
If every team member took a holistic view of the product release and the risks it faces, then every person on the team would be a critical contributor to the delivery of that solution.Matt Mansell - paraphrased
Is it the tester’s jobto think about quality?
![Page 29: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/29.jpg)
29
So, do you follow behind looking for bugs? or …. are you looking ahead for the risks?
![Page 30: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/30.jpg)
Can we really measure product
quality …..
if we don’t measure: - bugs, or - requirements or - coverage?
![Page 31: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/31.jpg)
• Customer satisfaction?
• Customer retention?
• The type of issues found in production?
What about …..
![Page 32: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/32.jpg)
Use analytics • Who uses your product?• Do they use it in the way you expected?
![Page 33: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/33.jpg)
• Perhaps we start with a risk profile, and focus on a risk-based solution delivery.
![Page 34: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/34.jpg)
Know your customers, your stakeholders
Manage your uncertaintyMitigate your risk
Understand the problemUnderstand the value
![Page 35: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/35.jpg)
CHANGETHE
CONVERSATION
from bugs and traceability
to business value, risks and uncertainty
about product quality
![Page 36: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/36.jpg)
CHANGETHE
CONVERSATION
From finding and counting bugs
To preventing bugs and measuring value
about measuring product quality
![Page 37: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/37.jpg)
Copyright 2015 : Janet Gregory – DragonFire Inc.
Agile Testing: A Practical Guide for Testers and Agile Teams
More Agile Testing: Learning Journeys for the Whole Team
By Janet Gregory and Lisa Crispin www.agiletester.cawww.agiletester.com
Contact infowww.janetgregory.caEmail: [email protected]: janetgregoryca
37
![Page 38: Change the conversation keynote StarWest 2015](https://reader036.vdocuments.mx/reader036/viewer/2022081521/587027941a28ab81258b4be7/html5/thumbnails/38.jpg)
References• Dan North, StarEast 2015 keynote• http://lizkeogh.com/embracing-uncertainty/• Dave Snowden on Cynafin http://www.youtube.com/watch?
v=N7oz366X0-8 • Matt Mansell – Risk-based testing, ANZTB 2014
http://www.anztb.org/userfiles/files/MATT_MANSELL_EffectiveRiskBasedTesting-Distribution.pdf
• Rob Lambert http://thesocialtester.co.uk/how-do-you-measure-the-effectiveness-of-a-tester-the-only-calculation-you-need/
• http://cherylquirion.com/• www.lisacrispin.com