agileee friday 17:15 talk
DESCRIPTION
The original title of this talk is "Agile Testing, Uncertainty, Risk, and Why It All Works." That's still the topic of this talk, however after hearing so many misconceptions about testing simply because the name "Test" carries so much baggage in our industry, I decided to reframe my talk so as to avoid using the word "Test" at all in the first half. Instead, we'll focus on how fast feedback supports learning and empirical evidence trumps speculation.TRANSCRIPT
![Page 1: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/1.jpg)
Agile Testing, Risk, Uncertainty, and Why It All Works (the updated for AGILEEE, almost all new edition) Elisabeth Hendrickson
Quality Tree Software, Inc. www.qualitytree.com
Last updated September 22, 2011 Copyright © 2011 Elisabeth Hendrickson, Quality Tree Software, Inc.
![Page 2: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/2.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
What Does Agile Really Mean?
Agile software teams…
…Deliver value in the form of releasable software at frequent regular intervals (at least monthly)…
…At a sustainable pace…
…While adapting to the changing needs of the business.
![Page 3: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/3.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Source: Wikimedia Commons. Courtesy of Ray Kurzweil and Kurzweil Technologies, Inc.
Increasing Complexity
![Page 4: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/4.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Speculation Buildup Sp
ecul
ation
Analyze Design Implement Stabilize Big Bang Release
![Page 5: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/5.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Speculation, Lack of Alignment, and Risk
Intentions
Implementation
Actual Need
?
? ?
![Page 6: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/6.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Agile eliminates speculation buildup… Sp
ecul
ation
![Page 7: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/7.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
…only if we eliminate the speculation
![Page 8: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/8.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
“frAgile”!Sp
ecul
ation
Iterations…
Stabilize
![Page 9: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/9.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Every. Single. Time.
Empirical Evidence
speculation!
![Page 10: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/10.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
The organizations best positioned to succeed
are the ones that
LEARN
![Page 11: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/11.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Build
Measure Learn
![Page 12: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/12.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
How do we check alignment?
Intentions
Implementation
Actual Need
Get out of the building!
Steve Blank, author of Four Steps to the Epiphany
?
![Page 13: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/13.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
How do we check alignment?
Begin with the End in Mind. Capture examples with expectations. Automate
checking of expectations. Explore to discover risks.
Intentions
Implementation
Actual Need
?
![Page 14: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/14.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
The Letter and Spirit of a Story
Explicit Expectations
Implicit Expectations
![Page 15: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/15.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Check that all previously met expectations are still met even as the solution grows in
capability and complexity.
![Page 16: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/16.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
How do we check alignment?
Intentions
Implementation
Actual Need
Demo. Rehearse delivery. Deliver frequently. Explore with the
customer or proxy.
?
![Page 17: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/17.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Reducing Feedback Latency
Latency
![Page 18: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/18.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
What Does Agile Really Mean?
Agile software teams…
…Deliver value in the form of releasable software at frequent regular intervals (at least monthly)…
…At a sustainable pace…
…While adapting to the changing needs of the business.
![Page 19: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/19.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Intentions
Implementation
Actual Need
✔
✔
![Page 20: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/20.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
(OK, now let’s talk about “testing.”)
![Page 21: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/21.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
any activity that yields
about the extent to which our
, our , and the
are .
![Page 22: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/22.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Checking Alignment
Intentions
Implementation
Actual Need
![Page 23: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/23.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Every. Single. Time.
speculation!
Empirical Evidence
![Page 24: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/24.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
The Whole Team Succeeds or Fails TOGETHER
“Hey! There’s a hole in your side
of the boat.”
There is no “Us” and “Them.”
There is only Us.
As Alistair Cockburn says:
![Page 25: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/25.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Nine Key Technical Testing-Related Agile Practices
ATDD TDD Exploratory Testing
Collective Ownership
Automated Unit Tests
Automated System Tests
Continuous Integration
Rehearse Delivery
Automated Deploy
![Page 26: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/26.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Initiative
Test-First Mindset: Begin with the End in Mind
Code
Strategy How will I know my efforts have the result I intended?
![Page 27: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/27.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Acceptance-Test Driven Development (ATDD)
User Story Workshop Implementation
Agile-Friendly Test Automation Framework
![Page 28: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/28.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Continuous Integration (CI)
CI tools do automated builds, execute tests, and report the results
Developers practicing CI merge their changes locally & execute tests before checking in
![Page 29: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/29.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Version ALL Technical Assets with the Code
Unit Tests
Production Code
Source Control Repository
(Plus All other
technical assets)
Test “Fixture”
Code
Acceptance Tests
![Page 30: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/30.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Increase Visibility
![Page 31: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/31.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Automated Deploy
![Page 32: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/32.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Fail Early, Fail Fast
Failing early & fast gives us time to fix the problems.
Local Unit Tests Secs- Mins
Mins CI Build
Mins- Hrs
Automated Regression
Hrs- Days
Exploration
![Page 33: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/33.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Red Build Means Stop the Line
If a previously passing expectation fails, there’s a bug. Bugs slow everything down. To keep
sustainable pace, fix bugs fast.
We can just throw that bug on the pile
with the others.
Yuck.
But that will increase technical
debt & slow velocity.
![Page 34: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/34.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Exploratory Testing
Simultaneously…
…learning about the software
…designing tests
…executing tests
using feedback from the last
test to inform the next
(See Jon and James Bach’s work on Session-Based ET)
![Page 35: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/35.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Done Includes Tested
Implemented
+ Checked
+ Explored
== DONE
![Page 36: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/36.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
Every. Single. Time.
speculation!
Empirical Evidence
![Page 37: AGILEEE Friday 17:15 Talk](https://reader035.vdocuments.mx/reader035/viewer/2022062319/5551cba4b4c905922b8b4d50/html5/thumbnails/37.jpg)
Copyr
ight
© 2
01
1 E
lisa
bet
h H
endri
ckso
n,
Qual
ity
Tre
e So
ftw
are,
Inc.
LEARN
TEST
Intentions
Implementation
Actual Need