![Page 1: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/1.jpg)
Lightning Talks
Presented at the Software Test and Performance Conference 2008
[email protected] San Mateo, California April 17, 2008
![Page 3: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/3.jpg)
![Page 5: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/5.jpg)
![Page 6: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/6.jpg)
![Page 7: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/7.jpg)
![Page 8: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/8.jpg)
![Page 9: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/9.jpg)
![Page 10: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/10.jpg)
![Page 11: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/11.jpg)
![Page 12: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/12.jpg)
![Page 13: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/13.jpg)
![Page 14: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/14.jpg)
![Page 15: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/15.jpg)
![Page 16: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/16.jpg)
![Page 17: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/17.jpg)
![Page 18: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/18.jpg)
![Page 19: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/19.jpg)
![Page 20: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/20.jpg)
![Page 21: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/21.jpg)
![Page 22: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/22.jpg)
![Page 23: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/23.jpg)
![Page 24: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/24.jpg)
![Page 25: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/25.jpg)
![Page 26: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/26.jpg)
![Page 27: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/27.jpg)
![Page 28: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/28.jpg)
![Page 29: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/29.jpg)
![Page 30: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/30.jpg)
![Page 31: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/31.jpg)
![Page 32: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/32.jpg)
![Page 33: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/33.jpg)
![Page 34: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/34.jpg)
![Page 35: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/35.jpg)
![Page 36: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/36.jpg)
![Page 37: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/37.jpg)
![Page 38: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/38.jpg)
![Page 39: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/39.jpg)
![Page 40: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/40.jpg)
![Page 41: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/41.jpg)
![Page 42: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/42.jpg)
![Page 44: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/44.jpg)
![Page 46: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/46.jpg)
On the optimization of physically distributed program management, development, testing, and operations
By Matthew Heusser
![Page 47: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/47.jpg)
You Are Screwed
![Page 48: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/48.jpg)
(I Was Wrong)
![Page 49: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/49.jpg)
“Awesome”
![Page 51: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/51.jpg)
![Page 53: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/53.jpg)
![Page 55: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/55.jpg)
If tools did spam…
![Page 56: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/56.jpg)
Not so ridiculous…?
![Page 57: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/57.jpg)
Why do we believe?
• Capture-Replay tools make us believe!– “automate testing as easy as recording a test”– it is highly praised as a “miracle cure”
• People cling to this promise– automated testing should not involve any effort– as it is described as a simple task
… and take up the offer for the “miracle cure”…
![Page 58: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/58.jpg)
Side effects
• Not enough forward planning for resources
• Not enough time set aside to…… learn to use tools
… design tests
… build a testing infrastructure
→ automated tests are often doomed to fail
![Page 59: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/59.jpg)
Learn to spot the spam
• automated testing is an important task– “You can’t get something for nothing!”
• Take it as seriously as software development
![Page 61: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/61.jpg)
![Page 62: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/62.jpg)
Matthew Heusser‘Best Practices’ – for [email protected]
![Page 63: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/63.jpg)
• Scrum
• Extreme Programming
• CMMI
![Page 65: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/65.jpg)
Expanded Black Box Testing Model
System
Under
Test
Test Inputs
Pre-condition Data
Pre-conditionProgram State
EnvironmentalFactors
Test Results
Post-condition Data
Post-conditionProgram State
EnvironmentalOutcomes
Copyright © 1999-2008 Software Quality Methods, LLC.
![Page 66: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/66.jpg)
Conclusions
• The factors are always present
• When there are defects
– Unexpected influencers may be involved
– Unexpected outcomes are possible
• Not Reproducible means influencers are not all known or controlled
• No Problem Found No Defect Present
![Page 68: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/68.jpg)
![Page 69: Lightning Talks Presented at the Software Test and Performance Conference 2008 matt.heusser@gmail.com San Mateo, California April 17, 2008](https://reader033.vdocuments.mx/reader033/viewer/2022051416/56649f065503460f94c1c2e0/html5/thumbnails/69.jpg)
So long – and thanks for all the fish!