lightning talks presented at the software test and performance conference 2008...
TRANSCRIPT
Lightning Talks
Presented at the Software Test and Performance Conference 2008
[email protected] San Mateo, California April 17, 2008
On the optimization of physically distributed program management, development, testing, and operations
By Matthew Heusser
You Are Screwed
(I Was Wrong)
“Awesome”
If tools did spam…
Not so ridiculous…?
Why do we believe?
• Capture-Replay tools make us believe!– “automate testing as easy as recording a test”– it is highly praised as a “miracle cure”
• People cling to this promise– automated testing should not involve any effort– as it is described as a simple task
… and take up the offer for the “miracle cure”…
Side effects
• Not enough forward planning for resources
• Not enough time set aside to…… learn to use tools
… design tests
… build a testing infrastructure
→ automated tests are often doomed to fail
Learn to spot the spam
• automated testing is an important task– “You can’t get something for nothing!”
• Take it as seriously as software development
Matthew Heusser‘Best Practices’ – for [email protected]
• Scrum
• Extreme Programming
• CMMI
Expanded Black Box Testing Model
System
Under
Test
Test Inputs
Pre-condition Data
Pre-conditionProgram State
EnvironmentalFactors
Test Results
Post-condition Data
Post-conditionProgram State
EnvironmentalOutcomes
Copyright © 1999-2008 Software Quality Methods, LLC.
Conclusions
• The factors are always present
• When there are defects
– Unexpected influencers may be involved
– Unexpected outcomes are possible
• Not Reproducible means influencers are not all known or controlled
• No Problem Found No Defect Present
So long – and thanks for all the fish!