Download - Good Testers Are Often Lucky - the test eye
![Page 1: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/1.jpg)
Good Testers Are Often Luckyusing serendipity in software testing
Nordic Testing Days, 6 June 2014
Rikard Edgren
![Page 2: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/2.jpg)
Serendipitous Life
Childhood
Friends
Education
Job
Family
It’s about creating opportunities for good luck
![Page 3: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/3.jpg)
Serendipity Definition
“finding something valuable when looking for something else,
thanks to an observant mind
Serendipitet
Serendipität
Serendipia
Sérendipité
Serendipo
Serendipisyys
セレンディピティ
سرندیپیتی
Juhuslik avastus
![Page 4: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/4.jpg)
Sampling & Serendipity
We can’t test everything, we sample.
We can observe carefully.
We want to make many, rich tests.
We change sampling strategy as we learn more.
![Page 5: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/5.jpg)
![Page 6: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/6.jpg)
Prepare for Serendipity
Error-Prone Machine
Background Complexity Heuristic
![Page 7: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/7.jpg)
Vary for Serendipity
Don’t run the same test twice (unless you really have to)
Observe carefully, on many places
Do One More Thing Heuristic
Galumphing
Also vary your testing techniques and approaches (Lessons Learned 283)
![Page 8: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/8.jpg)
Serendipity Observation Examples
Look carefully
Notepad Heuristic
Visualizing
![Page 9: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/9.jpg)
Serendipity Observation Examples
Look carefully
Notepad Heuristic
Visualizing
![Page 10: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/10.jpg)
Ongoing Serendipity
Things we know always matter, can be tested “for free”
Make tests richer.
![Page 11: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/11.jpg)
Capability. Can the product perform valuable functions?
Reliability. Can you trust the product in many and difficult situations?
Usability. Is the product easy to use?
Charisma. Does the product have "it"?
Security. Does the product protect against unwanted usage?
Performance. Is the product fast enough?
IT-bility. Is the product easy to install, maintain and support?
Compatibility. How well does the product interact with software and environments?
Supportability. Can customers’ usage and problems be supported?
Testability. Is it easy to check and test the product?
Maintainability. Can the product be maintained and extended at low cost?
Portability. Is transferring of the product to different environments and languages enabled?
http://thetesteye.com/posters/TheTestEye_SoftwareQualityCharacteristics.pdf
Ongoing Serendipity
![Page 12: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/12.jpg)
Connect for Serendipity
Daniel Liestman wrote an article about serendipity for library research.
who wants to admit they found it by chance?
Perseverance – thoroughness and hard work
Look often, and at many places, use variations.
Altamirage – tacit knowledge
Hidden heuristics and invisible skills
Sagacity – ability to make good judgments
Connect observations and experience, the more you know, the better…
![Page 13: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/13.jpg)
Capabilities
Failure Mode
Models
Data
Surroundings
White-
box
Product History
Actual software
Technologies
Competitors
Purpose
Image
Business
Knowledge
Legal
aspects
Creative Ideas
Internal
Collections
You
Project
Background
Information
Objectives
Risks
Test Artifacts
Debt
Conversations
Context Analysis
Many
Deliverables
Tools
Quality Characteristics
Fears
Usage
Scenarios
Field Information
Users
Public
Collections
Standards
References
Searching
![Page 14: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/14.jpg)
Serendipity Quotes
you can see lot by just looking (Yogi Berra)
this serendipity is what makes doing qualitative research and analysis
so much fun (Strauss/Corbin)
chance favors the prepared mind (Pasteur)
rely less on top-down planning and focus on maximum tinkering and
recognizing opportunities (Taleb)
computers are marvellous, but they suck at serendipity (Edgren)
wouldn’t it be interesting to… (your next great idea)
![Page 15: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/15.jpg)
Serendipity Summary
Software testing is oozing with serendipity.
Serendipity can be your friend and rescue, don’t hide it.
Learn a lot, prepare, do many tests and observe!
![Page 16: Good Testers Are Often Lucky - the test eye](https://reader036.vdocuments.mx/reader036/viewer/2022081503/62a276d94c324a3ac200abf9/html5/thumbnails/16.jpg)
Questions
???
Further reading:
Liestman, Chance in the Midst of Design: Approaches to
Library Research Serendipity
Edgren/Emilsson/Jansson, Software Quality Characteristicshttp://thetesteye.com/posters/TheTesteEye_SoftwareQualityCharacteristics.pdf
Edgren/Emilsson/Jansson, 37 Sources for Test Ideashttp://thetesteye.com/posters/TheTestEye_SourcesForTestIdeas.pdf
Edgren: The Little Black Book on Test Designhttp://thetesteye.com/papers/TheLittleBlackBookOnTestDesign.pdf
www.thetesteye.com [email protected]