exploratory testing live - wordpress.com · exploring, just for the sake of curiosity. what is...
TRANSCRIPT
![Page 2: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/2.jpg)
Who Am I• Simon ‘Peter' Schrijver
• Age : 51
• Coming from The Netherlands
• Married with children
• Independent Tester
• Since 2005
• Founding Member of DEWT
• Current : Mobile App Tester
![Page 3: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/3.jpg)
Just an Exploratory Test
![Page 4: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/4.jpg)
What was I thinking?• Is there a maximum size?
What is the value?
• Is there a minimum size? What is the value?
• Can I use decimals? How many behind the decimal point?Any rounding?
![Page 5: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/5.jpg)
Observations• Max size = 56 inch
• Min size = 1 inch
• Two digits -> 12,34
• Rounds 3rd digit
![Page 6: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/6.jpg)
QuestionWhat do you do with this requirement?
In this text field, no more 100 characters are allowed
Send a string with 101 characters and see what happens
![Page 7: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/7.jpg)
Skilled testers are always exploring, just for the
sake of curiosity.
![Page 8: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/8.jpg)
What is testing about?• In search for qualitative
information
• Questioning the product to evaluate it, to learn from it
• Gathering information to make an informative decision
Name 3 keywords within these statements
![Page 9: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/9.jpg)
What is testing about?• In search for qualitative
information
• Questioning the product to evaluate it, to learn from it
• Gathering information to make an informative decision
The 3 keywords within these statements
![Page 10: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/10.jpg)
3 key words• Information
• Question
• Learn
By asking questions, you collect information and learn more about the application you are testing
While learning, you create more questions to reveal more information
![Page 11: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/11.jpg)
Question
ExploratoryTesting
InformationLearn
![Page 12: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/12.jpg)
Another Exploratory Test“Enter your birthdate on your account in your favorite retailer's website so that it can be shown on your account on the mobile App of your favorite retailer”
date format is in ‘dd-mm-yyyy’ notation and will be translated into UNIX timestamp
Examples?? (i.e questions to your application)
15-07-1992; 21-01-1997; 27-08-1965; 18-02-1934
![Page 13: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/13.jpg)
Birthday Test - Observation
https://simonsaysnomore.wordpress.com/2016/03/08/the-summertime-bug/
![Page 14: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/14.jpg)
Next Year - Observation
![Page 15: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/15.jpg)
Example of Change Daily Limit
![Page 16: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/16.jpg)
Example of Change Daily Limit
![Page 17: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/17.jpg)
To make Exploratory Testing successful for your organization, you must provide tangible output
![Page 18: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/18.jpg)
To make Exploratory Testing successful for your organization, you must provide tangible output
![Page 19: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/19.jpg)
To make Exploratory Testing successful for your organization, you must provide tangible output
Why? To provide your stakeholders with information to help them make decisions
How (do I do that)? By asking questions so you can collect and reveal that information
What (do I need)? An approach like Session Based Exploratory Testing to document that information
![Page 20: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/20.jpg)
–E. L. Doctorow
“Writing is an exploration. You start from nothing and learn as you go.”
Author of “The Book of Daniel”
![Page 21: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/21.jpg)
Target your exploration based on the needs of
your team and stakeholder
![Page 22: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/22.jpg)
But be aware of the following …
![Page 23: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/23.jpg)
![Page 24: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/24.jpg)
KNOWN KNOWNS KNOWN UNKNOWNS UNKNOWN UNKNOWNS
TESTING
INFORMATIONCHECKING
https://findingdeefex.com/2016/05/20/the-testing-checking-synergy/
enables
confirms
informs
uncovers
![Page 25: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/25.jpg)
What do we know when we see this screen?
What do we not know when we see this screen?
What do we expect?
Do your exploration
Test and find out.
Write down what you observe
![Page 26: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/26.jpg)
I see the screen "Transfer"
I enter "1.10" in the "amount field"
I enter "<name>" in the "beneficiary field"
I enter "<account number>" in the "accountnumber field"
I tap on button "Next"
![Page 27: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/27.jpg)
And I tap on button "Transfer in mutations" And I see the screen "Transfer" And I enter "1.10" in the "amount field" And I enter "<name>" in the "beneficiary field" And I enter "<account number>" in the "accountnumber field" And I tap on button "Next" And I see the screen "Overview"
![Page 28: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/28.jpg)
Gathering information
http://swtester.blogspot.nl/2012/05/what-is-exploratory-testing.html
![Page 29: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/29.jpg)
Change the screen to add a new button to introduce a new feature
What do we check?
What do we test?
![Page 30: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/30.jpg)
I see the screen "Transfer"
I enter "1.10" in the "amount field"
I enter "<name>" in the "beneficiary field"
I enter "<account number>" in the "accountnumber field"
I tap on button "Next"I tap on button "Another payment"
And I enter "<description>" in the "description field"
![Page 31: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/31.jpg)
And I tap on button "Transfer in mutations" And I see the screen "Transfer" And I enter "1.10" in the "amount field" And I enter "<name>" in the "beneficiary field" And I enter "<account number>" in the "accountnumber field" And I enter “<description>” in the “description field” And I tap on button “Another payment” And I see the screen ”Transfer"
![Page 32: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/32.jpg)
Exploratory Testing will help you with answering
the risk question
![Page 33: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/33.jpg)
Risk is an uncertain event that can happen at some moment
in time affecting people
![Page 34: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/34.jpg)
RiskIn software testing, we think of risk on three dimensions:
• How the program could fail
• How likely it is that the program could fail in that way
• What the consequences of that failure could be
BBST - Test Design
![Page 35: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/35.jpg)
Exploratory Testing from risk point of view.
An approach to drive the discovery of unwanted, unexpected and unpredicted
behavior
![Page 36: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/36.jpg)
Look for uncertain events.
Where are the vulnerabilities?
![Page 37: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/37.jpg)
Which parts of the software are new or have been changed.
Which parts have not changed
![Page 38: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/38.jpg)
Check out the main flow(s) of your application
e.g. in Mobile banking • Payment flow • Signing flow
![Page 39: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/39.jpg)
• Imagine how the product can fail • Design tests to expose these
(potential) failures.
Design your tests with the risk in mind
BBST - Test Design
![Page 40: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/40.jpg)
Gather as much information as you can about the application. Then choose what is relevant for you to proceed.
![Page 41: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/41.jpg)
A CEO asks always the following two questions: • When can we ship? • Which risks do we have (when we ship)?
![Page 42: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/42.jpg)
All Testing Starts Exploratory, because …
![Page 43: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/43.jpg)
Exploratory Testing is about …
Questioning
![Page 44: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/44.jpg)
Exploratory Testing is about …
Information
![Page 45: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/45.jpg)
Exploratory Testing is about …Learning
![Page 46: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/46.jpg)
Exploratory Testing is about …Thinking
![Page 47: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/47.jpg)
Exploratory Testing is about …
Risk
![Page 48: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/48.jpg)
Exploratory Testing is about …
Experiments
![Page 49: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/49.jpg)
Exploratory Testing is about …
Observation
![Page 50: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/50.jpg)
Exploratory Testing is about …Validation
![Page 51: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/51.jpg)
Exploratory Testing is about …
Note taking
![Page 52: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/52.jpg)
Exploratory Testing is about …
Communication
![Page 53: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/53.jpg)
Exploratory Testing is about …Structure
![Page 54: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/54.jpg)
All Testing Is Exploratory
![Page 55: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/55.jpg)
Todays definition of TestAccording to James Bach and Michael Bolton, the definition of testing is now this:
“Testing is the process of evaluating a product by learning about it through exploration and experimentation, which includes: questioning, study, modeling, observation and inference, output checking, etc.”
http://www.satisfice.com/blog/archives/1509
![Page 56: Exploratory Testing Live - WordPress.com · exploring, just for the sake of curiosity. What is testing about? ... An approach like Session Based Exploratory Testing to document that](https://reader033.vdocuments.mx/reader033/viewer/2022042806/5f6e67f97b86df1bec3d9c6b/html5/thumbnails/56.jpg)
• Session Based Exploratory Test URL : https://simonsaysnomore.wordpress.com/
• Testopsyhttps://www.improveqs.nl/media/1382/testopsy-etc-2017-huib-schoots.pdf
Where to start