changing your testing mindset, booster conference, bergen, norway, 2014

Lisa Crispin Co-‐Author with Janet Gregory, Agile Tes)ng: A Prac)cal Guide for Testers and Agile Teams, and the upcoming

More Agile Tes)ng

Copyright 2014 Lisa Crispin and Janet Gregory

• A bit of lecture and story-‐telling •  Learning through exercises and discussions • Q&A


• more than “just” tesGng code • an acGvity; not a phase

4

What challenges do you see for tes2ng in agile?

5


Instead of ◦ We’re here to find bugs … or ensure requirements are met … or break the soRware …

Think – How do we “bake quality in”?

6


Can you think of some ways that you cross boundaries in how you work?

7

Also DevOps, UX designers, others


for tesGng in agile? Discuss at your tables, be ready to share your list

8

Breadth of Skills

Dep

th o

f Ski

lls

T-‐shaped Skill-‐set

Tester skills

Breadth of Skills

Dep

th o

f Ski

lls

Let’s make it T-‐shaped

Another version

Breadth of Skills

Dep

th o

f Ski

lls

and ... yet another

Breadth of Skills

Dep

th o

f Ski

lls


• Power of Three • 3 Amigos • Pairing • ConGnuous feedback

13


•  On an index card, each person draw what your “word” means to you personally 4 minutes

• Now, collaborate – remember what is important to you … • Draw one picture (large paper) that everyone can ‘live with’. 7-‐8 minutes

14

Picture by Augusta EvangelisG, based on diagram from Elisabeth Hendrickson


User Story

Expand Tests

High level AT

Auto-‐ mate tests

Code &

Execute tests

Explore

Exploratory TesGng

Accept Story

Fix defects

Explore examples

16


•  As a new shopper, I want to save my shipping and billing informaGon so I don’t need to enter it each Gme I buy something new.

17

Desired behaviour (BDD) Given I am a registered customer, When I add valid shipping and billing informaGon Then it is available to reuse every Gme I log in


Type # St City Prov/St Country Post Cd Exp Res

Billing 123 Lake St. Calgary Alberta Canada T2J 2M7 success

Shipping 123 Lake St. Calgary Alberta Canada T2J 2M7 success

18

Type # St City Prov/St Country Post Cd Exp Res

Billing 123 Lake St. Calgary Alberta Canada T2J 2M7 success

Shipping 125 Lake St. Calgary Alberta Canada T2J 2M7 success

What quesGons might you ask?

Does this give you enough informaGon to start coding?


• Examples provide common language •  Shared common understanding • Coding and tesGng concurrently •  Involves whole team •  Shared definiGon of DONE • Prevents defects

19

From Mak Barcomb


It’s not just about code !!! ◦  Test assumpGons ◦ Uncover hidden assumpGons

The goal: ◦  Shared common understanding of the story ◦ PrevenGng defects (eliminate waste)

21

• Know your customers • Make them real • Plan your exploratory tesGng using them

•  Picture – from Jeff Pakon’s PragmaGc Personas weekly column on SGcky Minds (1/25/2010)

24


Template: •  Explore (target) •  With (resources) •  To discover (informa)on) Where: •  Target: Where are you exploring •  Resources: What resources will you bring with you •  Informa2on: What kind of informaGon are you hoping to find?

•  Explore It! by Elisabeth Hendrickson

25


Explore ediGng profiles With real user names To discover if there are instances where username constraints are not enforced A tool to guide explora)on. Keep it simple.

26


Story backlog for feature “Remember Me”

•  As a new shopper, I want to create a user account, including a username, password, with a phrase or picture so that I can securely log in each )me I buy something new, and password hints to help me remember.

•  Think of some personas to use for tesGng, and write some charters to guide your exploratory tesGng

27


• Know your context • Have a tool box full •  Simple is oRen best • Use your imaginaGon

28

Taken from Ready to use Graphic Organizers for primary grade teachers

Day 1

A new user wants to create her account

Day 1

The new user wants to log into the system

Day 2

An exisGng user wants to change her password

Day 2

An exisGng user forgets her password

Day 2

The new user wants to log into the system

Day 30

The system asks user to change her password

Day ??

…….

Day 60

The user wants to delete her account

Day ??

…….

Day ??

…….

Words / Phrases •  I wonder …. • What caught your akenGon? •  Could you show me? • What makes you think there is more?

Ques2ons / Predic2ons •  What might happen next?

•  Why would that be? •  What is the worst thing that could happen?

•  …. or the best? •  What assumpGons do you have?


Block account

User enters wrong

password

Wrong password a 2nd Gme; Issue

warning

User can’t log in

They are in the

database

The credenGals

meet req’ts

They entered their

credenGals correctly

Their password expired ….

Wrong password a third Gme

Prevent user from logging in again; Display msg

32


• PracGce anGcipaGng what will happen • Define your tests • Check – testers, programmers and customer running collaborate before* coding • Be prepared to change your tests if your predicGons are wrong •  Learn by reviewing – what quesGons could you have asked first.

33

Sub topic

Sub topic

Sub topic

MAIN TOPIC

Sub topic

Sub topic

first 2me

change

new account

password rules

encryp2on

save user name

rules

Login : User name & password

Visualize your tesGng


35


Story backlog for feature “Remember Me”

•  As a new shopper, I want to save my billing address and credit card informaGon so I don’t need to enter it each Gme I buy something new.

•  Try mind mapping some tests

36

37

Challenge Yourself !

What experiments will you try back at work?


Agile Tes)ng: A Prac)cal Guide for Testers and Agile Teams

Coming soon: More Agile Tes)ng !

By Lisa Crispin and Janet Gregory www.agiletester.ca Contact info www.lisacrispin.com Email: [email protected] Twiker: lisacrispin

38

•  Elisabeth Hendrickson �  CAST keynote hkp://www.slideshare.net/ehendrickson �  Explore It! – new book on PragmaGc Programmers �  hkp://www.agileconnecGon.com/arGcle/two-‐sides-‐soRware-‐tesGng-‐checking-‐and-‐exploring

•  Ben Kelly, hkp://lets-‐test.com/wp-‐content/uploads/2012/05/LetsTest2012-‐BenKelly-‐TheTesGngDead.pdf

•  Markus Gartner, hkp://www.shino.de/2012/07/16/cast-‐2012-‐the-‐tesGng-‐dead/ •  Paul Carvalho, hkp://www.agilejournal.com/arGcles/columns/column-‐arGcles/6515-‐low-‐tech-‐tools-‐for-‐the-‐thinking-‐tester

•  Michael Bolton, hkp://www.developsense.com/blog/2009/08/tesGng-‐vs-‐checking

•  Ready to Use Graphic Organizers

•  hkp://www.exampler.com -‐ Brian Marick’s web site •  Gojko Adzic, Bridging the Communica)on Gap, 2009; Specifica)on by Example, 2011

•  www.sGckyminds.com/ PragmaGc Personas -‐ Jeff Pakon’s weekly column 1/25/2010

•  Jean Tabaka, Collabora)on Explained, 2006 Addison-‐Wesley •  hkp://www.uie.com/arGcles/indispensable_skills •  PorGa Tung – Power of Play hkp://www.selfishprogramming.com/category/playmaking/

•  Esther Derby and Dianne Larsen, Agile Retrospec)ves


Instead of saying NO,

or being the gatekeeper

Be the informaGon provider so business can make the decisions

Any unanswered ques2ons / concerns? 41

changing your testing mindset, booster conference, bergen, norway, 2014

Technology