ASSURIN

G

QUALITY

IN A

N

AGILE

MOBIL

E

WORLD

J EF

F R

OT

H | C

ON

SU

L TI N

G S

ER

VI C

ES

| BE

NC

HM

AR

KQ

A

11/13-14

/2012

2© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S

R E S E R V E D .

FAILURE SUCKS!

11/13-14

/2012

PLATFORM WARS

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 3

11/13-14

/2012

WHY ASSURE QUALITY?

• Deliver New Capabilities Instead of Fixes

• Prove it Works!• Prove it Works Well!• Prevent Damage to your

Brand!• Increase User Retention!

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 4

11/13-14

/2012

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 5

11/13-14

/2012

MOBILE LIFE CYCLE

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 6

Have an Idea

Build It!

Get Feedback

Fix/Enhance

11/13-14

/2012

WHAT CAN GO WRONG?

• App Doesn’t Deliver Promised Functionality

• App Crashes• App is Buggy• Coding Issues Cause

Secondary Issues• Runaway Memory Usage• App Drains Battery

• Customers Reject Design© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 7

11/13-14

/2012

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 8

HOW DEVELOPERS VIEW TRADITIONAL QA

11/13-14

/2012

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 9

HOW QA VIEWS DEVELOPERS

11/13-14

/2012

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 10

AN EFFECTIVE AGILE TEAM

11/13-14

/2012

QA LIFE CYCLE

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 11

Plan

Design

System TestUAT

Reflect

• Plan: Who, What, Where, When and How

• Design: Build Tests & Data

• System Test: Technical Tests

• UAT: Business User Tests

• Reflect: Improve for Next Time

11/13-14

/2012

TEST PLANNINGWhat Happened in the Past

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 12

11/13-14

/2012

Backlog To Do In Progress

Done

Sprint Scrum Board

Sprint Sprint Sprint Sprint

Release Plan

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 13

TEST PLANNINGHow Agile Does It

Product Backlog

Release Planning Meeting

Sprint Planning Meeting

11/13-14

/2012

QA TASKS

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 14

Get Test Devices

Build Test System

Create Test Cases

Create Test Data

Build Test Automation

Build Test Harness

Get Microwave Oven

Engage Crowd Source Testing

Provision Test Devices

Map Poor Cell Coverage Areas

11/13-14

/2012

GOOGLE “10 MINUTE” TEST PLAN

1. Attributes the adverbs and adjectives that describe the high level concepts testing is meant to ensure. Attributes such as fast, usable, secure, accessible and so forth.

2. Components the nouns that define the major code chunks that comprise the product. These are classes, module names and features of the application.

3. Capabilities the verbs that describe user actions and activities.

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 15

11/13-14

/2012

TEST DESIGN

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 16

User Story Acceptance • Happy Path• Negative

Scenarios• Adhoc

Testing …….. but with a Plan

11/13-14

/2012

EMBEDDED DEVICE TESTING

• Chip Dependencies • GPS/Location

Service• Accelerometers• NFC• WIFI/Cellular• Memory

Management

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 17

11/13-14

/2012

TEST AUTOMATION

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 18

Robot Testing Army

MVC Automation

11/13-14

/2012

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 19

USER ACCEPTANCE TESTING

11/13-14

/2012

REFLECT

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 20

11/13-14

/2012

QUESTIONS

© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 21