From Acceptance to DelightCrowd Testing Apps

Sanji Alwis | Vice President Business Development, Applause11th Nov 2015

THE WORLD HAS CHANGED

13

U S E R S D I C TAT E S U C C E S S , A N D S W I TC H I N G C O S T S A R E AT O R N E A R Z E R O

APPS HAVE TO DO MORE THAN WORK

14

T H E Y H AV E TO D E L I G H T U S E R S … E V E R Y T I M E

PERCEPTION IS REALITY

15

APPS ARE FRONT DOOR TO BRAND

| Users less tolerant of imperfect quality

| Social & app stores give every user a megaphone

| Switching costs vanishing to zero

| Cost of poor app quality has spiked

| Brands must delight in order to differentiate | Every new app

| Every new version

| 360⁰ app quality

16

OFFENSE AND DEFENSE

17

IN-THE-WILD TESTING SERVICES| Crowd testing beyond the QA lab (nearshore

or offshore)

| Coverage where your users work, live & play

| Across devices, OSes, browsers & carriers

| Complementary to in-the-lab and outsourced testing

18

PROFESSIONAL TESTER CROWD| Professional

testers who are real world users

| Profile for geo, devices, OS

| Data capture per issue / per cycle drives quality, velocity, and ability to scale

19

PROFESSIONAL TESTER CROWD| Visibility into

history of the professional crowd

| Down to the defect level

| Experience within vertical and with use cases

20

CROWD VALIDATION TO ACHIEVE GOALS

21

Device

OS

Browser

Connectivity

Location

Use Case Fragmentation

Multiscreen while travel

Paired Device Testing (phone,

car, watch)

Beacons & Geo-fencing

Targeted Testers (tester is also

client’s end user)

Mobile Payments

Frag

men

tatio

n of

all

type

s

Post-Sales Support

Delivery

Purchase

Consideration

Awareness

Business Goals

Con

vers

ion

Funn

el

Returns/Alerts

Pickup/Delivery

Checkout

Selection/Ordering

Registration

Components

Func

tiona

lity

FROM ACCEPTANCE TO DELIGHT| Adoption of Crowd testing

improves business functionality| Test beyond requirements and

acceptance

| Real World testing combining the rigor and expertise of professional testers with the outside-in perspective of Beta

| Across multiple verticals including• Banking • Insurance• Retail• Nonprofit & Government

22

CASE STUDY FORTUNE 500 GLOBAL RETAILER

Challenge

| Global fashion retailer needed to test mobile app for two of their main brands in several

countries

| UK, Spain, Germany, France and US

| Tests needed to take place in each country to ensure local payment methods worked

| Integrate test results into the client’s SDLC

| Europe time zone coverage for Test Lead

23

CASE STUDY FORTUNE 500 GLOBAL RETAILERCrowd Testing Solution| Functional and Usability Testing

| 62 Test Cycles

| Device coverage on a broad range of device types & OS’, including Android & iOS

| 249 Unique Device/OS/Browser combinations

| Global Team of Testers

| 1 Project Manager in California

| 1 Test Lead in the UK

| 413 Testers around the world

| Integration between Applause’s SDK and client’s JIRA for defect tracking

| Minimal disruption in the Client’s Development team; no additional overhead required from Client’s team

24

CASE STUDY FORTUNE 500 GLOBAL RETAILERResults

| In-country end user coverage using different payment methods for mobile

| A broad range of different mobile devices and OS’ (80% iOS & 20% Android)

| Usability feedback from testers in country through test cycle reviews

| Test Lead in the EU time zone key to escalating concerns to Fashion retailer in PDT time zone

25

www.QualiTestGroup.com

Thank You