1

Crowdtesting 2.0 From Anonymous Crowd to Target Audience & Customer Community

2

About PASS Group Global Delivery

Industry Coverage

• Mobile, Web & Destop Apps• Wearables • Mobile Health Devices• IoT Devices• Gaming Consoles• Set Top Boxes• Automotive IT

Product & Application Types

• 25 years in Quality Assurance

• Thought Leader + Leading Provider of Crowdsourcing & Community Engagement Solutions for Digital Assurance under the brand name passbrains since 2011

• Specialized in building public and private crowdsource communities and user groups for digital product innovation, testing and continuous quality improvement

• Delivery Model: SaaS, Managed Service

Sales Representations:GermanyAustriaFranceItalySpainNetherlandsUnited KingdomIsraelU.S.A.

PASS Subsidiaries:SwitzerlandGermanyIndiaSerbia

• Technology & Hi Tech• Retail & E-Commerce • Travel & Hospitality• Media & Entertainment• Education & eLearning• Financial Services• Healthcare & Life Sciences

3

Crowdsourced Digital Assurance

InsightsIdeation

EvaluationUsability Studies

TestingContent

ValidationUser Experience

Continuous Improvement

Support

Crowdsourced model for open innovation, evaluation and testing of devices, apps and websites, using cloud-based tools or platform solutions

Definition

4

Enterprise Workforce

Outsourced Skills & Capacities

Public Crowds

Private Crowds

Crowdsourcing leverages your Digital Assurance Programs

… by engaging Public & Private Crowds

5

• Subject matter experts• Good for deeper analytics on

improvement potentials

• Global coverage on-demand• Professional motivation• Neutral view

• Enterprise identification• Product knowledge• Utilization of excess capacity

• Reflect market requirements

• Provide relevant UX• Appreciate participating• Brand identification

6

… for your Apps & Digital Products

… and the Internet of Things

7

8

Who qualifies for Crowdsourced Digital Assurance?

Users+ Customers

Professional Testers

Employees & Contractors

Subject Matter Experts

9

Principle of Crowdsourced Engagement

Thousands of community members available

Members competing and

delivering immediate

results

Selecting the right ones based

on profile

Attractive bounties &

rewards offerings

• Demographics• Skills• Domain Background• Devices,

Configurations• Performance Track

Record

Deliverables – Issue Reports + Improvement Suggestions

10

Deliverables – Instructions + Structured Test Cases

11

Deliverables – User Experience Surveys

12

Deliverables – Narrated UX Video-Recordings

13

Deliverables – Audience / Contributor Segmentation

14

15

Deliverables: Analytics (e.g. CSAT)

16

Deliverables: Analytics (e.g. Ticket Types)

17

Deliverables: Analytics (e.g. Device Coverage)

18

19

Passbrains – the leading Digital Assurance Platform

20

Open Invitation for Web Shop Test: (UX+FN)

10/2

8/12

10/2

9/12

10/3

0/12

10/3

1/12

11/1

/12

11/2

/12

11/3

/12

0

100

200

300

400

500

600

Total Active TestersTotal Tickets

Case Study

21

Continous Post-Release Test Online Auction (UX+FN)

Effort Details• 16 Weeks Duration, Biweekly Updates• 8 Test Cycles• 88 Crowd Testers + 5 Crowd Champions• 1 Internal Test Managers• 3 Reviewers

Technology Coverage• OS: Linux, Mac, Windows (incl. Win8 beta)• Browsers: IE7 to 10, Firefox, Chrome, Safari

Regional Coverage• 26 Countries• 5 Languages

Platform

56% total cost reduction achieved 33% reduction of test cycle time 2748 tickets logged with > 70% acceptance 150+ new features & enhancement requests accepted

by client

Key Highlights

Case Study

Case Study: upc cablecom Customer Crowd

22

23

Benefits of Crowdsourced Digital Assurance

Product- & Service

Excellence

Improved product usability and quality

=> maximized customer satisfaction

On-Demand Cost-effective

Scalable Fast

Lead times of hours/ days instead of weeks

1000x contributors

50%-70% lower costs

Quick Turnaround

PASS GroupZürich Hamburg Boston Belgrade Bangalore www.pass.chwww.passbrains.com

24