deliver successful apps with 360° assurance
TRANSCRIPT
Predicting Application Behavior and Market Acceptance
Qualitrix360° Assurance
Index
• About Us• Qualitrix Assurance Services • Test Delivery Models• Your Benefits• Key Enablers• How it Works• Why Qualitrix• Management Team• Case Studies
Fastest Growing On-demand Assurance Firm.
Contact: [email protected] 3© Qualitrix Technologies
About Us
Delivery Centers:SwitzerlandGermanyIndia
Sales Representations:AustriaUnited KingdomU.S.A.Australia
HQ
• Leading provider of next-gen assurance solutions for
mobility, web, cloud, IoT and enterprise applications
• Global presence serving clients across US, EU, Australia
and Asia, headquartered in Bangalore, India
• Ready-to-use solutions: Test management on cloud, Mobile
test framework, Test automation tools &frameworks, Best
practices
• Thought leaders in crowdsourced QA solutions -specialized
in building public and private crowd communities of testers
and user groups to derive digital product innovation and
continuous quality improvement
80+ Active Clients
Across US,
Europe, Asia &
Australia
300 + Projects
DeliveredYour Partner for Success!
Strategic Partners:
Contact: [email protected] 4© Qualitrix Technologies
Industries and App Types• WEB & DESKTOP
• MOBILE
• CLOUD APPS
• ENTERPRISE APPS
• MOBILE HANDSETS
• OPERATOR SERVICES
• HEALTHCARE DEVICES
• WEARABLES
• SET TOP BOXES
• SMART DEVICES
• OTHER IOT
Travel & Hospitality
Retail & E-Commerce
Healthcare & Life Sciences
Telecom & Hi-Tech
Media & Entertainment
Education & E-Learning
Financial Services
Industry Coverage
Contact: [email protected] 5© Qualitrix Technologies
Insert Image
• Applications deployed in a complex
multi-platform, multi-geographic,
multi-lingual environment
• Diverse user demographic with low
tolerance and quick word- of-mouth
impact
• Companies have to keep up with
quality, cost, and speed altogether
• “Testing has never been more
critical to reputation/operations.”
- Computer Weekly
IT Industry Challenges
Contact: [email protected] 6© Qualitrix Technologies
Qualitrix Assurance Across App Life Cycle
VERIFICATION & VALIDATION
• Functional Testing• Non-Functional Testing• Content Validation• User Experience Testing
LAUNCH & IMPROVE• End User Experience• Touch Point Analysis• Business Process es• Support Inquiries
Services offered in various
phases of Application life
cycle.
Qualitrix Assurance empowered by
Crowdsourcing helps in improving your
Application throughout the entire
Application development lifecycle by
performing functional, non-functional
testing, real-world assurance and various
assessments that gets you early feedback
from your target end users.
DESIGN• Prototype Evaluation• Usability Studies• A/B Tests
RESEARCH
• Insights• Ideation• Benchmarking
Contact: [email protected] 7© Qualitrix Technologies
360°Assurance ServicesComplete Assurance services
for your Mobile, Web, Desktop,
Enterprise Applications and
Smart Devices.
• Testing Services: 360°Functional and
non- functional test coverage of your app
through on-demand professional test
specialists ensuring accuracy and
robustness of your application.
• Real-World Crowdtesting: 360°coverage
on devices, operating systems, browsers and
networks in a localized environment through
crowdtesters.
• Market Acceptance: 360°feedback from
target users across different stages of app
development ensures that your app is always
aligned with the market needs.
REAL-WORLDCROWDTEST-
ING
MARKET ACCEPTANCETESTING
SERVICES
• Functional• Test Automation• Performance• Security
• Real-world Scenarios• OS / Devices /
Browser Compatibility
• Localization• User Experience• Beta Testing• User Acceptance• Production Audits
Contact: [email protected] 8© Qualitrix Technologies
Testing ServicesFUNC-TIONAL
COMPAT-IBILITY
USABIL-ITY
LOCAL-IZATION
SECU-RITY
PER-FOR-
MANCE
ACCES-SIBILITY
Complete spectrum of testing
services for your Mobile, Web,
Desktop, Enterprise Applications
and Smart Devices.
Testing-as-a-Service :
Gain 100% assurance through
specialized professional testers in labs
combined with scalability and coverage
through part-time testers
On-demand Test Specialists:
Test Specialists available on-demand:
• Part-time and full-time basis
• Employees, Contractors, Freelancers
Contact: [email protected] 9© Qualitrix Technologies
MANAGED BETA TEST-
ING• STRUCTURED BETA WITH REAL USERS
GOOD TO
GREAT
Crowdtesting: On demand engagement with TESTERS IN THE FIELD to assess
your application behavior in real-world conditions on a multitude of device models,
OS versions, browsers, data networks etc.
Market Acceptance: On-demand engagement with your TARGET END USERS
to assess the relevance and usability of your application features and identify if
your application is aligned with the target user needs.
Crowdtesting & Market Acceptance
EARLY ADOPTORS
USER EXPE-RIENCE
TESTING• USER EXPERIENCE EVALUATION
• DESIGN / CONCEPT VALIDATION
• COMPETITOR ANALYSIS & BENCHMARKING GUIDELINES /
ACCEPTANCE TESTING• COMPLIANCE CHECKS
• APP STORE GUIDELINES CHECK
REAL-WORLD
CROWDTESTING
• REAL-WORLD SCENARIOS• OS/DEVICE COMPATIBILITY• LOCATION BASED TESTING• LANGUAGE TESTING
.
AUDITS IN PRODUC-
TION• PRODUCT AND SERVICE EXCELLENCE
• BUILD EARLY ADOPTORS FOR YOUR APPS IN TARGET MARKET
Go Beyond Testing in Labs to Gain Complete Assurance
Contact: [email protected] 10© Qualitrix Technologies
Test Delivery Models
TAILOR-MADE
FOR YOUR NEEDS
TESTING-AS-A-SER-
VICEFunctional / non-functional testing services delivered on fixed price for agreed scope
.
ON-DEMAND-TESTER
STAFFINGQA Specialists
available on-demand on hourly, daily, monthly rates
.
CROWDTESTING
SERVICESTest cycle subscriptions to assess your app behavior in real-world
conditions
SOFTWARE-AS-A-
SERVICETest mgmt. platform on cloud available for your needs incl. white-label
instance
”“
360° ASSURANCEYour partner for complete assurance of your app at
an agreed fixed price
On-demand test delivery
to help you deliver the
best quality applications
in the market at an
optimized cost.
.
Contact: [email protected] 11© Qualitrix Technologies
Insert Image Insert Image Insert Image Insert Image
Your Benefits
RELIABLE APP BEHAVIOR AFTER
GO-LIVE
FASTER LAUNCH ITERATIONS
LOWER COST OF APP QUALITY
PREDICTABLE MAR-KET ACCEPTANCE
• Maximized Test Coverage
• Functional, Non-functional through Test Specialists
• Crowdtesters Covering Multiple Devices / OS / Configurations / Languages
• Real World Scenarios Tested On-location
• User Experience Testing through Target End Users
• User Assessments Done Across Diffe-rent Stages of App Development
• Structured Beta Testing
• User Acceptance, Closed User Group, Friends & Family Testing
• Testers On-boarded within Hours
• Test Cycle Duration Reduced to
One Third
• All Issues Detected within Days
• On-Demand Test Delivery
• 30-50% Lower Testing Cost Compared to Traditional QA Models
• Cost Savings Due to Early Issue Detection and Lower Defect Leakage
Contact: [email protected] 12© Qualitrix Technologies
NEXT-GEN TOOLS /
FRAMEWORKS
BEST PRACTICES
Key EnablersTECHNO-
LOGYPROCESS
• 1000 TEST SPECIALISTS• 25000 CROWDTESTERS• 90 COUNTRIES• ALL MAJOR LANGUAGES• FUNCTIONAL TESTERS• AUTOMATION ENGINEERS• MOBILITY EXPERTS• SECURITY TESTERS• LOAD TESTERS• END USER GROUPS
BEST-FIT TESTERS
PEOPLE
• KNOWLEDGE MANAGEMENT
• HIRING & ONBOARDING• OFFSHORE SET UP• CROWDTEST PROCESS• TEST DELIVERY
• TEST MGMT. ON CLOUD• MOBILE TEST FRAMEWORK• SELENIUM AUTOMATION • TECHNOLOGY PARTNERS• SECURE OFFSHORE SETUP• TEST DEVICE LAB
Our three key enablers
ensure top-notch assur-
ance to your applications
and help you deliver best
apps in the market.
Contact: [email protected] 13© Qualitrix Technologies
CONTINUOUS IMPROVE-MENT OF
YOUR AP-PLICATION
How it Works
What kind of Testing team you would prefer in terms of technical skills, language skills, demographic etc..
Whether you want to engage in managed services, staf-fing or 360 assurance mode..
There is always last minute change in plan, pause the testing whenver you want and re-engage when you are ready to start again, without any cost impact..
Real-time bugs reported to you through online test ma-nagement system with integrated defect management and review work flows..
Fully on-demand delivery
with complete control of
every testing activity in
your hands.
Step. 04PAUSE AND RE-
ENGAGE TESTING ON-DEMAND
Step. 01CHOOSE YOUR TEST DELIVERY MODEL
Step. 02GET HANDPICKED
TESTERS MATCHING YOUR REQUIREMENT
Step. 03START RECEIVING TEST RESULTS WITHIN HOURS THROUGH OUR ONLINE TEST MGMT. TOOL
SHARE YOUR REQUIREMENTS
TESTING TYPE ¦ COVERAGE REQUIRED ¦ SERVICES REQUIRED
Contact: [email protected] 14© Qualitrix Technologies
Why Qualitrix
DELIVER BEST QUALITY APPLICATIONS AT MAR-KET SPEED AND LOW COST GET HIGH LEVEL OF
TEST MATURITY: TOOLS, FRAMEWORKS & PROCESSESGET ON-DEMAND AC-
CESS TO THE BEST TESTERS IN THE IN-DUSTRY
GO BEYOND TESTING: REAL-WORLD ASSURANCE, END USER ACCEPTANCE
ON-DEMAND TEST DELIVERY CUSTOMIZED FOR YOUR
NEEDS: ONSITE, OFFSHORE, CROWDSOURCE
One-Stop-Shop Providing
Complete Assurance To
Your Applications.
Contact: [email protected] 15© Qualitrix Technologies
Management Team
(MANAGING DIRECTOR)MAYANK MITTAL
Formerly a core member of the EU leadership team and Testing Practice at Cognizant Tech-nology Solutions, a U.S.-based IT Service Provider with 20,000+ employees. Created one of largest testing engagements for the company, establishing a 5-year long partner-ship with a large financial enterprise worth $25 M in annual revenue with a 120+ person global delivery team working across 5 geographies.
(ADVISORY BOARD – MAR-KETING)
VISHAL SHRIVAS-TAVA
Vishal is a Senior Digital Marketing Consultant with close to 20 years of industry experience. He has helped several technology startups in US and India leverage digital marketing chan-nels and tools to build brand, generate leads and increase sales. He has worked as a Man-agement Consultant with the Big Four as well as with technology firms..
DIETER SPEIDEL(ADVISORY BOARD – STRAT-EGY)Founder & CEO of PASS Group AG. Board member of Crowdsourcing Asia. Serial in-vestor in various IT startups. 25+ years of ex-perience in software product development and system verification & validation. Former Co-Founder and Board Member of international industry associations such as Toolpoint,SiLA.
Contact: [email protected] 16© Qualitrix Technologies
1. Case Study: Offshore Test Center Set Up
• Duration: 24 Months
• Peak Team Size: 15
• Average ramp up time: 2-4 weeks
• 3 Healthcare Software Products
• 450 High Complexity Test cases
(~80 Test Steps Each)
20% Test cases Automated
Testing Type: Functional, Automation,
Compatibility.
24 8 850
MONTHS OF
ENGAGEMENT
MAJOR RELEASES
DEFECTS REPORTE
D
TEAM COMPOSITION
Client is one of the largest suppliers of healthcare IT solutions in US. They wanted a testing partner for their eHealth
and mHealth Apps division that can provide them professional services with on-demand scalability at an optimum cost.
• Set up an offshore test center at Bangalore, India
• Core-flex capacity based engagement with possibility to ramp up/ down on short notice
• Leveraged offshore testing pool to build the testing team with following skillset:
• Manual testers, automation engineers, business analysts, and test managers
• Approved security concept for offshore setup
• Excellent client feedback for improving overall product quality and test maturity of the
testing division
OUR SOLUTION
KEY HIGHLIGHTSCLIENT
CONTEXT
ON-DEMAND TESTING SERVICES FOR A US HEALTHCARE IT SOLUTION PROVIDER
Contact: [email protected] 17© Qualitrix Technologies
1. Case Study: Offshore Test Center Set Up
0.5 Million Direct Savings through On-demand
Ramp Up / Down First 10 resources ramped up in 3
weeks
SCALABILITY AND COST REDUCTION
TEST COVERAGE
KEY METRICS
20% Lower Offshore Rates against industry standard
45% less tester on-boarding time against industry standard
Qualitrix
Industry Average
Contact: [email protected] 18© Qualitrix Technologies
2. Case Study: Enterprise Crowdtesting
• Duration: 8 Months
• Average ramp up time: 2 Days
• 9 Android Apps
• 13 iOS Apps
• 5 Web Apps
• 26 Test Cycles
• 800 Test Scenarios Designed and
Executed
• Testing Mode: Guided Exploratory
(Test Scenario Based)
• Testing Types: Functional,
Compatibility, Usability, Accessibility,
SEO Testing, Security
• Special Test Cycles for All Apps:
iOS 9 Compatibility, Android
Marshmallow Compatibility
30 26 1050
CROWDTESTERS
PER CYCLE
TEST CYCLES
EXECUTED
DEFECTS REPORTE
D
Client is one of the largest broadcasting media firms in Australia. They were looking for a crowdtesting partner to asse-
ss their consumer web and mobile apps in real-world conditions on multiple PC and mobile handet models, OS
version, browser versions, network conditions. The partner also had to support non-functional testing for some apps.
• Engaged a testing team of 30 crowdtesters distributed across differnt cities in Australia
• Crowdtesters picked for each test cycle from a profiled Qualitrix testing community of 25,000 size
• Crowdtesters picked to cover the target device models, system configurations, and locations
• Picked non-functional test specialists for specific test cycles - Accessibility, SEO and Security
• App distribution or website access provided only through secure channel
• Thorough background verification conducted for each participating crowdtester
OUR SOLUTION
KEY HIGHLIGHTSCLIENT
CONTEXT
ENTERPRISE CROWDTESTING ENGAGEMENT FOR AN AUSTRALIAN MEDIA FIRM
Contact: [email protected] 19© Qualitrix Technologies
2. Case Study: Enterprise Crowdtesting
COST COMPARISON PER CYCLEOUTSOURCED VS. CROWDSORCED
AVERAGE TEST COVERAGE PER CYCLE
KEY METRICS
24 16
ANDROID DEVICES COVERED
iOS DEVICES COVERED 8
COUNTRIES
COVERED
30 CROWD TESTERS
1 OFFSHORE RESOURCES
33% less than conventional testing
5X higher test coverage
TEST CYCLE TIME
Qualitrix
Industry Average
5-10 days test cycle execution time
Contact: [email protected] 20© Qualitrix Technologies
3. Case Study: Field Assessment
• Duration: 13 Months
• 30+ services tested per month
• 450 assessments per month
• Team size: 40 field testers,
4 regional coordinators,
1 test program manager
• 26 cities covered
• 12 Indian languages covered
95690
5400
IMPROVEMENTS
SUGGESTED
PRODUCTION
ISSUES REPORTED
ASSESSMENTS
CONDUCTED
The client was looking for a Field assessment partner to cover the following activities:
• Pan India Operational audits to verify the performance of all key VAS services
• VAS performance under different network conditions – 2G / 3G/ LTE,
• VAS performance across different cities covering Metropolitan, Urban and Semi-Urban areas
• Content audit to be collated at 4 hubs (North, South, East, West) for all major regional languages
• Hub wise Competition tracking for other network operators for similar VAS
• Voice of Customer – National level
• Team deployed with test program manager at client location, regional auditors and testers distributed across India
• List of services to be assessed prioritized each month
• Assessment scenarios defined for each service
• Test program manager assigns services and test surveys to all field testers through passbrains platform
• Testers & test manager activate the services and execute all the assigned surveys
• Testers report issues found while performing the audits in addition to submitting a summarized weekly and monthly
report to client and partners
SCOPE OF SERVICES
KEY HIGHLIGHTS
CLIENT CONTEXT
END USER ASSESSMENT OF VAS SERVICES IN PRODUCTION FOR AN INDIAN TELECOM OPERATOR
Contact: [email protected] 21© Qualitrix Technologies
3. Case Study: Field AssessmentKEY METRICS
Qualitrix
Industry Average
26 CITIES MONTHLY
12 LANGUAGES
MONTHLY
32% Reduction in Production Issues
Observed
5X Times Higher ROI
AVERAGE TEST COVERAGE PER CYCLE
QUALITY IMPROVEMENT ACHIEVED
VALUE DELIVERED - ROI
Qualitrix Technologies#48, Vaishnavi Badri Towers, Jayamahal Extension, Bangalore, India – 560046+91 [email protected]
Thank You