app qualityoverview

who am i? tester

eng director/developer

Analytics1,000,000+ apps100,000,000+ reviews

Crowd Testing1,000+ apps100,000+ Testers

app startup

app-specific issues

● 3rd party sdks● agile/lean● backend services● competition● continuous

integration● deployment● distribution● device state● device fragmentation

● platform fragmentation● in the wild● KPIs● location● mobile networks● review feedback● security● tools● user interface● web vs native vs hybrid

app quality attributes● content● elegance● interoperability● performance● pricing● privacy● satisfaction● security● stability● usability

keys to quality apps1. care about fixing your bugs2. instrument your app3. quality: perception, stars, feedback4. prepare for changes like iPhone5 and iOS75. dogfood, beta, testing in the wild6. watch competition7. hybrid vs native question

fix known issues

instrument your app

popular. basic web and app performance too.

most popular with mobile-first and mobile-only

perception is importantbrand download

perception is important

trend: ask user for feedback.if good: point to appstoreif bad: custom feedback system

perception is important

changesbe ready iphone users especially fickle

competitionone click away

top tests that find bugsLandscape/portrait orientationSlow network, turning network on/off, switching wifi/LTELots of data/contentFirst launch of app with no network or location or social authApp handling incoming call or other system interruption like battery warning during data entry, device lock, etc

top tests that find bugsBackground processingLots of usage (flow issues and mem usage)Multi-touch gestures/zoomingCorrectness of branding and language used within the app vs desktop and web.Custom login—basic form validationOther apps in the background

test automationwait for design stabilizationwait for tractionframework? no great ones. suggest opensource and real-device compatible...if you automate, use cloud devicesmonkey’s for android frag

dogfood, beta, crowd

hybrid vs native answer

freq updates != quality

future of app qualityreal-time automated and manual test resultstools for engaging users/feedbackquantifiedquality tied directly to engagement, $, downloadsautomatic suggestions (turing test for test lead)

future of app quality

app quality workshopall day workshop for SASQAG tomorrow btw

contactjarbon@gmail.com@jarbon

always love to chat about app quality