how to test on the right mobile platforms
TRANSCRIPT
![Page 1: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/1.jpg)
Choose the Right Digital Platforms for Dev & Test
January, 2016
![Page 2: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/2.jpg)
Presenters
05/01/2023 2© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Eran KinsbrunerDir. Technical Evangelist
Gil KidronDir. Product Management
Gidi Pridor VP Marketing
![Page 3: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/3.jpg)
A few housekeeping items
1. Submit questions using the Q&A panel.
2. Slides and recording sent
after the webinar.
3. Please complete survey after the
presentation.
![Page 4: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/4.jpg)
“What devices/platforms/browsers should I test on to ensure efficient
market coverage?”
Answering the most common question
![Page 5: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/5.jpg)
Agenda for Today
05/01/2023 5© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Discussion: How to plan your own coverage strategy
Web test coverage insights
& recommendation
s
Trends & insights from Digital Test Coverage Index
Edition 3
![Page 6: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/6.jpg)
Coverage Strategy is Fundamental All-Around
For the Business it’s market coverage
• Great end user experience
• Build requirement for IT
• Optimize user engagement & rating
For the Dev/QA it’s test coverage
• Optimize process
• Discover bugs early, mitigate risk
• Continuously test on what matters
![Page 7: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/7.jpg)
What does it take to cover the REAL end user experience?
v
Device & Platform
Model
OS Version
Screen Size
browserv
Environment
Location
Network
Phone events
Other apps
v
Conditions
Signal
Load
CPU
![Page 8: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/8.jpg)
Device
Test Cases
iPhone 4iPhone 4siPhone 5iPhone 5siPhone 6iPhone 6+iPad MiniiPad MiniiPad Gen3iPad Gen4Samsung S4Samsung S5Samsung Note IIIAndroid 2.4Android 4.4
Improving Test Coverage Through Automation
Environment
While DrivingCell Site handoff
GPS LocationsUnder Load
4GLTE
Wifi
Improve Overall Quality - Run Test Automation as part of CI- Run Parallel Unattended Tests - Run Anytime & More Frequently
![Page 9: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/9.jpg)
Test Coverage Optimization Process
2. Lab Sizing
Teams Projects
SDLC Cycle
Requirements
How many?
v
Me
Analytics
Market
My Space
Popular & emerging
1. Coverage Mix
Industry trends & insights
Which?
![Page 10: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/10.jpg)
Test Coverage Optimization Process
Me
Analytics
Market
My Space
Popular & emerging
Industry
Current state
Internal
External
Future state
The Index
![Page 11: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/11.jpg)
What’s new?• Web browsers index• Canada and Australia index
Digital Test Coverage Index 3nd Edition
![Page 12: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/12.jpg)
Did you send a gift to your travel agent this Christmas?
05/01/2023 12© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Survey
![Page 13: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/13.jpg)
One Experience on All Digital Platforms
05/01/2023 13© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Using multi-screens one after the other to accomplish one task requires one experience across all of those screens
Mobile is the #1 platform to start the digital experience but it is only a part of a broader set of digital platforms
Source: Google
![Page 14: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/14.jpg)
05/01/2023 14© 2015, Perfecto Mobile Ltd. All Rights Reserved.
![Page 15: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/15.jpg)
2015 Retrospective – A Lot To Learn From…
05/01/2023 15© 2015, Perfecto Mobile Ltd. All Rights Reserved.
![Page 16: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/16.jpg)
The new index
Web test coverage
Index
Recommended OS versionPixels per Inch
Trend
![Page 17: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/17.jpg)
U.S Index Q4 2015
Apple & Samsung Leads
Legacy & Critical Devices
![Page 18: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/18.jpg)
Canadian Index Q4 2015
Blackberry holds ~8% Share
Apple & Samsung Leads The Market
Chrome & IE On Win 7 dominate
![Page 19: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/19.jpg)
Digital Test Coverage Index - Q4 2015 Key Insights & Trends
05/01/2023 19© 2015, Perfecto Mobile Ltd. All Rights Reserved.
iOS 9 stabilized on 70% market share, iOS 8 holds ~20%
Android stronger in Europe (EU5) than in U.S, Canada
Windows Phone clearly stronger In Europe (10% share)
Disruptive technologies (Touch ID, Force Touch) enhances
fragmentation and test coverage (e.g. Samsung S7 vs. S6, iPhone
6S vs. iPhone 6)
Mobile Insights
![Page 20: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/20.jpg)
Digital Test Coverage Index - Q4 2015 Key Insights & Trends
05/01/2023 20© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Desktop browsers auto update forces an instant response for Dev/Test
Laggards desktop OS users shift towards early adopters **Microsoft heavily pushes for Windows 10 adoption
Users transition to new Chrome & Firefox OS version is swift (3-4 Days)
Web Insights
![Page 21: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/21.jpg)
05/01/2023 21© 2015, Perfecto Mobile Ltd. All Rights Reserved.
A word about Screen properties
• Screen properties (Size, Resolution, HW) Impacts • CPU, Battery, Performance
• Often large screen size reduces PPI (iPad Pro e.g.)
• Mixing various PPI levels assures better UX coverage (Responsive web, intensive UI apps)
Source: Mobile Jury
![Page 22: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/22.jpg)
Mobile Market Calendar
Force Touch
Large screens trendingSamsung 18.4’’, iPad Pro 12.9’’Growing customer demand
1st Tablet by Google, 10’’, Android 6.x
![Page 23: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/23.jpg)
Web Index Insights
© 2015, Perfecto Mobile Ltd. All Rights Reserved. 2305/01/2023
![Page 24: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/24.jpg)
2016 – The Web Chase
51
5049
48
52
53 5455
4344
4546
4748 49
50 5152
10.0.210.0
9.0.9
9.0.89.0.79.0.6
9.0.59.0.49.0.3
10.0.1OS X 10.12
![Page 25: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/25.jpg)
Today’s Browsers are Auto-Updated by Default
05/01/2023 25© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Dec 2nd
Dec 5th
3 days
46 47
Dec 15th
Dec 19th
4 days
42 43
![Page 26: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/26.jpg)
New Version Adoption Rate (days)
05/01/2023 26© 2015, Perfecto Mobile Ltd. All Rights Reserved.
USA 3 4 5
Europe 3 4 7
UK 3 4 5
Germany 3 4 7
Australia 3 4 6
India 3-4 4 7
![Page 27: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/27.jpg)
News Flash
05/01/2023 27© 2015, Perfecto Mobile Ltd. All Rights Reserved.
![Page 28: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/28.jpg)
Microsoft Cleaning the Stables
05/01/2023 28© 2015, Perfecto Mobile Ltd. All Rights Reserved.
![Page 29: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/29.jpg)
…and Cleaning
05/01/2023 29© 2015, Perfecto Mobile Ltd. All Rights Reserved.
![Page 30: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/30.jpg)
The EDGE Factor
05/01/2023 30© 2015, Perfecto Mobile Ltd. All Rights Reserved.
?
![Page 31: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/31.jpg)
Too Many Choices
05/01/2023 31© 2015, Perfecto Mobile Ltd. All Rights Reserved.
48
51
50
49
48
52
53 5455
4344
45
4647
4849
5051
5210.0.2
10.0
9.0.9
9.0.8
9.0.7
9.0.6 9.0.59.0.4
9.0.3
10.0.1
![Page 32: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/32.jpg)
U.S Index Q4 2015
![Page 33: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/33.jpg)
Discussion – Planning your own Test Coverage
• How to use the index when planning your own test coverage
strategy? How to combine it with your own analytics data?
• How often should you revisit the coverage plan
• Who should be involved and sign off on the coverage plan?
• The role of automation in increasing your test coverage
• Are user conditions part of the coverage strategy?
05/01/2023 33© 2015, Perfecto Mobile Ltd. All Rights Reserved.
![Page 34: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/34.jpg)
Reminder
Please Complete the survey
Learn More: www.perfectomobile.com
![Page 35: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/35.jpg)
Thank You
![Page 36: How to Test on the Right Mobile Platforms](https://reader035.vdocuments.mx/reader035/viewer/2022070514/587ec9af1a28abf37b8b6b81/html5/thumbnails/36.jpg)
• 1) Assign a person in charge of continuously planning test coverage .• merging business requirements (which are often based on analytics)
with Index report and market stats is a valuable to do item• 2) CI & automation is key to continuous quality. Build the lab based
on the right coverage and cross platform test automatically to assure no regressions introduced when lab is refreshed by new device, new OS version, new browser/desktop permutation• 3) The index is a recommendation but it includes valuable platform
characteristics such as recommended OSV, screen properties, legacy & new devices etc. - even if you decide to include additional devices or change the mix based on your analytics, please make sure to keep the various mix of the above properties to assure high quality across screens, platforms etc. • 4) Though reference devices do not often tend to be that popular
from a market share perspective (e.g. Nexus devices) - their importance to the test coverage does not come from their market share but from the frequent OS updates these devices receives - making them the 1st in the market to run on the latest Android OS. These devices are a must in any test lab in today's market• 5) From a desktop and web perspective there is a clear auto update
mechanism for leading web browsers (e.g. Chrome) where the end users are not even aware to. The fast adoption of these new platforms due to them being transparently updated, forces Dev/Test teams to continuously update their lab and test on early Beta/Dev versions of these browsers so they are ready to support them on Day 1
05/01/2023 36© 2015, Perfecto Mobile Ltd. All Rights Reserved.