Mobile Testing Approach

Mobile Devices vs. Computers

Source: RingCentral, Nielsen

I can run the app from any location

My computer is at work, but I need to run the app away from the office

I need to use the app while commuting

I spend time at locations where I can’t use my computer

I don’t feel like turning on my computer

I can run the app more easily and quickly on my smartphone

Generic Challenges

# of Platforms / OS1

Device Variety2

Displays Pixel Density3

Hardware Complexity4

App Complexity5

Security6

Carriers & Providers7

Limitations over PCs8

Native Apps vs. Mobile Web9

Test Specific Challenges

Dynamic SDLCs1

Need for Regression Testing2

Back-end Testing3

Performance Testing4

Do not have the Right Tools5

Lack of Mobile Testing Experts6

No Time to Test7

Do not have Right Methodology8

Do not have the Devices & Environment9

Guide to Mobile Testing

Mobile Testers are Actors!

They should act like;

• Novice users,

• Experienced users,

• Generation X,Y,Z and C,

• Developers,

• Business Analysts,

• Project Leaders,

• Upper Managers,

• Fans,

• Hackers,

• and also Competitors

Guide to Mobile Testing

Mobile Testing should not be Stationery…

• People generally do mobile testing in their offices, on their tables.

• Once you do mobile testing on the table, you miss a lot of insights about real usageand mobility!!!

Mobile Testing Approaches - Devices

Real Device Testing

• True User Experience, Real Hardware & Real Performance, Realistic Results, More Coverage [+]

• Is slow compared to Emulators [-]

• Provider & Carrier issues [-]

• Logistics & Cost [-]

Emulator / Simulator Testing

• Simple, Fast & Cheap [+]

• Emulator Errors [-]

• Do not reflect real hardware & carrier behavior [-]

• Performance is high and this can be unrealistic [-]

Cloud Testing

• Logistics & Cost (Rent per hour) & Accessibility [+]

• High variety of Devices (Swapping) & Scalability [+]

• Cleaner & Greener Testing [+]

• Security, Connectivity & Infrastructure problems [-]

Mobile Testing Approaches - Sourcing

Inhouse Testing

• Easy to Control [+]

• Domain Knowhow [+]

• Capacity and Demand Constraints [-]

• Mobile Device Costs & Not Matching User Demographics [-]

Outsourced Testing

• Professional and Independent Testers [+]

• Access to Range of Mobile Devices [+]

• Communication & Time-zone Problems [-]

• Hidden Costs [-]

Beta Testing

• Logistics & Cost [+]

• High variety of Devices, Real Users, Carriers & Locations[+]

• Users are not Testers! [-]

• Reputation, Control and Security [-]

Crowdsourced (Community) Testing

• Actual Users, Actual Devices & Professional Testers [+]

• Broad Range of Personas & Devices [+]

• Comparably Difficult Adoptation, Communication & Delivery [-]

• High Probability of False Defect Detection [-]

In-The-Lab

Testing

In-The-Wild

Testing

Mobile Testing Approaches – Test Types

ISTQB Foundation LevelISTQB Advanced Level

Test AnalystTechnical Test AnalystTest Manager

Test Automation CoursePerformance Testing CourseMobile Testing CourseUsability Testing Course

Value-added OutsourcingService Level AgreementsISTQB Certified Test Engineers

Testing Center of ExcellenceTest Automation Services Performance Testing ServicesTest Maturity Assessments

(TMMi, TPI, customized)

More than 350 corporate clients…+

+Turkey Software Quality Report+

http://turkishtestingboard.org/turkish/tsqr.htm

TestIstanbul Conferences+

http://www.testistanbul.org/

Bize Ulaşın

www.twitter.com/Keytorc

blogs.keytorc.com

tr.linkedin.com/in/keytorc

Contact

info@keytorc.com

Keytorc Software Testing Services