learning's from mobile testing

Learnings – Mobile Apps Testing

The World of Mobile Apps

Native

Native: An app build purely using the components build using the underlying platform e.g. objective C, Java

Native app examples: Calendar, Calculator

Hybrid

Hybrid: An app build using combination of HTML 5 with the native components.This approach helps in making the app platform independent in some Way. Frameworks based on itCalatrava, PhoneGap

e.g. LinkedIn app, Facebook app

Mobile Web

It’s a web site which run on Mobile phones.

Many companies go for a mobile web instead of building an app as its platform independent.

e.g. m.timesofindia.com, m.facebook.com

Challenges in Testing Mobile apps

Number of Devices & OS versions (Hardware configuration)

Display densityDifferent BrowsersNetwork connectionsInstallation issues

Challenges in Testing Mobile apps

Simulating real life scenarios

• Call Interrupts• Low Battery• Alarms • Network Issues

Challenges in Testing Mobile apps

Usability• Accessibility

• Identity

• Navigation

• Content

Challenges in Testing Mobile apps

Automation

What to Automate???

Tools

Effort v/s Value

Developmental Practices

Non Functional Testing

Key Learnings

Ensure coverage on various devices

Select a set of representative devices

Test End to End Flow on each device

Extensively use Simulators

Ensure testing of real life scenarios

Apps can behave erratically when-Multiple process run in the background -Hardware is incompatible-Memory Warnings are thrown

Constant Monitoring of Device Logs

Uncover potential problems before they occur.

Extremely helpful to understandthe API calls the app makes

Showcase Tools

IOS – ReflectionsAndroid- Android Projector

Extremely useful tools to demo your app to clients

Automation Tools

FrankCalabashMonkeyTalkSikuiliUIAutomation

Automation Tools

RobotiumCalabashMonkeyTalkSikuiliNative DriverAndroid Instrumentation

Automation Tools

Android DriveriPhone DriverWatir

Automation Tools

MobiTestGoogle Page SpeedLoad RunnerJmeter

Key Learning’s

Use simulators to get the breadth of devices tested.Testing on different Display density mobilesKeep an eye on smaller details as wellSimulating real life scenariosConstant monitoring of device logs while testingSelective automation on Devices/simulatorsShowcase tools

Contact us

How can we help?ThoughtWorks is a global custom software solutions consultancy trusted by many of the world’s leading businesses with their most complex and critical systems. We deliver consulting grounded in delivery expertise, build custom

applications and help organisations across all market sectors to drive IT efficiency – working to an exceptionally high standard.

Private and Confidential. © 2012 ThoughtWorks. All rights reserved.

Vikrant.g.chauhan@thoughtworks.com

dubinsky@thoughtworks.com