User Interface Test Automationfor Android

Vendor Benchmarking

Target

• Check User Interface of applications for Android• Examples include: games, maps• Requirements:– All UI elements– Quick execution (runtime)– Reasonable maintenance – Good reports– Advantage of plug-in to the frameworks we already use (QTP,

C#)

Tools Evaluated

• Autoandroidhttp://code.google.com/p/autoandroid/

• SeeTesthttp://experitest.com

• Calculonhttp://github.com/kaeppler/calculon#readme

Android Test Automation BenchmarkCriteriaAutoandroidSeeTestCalculon

SimplicityMedium*SimpleMedium*

ExecutionDevice**/EmulatorDevice**/EmulatorDevice**/Emulator

MethodologyGoogle Automation APIVisual element identification

Google Automation API

Coverage- Application - Application-3rd party events (e.g. behavior while incoming call)

- Application

MaintenanceLowMedium***Low

CostOpen source~600$Open source

DocumentationNot a strong partOKNo

Report++++++

Plugs into our exisiting testing environment

JavaJava, Python, C#, Perl, QTP(I only tried with QTP)

Java

Resourcehttp://code.google.com/p/autoandroid/

http://experitest.comhttp://github.com/kaeppler/calculon#readme

* Requires some Android programming internals** Wasn’t tested by me*** I assume that the visual identification technology will requires some maintenance.

Conclusion

• I think to sum up that the three tools cater for somewhat different needs:– Autoandroid and Calculon are better for Unit

testing– Experitest’s Seetest is better for System testing

• Pricewise, Autoandrois and Calcuolon are free while Experitest requires a licence (one-time but still…)