AQuA TestBorgA Software Cyborg for Automated Quality Assurance

Android Trends

Test Automation Tools Landscape

Comparative Analysis

Typical Challenges vs. Possible Solution

AQuA TestBorg as A Solution

Success Stories

Agenda

2

Android Trends

Behind the 'Internet of Things' Is Android—and It's Everywhere

Android not limited to Smartphones and Tablets resulting in - Complex interactions between connected devices and smart sensors

- Highly customized Android for specific tasks

- Stringent performance requirements

Complex and Time Consuming QA 3

Test Automation Tools Landscape

Cloud based Application Testing

User Interface Testing

Functional Testing In-car Navigation

Home Automation In-flight Entertainment

Office Automation

System & Solution Validation

Compliance Test Suite (CTS)

Performance Testing

Functional Testing

Target Market

4

Comparative Analysis

5

Typical Android QA Challenges

Device and OS Fragmentation

Limited Market Window

Cost Performance Pressures

Complexity / Reliability

6

Challenge: Device and OS fragmentation

Critical Challenges

• Migrating to newer OS versions (every 6 months)

• Ensure backward compatibility

• Compliance Test Suite (CTS) for Device & Application

• 399 Devices required to achieve 90% app test coverage

A Probable Solution CTS support for latest Android versions

Re-usable test assets across OS versions / Devices

7

Challenge: Limited Market Window

Critical Challenges

• QA and testing gates an early product release

• Manual testing is time consuming

• Exhaustive efforts in resolving identified bugs during QA cycle

A Probable Solution Parallel Remote Testing on multiple devices

In-built analytics that can help debug bugs faster

8

Challenge: Price Performance Pressures

Critical Challenges

• Intense competition

• Long QA cycles without automation

• Additional efforts to implement

automation

A Probable Solution Scriptless automation

Re-usable automation scripts across OS/Devices

Screen Replication

9

Challenge: Complexity / Reliability

Critical Challenges

• Highly customized Android stack for embedded device

• Stringent performance requirements

• Complex M2M and user interactions

A Probable Solution Automate and validate M2M interactions

Stress testing to ensure reliability

10

AQuA TestBorg, The eInfochips Solution

11

Unified Platform End to end solution testing covering real-life user scenarios

Execution Intelligence, Batch Testing Automated regression across scalable distributed test environment for faster time to market

Scriptless Test Automation Intelligent record and playback enabling 35% effort reduction

Device Agnostic Test Automation Record on one device and run across device / screen / OS

Comprehensive System Validation Pre-integrated Compliance Test Automation, Performance and benchmarking test assets

Insightful Reporting In-built analytics to shorten debug cycle by 25%

Extensive Integration Options Integration with existing ALM, Test Management, Build Integration Management

11

12

Success Story : Video Conferencing Device

User Interface and Functional Test Automation of Android based Video Conferencing Device

Challenges

• 1000+ manual test cases for• Validation for external events from Web interface• Testing the cross interaction of the applications on the device.• Automating of testcases which interacts between two devices.

Example: Calling from one device & receiving call from another device.

AQA as A Solution

• Overnight regressions on multiple devices to accelerate QA cycle• Web Automation integration to validate interaction between

device and web interface • Ability to test interaction between two conferencing devices in a

single testcase to achieve better coverage

Benefits Achieved 61% test automation, reducing the QA effort by 40%

13

Success Story : In-Flight Entertainment Manufacturer Challenges

• Android ICS based, handheld device for IFE with multiple native applications• Multiple variants for different aircrafts, resulting into complex test beds• Remote testing of devices in aircrafts and manual efforts in collecting data

AQA as A Solution

• Automated Rack Testing using AQA • Remote and parallel CTS testing consisting 21,000 Test cases • Automated result updates and report generation of test run • Comparison Reports across builds and variants • In-built Analytics for faster debug of the failed testcases • Consolidated reports and graphs via test management feature of AQA for better tracking

Benefits• QA Cycle time reduction by ~28%• Effort reduction by 45%

LAN2

LAN1

AQA Test Suite

Thank you

14

For more information and AQuA TestBorg Demo, write us at marketing@einfochips.com or visit www.einfochips.com