Collaborative Mobile Test Automation

July 14, 2015

Uber, the world’s largest taxi company, owns no vehicles. Facebook, the world’s most popular media owner, creates no content. Alibaba, the most valuable retailer, has no inventory. And Airbnb, the world’s largest accommodation provider, owns no real estate.

Something interesting is happening.

– Tom GoodwinTech Crunch

3/3/15

toddler apps by jenny downing on Flickr

Today’s technology priority: growth

5%

6%

10%

11%

8%

9%

16%

12%

23%

3%

6%

11%

7%

15%

14%

13%

15%

15%

6%

9%

8%

12%

9%

10%

12%

19%

16%

Hire a C-level executive who is focused…

Invest in more outsourced resources to…

Improve usability

Reduce IT costs

Increase proportionate investment in…

Develop or acquire new skills in IT

Invest in more external digital services…

Expand the breadth of digital assets…

Improve the quality and performance of…

Top strategies for digital success next 18 mos.

1 2 3

16%

12%

23%

13%

15%

15%

12%

19%

16%

More external digitalservices

Expand digitalassets (e.g. mobile)

Improve customerexperience qualityand performance

1 2 3

Top 3

210 IT and LOB decision-makers in the US, UK, and Germany from organizations with 1000+ employees

Source: A commissioned study conducted by Forrester Consulting on behalf of Keynote, March, 2015

Innovation… faster

Higher release frequency, user expectations

28 DAYS

59 DAYS

iOS vs Android App Update Management Insights, UEA/CCP, 2015

ONLY 16% OF CUTOMERS

willing to give a bad app more than one attempt

20% of apps are used once, then deleted

Localytics, 2014

Development realities

Specialization Open Source Testing

“Open Source Water” by schoschie on flickr"TIO

BE

ind

ex"

on

Wik

iped

ia

Units

Feature validation

Development environment

Mix of emulators, personal devices

Testing in Development

End-to-end, exploratory

Coverage, regression

Application lifecycle management, build acceptance/automation

Higher reliance on real devices

Testing in QA

Bridging approaches

Collaboration

Dev -> QA

1. Leverage assets without sacrificing capability

2. Enhance narrow units with additional coverage E.g., modify unit testing registration functionality based on single data

value to run on broad data arrays

3. Combine multiple units into full cases

Collaboration

QA -> Dev

1. Reduce “source of truth” conflicts

2. Improve defect fix veracity

3. Improve test validity with the accuracy of same real device(s)

Shortcomings

“bridge-to-nowhere” by careax on wikiality

Real Device Technology

Perform cloud-based testing and monitoring of any app or website on the largest library of real mobile devices, or your own private devices.

Shared Devices

24X7 access to hundreds of smart devices

Use for manual, compatibility, “untrusted device” testing

Private Devices

Managed and hosted by Keynote or on premise Inside corporate firewall

Enterprise only

Best for automation

Local Devices

Plug your smart devices on hand directly into your local computer

Make use of existing assets, great for local teams

Enterprise only

Android only (iOS on roadmap)

Flexible device options

© 2015 Keynote, LLC

Keynote + Appium

Run Appium scripts on real Android and iOS smartphones and tablets remotely

Test on demand

Execute multiple tests on multiple devices without the need to manage them

Run test sequences with hundreds of test cases, across multiple devices

Manage your tests online:

View device interactions in real-time and share with colleagues using built-in collaborative screencasting

Leverage results directly in Appium

© 2015 Keynote, LLC

Live Appium testLet’s watch a test case run on a real iPhone

Collaboration—the sooner the better!

User expectations are higher than ever—quality is critical

Seek integrated approaches for both developers and quality assurance teams

Prioritize consistency in testing, and foster connection across testing teams

Questions?

Thank youLearn more about Keynote Mobile Testing with Appium:http://www.keynote.com/solutions/testing/appium-integration