mobile test automation - 10 questions to ask when picking the right tool
DESCRIPTION
Presentation at Next Generation Testing Conference Singapore on 30-Oct-2014. The presentation lists down 10 questions that one should ask to the tools vendor and to the business requirements when evaluating and selecting a suitable mobile test automation tool.TRANSCRIPT
![Page 1: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/1.jpg)
Next Gen Testing Conference Singapore
Mobile Test Automation :Questionsto Ask when
Picking the Right Tool
Brynley Scully, Head of Testing, Singapore
Rupesh More, Test Lead
Hewlett-Packard
Oct-2014
www.unicomlearning.com
10
![Page 2: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/2.jpg)
2
Mobile Test Automation
![Page 3: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/3.jpg)
Growth in Mobility
![Page 4: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/4.jpg)
4
Growth in Mobility
![Page 5: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/5.jpg)
5
Mobile Devices in our Daily Life
PCs dominate working hours
Tabletsrule the home
Smartphonesbridge the gaps
Tablets
Smartphones
PCs
![Page 6: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/6.jpg)
6
Growth in Mobility2014 total smartphone subscribers
1,064 million
394 million
213 million
US Europe Asia Pacific
Source: Forrester. “The State of Digital Business in Asia Pacific in 2014”, dated August 2014.
![Page 7: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/7.jpg)
The Need for Mobility Testing
![Page 8: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/8.jpg)
8
Mobility App Testing Coverage
![Page 9: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/9.jpg)
9
Why Automate Mobile Testing?
SpeedFaster Regression test cycles
Unattended test execution
ScopeRepeated execution of test cases across devices, OS, network, browsers
Many checkpoints and validation points in test steps
RiskReduced risk of human errors in test execution
![Page 10: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/10.jpg)
Mobile Test Automation10 Questions to Ask whenPicking The Right Tool
![Page 11: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/11.jpg)
11
Picking the Right ToolChoices, choices, choices
Mobile Automation Tool
?
![Page 12: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/12.jpg)
12
1. Software License Type & Costs ?
Open Source vs Commercial
Seat vs Concurrent
Single vs Multiple Platform
Term vs Annual
AddOn Costs
![Page 13: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/13.jpg)
13
2. Compatible with Automation Scripting Tools ?
Mobile Automation Tool
HP UFT
HP UFT
![Page 14: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/14.jpg)
14
3. Test on Real Devices and/or Emulators ?
Mobile Automation Tool
Real Device
Emulator
![Page 15: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/15.jpg)
15
4. Test on Single or Multiple Mobile Platforms ?
Mobile Automation Tool
![Page 16: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/16.jpg)
16
5. Type of Mobile Application ?
Mobile Automation Tool
Native
Web / HTML5
Hybrid
![Page 17: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/17.jpg)
17
6. Type of Connectivity to Real Devices ?
Mobile Automation Tool
Cloud
WIFI
USB
![Page 18: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/18.jpg)
18
7. Need Additional Hardware and/or Software ?
Mobile Automation Tool
Cloud
WIFI
USB
iOS
emulator
Android emulator
No additional hardware
No additional hardware
USB cables
Mac machine
Windows PC
![Page 19: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/19.jpg)
19
7. Need Additional Hardware and/or Software ?
Mobile Automation Tool
Additional Software
Instrument the App
Why ?
How ?
− By developer
− Self instrument
− SDK needed
− Mac needed for IOS devices
− PC needed for Android devices
![Page 20: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/20.jpg)
20
7. Need Additional Hardware and/or Software ?
Mobile Automation Tool
Additional Software
Instrument the App
Why ?
How ?
− By developer
− Self instrument
− SDK needed
− Mac needed for IOS devices
− PC needed for Android devices
![Page 21: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/21.jpg)
21
7. Need Additional Hardware and/or Software ?
Mobile Automation Tool
Need to install agent software on devices or emulators?
![Page 22: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/22.jpg)
22
8. Object Recognition Methods ?
Mobile Automation Tool
OCR – based on text displayed in application.
Object ID Recognition – based on object properties. Unique ID used to locate and tag the object.
![Page 23: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/23.jpg)
23
9. Same Script on Multiple Platforms ?
Mobile Automation Tool
Same Script
No editing
Runs on multiple platforms
![Page 24: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/24.jpg)
24
10. Results with Screenshots and/or Videos ?
Mobile Automation Tool
Screen shots
Videos
![Page 25: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/25.jpg)
25
10 Questions To Ask when Picking the Right Tool
1. Software License Type & Costs ?
2. Compatible with Automation Scripting Tools ?
3. Test on Real Devices and/or Emulators ?
4. Test on Single or Multiple Mobile Platforms ?
5. Type of Connectivity to Real Devices ?
6. Type of Mobile Application ?
7. Need Additional Hardware and/or Software ?
8. Object Recognition Methods ?
9. Same Script on Multiple Platforms ?
10. Results with Screenshots and/or Videos ?
![Page 26: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/26.jpg)
26
Harness Benefits from the Tool
1. Do not use Record-and-Playback
2. Use Advanced Frameworks ; Insert many checkpoints
3. Script for compatibility across multiple platforms
4. Repeat execution runs across different devices, browsers, OS versions
5. Complement automation testing with manual testing and emulator testing
![Page 27: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/27.jpg)
27
Select your Testing Service Vendor
1 Where to Test? Onshore / Offshore
2 Testers Experience Mobile test tools; mobile testing projects; relevant industry
3 Testing Commercial Models Staff Augmentation, Managed Service, Testing-as-a-Service
4 Mobile Test Strategy Manual testing, automated testing, performance & load testing, network testing, security testing, emulator testing
![Page 28: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/28.jpg)
Demo
![Page 29: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/29.jpg)
29
Demo : Overview
Mobile Test Automation Tool
HP UFT HP UFT Mobile Airline Ticket Booking Mobile App
Devices on Cloud
Screenshots
Videos
![Page 30: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/30.jpg)
30
Demo : Addressing the 10 Questions
1. Software License Type & Costs ? Annual, Concurrent, Multiple Platforms
2. Compatibility with Automation Scripting Tools ? Yes. HP-UFT, HP-ALM
3. Test on Real Devices and/or Emulators ? Yes. Testing on Real device.
4. Test on Single or Multiple Mobile Platforms ? Yes. iOS, Android, Windows
5. Type of Mobile Application Supported? All. Native, Hybrid & Web
6. Type of Connectivity to Real Devices ? Cloud, USB, WIFI
7. Need Additional Hardware and/or Software ? No
8. Object Recognition Methods ? OCR, Object ID
9. Same script on multiple platforms ? Yes
10. Results with screenshots and/or videos ? Screenshots and Videos
![Page 31: Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool](https://reader034.vdocuments.mx/reader034/viewer/2022052601/559403b21a28abb3458b47a1/html5/thumbnails/31.jpg)
Next Gen Testing Conference Singapore
Mobile Test Automation :Questionsto Ask when
Picking the Right Tool
Brynley Scully, Head of Testing, Singapore
Rupesh More, Test Lead
Hewlett-Packard
Oct-2014
www.unicomlearning.com
10