Modern State of Test Automation

SURVEY GUIDE

Enterprise software developers since 1997

The survey was aimed at evaluating

current test automation needs and pain

points as well as at identifying what

changes in the use of testing tools took

place in the recent years.

The survey captured results of more than

100 respondents, including test leads, QA

managers, test automation engineers and

software developers.

The responses were collected over a four-

week period using domain-specific forums,

groups and communities.

The survey findings can be used for a

better understanding of testing

challenges that exist in your company,

choosing effective test automation tools

and improving your overall QA and

testing processes.

SURVEY OVERVIEW | MODERN STATE OF TEST AUTOMATION

KEY FINDINGS | YOUR POSITION WITHIN THE COMPANY

QA Engineer – 36%

Test Lead – 31.6%

QA Manager – 15.8%

Software Developer – 4.4%

Test Automation Engineer – 28.1%

Other* – 7.9%

*Consultant, software tester, project

manager

KEY FINDINGS | MODERN STATE OF TEST AUTOMATION

KEY FINDINGS | MODERN STATE OF TEST AUTOMATION

Operate virtual machines – 28.9%

Prepare physical PC manually – 22.8%

Copy configuration files on the test

machine – 21.9%

Install the product being tested – 29.8%

Launch automated tests – 31.6%

Manage the testing queue – 19.3%

Submit bugs to the bug-tracking system

– 68.4%

Close fixed bugs in the bug tracking

system – 64.9%

Create reports with test results – 29.8%

All the above mentioned activities are

fully automated – 7%

Other* – 5.3%

*Analyzing the cause of defects, installing

and upgrading tests

KEY FINDINGS | MODERN STATE OF TEST AUTOMATION

*IBM Rational Team Concert, VersionOne

KEY FINDINGS | MODERN STATE OF TEST AUTOMATION

*Bamboo, Jenkins, Build Forge *Sauce Labs, OpenStack, Vagrant

KEY FINDINGS | MODERN STATE OF TEST AUTOMATION

Microsoft Visual Studio – 25.4% HP QTP – 17.5% Selenium IDE – 36% Silk Test – 3.5% Test Complete – 9.6% FitNesse – 3.5% Eclipse – 20.2% JUnit – 27.2%

NUnit – 13.2% Auto IT – 4.4% VB Scripts – 5.3% Batch scripts – 4.4% Other* – 40.4%

*Selenium WebDriver, Robot framework, TestNG

*ALM, CA Harvest, IBM RTC, Surround SCM

CONCLUSION | MODERN STATE OF TEST AUTOMATION

Nowadays more and more software development companies

(66.7% of the respondents) actively use automated testing. And

the percentage of test automation adopters is expected to grow

in the coming years.

83.8% of the survey participants plan to implement test automation instead of costly and time-consuming manual testing

The top automated testing needs and challenges can be deduced from operations that are still performed manually by the majority of respondents

The top tools and systems that are given preference by the

survey respondents:

Bug-tracking system – Jira (45.6%)

Build machine – MS Build (25.4%)

Virtualization system – VMware (37.7%)

Revision control tool – Git (43%)

Testing automation framework – Selenium IDE (36%)

The top tools and systems that are given preference by the survey respondents: Git Jira VMware MS Build Selenium IDE

RECOMMENDATION | MODERN STATE OF TEST AUTOMATION

Quality assurance is crucial when it

comes to automation software as it is

complex and errors are expensive.

Automated scripts can improve the

quality of software testing, however,

their implementation involves mastering

several independent tools and requires

a lot of routine manual actions.

We suggest an effective approach that

brings test execution to the highest

automation level - automated software

testing integration framework Octopus.

The implementation of Octopus

brings businesses numerous

advantages, including automation of

labor-intensive routine operations

and 5 times more productive test

engineer performance.

To learn more visit http://octopus-

testing.com/

Octopus simplifies and accelerates

the process of application testing

and contributes to a significant

improvement of the productivity.

Applied Systems Ltd. is an ISO 9001:2008 certified software developer with more than 19

years of experience. The company is a Hi-Tech Park member, a Microsoft Silver partner

with Application Development Competence and an ISTQB Certified Tester.

We develop machine-to-machine and business process automation software coming up

with solutions that perfectly match customers’ needs. Our expertise areas include real-

time measurement and process visualization, test and service automation, software

testing and QA.

SlideShare:

Applied Systems Ltd.

Contact us:

www.appsys.net

Email: info@appsys.net

Tel: +375 17 277 10 80

Twitter:

@appsysltd

LinkedIn:

Applied Systems Ltd.

ABOUT US | APPLIED SYSTEMS LTD.