"agile test autom. at scale"? - pnsqc
TRANSCRIPT
![Page 1: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/1.jpg)
![Page 2: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/2.jpg)
AGILE TEST AUTOM. AT SCALEPaper presentation at PNSQC 2013
Mark FinkQuality Engineer, Tabane Limited
(c) 2013 Mark Fink
![Page 3: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/3.jpg)
Consulting-Services & Customers
Consulting-Services:
Customers:
AGILE TEST AUTOMATION AT SCALE
Performance Testing
Test Automation
Exploratory Testing
·
·
·
3/18
![Page 4: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/4.jpg)
AGILE TEST AUTOMATION AT SCALE 4/18
![Page 5: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/5.jpg)
Agenda
AGILE TEST AUTOMATION AT SCALE
Context & Problems
How to approach this situation
Activity Testing Pattern
Emphasis of Scope over Form
·
·
·
·
5/18
![Page 6: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/6.jpg)
What is meant by "Agile Test Autom. at Scale"?
AGILE TEST AUTOMATION AT SCALE
Agile -> no big design up front, release often
Modern Web-App -> Single page app (SPA): HTML, CSS, Javascript (Ajax)
Test Automation -> using continuous integration
Scale -> scope >10 man years, more than 5 developers, high velocity
·
·
·
·
6/18
![Page 7: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/7.jpg)
Continuous Integration
AGILE TEST AUTOMATION AT SCALE 7/18
![Page 8: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/8.jpg)
Evolving with Continuous Integration
AGILE TEST AUTOMATION AT SCALE 8/18
![Page 9: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/9.jpg)
Jenkins Wall Display
AGILE TEST AUTOMATION AT SCALE 9/18
![Page 10: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/10.jpg)
Test Automation Methodology
Common Goals:
AGILE TEST AUTOMATION AT SCALE
Release the application often e.g. every two to four weeks
Go-Live decision support for each release
Instant feedback regarding regressions to developers
Means to identify gaps in the test infrastructure
·
·
·
·
10/18
![Page 11: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/11.jpg)
Method: Activity-Testing Pattern
An excellent model when designing GUI level functional tests is to think aboutdescribing the test and the automation at the following three abstraction levels:
AGILE TEST AUTOMATION AT SCALE 11/18
![Page 12: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/12.jpg)
Method: Activity-Testing Pattern
Level Description Example
BusinessRule /Functionality
What is the intention of the test, what is itdemonstrating or exercising? A good start whenimplementing tests is using examples which havebeen gained during specification of the storyregarding the feature in question.
Free delivery is offered to customers whoorder two or more books.
GUIWorkflow
What does a user have to do in order to exercisethe functionality through the GUI, on a higheractivity level.
Put two books in a shopping cart, enteraddress details, verify that delivery optionsinclude free delivery.
TechnicalActivity
What are the technical steps required to exercisethe functionality. On this level the API of theautomation tool (in this case Selenium) is used.There is no need to wrap the features of theautomation tool!
Open the shop homepage, log in with'testuser' and 'password', go to the '/book'page, click on the first image with the 'book'id, wait for page to load, click on the 'Buy-now' link and so on.
by Gojko Adzic
AGILE TEST AUTOMATION AT SCALE 12/18
![Page 13: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/13.jpg)
Emphasizing Scope over Form
James Whittaker, 2012, "How we test at Google"
AGILE TEST AUTOMATION AT SCALE 13/18
![Page 14: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/14.jpg)
AGILE TEST AUTOMATION AT SCALE 14/18
![Page 15: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/15.jpg)
Hitchhiker's Guide to Test Automation
Tutorial Style:
AGILE TEST AUTOMATION AT SCALE
Working single page application (SPA)
Test-Suites to demonstrate different test scopes
Jenkins job configurations
Section on performance testing
Section on exploratory testing
Samples on Nosetests, FitNesse, Selenium, Jasmine BDD, Jenkins, JMeter, ...
·
·
·
·
·
·
15/18
![Page 16: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/16.jpg)
and... it has supercars!
AGILE TEST AUTOMATION AT SCALE 16/18
![Page 17: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/17.jpg)
</ Thank You! >
twitter @markfinkwww www.testing-software.orggithub github.com/markfink
![Page 18: "Agile Test Autom. at Scale"? - PNSQC](https://reader031.vdocuments.mx/reader031/viewer/2022021717/620c43530d706752b56fd8b4/html5/thumbnails/18.jpg)