shaping the future of testing tools
DESCRIPTION
The testing tools marketplace is flooded with products that address very specific parts of the quality management lifestyle. Many of these tools have been around, in one form or another, for the best part of 20 years. As a result, they are inflexible and, quite frankly, do not apply to today’s way of working. Others are more recent innovations, typically open-source and, on the surface, shiny and new. However, once we get past the shiny wrapper, they tend emulate their significantly older relatives. As such, the currently available support infrastructure tends not to deliver benefits, only overhead. In this presentation from our Webinar session you will explore how the current tool sets limit our agility in an ever-changing environment. Tim Bower, Solutions Architect, introduced some alternative approaches that could allow flexibility in our way of working and, most importantly, our way of thinking. Discover what you should be demanding from the tools industry and why... http://www.origsoft.com/solutions/software-test-automation/TRANSCRIPT
![Page 1: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/1.jpg)
Shaping the Future of
Testing Tools: Escaping the 1990s!
Tim Bower
Senior Solutions Consultant
Original Software
(Assisted by Dilbert)
![Page 2: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/2.jpg)
Introductions
Original Software
SQA & AQM - 14 years
500 customers
Home of
» Code free automation
» Dynamic Manual testing
» Top to bottom
Tim Bower (me)
Very Old
Developer, Tester, BA
Been in IT since it was called DP
![Page 3: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/3.jpg)
History of Testing
Until 1956 – Debugging oriented
1957–1978 – Demonstration
oriented
1979 – Glenford J. Meyers
introduced the separation between
debugging and testing
1979-1982 – Destruction oriented
1983-1987 – Evaluation oriented
1988-2000 – Prevention oriented
![Page 4: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/4.jpg)
History of Testing Tools
Y2K - very significant event
Test Automation gained the
‘spotlight’ in the 1990s as a
result of the impending event
Mercury Interactive’s WinRunner
– Possibly the most famous
First ‘tool’ appeared 29 years
ago
![Page 5: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/5.jpg)
Tool writers have been busy…
![Page 6: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/6.jpg)
Market According to Gartner
![Page 7: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/7.jpg)
Management Driven Testing
![Page 8: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/8.jpg)
Management View of ALM
Design Build Test Deploy
Design Build Test Deploy
![Page 9: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/9.jpg)
What it feels like……
Build
Test
Deploy Design Test
![Page 10: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/10.jpg)
Hands up all QA/Testing engineers and managers
Keep your hands up if you report into the development function
Now hands up if reporting into the business
And finally hands up if into an independent Head of QA
Quality in the organisation
![Page 11: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/11.jpg)
Management view….
I want these systems
delivered sooner and
working perfectly.
Why can’t I have that?
A fair question?
![Page 12: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/12.jpg)
Testing Bottleneck.
Needs automation.
That did not help.
Need experts. A TCOE!
That did not help.
Offshore it.
That did not help.
The problem moved
Agile!
Testing Industry Evolution
B
T
D
Time passes…..
![Page 13: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/13.jpg)
Agile means…
![Page 14: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/14.jpg)
Alignment of Teams
![Page 15: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/15.jpg)
What is the point of tools?
Better
Faster
Cheaper
Productivity
Quality
Silver bullet?
![Page 16: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/16.jpg)
Science project or get in & go?
![Page 17: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/17.jpg)
Scripting code
![Page 18: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/18.jpg)
Code
Line
Coded testing
Test automation
![Page 19: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/19.jpg)
Easy to learn
Easy & quick to build
Easy to update
Extendable
Full function
Robust to change
Reliable
Widely applicable in the team Dev, QA, UAT, BAU…
Modern Automation Requirements
![Page 20: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/20.jpg)
Afterthought Regression
Sp 1 Sp 2 Sp 3 Sp 4 Build regression
Not a separate sprint.
Sp 1 Sp 2 Sp 3 Sp 4
Regn Regn Regn
Not overflowing the sprint.
![Page 21: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/21.jpg)
Regression Deliverable
Des
Code
FT
RT
Sprint 1 Sprint 2 Sprint 3
ReF
Des
Code
FT
RT
ReF
Des
Code
FT
RT
ReF
Design
Code, TDD
Refactor
Functional Test
Regression Test
Regression in each sprint
Easy, Flexible
Avoid toxic debt – bugs and scripts
![Page 22: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/22.jpg)
Automation is the use of machines, control
systems and information technologies to
optimize productivity in the production of goods
and delivery of services.
The correct incentive for applying automation is
to increase productivity, and/or quality beyond
that possible with current human labor levels so
as to realize economies of scale, and/or realize
predictable quality levels.
Agile Automation
![Page 23: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/23.jpg)
Automated Manual Testing
Evolve into automation
Not specialist skills
Quick to build
Disposable if necessary
Can be built upon
Helps the team
and delivers when
Done is Done!
Agile Automation
![Page 24: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/24.jpg)
AQM Challenges
Collaboration
Metrics
Traceability
Presentation of Metrics and Results
Frequency
Recency
Baselines and Versions
Workflow
Data
Knowledgebase
![Page 25: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/25.jpg)
Defining the Solution
Agility
Flexibility
Velocity
Applicability
Integration
Cost of ownership
![Page 26: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/26.jpg)
AQM breadth and depth
![Page 27: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/27.jpg)
Measure
![Page 28: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/28.jpg)
Predict
![Page 29: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/29.jpg)
Respond
![Page 30: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/30.jpg)
Automation heavily reliant on code will slow you
down.
Employ technology to help all parties,
technology they can use.
Encourage collaboration and unite the team
Quality is a team responsibility.
Get immediate, relevant data to manage by.
Conclusion
![Page 31: Shaping the Future of Testing Tools](https://reader033.vdocuments.mx/reader033/viewer/2022060120/5591a8681a28ab384e8b459e/html5/thumbnails/31.jpg)
Questions?
Tim Bower – [email protected]
www.origsoft.com
Please fill out our feedback form as you leave