do you even need to automate the gui?
TRANSCRIPT
Do You Even (Need) To Automate (The GUI)?
Matt Heusser 2017 Edition
The Great Lifting Irony
Setting Goals
VAPID goals:
Vague Amorphous Pie in the sky Irrelevant Delayed
Setting Goals
VAPID goals:
Vague Amorphous Pie in the sky Irrelevant Delayed
Sub-Optimization
Sub-Optimization II
Sub-Optimization III
de Automation Delay
What are estimates for?Five-Minute Provisioning
What about: * Continuous Integration yields builds * Create a test environment for a given build on-demand * Self-service * Within 5 minutes
What are estimates for?Unit Tests - Test Driven Development
• Measure Twice, Cut Once • Higher First-Time Quality • Less Regressions • Small, easy to separate components • … but we can’t • That is a design problem • TDD Enables good design
What are estimates for?Unit Tests - Test Driven Development
What are estimates for?Unit Tests - Test Driven Development
What are estimates for?Unit Tests - Test Driven Development
What are estimates for?Unit Tests - Test Driven Development
What are estimates for?Isolated Components and Service Contracts
What are estimates for?Deploy by Component
Why deploy the entire app when you can: - Deploy a single web service? - Deploy a single web page? - Deploy a single PHP file?
Continuous Monitoring
Right Project 90%Right StoryRight DesignRight CodeRight TestingRight Deploys
Improve First-Time Quality
Right Project 90%Right Requirements
90%
Right Design 90%Right Code 90%Right Testing 90%Right Deploys 90%
Improve First-Time Quality
Activity FTQ CumulativeRight Project 90% 90%Right Requirements
90% 81%
Right Design 90% 73%Right Code 90% 66%Right Testing 90% 59%Right Deploys 90% 53%
Improve First-Time Quality
Activity FTQ CumulativeRight Project 80% 80%Right Requirements
80% 64%
Right Design 80% 51%Right Code 80% 41%Right Testing 80% 33%Right Deploys 80% 26%
Improve First-Time Quality
Activity FTQ CumulativeRight Project 70% 70%Right Requirements
70% 49%
Right Design 70% 34%Right Code 70% 24%Right Testing 70% 17%Right Deploys 70% 12%
Improve First-Time Quality
Putting it all together
Deploys are local / micro Test environments are easy to create
Serious problems are rare Found quickly
local And easy to roll back
Putting it all together
What problems does mass-inspection GUI Automation solve?
Do we have them anymore? …
Do you even need to automate the GUI?
Deploys are local / microRegression-Testing can be triaged
Serious problems are rareFound quickly
localAnd easy to roll back
The Great Lifting Irony
Solution: Tool Assisted Testing
Combine human and machine for the best
attributes of each