Download - Shift left-devoxx-pl
#DevoxxPL#DevoxxPL @wakaleo
SHIFT-LEFTThe role of the tester in a DevOps World
@wakaleo
www.johnfergusonsmart.com
#DevoxxPL#DevoxxPL @wakaleo
Change is not constant
Change is accelerating
#DevoxxPL#DevoxxPL @wakaleo
Don’t work in silos
Modern test teams…
#DevoxxPL#DevoxxPL @wakaleo
Prevent more bugs than they find
Modern test teams…
#DevoxxPL#DevoxxPL @wakaleo
Engage early
Modern test teams…
#DevoxxPL#DevoxxPL @wakaleo
Master automation
Modern test teams…
#DevoxxPL#DevoxxPL @wakaleo
Play with production
Modern test teams…
#DevoxxPL#DevoxxPL @wakaleo
How can testers stay at the top of their game?
#DevoxxPL#DevoxxPL @wakaleo
440x faster lead time
5x lower change failure rate
DevOps is…
96x faster mean time to recover
#DevoxxPL#DevoxxPL @wakaleo
But deploying a broken product faster does not make it any less broken
#DevoxxPL#DevoxxPL @wakaleo
But deploying a useless product faster does not make it any more useful
#DevoxxPL#DevoxxPL @wakaleo
Rapid
ReliableRelevant
Quick to deploy, quick to test
Verified by automated testing at multiple levels
Driven by a deep understanding of business needs
DevOps is…
#DevoxxPL#DevoxxPL @wakaleo
Shift-LeftRequirements
Discovery Stretch rightProduction Monitoring and testing
Lift upBetter, faster automation
Push
out
Exploratory testing
Traditional testing
#DevoxxPL#DevoxxPL @wakaleo
Shift-LeftRequirements
Discovery Stretch rightProduction Monitoring and testing
Lift upBetter, faster automation
Push
out
Exploratory testing
Traditional testing
#DevoxxPL#DevoxxPL @wakaleo
The $600,000 Tester
#DevoxxPL#DevoxxPL @wakaleo
Left-Shifting
Embracing uncertainty earlier rather than later
#DevoxxPL#DevoxxPL @wakaleo
Business
BA
Developers
As a corporate frequent flyer I want to earn points on my business flights So that I can get discounts on my holiday flights
Scenario: First class earns double points Given I fly from London to Paris When I am in First Class Then I should earn twice as many points …
Testers
TEST SCRIPT… … …
#DevoxxPL#DevoxxPL @wakaleo
Business
BA
Developers
As a corporate frequent flyer I want to earn points on my business flights So that I can get discounts on my holiday flights
Scenario: First class earns double points Given I fly from London to Paris When I am in First Class Then I should earn twice as many points …
Testers
TEST SCRIPT… … …
rework
misinterpretation
missed opportunities
#DevoxxPL#DevoxxPL @wakaleo
#DevoxxPL#DevoxxPL @wakaleo
source: - 44% - “Out of Control - Why Control Systems Go Wrong and How to Prevent Failure” - 56% - “An Information Systems Manifesto” - 80% - “Requirements: A quick and inexpensive way to improve testing”
44-80%of all defects are caused by unclear, ambiguous or incorrect requirements
#DevoxxPL#DevoxxPL @wakaleo
Business
BA
Developers
Testers
As a corporate frequent flyer I want to earn points on my business flights So that I can get discounts on my holiday flights
Examples
Rules
Acceptance Criteria
SHARED UNDERSTANDING
Executable Specifications
Scenario: First class earns double points Given I fly from London to Paris When I am in First Class Then I should earn twice as many points
Scenario: First class earns double points Given I fly from London to Paris When I am in First Class Then I should earn twice as many points
Development and exploratory testing
#DevoxxPL#DevoxxPL @wakaleo
The Advocate
#DevoxxPL#DevoxxPL @wakaleo
The Sceptic
#DevoxxPL#DevoxxPL @wakaleo
The Cross-Examiner
#DevoxxPL#DevoxxPL @wakaleo
Advocate
Sceptic Cross-Examiner
What should it do?
How can it work?What can go wrong? How can we prove it works?
#DevoxxPL#DevoxxPL @wakaleo
Shift-LeftRequirements
Discovery Stretch rightProduction Monitoring and testing
Lift upBetter, faster automation
Push
out
Exploratory testing
Traditional testing
#DevoxxPL#DevoxxPL @wakaleo
If you don’t master automation
You become a slave to automation
#DevoxxPL#DevoxxPL @wakaleo
Are wary of vendor hype
Successful DevOps teams
#DevoxxPL#DevoxxPL @wakaleo
Treat their test automation code like their production code
Successful DevOps teams
#DevoxxPL#DevoxxPL @wakaleo
Make their application testable
Successful DevOps teams
#DevoxxPL#DevoxxPL @wakaleo
Use layers of abstraction well
Successful DevOps teams
#DevoxxPL#DevoxxPL @wakaleo
Obsess over feedback
Successful DevOps teams
#DevoxxPL#DevoxxPL @wakaleo
Good DevOps tests are FAST
Fast
#DevoxxPL#DevoxxPL @wakaleo
Good DevOps tests are FAST
FastActionable
#DevoxxPL#DevoxxPL @wakaleo
Good DevOps tests are FAST
FastActionableScalable
#DevoxxPL#DevoxxPL @wakaleo
Good DevOps tests are FAST
FastActionable
TrustworthyScalable
#DevoxxPL#DevoxxPL @wakaleo
Shift-LeftRequirements
Discovery Stretch rightProduction Monitoring and testing
Lift upBetter, faster automation
Push
out
Exploratory testing
Traditional testing
#DevoxxPL#DevoxxPL @wakaleo
FAKE NEWS!
#DevoxxPL#DevoxxPL @wakaleo
Practice Continuous Testing
Successful DevOps teams
#DevoxxPL#DevoxxPL @wakaleo
Unleash the Monkeys of Chaos
"The best defence against major unexpected failures is to fail often. By frequently causing failures, we force our services to be built in a
way that is more resilient”
- Netflix engineer Cory Bennett and executive Ariel Tseitlin
#DevoxxPL#DevoxxPL @wakaleo
Shift-LeftRequirements
Discovery Stretch rightProduction Monitoring and testing
Lift upBetter, faster automation
Push
out
Exploratory testing
Traditional testing
#DevoxxPL#DevoxxPL @wakaleo
SCARLETCRIMSON
#DevoxxPL#DevoxxPL @wakaleo
REDRED
#DevoxxPL#DevoxxPL @wakaleo
Test automation should serve the team
Not the other way round.
#DevoxxPL#DevoxxPL @wakaleo
The six stages of QA DevOps Maturity
Name Focus Benefits
#DevoxxPL#DevoxxPL @wakaleo
The six stages of QA DevOps Maturity
Name Focus Benefits
Siloed
#DevoxxPL#DevoxxPL @wakaleo
The six stages of QA DevOps Maturity
Name Focus Benefits
Colocated Breaking down the silos Reduce delivery bottlenecks
Siloed
#DevoxxPL#DevoxxPL @wakaleo
The six stages of QA DevOps Maturity
Name Focus Benefits
Engaged Improving collaboration Prevent bugs and deliver the right product
Colocated Breaking down the silos Reduce delivery bottlenecks
Siloed
#DevoxxPL#DevoxxPL @wakaleo
The six stages of QA DevOps Maturity
Name Focus Benefits
Mechanised Effective automation Deliver the right product faster
Engaged Improving collaboration Prevent bugs and deliver the right product
Colocated Breaking down the silos Reduce delivery bottlenecks
Siloed
#DevoxxPL#DevoxxPL @wakaleo
The six stages of QA DevOps Maturity
Name Focus Benefits
Pioneering Leverage Delight the customer
Mechanised Effective automation Deliver the right product faster
Engaged Improving collaboration Prevent bugs and deliver the right product
Colocated Breaking down the silos Reduce delivery bottlenecks
Siloed
#DevoxxPL#DevoxxPL @wakaleo
The six stages of QA DevOps Maturity
Name Focus Benefits
Projecting Experimentation Deliver value faster, and learning from it
Pioneering Leverage Delight the customer
Mechanised Effective automation Deliver the right product faster
Engaged Improving collaboration Prevent bugs and deliver the right product
Colocated Breaking down the silos Reduce delivery bottlenecks
Siloed
#DevoxxPL#DevoxxPL @wakaleo
Would you like to know more?
Subscribe to the newsletter
https://www.johnfergusonsmart.com
Read the book!
#DevoxxPL#DevoxxPL @wakaleo
QUESTIONS?
www.johnfergusonsmart.com
@wakaleo