qa in an agile world for agile and beyond 2015
TRANSCRIPT
![Page 2: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/2.jpg)
Agenda
2
● Role Setup (5 Minutes)
● Exercise 1 (2 Minutes)
● Agile QA In 3 Easy Steps (20 Minutes)
● Exercise 2 (15 Minutes)
● Q&A/Retro (5 Minutes)
![Page 3: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/3.jpg)
Role Setup
3
● Product Owner
● Architect
● QA
● Everyone Else is Developers
![Page 4: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/4.jpg)
Exercise 1
4
Stand Up
Stretch your arms above your head
Fold your arms
Are you left arm over right or right arm over
left?
![Page 5: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/5.jpg)
Exercise 1
5
Stretch your arms above your head
Fold your arms the opposite way
1. Could you do it?
2. Is it comfortable?
Change is uncomfortable. Be compassionate.
![Page 6: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/6.jpg)
Team/Organization Prerequisites
1. Teamful Practices
a. Customer is the locus of concern
b. Teams Survive Beyond Projects
c. Self-Organizing, Autonomous, Craftspeople
d. Coordination, Communication, Collaboration
i. Co-Located - High Trust
2. Craftsmanship/Continuous Improvement Practicesa. Retro’s
b. Exploratory Testing
c. Code Kata’s/WISE/Lunch’N’Learns/etc...
![Page 7: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/7.jpg)
Getting To Agile QA in 3 Easy Steps
1. Establish Quality Standards and a Definition of
Done
a. DOD for each phase of delivery
i. Story Done
ii. DEV Done
iii. Quality (Not Necessarily QA) Verified
b. Empower Team Ownership of Quality
c. Move Escalations/Discovered Defect to the top
of the Queue
![Page 8: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/8.jpg)
Getting To Agile QA in 3 Easy Steps
2. Gather Metrics and make them prominent
a. Code Quality
b. Delivery Velocity
c. Defects
d. Performance
e. Others….
Not A Bludgeon!
Make it easy for people to do the right things
![Page 9: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/9.jpg)
Getting To Agile QA in 3 Easy Steps
3. Automate Everything
a. Testing
i. All Possible Layers
b. Builds
c. Releases
![Page 10: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/10.jpg)
What Is Different?
10
● Big Definition Up Front vs Emergent Design
● Adaption vs Prediction
● Short vs Long Iterations
● Short vs Long Customer Feedback Loops
● Working Software Baked In vs Tested In
● Whole Team Quality Ownership vs QA
● Automated vs Manual (Test, Build, Release)
● And so much more….
![Page 11: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/11.jpg)
BDUF - Big Definition Up
Front
11
![Page 12: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/12.jpg)
Adaption vs Prediction
12
● Tradition tries to understand how things will work and
defines architecture up front
● Tradition makes change hard to accommodate.
● Agile embraces emergent design and adapts as a system
evolves.
● Agile embraces change.
![Page 13: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/13.jpg)
Last Responsible Moment
13
![Page 14: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/14.jpg)
Long vs Short Iterations &
Customer Feedback Loops
14
● Agile anticipates releases to PROD more and more
often…sometimes even multiple times a day
● Testing starts earlier, happens more often and relies almost
entirely on automation to include build automation
● Agile wants feedback weekly at the BV Demo
![Page 15: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/15.jpg)
Otto The Autopilot
15
![Page 16: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/16.jpg)
Working Software & Quality Ownership
16
● Tradition uses QA to verify functionality after development
● Traditional relies on QA to test and verify and “Own”
quality and as a result hands responsibility for quality
over to QA
● Test Drive
● Automate Testing
● Verify working software during and after development
● Bake Quality In
![Page 17: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/17.jpg)
Bake Quality In…
We Cannot Improve Our Recipe’s By Eating More
Cookies…
We Must Bake, Rather Than Try To Test Quality In!
![Page 18: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/18.jpg)
Testing Pyramid
![Page 19: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/19.jpg)
19
Agile Does Not Move At Manual Testing
Speed
![Page 20: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/20.jpg)
Automation (Test, Build, Release)
20
● Is anyone still testing manually?
● The slow manual testing practices of traditional QA will not
be sufficient to meet the new pace of iterative development
● If a full manual testing cycle is more than a week, then a
new testing cycle is needed as soon as the last deployment is
complete
![Page 21: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/21.jpg)
Getting To Agile QA in 3 Easy Steps
Culture of Quality
Organic Not Mechanical
Team Confidence is the Goal
Swagger is Good!
1. Establish Quality Standards and a Definition of
Done
2. Track and Make Metrics Prominent
3. Automate Everything
![Page 22: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/22.jpg)
Team Confidence
22
● Confidence in the codebase is the key to:
● Generating
momentum
● Having choices
● Velocity
● Autonomy
● Adaptability
● Competitive
advantage
● And the inherent
propensity for
innovation and
luck
![Page 23: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/23.jpg)
Traditional Team Ownership of Quality
● Historically QA has been:◦ An event that occurs after development is done
⚫ Point in time validation rather than an ongoing standard for quality
⚫ Verification before production launch
◦ Held by QA ⚫ Not part of “Definition of Done” for the team
⚫ Not part of what every member of the team was committed to uphold.
◦ Part of a rigid sequential process⚫ At the end of development
⚫ An event rather than an ongoing concern
![Page 24: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/24.jpg)
Whole Team Ownership
● Quality as a fundamental ongoing concern for the team◦ Not just at the end of a release
◦ Meeting quality standards has become a part of the “Definition of Done” for the whole team
● An Integrated Team Focus◦ Teams take ownership
⚫ Definition of Done
⚫ Quality Standards
⚫ Level of quality being produced every day
● Business Verification◦ Weekly verification demo
◦ Product Owner Drives the Demo
![Page 25: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/25.jpg)
Exercise 2
25
Review Designs for Feasibility (2 Min)
Iteratively:
1. Estimate Production (1 Min)
2. Develop/Quality Check Plane(s) (4 Min)
3. Retro & Metrics ( 2 Min)
2 Iterations
Report outs
![Page 26: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/26.jpg)
Exercise 2 Success Criteria
26
● 1 Plane must gently fly 18 feet
● Plane must have a 5 point star on the
underside of each of the wings
● Plane cannot have any markings on the
topside of the wings
● Team must capture:
◦ Estimated Production vs Actual Production
◦ Defects Found (Pre-Dev, Dev, Testing)
![Page 27: QA in an Agile World for Agile and Beyond 2015](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55adf48f1a28abdd078b4764/html5/thumbnails/27.jpg)
Questions● Did you feel constrained to use a design
from the packet?
● Did the team own quality or did the QA
role?
● Did you capture accurate metrics?
● Did you make more than one plane? (Over-
achievers)