#agilebizconf18 coaching in a data-driven world · nicolas brown, agile lead [email protected]...
TRANSCRIPT
![Page 2: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/2.jpg)
TLDR;Stop using metrics as targets.
Use metrics as a coaching aid to inform, to have safe
conversations, open questions and model curiosity.
![Page 3: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/3.jpg)
The growth in metric obsession
#AgileBizConf18 @nbrown02
![Page 4: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/4.jpg)
Which of the following best describes decision-making in your organisation?
8%Rarely data-driven
Somewhat data-driven
Highly data-driven
53%
39%
PwC's Global Data and Analytics Survey: Big Decisions TM. Base: 2,106 senior executives
#AgileBizConf18 @nbrown02
![Page 5: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/5.jpg)
“When a measure becomes a target, it ceases to be a good measure”
- Charles Goodhart
![Page 6: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/6.jpg)
![Page 7: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/7.jpg)
![Page 8: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/8.jpg)
Commissioner Ervin Burrell
Deputy Commissioner Bill Rawls
![Page 9: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/9.jpg)
Police Majors & Lieutenants
![Page 10: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/10.jpg)
![Page 11: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/11.jpg)
No more murders.You will reduce the felony rate by 5% or
more or….let no man come
back alive
![Page 12: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/12.jpg)
Anyone of you who can’t bring in the numbers we need will be replaced by
someone who can
![Page 13: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/13.jpg)
Major Bunny Colvin
![Page 14: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/14.jpg)
![Page 15: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/15.jpg)
“Hamsterdam”
![Page 16: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/16.jpg)
We’ve had a 14% dropin felony rate over the
last 4 weeks
![Page 17: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/17.jpg)
Ah yes, now I am happy. You won’t mind if I
check your numbers will you?
![Page 18: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/18.jpg)
![Page 19: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/19.jpg)
![Page 20: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/20.jpg)
![Page 21: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/21.jpg)
![Page 22: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/22.jpg)
The tyranny of metrics
#AgileBizConf18 @nbrown02
● Penalizing hospitals based on the percentage of patients who fail to survive for thirty days beyond surgery
Patients sometimes kept alive for thirty-one days, so that their mortality is not reflected in the hospitals metrics
● The National Health Service (NHS) decided that wait times were too long for patients to enter emergency wards, moving to evaluating hospitals based on what extent patients were admitted within four hours
Some hospitals responded by keeping incoming patients in queues of ambulances outside the hospital doors, until staff were confident that the patient could be seen within the allotted four hours of being admitted
● No Child Left Behind (NCLB) legislation measured students grades 3-8 each year in math, reading and science. Aiming to bring all students to academic proficiency whilst penalising and sanctioning schoolswhere students did not progress
Teachers diverted class time to teaching the subjects tested, neglecting other subjects as well as reclassifying weaker students as disabled (thus removing from the assessment pool), altering results, reducing test difficulty or lowering the grades needed to pass them
![Page 23: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/23.jpg)
The tyranny of velocity?
#AgileBizConf18 @nbrown02
![Page 24: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/24.jpg)
The tyranny of velocity?
#AgileBizConf18 @nbrown02
![Page 25: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/25.jpg)
The tyranny of velocity?
#AgileBizConf18 @nbrown02
![Page 26: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/26.jpg)
The tyranny of velocity?
#AgileBizConf18 @nbrown02
![Page 27: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/27.jpg)
Police Majors & LieutenantsAgile Project Managers/ Scrum Masters
![Page 28: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/28.jpg)
You asked to improve velocity
and I have delivered.
We are now Agile.
![Page 29: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/29.jpg)
We are so friggin agile...
![Page 30: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/30.jpg)
![Page 31: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/31.jpg)
So long as I have increased velocity, none
of this will matter
HamsterdamTechnical Debt
![Page 32: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/32.jpg)
![Page 33: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/33.jpg)
Two-thirds of the population are visual-spatial learners
![Page 34: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/34.jpg)
Agile experience in relation to hair
Date2017 2018201620152014
?
Vo
lum
e
?
2013
#AgileBizConf18 @nbrown02
![Page 35: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/35.jpg)
Our Agile roots...
#AgileBizConf18 @nbrown02
Transparency
Inspection
Adaptation
Scrum
![Page 36: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/36.jpg)
Data-based coaching uses data visualisation as a basis for safe conversations and open questions, as well as facilitating more informed, transparent decision making whilst staying true to our Agile roots...
#AgileBizConf18 @nbrown02
![Page 37: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/37.jpg)
Data-based retrospectives
#AgileBizConf18 @nbrown02
Let’s take anything above 10
days - what happened?
-Better BDD needed- Work as a team when it’s not working
- Too long for PO feedback (20 days!)- Better DoR check needed as was not met
PO Feedback
Data not available
(improve DoR)
Rework due to tech debt
- Better DoR check needed- Flowed quickly once sat with the SME
Delayed due to lack of clarity on deployment
Data not available
(improve DoR)
![Page 38: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/38.jpg)
Data-based retrospectives
#AgileBizConf18 @nbrown02
What principles could these relate
to?
-Better BDD needed- Work as a team when it’s not working
- Too long for PO feedback (20 days!)- Better DoR check needed as was not met
PO Feedback
Data not available
(improve DoR)
Rework due to tech debt
- Better DoR check needed- Flowed quickly once sat with the SME
Delayed due to lack of clarity on deployment
Data not available
(improve DoR)
![Page 39: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/39.jpg)
Data-based retrospectives
#AgileBizConf18 @nbrown02
What principles could these relate
to?
Continuous attention to
technical excellence
Feedback loops
Customer collaboration
Make process policies explicitMake process
policies explicit
Feedback loops
Customer collaboration
Feedback loops
Make process policies explicit
Make process policies explicit
Feedback loops
![Page 40: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/40.jpg)
Story Point Correlation
What happened
here?#NoEstimates?
Our sprints are 3 weeks long - why
could this be happening?
#AgileBizConf18 @nbrown02
![Page 41: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/41.jpg)
#AgileBizConf18 @nbrown02
The best so far!
![Page 42: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/42.jpg)
Landing Zone
#AgileBizConf18 @nbrown02
What is likely to happen?
What options are
there?
![Page 43: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/43.jpg)
Landing Zone
#AgileBizConf18 @nbrown02
What is likely to happen?
What options are
there?
![Page 44: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/44.jpg)
Potentially Deliverable Scope (PDS)
#AgileBizConf18 @nbrown02
What options
are there?
What is likely to
happen?
![Page 45: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/45.jpg)
Stop starting, start finishing
#AgileBizConf18 @nbrown02
What is happening?
![Page 46: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/46.jpg)
Backlog items are like bread
#AgileBizConf18 @nbrown02
What is the next best action?
What should I do?
![Page 47: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/47.jpg)
#AgileBizConf18 @nbrown02
Coaching in a data-driven world
Descriptivereporting
QuestionsWhere is the problem?Why is it happening?What are the trends?
What happened?What is happening?
Visuals
What should I do?What is the next best
action?
Diagnosticdiscover & explore
Predictiveforecast
Prescriptiveanticipative
- WIP Items per Week- Scatter Plot- Net flow per week
- Estimate Correlation- Flow Efficiency- Cumulative Flow (CFD)
- Stale Work- WIP by Person- Aged WIP
- PDS- Landing Zone (Burn-up)- Throughput Forecaster
What is likely to happen?
What options are there?
![Page 48: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/48.jpg)
#AgileBizConf18 @nbrown02
Further reading
● Dominica Degrandis - Making Work Visible - tiny.cc/workvisible
● Troy Magennis - Focused Objective - bit.ly/SimResources
● Dan Vacanti - Actionable Agile Metrics for Predictability - tiny.cc/danvac
● Jerry Z. Muller - The Tyranny of Metrics - tiny.cc/tyranny
● Goodhart, Charles (1981). "Problems of Monetary Management: The U.K. Experience"
● PwC's Global Data and Analytics Survey 2016
![Page 49: #AgileBizConf18 Coaching in a data-driven world · Nicolas Brown, Agile Lead nicolas.brown@pwc.com @nbrown02 #AgileBizConf18 Coaching in a data-driven world. TLDR; Stop using metrics](https://reader034.vdocuments.mx/reader034/viewer/2022042314/5f01c9417e708231d401070a/html5/thumbnails/49.jpg)
#AgileBizConf18 @nbrown02
Thank you
© 2017 PwC. All rights reserved.
PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.
Please see www.pwc.com/structure for further details.
Nicolas Brown, Agile [email protected]