dashboards don't work - unless you have a metrics management strategy

81
Dashboards Don’t Work (Without a strategy for managing metrics!)

Upload: teamquest-corporation

Post on 15-Feb-2017

372 views

Category:

Leadership & Management


0 download

TRANSCRIPT

Page 1: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Dashboards Don’t Work(Without a strategy for managing metrics!)

Page 3: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

How to Communicate IT’s Value to Execs through Metrics Optimizing Communications through Visualization Transforming Operations Metrics into Business Value

Today’s Agenda

Page 5: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Operations Leadership

BVDs

Strategic Insights

Business Value Metrics

Leveraging Metrics to Communicate with Leadership

Page 6: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

As you go higher in the organization, the scope of metrics expands and the need for summarization increases

Metrics empower all levels of management Teams focus on operations

Page 7: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

As you go higher in the organization, the scope of metrics expands and the need for summarization increases

Metrics empower all levels of management Teams focus on operations Senior managers provide leadership,

direction, and oversight

Page 8: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Metrics empower all levels of management Teams focus on operations Senior managers provide leadership,

direction, and oversight Executives concentrate on decisions that

shape the company

Each level has a unique profile Tailored and interconnected metrics

As you go higher in the organization, the scope of metrics expands and the need for summarization increases

Page 9: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Organizational Transparency through Metrics

Page 10: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

= Key metrics that develop penetrating understanding Must be valuable to the user, worthy of attention “a bite-sized chunk of knowledge” for rapid review

Types include any combination of: Inform – Educate, provide context and/or talking points

Awareness – Make aware of current status, recent events

Progress – Show trending vs. baselines

Results – Metrics showing results vs. targets & objectives

Anticipate – Leading indicators, contributing factors

What are strategic insights?

Page 11: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

StrategicInsights

Execs

ExecBriefing

BriefingNotes

SeniorLeaders

SummaryRollups

BriefingNotes

Ops Teams

MgmtTools

TheBusiness

Middle Mgmt

Operations Dashboards and

Reports

Strategic Insights

Page 12: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

New insights from combining metrics Added areas make framework richer

ITOM

Other InternalSupporting

Areas

IndustryBenchmarks

StrategicInsights

Layer other areas Marketing, Sales, Finance, HR, etc. Intertwine results with the business

Industry metrics as baseline comparison

Market share, cust sat, profitability, efficiency, etc.

Strategic Insights

InternalCore Areas

ITSM

GSE

Sale

s

FinanceMarketi

ng

Manuf.

Efficiency

Profitability

Field Svcs

Int’lSIE

M

Page 14: Dashboards Don't Work - Unless You Have a Metrics Management Strategy
Page 15: Dashboards Don't Work - Unless You Have a Metrics Management Strategy
Page 16: Dashboards Don't Work - Unless You Have a Metrics Management Strategy
Page 17: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

2014-Q1 2014-Q2 2014-Q3 2014-Q4 2015-Q1 2015-Q2 2015-Q3 2015-Q4 2016-Q1

Aggregate Risk Score

7282 89

65

42

Risk Score

Page 18: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

2014-Q1 2014-Q2 2014-Q3 2014-Q4 2015-Q1 2015-Q2 2015-Q3 2015-Q4 2016-Q1

20

40

60

80

100

Major Apps Released

Risk Score to App Deployment

89

1320

5862

75

105110

95

Risk Score

7282 89

65

42

Major A

pplication Release C

ount

Page 19: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

2014-Q1 2014-Q2 2014-Q3 2014-Q4 2015-Q1 2015-Q2 2015-Q3 2015-Q4 2016-Q1

20

40

60

80

100

Emergency Change Volume Major Apps Released

App Deployment to Emergency Change Volume

89

1320

5862

75

105110

95

Risk Score

7282 89

65

42

Major A

pplication Release C

ount

Page 20: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

1.75 1.82.15

2.2

2.482.9 3.09 3.12

3.4

2014-Q1 2014-Q2 2014-Q3 2014-Q4 2015-Q1 2015-Q2 2015-Q3 2015-Q4 2016-Q1

I&O

Mat

urity

Lev

el

1

2

3

4

5

20

40

60

80

100

Major A

pplication Release C

ount

Emergency Change Volume Major Apps Released

Operations Impact of I&O Maturity

89

1320

5862

75

105110

95

Risk Score (Capacity)

7282 89

65

42

I&O Organizational Maturity

Page 21: Dashboards Don't Work - Unless You Have a Metrics Management Strategy
Page 22: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

55 Executive Metrics and Reporting Tenets

Tenetsfor executive metrics and reporting

Page 23: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

transparency1Tenet

5 Executive Metrics and Reporting Tenets

Page 24: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Organizational Transparency through Metrics

Page 25: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

automation2Tenet

5 Executive Metrics and Reporting Tenets

Page 26: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

5 Executive Metrics and Reporting Tenets: Automation

Page 27: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

clarity3Tenet

5 Executive Metrics and Reporting Tenets

Page 28: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

5 Executive Metrics and Reporting Tenets: Clarity

Executive view: Answers the question ‘Is there anything I should focus on right now?’

HOW ARE THINGS TODAY?

Page 29: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

5 Executive Metrics and Reporting Tenets: Clarity

Page 30: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

5 Executive Metrics and Reporting Tenets: Clarity

Page 31: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

5 Executive Metrics and Reporting Tenets: Clarity

Page 32: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

context4Tenet

5 Executive Metrics and Reporting Tenets

Page 33: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Overall IT Performance

Too Low

Medium

Real Good

2016 Target

FY16 Productivity Targets exceeded as a result of certification program, we all get a

bonus

5 Executive Metrics and Reporting Tenets: Context

Page 34: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

5 Executive Metrics and Reporting Tenets

continualimprovement5Tenet

Page 35: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

5 Executive Metrics and Reporting Tenets: Continual Improvement

Page 36: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

5 Executive Metrics and Reporting Tenets Transparency

Open access to performance measures that apply to all organizational levels, top-to-bottom.

AutomationEliminate manual handling and consolidation where possible to reduce errors and report latency. Automation builds trust and confidence.

ClarityUnambiguous as to what metrics are, what they mean, who they are for and why they are important.

ContextAnswers the question ‘So what?’

Continual Improvement Metrics and performance management is not a ‘project’ with a finite end. It is a process that will continue as the business evolves.

Page 37: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

5 Executive Metrics and Reporting Tenets Transparency

Open access to performance measures that apply to all organizational levels, top-to-bottom.

AutomationEliminate manual handling and consolidation where possible to reduce errors and report latency. Automation builds trust and confidence.

ClarityUnambiguous as to what metrics are, what they mean, who they are for and why they are important.

ContextAnswers the question ‘So what?’

Continual Improvement Metrics and performance management is not a ‘project’ with a finite end. It is a process that will continue as the business evolves.

Page 38: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

How to Communicate IT’s Value to Execs through Metrics Optimizing Communications through Visualization Transforming Operations Metrics into Business Value

Today’s Agenda

Page 39: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Graphic Visualization IQ TestPick the graphic that you think is easier to understand: A or B

B

A

Page 40: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

BA B

Page 41: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A B

Studies have found that it is more difficult for people to judge differences in area, such as slices of pie, than it is to judge differences in length such as the length of bars.

Page 42: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

AA B

Page 43: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A B

Making objects in a graph appear 3-D adds no value and usually makes the values harder to read and compare as you can see in example B.

Page 44: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A B

Page 45: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A B

The grid, fill colors, unnecessary precision, and redundant use of the dollar signs in the table A all distract from the data and make it unnecessarily difficult to read and compare values.

Page 46: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A

B

Page 47: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A

B

Bars work very well for comparing differences in magnitude, but when you need to see the shape of change over time, nothing is more effective that a line.

Page 48: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

AA B

Page 49: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A B

Graph A lies. Because the bars start at 2,000 instead of 0, their respective height differences have been greatly exaggerated.

Page 50: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

AA B

Page 51: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A B

To use Map B, you’re required to memorize the meanings of seven colors (which exceeds the limits of short term memory) or constantly refer to the legend. With Map A, you can remember the meanings of red and blue, and the rest is intuitive.

Page 52: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A

B

Page 53: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A

B

This isn’t a video game! 3-D effects make graphs harder to read and can hide some of the values altogether, through occlusion. The small ‘multiples’ display allows for easy comparison of all of the bars.

Page 54: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

AA B

Page 55: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A B

Vertically-oriented or angled text is much harder to read than horizontally oriented text.

Page 56: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A

B

Page 57: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A

B

Look at the graphs before answering! Bright colors are important for making things stand out but when they’re overused nothing stands out and it becomes more difficult to focus on the data.

Page 58: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A

B

Page 59: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

A

B

Color should be used sparingly. Overuse of color is distracting. Additionally, when everything is colored, the most important things don’t jump out as they should.

Page 60: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Now here is your chance to be a dashboard critic!

Page 61: Dashboards Don't Work - Unless You Have a Metrics Management Strategy
Page 62: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

• How to Communicate IT’s Value to Execs through Metrics• Optimizing Communications through Visualization• Transforming Operations Metrics into Business Value

Today’s Agenda

Page 63: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Business ValueMetrics Leadership

Eliminate below-the-line information in above-the-line communication,but maintain continuity in views so that below-the-line details are always accessible when needed.

‘The Line’Above-the-Line Metrics

Below-the-Line Metrics

Operations Metrics

Management

Operations

Page 64: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Operations Metrics

Tool-level Process metrics Technical/Operations-level focus

Business ValueMetrics

Align priorities and investment with business strategy Provide transparency of operation and cost Showcase business value

BV versus Operations Metrics

Page 65: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Operations Metrics Summarized in Business Dimensions

Page 66: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Operations Metrics Summarized in Business Dimensions

Page 67: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

ITSM IT Service MgmtDash Template

ITOM IT OperationsManagement

Operations MetricsOperations

Page 68: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Copyright © 2016 TeamQuest Corporation. All Rights Reserved.

Customers

Leadership

Management

Staff

Connect - Collect - Consolidate - Organize - Rationalize - Publish - Action

Automation

Metrics Catalog

Visualization Presentation

MetricsDatabase

Dimensions Aliasing

FormulasAttributes

Metrics Catalog

Page 69: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

BusinessDimensions

ITSM IT Service MgmtDash Template

ITOM IT OperationsManagement

Operations MetricsOperations

Management

Page 70: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

BusinessDimensions

GRC Governance,

Risk Management and Compliance

ITSM IT Service MgmtDash Template

ITOM IT OperationsManagement

ITAM IT Asset

Management

Operations MetricsOperations

Management

Page 71: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Core Business Metrics

BusinessDimensions

GRC Governance,

Risk Management and Compliance

ITSM IT Service MgmtDash Template

ITOM IT OperationsManagement

ITAM IT Asset

Management

SIAMService Integrationand Management

SIEMSecurity Information

and Event Mgmt

CCMContact Center

Metrics Template

BVDBusiness Value

Dashboards for IT

Operations Metrics

Business ValueMetrics

Operations

Management

Leadership

Page 72: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Starting down the Business Value path?

WHY?

Page 73: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Business Value Metrics and Dashboards:

1. Eliminate your leadership’s need for to constantly justify budget

2. Quantify how people, process and technology help business

3. Build business agility4. Become operationally mandatory

Page 74: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Starting down the BVD path? Here are the steps:

1. Get support Obtain key leadership support for an incremental but

sweeping metrics initiative. Leverage controversial metrics if needed to stimulate

conversation with leadership.

P1 Cost per Minute = $2,666,666

Page 75: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

The Path to Business Value Dashboards

1. Get support2. Discover pressing, unanswered ‘above-the-line’ questions

Collaborate with leadership to find pressing questions BVDs can answer, including finding the proper way to present answers.

How much has IT investment added to the business bottom line?

Page 76: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

The Path to Business Value Dashboards

1. Get support2. Discover pressing, unanswered ‘above-the-line’ questions3. Catalog the process required to derive business-value metrics

+ = BVD

Page 77: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

The Path to Business Value Dashboards

1. Get support2. Discover pressing, unanswered ‘above-the-line’ questions3. Catalog the process required to derive business-value metrics4. Test and validate. Your audience knows its metrics and sound

numbers boost credibility

Page 78: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

The Path to Business Value Dashboards

1. Get support2. Discover pressing, unanswered ‘above-the-line’ questions3. Catalog the process required to derive business-value metrics4. Test and validate. Your audience knows its metrics and sound

numbers boost credibility.5. Incrementally expand metrics footprint, automate

where possible

Page 79: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

People Processes Technology Resources

Organization, Roles, Culture, Skills, Training

Metrics

Focus, Standards, Integration, Metrics

Standards, Efficiency, Agility, Service Quality,

Tools, Metrics

Planning, Financial Management, Metrics, Governance, Sourcing, Project Management

Advancing Organizational Maturity through Metrics

Page 80: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

1. Metrics can significantly impact business outcomes2. Dashboards don’t work (without a metrics strategy)3. Access to answers should be effortless!

In Summary:

Page 81: Dashboards Don't Work - Unless You Have a Metrics Management Strategy

Connect IT to the business value it delivers

Automated capacity managementintelligence

Analyze real-time and historical IT performance

Vityl Suite