data story toolkit updated 2020

24
Data Story Toolkit Project Three I want to have a standardized and user-centric process to create data stories..

Upload: others

Post on 10-Apr-2022

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Data Story Toolkit Updated 2020

Data Story ToolkitProject Three

“ I want to have a standardized and user-centric process to create data stories..

Page 2: Data Story Toolkit Updated 2020

User-centric design is misunderstood in the Business Intelligence world

+4.88% 7,200

+5.68% 5,765

+2.53% 3,200

-5.05% 2,544

+1.88% 6,100

-20.00% 4,300

+1.88% 6,731

At Risk PopulationsAverage Days Supply

Average Prescribers

5

1

1

1

N/A

2.2

1

664.22

161.31

207.5

39.15

N/A

40

171.42

Received treatment services

Neonatal Abstinence Syndrome (NAS)

First opioid prescription in 3 months

Non-fatal overdose

Received opioid prescription(s)

Substance Use Disorder and/ or Opioid Use Disorder diagnosis

Enrolled in Medication Assisted Treatment (MAT) Service

Members Count(Year-Over-Year)

Average Prescriptions(Year-Over-Year)

Total Net Paid(Year-Over-Year)

Male Female

Members age and gender(At Risk)

10,000

20,000

30,000

0 2-4 5-140-1 19-21 22-24 45-64 65-84 85+

Members

Age

Prescriptions - Morphine Milligram Equivalent Per Day(At Risk)

1000

2000

3000

0 50-89 90-990-49 100-200 >200

Prescriptions

Distribution of MME on Prescriptions

+3331, +5.95%5,000From 01/01/18 to 12/31/1832% of the State Providers

Total number of providers who prescribed opioid above 7 days supply in reporting period.

High Prescribing Providers

1,000

0MarJan Jun Sep Dec

5,000

+233, +48.5%543From 01/01/18 to 12/31/1810% of the At Risk Population

Total number of non-fatal opioid overdoses

Non-Fatal Opioid Overdoses

300

0MarJan DecJun Sep

600

CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.

RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).

Applicable FARS/DFARS Restrictions Apply to Government Use.

Licenses

U.S. Government Rights

Legend: Opioid Prescription Total Allowed AmountMember

Reporting Time Period: 01 Jan 2017 - 31 May 2018

Summary Utilization Opioid Risk

Opioid Epidemic Insights

IBM Watson Health and Human Services Analytics Foundation Hi Sue

View Report List

100 - 500 500 - 1000 1000 - 6000 > 6000

*Number represents member count

Members per County(At Risk)

Members with Multiple Opioid Prescriptions(At Risk)

Over 500 members 500 members or under

>25

25

20

15

10

5

0 2 3 51 4 6 >6

Prescriptions

Prescribers

July2017

July2017

Jun2017

Jun2017

Aug2017

Aug2017

Sep2017

Sep2017

Oct2017

Oct2017

Nov2017

Nov2017

Dec2017

Dec2017

Jan2018

Jan2018

Feb2018

Feb2018

Mar2018

Mar2018

Apr2018

Apr2018

May2018

May2018

45

Total Net Paid

Average Prescriptions

Patient Count

$74,309

42,840

50

$85,000

40

$75,000

30

$65,000

25

$60,000

45

$80,000

35

$70,000

40,000

30,000

20,000

15,000

35,000

25,000

At Risk Population (Month by Month)

NoneFilters applied:

+3331, +5.95%42,840From 01/01/18 to 12/31/1810% of the State Population

Total members identified as at risk in the reporting period

At Risk Opioid Populations

20,000

0MarJan DecJun Sep

40,000

Members identified as at risk of opioid dependance as they a members of an identified at risk cohort

At Risk: 42,840Members who belong to multiple opioid cohorts or have dangerous consumption behaviors.

High Risk: 5,000Members who have greater than 60 days supply of opioids in a 90 day period.

Chronic Risk: 543

Members Count Prescriptions Total Net Paid Previous Year

Page 3: Data Story Toolkit Updated 2020

Different user mental models (non-linear, safari)

Neglect of data

Distinction between business objectives and user needs

Evaluation of feasibility

Lack of highly domain-specific business knowledge

Doesn’t speak data scientists’ language

Knowledge of the BI tools and standards

No consensus on UX designer’s responsibility

Problem with Standard DT Exercises Designer Challenge

Page 4: Data Story Toolkit Updated 2020

A Data Story Toolkit Based on Design Thinking Framework

Business Outcome

Needs Statement

Story Template

Reasoning

Story Outline Wireframe

Translate top business objectives into user needs

Map user mental model and place data in context

Decide on the best structure to tell a compelling story and

visualize it

Page 5: Data Story Toolkit Updated 2020

Business Outcome

Need Statement

Story Template

Reasoning

Story Outline Wireframe

Page 6: Data Story Toolkit Updated 2020

Traditional Empathy Map

Key Takeaway

Focus on the actionable insights

Consider data sources

Actions that

Understand User Needs

Does Thinks

Says Feels

I do I want to

I need data I feel

Page 7: Data Story Toolkit Updated 2020

Write Need Statement

I do I want to

I need data I feel

To achieve a business outcome, a user needs to discover

actionable insights in the area of data sets.

Example: To achieve an annual saving of 5% on operational cost, a COO needs to discover excessively inefficient

administrative activities in the distribution chain.

Page 8: Data Story Toolkit Updated 2020

Business Outcome

Need Statement

Story Template

Reasoning

Story Outline Wireframe

Page 9: Data Story Toolkit Updated 2020

Intent

Questions

Data sources

Measures

Story TemplateComprehend Explore Monitor Evaluate

To achieve a business

outcome, a user needs to

discover actionable insights in

the area of data sets.

Page 10: Data Story Toolkit Updated 2020

Discovery Needs

Intent

Questions

Data sources

Measures

Comprehend Explore Monitor Evaluate Synthesize Test

Find

Compare

Analyze

Correlate

Model

These needs shaped via client research

n=744 Clients

Page 11: Data Story Toolkit Updated 2020

Business Outcome

Need Statement

Story Template

Reasoning

Story Outline Wireframe

Page 12: Data Story Toolkit Updated 2020

Intent

Questions

Data sources

Measures

ReasoningComprehend Explore Monitor Evaluate

Given the data sources and measures available, how many of these questions can be answered?A “compelling” story will have more questions answered on the latter part of this data discovery journey.

Question?

Question?

Question?

Question?

Question?

Question?

Question?

Question?

Question?

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Data Source

Data Source

Data Source

Data Source

Data Source

Data Source

I want to.. I want to.. I want to.. I want to..

Page 13: Data Story Toolkit Updated 2020

Discovery Needs

Intent

Questions

Data sources

Measures

Comprehend Explore Monitor Evaluate

Question?

Question?

Question?

Question?

Question?

Question?

Question?

Question?

Question?

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Measure

Data Source

Data Source

Data Source

Data Source

Data Source

Data Source

I want to.. I want to.. I want to.. I want to..

Question?

Question?

Question?

√X √ √ √ X

√ X√√

Page 14: Data Story Toolkit Updated 2020

Business Outcome

Need Statement

Story Template

Reasoning

Story Outline Wireframe

Page 15: Data Story Toolkit Updated 2020

Use lo-fi wireframes to validate information

structure, chart essentials and flows

Wireframe

Page 16: Data Story Toolkit Updated 2020

30 June 2019

01 July 2017

Report Time Period

Admissions Report List

IBM Watson and Human Services Analytics Foundation

Description

Admissions Net Paid Total

Trendline$120,000+2%

Description

Admissions - Total

Trendline45,000+2%

Admissions Key Performance Indicators % Change Total Trend

Description

Admissions Net Paid PMPY

Trendline$2,345+2%

Description

Average Net Paid Per Admission

Trendline$2,345+2%

Description

Admissions per 1000

Trendline500+2%

Top Admissions by Diagnostic Catefgory

Chart

Variables: Avoidable admissions % and cost

Potentially Avoidable Admissions

Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)

Chart

Readmissions Percentage

CardioVascular Disorder

Signs/Symptoms/Other Conditions NEC

Raspiratory Disorders

Diabetes

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

Infections

Injury

Headache

Category Net Paid per Admission PMPM PMPY

Chart

Variables: County, number of admissions

Admissions Per County

Admit Types

Surgical

Medical

Total Net Pay: $172053%

Total Net Pay: $172053%

Total Net Pay: $172053%

Maternity/Newborn

Total Net Pay: $172053%

Psychiatric/Substance Abuse

Total Net Pay: $172053%

Missing/Unknown

30 June 2019

01 July 2017

Report Time Period

Admissions Report List

IBM Watson and Human Services Analytics Foundation

CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.

RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).

Applicable FARS/DFARS Restrictions Apply to Government Use.

Licenses

U.S. Government Rights

Description

Admissions Net Paid Total

Trendline$120,000+2%

Description

Admissions - Total

Trendline45,000+2%

Admissions Key Performance Indicators % Change Total Trend

Description

Admissions Net Paid PMPY

Trendline$2,345+2%

Description

Average Net Paid Per Admission

Trendline$2,345+2%

Description

Admissions per 1000

Trendline500+2%

Top Admissions by Diagnostic Catefgory

Chart

Variables: Avoidable admissions % and cost

Potentially Avoidable Admissions

Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)

Chart

Readmissions Percentage

CardioVascular Disorder

Signs/Symptoms/Other Conditions NEC

Raspiratory Disorders

Diabetes

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

Infections

Injury

Headache

Category Net Paid per Admission PMPM PMPY

Chart

Variables: County, number of admissions

Admissions Per County

Admit Types

Surgical

Medical

Total Net Pay: $172053%

Total Net Pay: $172053%

Total Net Pay: $172053%

Maternity/Newborn

Total Net Pay: $172053%

Psychiatric/Substance Abuse

Total Net Pay: $172053%

Missing/UnknownInformation Structure

What are the main admission

categories or service groups

being admitted? Can I help prevent

these?

What is being spent on certain disease

categories by place setting?

(Outpatient, Inpatient , RX? actual and %)

How’s my cost compare to last

year?

What are the main inpatient visit

reasons conditions / surgeries etc?

What are the admissions and ER

visits costing ?

What are my admission trends?

How much are manageable

conditions costing me? Asthma, Depression,

Hypertension, Diabetes, CAD?

What are my top episodes by

member counts and cost?

I want to view detailed information about hospital admissions by population and care

plan.

Page 17: Data Story Toolkit Updated 2020

30 June 2019

01 July 2017

Report Time Period

Admissions Report List

IBM Watson and Human Services Analytics Foundation

Description

Admissions Net Paid Total

Trendline$120,000+2%

Description

Admissions - Total

Trendline45,000+2%

Admissions Key Performance Indicators % Change Total Trend

Description

Admissions Net Paid PMPY

Trendline$2,345+2%

Description

Average Net Paid Per Admission

Trendline$2,345+2%

Description

Admissions per 1000

Trendline500+2%

Top Admissions by Diagnostic Catefgory

Chart

Variables: Avoidable admissions % and cost

Potentially Avoidable Admissions

Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)

Chart

Readmissions Percentage

CardioVascular Disorder

Signs/Symptoms/Other Conditions NEC

Raspiratory Disorders

Diabetes

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

Infections

Injury

Headache

Category Net Paid per Admission PMPM PMPY

Chart

Variables: County, number of admissions

Admissions Per County

Admit Types

Surgical

Medical

Total Net Pay: $172053%

Total Net Pay: $172053%

Total Net Pay: $172053%

Maternity/Newborn

Total Net Pay: $172053%

Psychiatric/Substance Abuse

Total Net Pay: $172053%

Missing/Unknown

Chart Essentials

How’s my cost compare to last

year?

What are my admission trends?

30 June 2019

01 July 2017

Report Time Period

Admissions Report List

IBM Watson and Human Services Analytics Foundation

CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.

RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).

Applicable FARS/DFARS Restrictions Apply to Government Use.

Licenses

U.S. Government Rights

Description

Admissions Net Paid Total

Trendline$120,000+2%

Description

Admissions - Total

Trendline45,000+2%

Admissions Key Performance Indicators % Change Total Trend

Description

Admissions Net Paid PMPY

Trendline$2,345+2%

Description

Average Net Paid Per Admission

Trendline$2,345+2%

Description

Admissions per 1000

Trendline500+2%

Top Admissions by Diagnostic Catefgory

Chart

Variables: Avoidable admissions % and cost

Potentially Avoidable Admissions

Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)

Chart

Readmissions Percentage

CardioVascular Disorder

Signs/Symptoms/Other Conditions NEC

Raspiratory Disorders

Diabetes

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

Infections

Injury

Headache

Category Net Paid per Admission PMPM PMPY

Chart

Variables: County, number of admissions

Admissions Per County

Admit Types

Surgical

Medical

Total Net Pay: $172053%

Total Net Pay: $172053%

Total Net Pay: $172053%

Maternity/Newborn

Total Net Pay: $172053%

Psychiatric/Substance Abuse

Total Net Pay: $172053%

Missing/Unknown

Average Net Paid Per Member

Per Year

Average Net Paid Per Admission

Admissions Per 1000 members

Year-over-year comparison

Total Admission

Chart Type: year-over-year comparison; monthly trend Measures: see left side Variables: total cost, change% Data update: every month Interaction: show each month’s cost on hover Data density: 2-year data

Page 18: Data Story Toolkit Updated 2020

Flow

Dashboards Reports Drill-Through Paths

30 June 2019

01 July 2017

Report Time Period

Admissions Report List

IBM Watson and Human Services Analytics Foundation

CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.

RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).

Applicable FARS/DFARS Restrictions Apply to Government Use.

Licenses

U.S. Government Rights

Description

Admissions Net Paid Total

Trendline$120,000+2%

Description

Admissions - Total

Trendline45,000+2%

Admissions Key Performance Indicators % Change Total Trend

Description

Admissions Net Paid PMPY

Trendline$2,345+2%

Description

Average Net Paid Per Admission

Trendline$2,345+2%

Description

Admissions per 1000

Trendline500+2%

Top Admissions by Diagnostic Catefgory

Chart

Variables: Avoidable admissions % and cost

Potentially Avoidable Admissions

Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)

Chart

Readmissions Percentage

CardioVascular Disorder

Signs/Symptoms/Other Conditions NEC

Raspiratory Disorders

Diabetes

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

Infections

Injury

Headache

Category Net Paid per Admission PMPM PMPY

Chart

Variables: County, number of admissions

Admissions Per County

Admit Types

Surgical

Medical

Total Net Pay: $172053%

Total Net Pay: $172053%

Total Net Pay: $172053%

Maternity/Newborn

Total Net Pay: $172053%

Psychiatric/Substance Abuse

Total Net Pay: $172053%

Missing/Unknown

Comprehend

Explore

Monitor

Evaluate

Page 19: Data Story Toolkit Updated 2020

30 June 2019

01 July 2017

Report Time Period

Admissions Report List

IBM Watson and Human Services Analytics Foundation

CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.

RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).

Applicable FARS/DFARS Restrictions Apply to Government Use.

Licenses

U.S. Government Rights

Description

Admissions Net Paid Total

Trendline$120,000+2%

Description

Admissions - Total

Trendline45,000+2%

Admissions Key Performance Indicators % Change Total Trend

Description

Admissions Net Paid PMPY

Trendline$2,345+2%

Description

Average Net Paid Per Admission

Trendline$2,345+2%

Description

Admissions per 1000

Trendline500+2%

Top Admissions by Diagnostic Catefgory

Chart

Variables: Avoidable admissions % and cost

Potentially Avoidable Admissions

Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)

Chart

Readmissions Percentage

CardioVascular Disorder

Signs/Symptoms/Other Conditions NEC

Raspiratory Disorders

Diabetes

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

$2000 $2000 $2000

Infections

Injury

Headache

Category Net Paid per Admission PMPM PMPY

Chart

Variables: County, number of admissions

Admissions Per County

Admit Types

Surgical

Medical

Total Net Pay: $172053%

Total Net Pay: $172053%

Total Net Pay: $172053%

Maternity/Newborn

Total Net Pay: $172053%

Psychiatric/Substance Abuse

Total Net Pay: $172053%

Missing/Unknown

Testing - Step One

Designer User

Before you start validating the content on the dashboard, ask these questions first

Timeliness: How frequently is the data in the dashboard updated?

Aesthetic value: How important is it that the dashboard look attractive, or can it be purely utilitarian?

Platform: Does the audience need to access the information on-the-go?

Connectivity: Does the dashboard need to connect to live data sources?

Collaboration: Is it important that your audience be able to easily share findings?

Page 20: Data Story Toolkit Updated 2020

Testing - Step Two

Designer User

Can this chart answer your questions? Is this the right chart type? Validate the other chart attributes.

Chart Type: year-over-year comparison; monthly trend Measures: see left side Variables: total cost, change% Data update: every month Interaction: show each month’s cost on hover Data density: 2-year data

value: total cost, number of membersyear-over-year changesMeasures

I want to know the total number of admissions and the cost associated with it.“

Page 21: Data Story Toolkit Updated 2020

Testing - Step Three

Designer User

Define the requirements for basic dashboard functions

1. Filters (global/local) Allow users to define the scope of the data in the dashboard to reflect their needs. Filters can either be global (refining scope for the entire dashboard) or local (refining scope for a specific chart or metric or view).

2. Alerts Highlight information based on pre-defined criteria. The alert may be activated when a metric goes outside of a particular threshold.

3. Export Give users the ability to pull information out of a dashboard. Export to formats that let users do more with the data like Excel and CSV rather than PDF.

IBM Watson and Human Services Analytics Foundation

Apply Clear filters

1-4

<1

5-9

15-17

20-24

10-14

18-19

Age Group

Aid Category

Benefit Plan

County

Gender

Payer Plan

FiltersFilters

Page 22: Data Story Toolkit Updated 2020

“I think allows us all a structured approach to get on a shared view”

“it provides a nice look back (in mural ) of analysis and shared understanding” “It brings consistency to the design process” “business people and design people can swap in and out and it works”

"A great way to ensure consistency and maintain standards across the team when developing requirements." “Forces you to ask the right questions” “Helps us to ensure we are answering the right questions in the designs”

“Helps us ensure we are presenting the right data with the right charts to help it be understood” “Helps us to ensure the designs close the loop” “The design matrix helps the design and business team ensure we are focused on solving the right problem or question for the right user"

Quotes

Page 23: Data Story Toolkit Updated 2020

1. Bring user-centric thinking back

2. Create a story instead of a few snapshots

3. Promote consistency and coherence

What is the value of UX

Page 24: Data Story Toolkit Updated 2020

2+1

-30%

Outcome

Team Adoption

Development Time

1. Successfully brought 2 state services teams onboard to replace their standard reports with our data packages.

2. One design team outside of my organization has started using this Toolkit for BI products.

3. BAs have saved 30% of the time on writing requirements and user stories.

4. Design and FED teams have continuously been shortening development time.