Innovation in Evidence Conference

Regina, SK Nov 15, 2018

Building the evidence base: A perspective from Washington State

WASHINGTON STATE INSTITUTE FOR PUBLIC POLICY

Stephanie Lee Director

Washington State Institute for Public Policy

!  Explicitly nonpartisan !  Mission to produce practical research for the legislature

Nov 15, 2018 www.wsipp.wa.gov Slide 2 of 7

Capitol → ← WSIPP

Created by the 1982 Washington State Legislature

Assignments to produce evidence

Nov 15, 2018 www.wsipp.wa.gov Slide 3 of 7

What works? (and what does not?) a)  Produce new evidence

!  Evaluate outcomes for participants in state programs

b)  Synthesize existing evidence !  Meta-analyze research on specific programs

!  What is the potential return on investment?

2018 ESSB 6032 Sec. 606 (22) $57,000 of the general fund—state appropriation for fiscal year 2019 is provided solely for the Washington institute for public policy to conduct a review of the available research literature on step therapy protocol usage, including any rigorous evidence concerning positive or negative health outcomes resulting from step therapy protocol usage.

What is the evidence in Washington?

Nov 15, 2018 www.wsipp.wa.gov Slide 4 of 7

Outcome evaluations of real-world programs implemented in the state

!  Administrative data

!  Use rigorous research methods (establish causality)

!  Identify comparison groups not receiving the program

!  Apply statistical controls for potential confounds •  Special attention to selection bias

What does the existing research tell us?

Nov 15, 2018 www.wsipp.wa.gov Slide 5 of 7

Meta analysis of research on specific programs !  Standardized approach

!  Consider all published evidence we can find

!  Apply consistent standards of rigor (causal evidence)

!  Combine evidence statistically

!  Estimate how much change we would expect

What is the potential return on investment?

Nov 15, 2018 www.wsipp.wa.gov Slide 6 of 7

WSIPP’s benefit-cost analysis !  Standardized approach !  Use results from a meta-analysis (or outcome evaluation)

•  How much change can we expect? !  Apply consistent valuation of outcomes !  Estimate cost of program per-participant !  Consider risk of each investment

•  How likely to “break even”?

Value of crime includes: !  Police !  Courts, prosecutors !  Prison or jail !  Probation or parole !  Victim property !  Victim physical and mental health, quality of life

Nov 15, 2018 www.wsipp.wa.gov Slide 7 of 7

Publishing our findings