em&v: the future of evaluation - illume …...em&v: the future of evaluation 2015 midwest...

18
EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy Efficiency Alliance

Upload: others

Post on 29-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

EM&V: THE FUTURE OF EVALUATION2015 MIDWEST ENERGY SOLUTIONS CONFERENCE

Laura Schauer, ILLUME Advising, LLC

January 29, 2015

Midwest Energy Efficiency Alliance

Page 2: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

Let’s start from the very beginning

Page 3: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

Evaluation and M&V Terms

M&V Impact Evaluation Other evaluation

Verify project savings

Estimate program savings

ProcessMarketAttributionCost-effectivenessNEBs

3

Page 4: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

“Way Back When”

It seemed we had more…. Time

Funding for each study (not absolute)

Opportunity to evaluate programs as more than a widget or energy unit

Oh those were the

days!

4

Page 5: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

But, alas.... there are three constants in life…

change, choice, and principles

(Stephen Covey)

Page 6: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

Markets are continually evolving…

6

Low-hanging fruit continues to decrease

Codes and standards increasing baselines

Cost-effectiveness is becoming more difficult to attain

Page 7: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

…so we respond to changes

Increased emphasis on holistic program designs

Technology advancements

Expansion of program approaches

Resurgence of market studies

7

Page 8: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

Market Shifts Create EM&V Challenges

Page 9: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

These Changes Raise Questions on How we Approach EM&V

Standard impact approaches: Are these approaches (e.g., engineering analysis) accurately accounting for savings?

TRMs: Are they sufficiently nimble and sophisticated?

Attribution: Are stakeholders convinced funds are being used wisely, and do we have the right techniques to illustrate this?

Cost-effectiveness: Are results accurately representing all the costs against all the benefits?

Timeliness: Are we providing information when it is most useful, in a format that is most useful?

9

Page 10: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

To Further Complicate Matters

Each jurisdiction differs

Incentive and recovery mechanisms

Application of EM&V findings

Reporting requirements

Program administration and EM&V models

Concern over consistency of E and M&V techniques

Scrutiny over how EM&V funds are spent and attempt to determine value for funds

10

Page 11: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

Energy and Efficiency Continue to Gain Federal Attention

American Reinvestment and Recovery

Act

National WAP Evaluation

ENERGY STAR programs

Evaluation certification

SEE Action

Uniform Methods Project

Section 111(d) of the Clean Air

ActDOE

Benchmarking

Better Buildings Challenge

11

Page 12: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

EM&V 2.0: Is it the solution?

Page 13: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

Promises and Offerings

“Real-time” EM&V

Reliable results

Defensible models

Broad applicability

Advanced analytic tools

Less costly – more efficient – EM&V

Sounds amazing, right?

13

Page 14: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

My Position

14

Page 15: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy
Page 16: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

Then What Is the Future of EM&V?

16

Retrospective Analysis

Prospective Support

Progress

EM&V 2.0Data Mining

Transparency

NEBs and other Benefits

Predictions

Page 17: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

QUESTIONS

Page 18: EM&V: THE FUTURE OF EVALUATION - ILLUME …...EM&V: THE FUTURE OF EVALUATION 2015 MIDWEST ENERGY SOLUTIONS CONFERENCE Laura Schauer, ILLUME Advising, LLC January 29, 2015 Midwest Energy

Laura SchauerPrincipal Advisor

m: 608 535 9849e: [email protected]

@lauraillume

ILLUME Advising