p15186 infographic utility#3 - enel xan infographic series part 3 early visibility measure regularly...

www.enernoc.com

SOURCES:

SEE Action EM&V of Residential Behavior-Based Energy Efficiency Programs: Issues and Recommendations http://www1.eere.energy.gov/seeaction/pdfs/emv_behaviorbased_eeprograms.pdf

LBNL/EPRI Quantifying the Impacts of Time-based Rates, Enabling Technology, and Other Treatments in Consumer Behavior Studies: Protocols and Guidelineshttp://emp.lbl.gov/sites/all/files/lbnl-6301e.pdf

ACEEE 2013 State Energy Efficiency Scorecardhttp://aceee.org/research-report/e13k

Continuously evaluate andimprove your program

Planning up front can help you incorporate ongoing program reporting into your evaluation.

Experimental DesignPlan ahead for great results and easy evaluation.

Continuous improvementRe�ne your message to boost your program results.

One way to re�ne and personalize your messaging is with split testing.

For example, test two messages as follows:

Use what you learn about your customers to better structure your future programs.

With the right foundation in place, you’re in a good position to evaluate as you go.

Thanks for joining us.

To learn more visitenernoc.com/infographic

Drive action withpersonalized messaging.

2Select the right

audience to achieve your program goals.

1

Three steps to engaging small commercial enterprises

Message A“Cut energy wasteby $55 per month”

Message B“Save $55 per monthon your energy bills”

Message A2.5% more portal sign-ins

VS

WINNER

Use these metrics as a guide to continuously improve your program.

There is great potential to deliver value to underserved small and medium enterprises.

Using advanced analytics and program know-how, you can provide targeted, relevant and actionable insight to help

customers better manage their energy use.

Experimental Design

Simplify program evaluation with proper experimental design.

Plan to capture value from your program evaluation expenses.

Consider these three key components:

Continuously evaluate and improve your

program.

3

Program AttritionAllow for 10–15% attrition per year due to businesses closing or moving; the larger the organization, the lower this number could be.

Avoid missteps by considering the following:

Historical DataUse customers with 12 months or more of historical data to improve analytics and evaluation.

Strati�ed SamplingDivide each vertical equally between treatment and control to facilitate evaluation within speci�c verticals.

PROGRAM MONTH

For example, track percent energy savingsas you go to ensure your program is on target.

That's enough to run thecombined energy ef�ciency programs of:

Georgia Vermont Maine

Engaging Utilities’ Business Customers:An infographic series

Part 3

EarlyVisibility

Measure regularly and identify issues

earlier.

Continuous Improvement

Track user behavior to improve selection

and messaging.

Assign customers into balanced treatment and control groups.

Randomization is not enough. Use statistical checks to ensure that treatment and control groups are equivalent in terms of energy usage, climate zones and business types.

Jan Apr Jul Oct Jan Apr Jul Oct Jan

PRE-PROGRAM PROGRAM DELIVERY

AVER

AGE

kWh

/ da

y

Treatment with EnerNOCTreatmentControl

Opt-Out ProgramsImplement an opt-out program for small and medium enterprises (SME) to provide broader customer reach and simpler evaluation. For larger customers who are willing off the bat to dedicate more resources, opt-in programs often do the trick.

Build evaluation into your program delivery.

Measure the following key metricson a regular basis:

Early visibility builds evaluation into your program delivery.

Uptake ofOther Programs

Opt-Out andOpt-In Requests

CustomerSatisfaction

Call CentersInteractions

ApplicationSign-Ins

PercentEnergy Savings

PER

CEN

T EN

ERG

Y S

AVIN

GS

Allocate more resources to channels with higher traf�c.

Tailor offers and rebates to speci�c verticals.

For instance:

0 1 2 4 6 8 103 5 7 9 11 12

0.0

1.0

2.0

3.0

TARGET

$100 millionIn California, over

is spent each year on program evaluation.