measuring for success ncher legislative conference sophie walker september 26, 2013

Measuring for Success

NCHER Legislative Conference

Sophie Walker

September 26, 2013

NCHER | September 26, 2013© 2013 Mission Measurement, LLC

2

Mission Measurement helps nonprofits, foundations, and corporations measure and improve their social impact

http://www.cityofmadison.com/planning/150/images/KraftLogo.jpg

http://www.easterseals.com/site/PageServer?pagename=homepage


3

The evolution of the social capital market has changed the donor landscape

Programs valued more than results

Relationship-driven fundraising

The market values social change

Donors act like consumers and want to purchase results

Yesterday: Independent Sector Today: Social Capital Market


4

Nonprofits need data that shows how they create value in one of three ways

Can produce certain outcomes that others can’t

MOST EFFECTIVE

MOST EFFICIENT

MOST INNOVATIVE

Can produce the same outcomes as others but at

a lower cost

Have the potential to produce breakthrough results but untested


5

There are a continuum of approaches to measure social impact

Science5 Year Impact Study

HopeWe know we have impact,

no need to measure

Outcome MeasurementMeasure your near-term outcomes


6

Define SuccessWhat are we really

trying to accomplish?

Measure Results

How do we measure what we do?

Drive StrategyHow do we use data to

inform decisions?

• Identify Priority Outcomes

• Define Performance Metrics

• Design Measurement Process

• Implement Data Collection

• Report and Analyze Results

• Inform Strategic DecisionsAlign

Strategies

Mission Measurement approaches measurement in three inter-related stages


7

Identifying high-value outcomes is the first step to effective measurement

Leve

l of I

mpa

ct

Time

Activities

Outcomes

ImpactWe measure long-term change only if it is possible, practical and informative to do so

Outcomes are the focus of our measurement. They tell our impact story, let us know if we’re on track, and help us make timely improvements

We track activities (as required) to show accountability and track execution


8

Measuring outcomes is much higher value than measuring activities

ActivitiesThings we do

OutcomesResults or changes we produce

Conduct training

Provide mentoring

Gain press coverage

Measuring activities asks, “how many?”

Increase skills

Improve leadership

Improve perception

Measuring outcomes asks, “how well?”


9

Change in Chicago unemployment rate

% of participants placed in jobs

Job retention after 1 year

Job retention after 90 days*

Develop strong metrics that are credible, feasible, and valuable

Total number of organizations

contacted

# of activated or highly-engaged

partners

Weak Strong

Credible

Feasible

Valuable

*Research shows that 90-day job retention leads to longer-term retention.


10

A + B + C = D

ImpactWhat are we ultimately trying to accomplish?

Priority OutcomesWhat changes in behavior, condition, or status are required?

Performance Measures

How do we measure progress toward our

outcomes?

Key StrategiesWhich programs will

drive results?

To begin, build a Success Equation


11

USA Funds evolved to having a laser focus on results

USA Funds faced new pressures as a nonprofit organization:

• Changing and evolving role of funders

• Shift towards an investment orientation in philanthropy

• Increased demand for results

• Opportunities for sustainable value creation or shared value creation

USA Funds wanted to use measurement to:

• Determine if investments made were worthwhile

• Illustrate good stewardship of resources

• Build credibility with stakeholders

• Maximize actions to reach strategic goals

• Demonstrate contribution to social good


12

Outcomes Outcomes Outcomes

Outcome Statement Outcome StatementOutcome Statement

Outcome Statement Outcome Statement Outcome Statement

Outcome Statement Outcome Statement Outcome Statement

Postsecondary Readiness and Enrollment

Postsecondary Persistence and Success

Utilization of Best Practices at Participating Institutions

USA Funds and Mission Measurement created an Impact Framework based on high-value outcomes

Corporate Impact: Increase economic and social opportunity for disadvantaged students through enhancing attainment of post-secondary education goals

Products, Services, & Grants

Sho

rter

te

rm

L

onge

r t

erm


13

USA Funds and Mission Measurement developed a deliberate, thoughtful approach to implementation

Overcoming Internal Challenges

• Using new terminology

• Managing multiple data sources

• Non-existent data collection tools

• Lack of automation

Moving from Concept to Practice

• Identify useful data sources and metrics

• Create data collection tools

• Use a consistent set of evaluation terms

• Develop a process and regular schedule for data collection and reporting

• Involve product/program managers throughout the process to create buy-in

• De-mystify evaluation (i.e. internal training sessions for staff)

• Allow a role for both external and internal evaluation

• Regular progress monitoring


14

USA Funds learned some key lessons in how to make measurement “stick”

• Management commitment

• Employees have ownership in a process they helped develop

• Yield better and more useful information

• Bringing in outside firm to accelerate process


15

Measurement is not a one-time event, but a dynamic learning process

Develop & refine USA

Funds’ investment

strategy

Makeinvestment

Monitor progress

Assess and communicate

results

Integrate learning


16

Thank you!

Sophie WalkerEngagement [email protected]

www.missionmeasurement.com@MissionMeasure

mailto:[email protected]

measuring for success ncher legislative conference sophie walker september 26, 2013

Documents

outcome measurement

outcomes results

social impact slide

priority outcomes

measure results

nearterm outcomes

certain outcomes

perception measuring