impact pathways for the bfps boru douthwaite bfp-impact assessment project leader, ciat, cali,...

Impact pathways for the BFPs

Boru DouthwaiteBFP-Impact Assessment Project Leader, CIAT, Cali, Colombia

Presentation made at the BFP PFF, Don Chang Palace Hotel, Vientiane, Laos

Sunday, 12th November, 2006

CPWF-BFP Impact Assessment Project

• Goal– To contribute to the CPWF fulfilling its impact potential– To contribute to the CPWF being perceived as a “coherent,

problem-focused research program”

• Purpose– CPWF scientists and management are using IA products

and methods

• Intervention– Carry out “exemplary” impact analysis

• Impact pathways; scenario analysis; extrapolation domain analysis

– Develop methodology

Impact pathways – two conceptualizations….

<-----the full picture---->

>----------Actor-orientated perspective--------->

>--

-Res

ult

s-o

rien

tate

d p

ersp

ecti

ve--

-->

Logi

c m

odel

Network maps

Impact Pathways

1. A visual description of the causal chain of events and outcomes that link outputs to the goal (logic model); and

2. Network maps that show the evolving relationships necessary to achieve the goal

• Implementing organizations; boundary partners; beneficiaries

Shows the project rationale; its logicShows multiple pathways

Foundations of the IP Approach

• Synthesis of concepts and tools from:– Program Evaluation

• Renger and Titcomb (2002) – problem trees• Chen (2005) – program theory• Mayne (2004) - performance stories

– Social network analysis• Cross and Parker, 2004

Participatory Development of Impact Pathways

Project Problem Tree

Project Objective Tree

Outputs Vision

Project Tim eline

"Now" networkm ap

W hat needs to change

W hat thepro ject w illproduce

W here pro j ect isgo ing- Goal

How pro j ectgoes fromoutputs to goals

Necessaryrelationshipsto producethe OUTPUTS

I P logic m odel

Network m aps( Relationsh ip by

relationsh ip)

Helps understandpro ject rationale

( Draft produced before w orkshop)

"Future"network m ap

Necessaryrelationshipsto achievethe VI S I ON

De

velo

pin

g a

re

sult

s-o

rie

nta

ted

vie

w o

f a

pro

ject

's I

PD

eve

lop

ing

an

act

or-

ori

en

tate

dvi

ew

of

a p

roje

ct's

IP

O UTPUTS O F I MPACT PATHW AYS ( I P) W O RKS HO P

I m pactNarrative

ExtrapolationDom ain Analysis

PRO DUCTS PRO DUCED AFTER W O RKS HO P

I terativeprocess

Tw o descrip tionsof the project'sim pact pathw ays

S cenarioAnalysis

The Process of Developing Impact Pathways – The Workshop

Project Problem Tree

Project Objective Tree

Outputs Vision

Project Tim eline

"Now" networkm ap

W hat needs to change

W hat thepro ject w illproduce

W here pro j ect isgo ing- Goal

How pro j ectgoes fromoutputs to goals

Necessaryrelationshipsto producethe OUTPUTS

I P logic m odel

Network m aps( Relationsh ip by

relationsh ip)

Helps understandpro ject rationale

( Draft produced before w orkshop)

"Future"network m ap

Necessaryrelationshipsto achievethe VI S I ON

De

velo

pin

g a

re

sult

s-o

rie

nta

ted

vie

w o

f a

pro

ject

's I

PD

eve

lop

ing

an

act

or-

ori

en

tate

dvi

ew

of

a p

roje

ct's

IP

O UTPUTS O F I MPACT PATHW AYS ( I P) W O RKS HO P

I m pactNarrative

ExtrapolationDom ain Analysis

PRO DUCTS PRO DUCED AFTER W O RKS HO P

I terativeprocess

Tw o descrip tionsof the project'sim pact pathw ays

S cenarioAnalysis

The Process of Developing Impact Pathways

Fishers cooperatein fisheries

management

K nowledge o foptions in

enhancementtechno logiestrans ferred

Financial resourcesfo r improved

fisheriesproductivity and

managementobtained

Respons ib leharves t ings trategies

Improvedprocess ingmethods

A quacultureact ivit ies

implemented

Optimized use o ffisheries

productioncapacity

Increasedreservo ir

productivity andmanagement

Enhancedlivelihoods

PN 34 ( I m proved F isheries Production) Objectives Tree

Goal1st LEVEL2nd LEVEL

3rd LEVEL4th LEVEL

D epressedLivelihoods

LimitedReservoir

Productivity

UnderusedFisheries

ProductionC apacity

Bad HarvestingStrategies

Uncooperativeattitudes of fishers

w ith respect tomanagement of

fisheries resources

Lack of know ledgeof options ofenhancementtechnologies

Processinglimitations

Lack ofaquaculture

activities

S tart Here

D eterminants

Lack of financialresources capacity

to implementscenarios for

improved fisheriesproduction

1st LEVEL

2nd LEVEL3rd LEVEL4th LEVEL W hy is th is problem happening?

W hy?W hy?W hy?

Problem

PN 34 I m proved fisheries productivity Problem Tree

Key IP Concepts: How change happens

• “Improvements in poverty alleviation, food security and the state of natural resources result from dynamic, interactive, non-linear, and generally uncertain processes of innovation.”

EIARD, 2003EIARD represents a group of European donors

15 EU Countries plus Norway and Switzerland

Level of influence of Project

High

CONTROL

Low

Research Output Output Outcome Impactactivity target

Scaling Out and Scaling Up

• Scaling up - an institutional expansion, from adopters and their grassroots organizations to policy makers, donors, development institutions

• Scaling out - spread of a project outputs (i.e., a new technology, a new strategy, etc.) from farmer to farmer, community to community, within the same stakeholder groups

The theory behind the IP approach

Program Theory(Chen, 2005)

Normative Theory(What is expec ted - projec tm ilestones, et c . )

Causat ive Theory( Explanat ions of c ausat ion)

Ex plicit Theory( T heor ies as explainedto others)

Implicit Theory(Personal t heor iesof ac t ion)

Greater c ongruenc einc reases projec teff ec t iveness(Argyr is , 1980;Pat ton, 1997)

Impact Pathways

=

“Stakeholders' implicit theories are not likely to be systematically and explicitly articulated, and so it is up to evaluators to help stakeholders elaborate their ideas.” (Chen, 2005, p. 14)

Project Problem Tree

Project Objective Tree

Outputs Vision

Project Tim eline

"Now" networkm ap

W hat needs to change

W hat thepro ject w illproduce

W here pro j ect isgo ing- Goal

How pro j ectgoes fromoutputs to goals

Necessaryrelationshipsto producethe OUTPUTS

I P logic m odel

Network m aps( Relationsh ip by

relationsh ip)

Helps understandpro ject rationale

( Draft produced before w orkshop)

"Future"network m ap

Necessaryrelationshipsto achievethe VI S I ON

De

velo

pin

g a

re

sult

s-o

rie

nta

ted

vie

w o

f a

pro

ject

's I

PD

eve

lop

ing

an

act

or-

ori

en

tate

dvi

ew

of

a p

roje

ct's

IP

O UTPUTS O F I MPACT PATHW AYS ( I P) W O RKS HO P

I m pactNarrative

ExtrapolationDom ain Analysis

PRO DUCTS PRO DUCED AFTER W O RKS HO P

I terativeprocess

Tw o descrip tionsof the project'sim pact pathw ays

S cenarioAnalysis

The Process of Developing Impact Pathways

Identify Project Outputs

• Identify the outputs your BFP will produce. Write them on cards.– Outputs are things that others outside the project use

• Take 10 minutes and then present them (presentation maximum 2 minutes)

Task 1

Develop a vision of project success two years after the project ends

• Work in project groups• Take 5 minutes to individually answer the

question– You wake up 2 years after your project has ended.

Your project has been a success and is well on its way to achieving its goal. Describe what this success looks like to a journalist:

• What is happening differently now? • Who is doing what differently? • How are project outputs disseminating (scaling-out)? • What political support is nurturing this spread (scaling-up)?

How did that happen?

• Discuss and develop a common vision

Keep it realistic

Task 2

Family ties

Friendship ties

Workplace ties

Network Exercise

1. Develop network diagrams for • Your project now • “Vision” network 2 years after project has finished

2. Develop now and future network maps for:• Research• Scaling out / extension • Scaling up / political support

3. Identify differences between the now and future networks

4. Discuss changes in terms of concrete actions needed to bring them about

5. Develop work plans6. Present maps, implications and work plans to each other

Task 3

Final maps based on answers

Extrapolation Domain Analysis

• Use Weight of Evidence models – Socio-economic, example PN6:

• Existence of fish production (FAO, 2006);

• Percentage coverage of sanitation facilities (UNICEF, 2005);

• The poverty line as describe by the below U$D 1 per/day index (ILRI, 2006).

– Agro-ecological

Choice of Variables

Pilot Sites

Socio-economic extrapolation

Agro-ecological Extrapolation

Putting them together