evaluation optimising evidence for accountability and learning … · 2018-06-12 · evaluation –...

10
Evaluation Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta Rosenberg (Rhodes University), Nosiseko Mtati (NLEIP and Rhodes) and Vhutshilo Mudau (AWARD and Rhodes) Biodiversity Research and Evidence Indaba 17 August 2017

Upload: others

Post on 24-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

Evaluation –Optimising Evidence for Accountability andLearning in NRM Programmes

Prof Eureta Rosenberg (Rhodes

University), Nosiseko Mtati (NLEIP

and Rhodes) and Vhutshilo Mudau

(AWARD and Rhodes)

Biodiversity Research and Evidence Indaba 17 August 2017

Page 2: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

2

Resilience in the Olifants(RESILIM-O) – Limpopo Province, AWARD & USAID

Ntabalanga-Laleni Ecological Infrastructure program (NLEIP) -Eastern Cape, DEA & Rhodes

Two NRM Programmes with Innovative MEAR:

Photo Credits: NLEIP and AWARD

Page 3: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

3

If we want Monitoring, Evaluation & Reporting to optimise accountability and learning, we need:

1. Complementarity of multi-methods

2. Reporting with built-in reflection

3. Social & educational protocols forcitizen monitoring

Page 4: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

1. Complementarity of Multi-Methods

• On its own an indicator is just suggestive.

• On its own, a story is just anecdotal.

• Indicators plus narratives can add up to

robust evidence.

Page 5: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

Complementarity of Multi-Methods

Indicator based monitoring (e.g. # of wetlands restored, # of training days) +

Open-ended narrative

monitoring +

Focussed evaluation

case studies +

Meta-evaluation = generalizable

insights

Page 6: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

2. Reporting with Built In Reflection:

• Action-reflection cycles

• In complex,

stochastic systems =

• Strategic adaptive

management

Plan

Take action

Get feedback

Reflect

Page 7: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

2. Reporting with Built In Reflection:

• B2O Back to Office reports

• Teams compile monthly reports

• Evaluation Champs & Coordination

• Reflection may require training

• Need not be more onerous!Research: Mudau, Thulare, Kotschy, Burt, Rosenberg

Page 8: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

3. Citizen Monitoring can be valuable

• For NRMPs• For citizens

Research: Bannatyne, Nyamela, Rowntree, Van der Waal, Mtati, Rosenberg

Page 9: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

3. Citizen Monitoring protocols:

• Scientific• Social• Educational

Research: Bannatyne, Nyamela, Rowntree, Van der Waal, Mtati, Rosenberg

Page 10: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta

Conclusion: Some NRM programmes are collecting evidence through new MEAR

frameworks which have potential to increase learning and accountability.

Research investigating such claims is underway. How do we make this work into the national system?

Plan

Act

Evaluate