Download - Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions
![Page 1: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/1.jpg)
Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions
Prepared by
Ministry for Foreign Affairs of Finland
![Page 2: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/2.jpg)
Purpose of the evaluation
• To deepen the understanding of the results-based approach and management requirements
Overall Objective
• Desk study• Review of project
documentation and interviewsScope
2
![Page 3: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/3.jpg)
Methodology
From TOR to Evaluation Framework
Topic list of interview questions
Staff survey76/120
Management survey10/18
Document review checklist
Rating assessment of 17 projects
3
![Page 4: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/4.jpg)
RBM Conceptual framework
4
Strategic Results Framework• Priorities•Objectives• Strategy
Credible measurement & analysis•Measure & assess results•Assess contribution to strategic objectives
Programme Results Framework•Results chain/theory of change•Align with strategic framework•Performance indicators
Credible performance reporting•Relevant, timely & reliable reporting
Use results to improveperformance•Adjust the programme•Develop lessons & good practices
![Page 5: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/5.jpg)
5
How to manage
for results
Reporting on performance
against expectations
Deliberately learning from evidence and
analysis
Understanding the theory of
change
Setting out performance expectations
Measuring and analysing results & contributions
to outcomes
![Page 6: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/6.jpg)
Developing a culture of results
0
1
2
3
4
5
6
![Page 7: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/7.jpg)
An organisation with a results culture…
Engages in self-reflection
& self-examination
Engages in results-based
learning
Encourages experimentation
& change
10
![Page 8: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/8.jpg)
Factors that help build such a culture
Demonstrated senior management leadership and commitment Informed demand for results informationA results-oriented accountability frameworkSupportive organizational systems, practices and proceduresResults measurement and results management capacityA capacity to learn and adapt
11
![Page 9: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/9.jpg)
Findings and recommendations
![Page 10: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/10.jpg)
Finding 1There is no statement or document guiding the adoption of results-based management for the MFA.
Recommenda
tion 1
A formal approach should be established for adopting results-based management.It should set out principles, objectives and accountability
13
![Page 11: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/11.jpg)
Finding 2Policy documents do not contain a strategic results framework
Recommenda
tion 2
Develop a SRF with clear objectives to guide regional and country strategies
14
![Page 12: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/12.jpg)
Finding 3Planning is methodical and systematic but lacks clear outcomes and indicators at country level
Recommenda
tion 3
Reorganise country-level planning with measurable objectives and indicators
15
![Page 13: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/13.jpg)
Finding 4Despite clear and comprehensive guidelines, good standards of project design are not consistently applied.
Recommenda
tion 4
Improve quality by:a) Accessible guidelines & checklistsb) Provide good practice examplesc) Apply to all interventionsd) More effective QA
16
![Page 14: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/14.jpg)
Finding 5The Monitoring, Reporting & Evaluation system is established but lacks added-value
Recommenda
tion 5
Redesign reporting to be more analytical at 3 levels:a) Project reporting & the supervisory boardb) Semi-annual reporting by embassiesc) Unit scorecards
17
![Page 15: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/15.jpg)
Finding 6Meta-analysis by EVA-11 has scope to consolidate evaluation findings
Recommenda
tion 6
This should be continued with more analysis of trends of performance
18
![Page 16: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/16.jpg)
Finding 7Management culture is risk averse and makes little use of past results to set policy
Recommenda
tion 7
Improve institutional culture[Build on new HR policy]
19
![Page 17: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/17.jpg)
Finding 8HR systems lack incentives for delivering results
Recommenda
tion 8
[Build on new HR policy]Train managers to be more effective in RBM
20
![Page 18: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/18.jpg)
Finding 9Information management is inadequate for document retrieval and comparative analysis
Recommenda
tion 9
Improve information management to enable analysis of performance
21
![Page 19: Evaluation of the Results-Based Approach and M&E of Finnish Development Cooperation Interventions](https://reader035.vdocuments.mx/reader035/viewer/2022070302/548315ebb4af9f85028b464f/html5/thumbnails/19.jpg)
The End