tor midterm eval eureccca project july2019

EURECCCA Project

“Enhancing Resilience of Communities to Climate Change through Catchment Based Integrated

Management of Water and Related Resources in Uganda (2017-2021)”

TERMS OF REFERENCE FOR MID-TERMPROJECT EVALUATION

[AO/OSS/EURECCCA/190710]

Title/Field International Consultant as evaluator/ Water and Environment Duty station Home-based with mission travel to Uganda Duration of the field trip 12 days Starting date Beginning of September 2019 Mission duration 25 working days (September – October 2019) Application deadline 25 August 2019

Termsofreferenceformid-termevaluation(MTE)ofEURECCCAProject

OSS-EURECCCAProject 2

1 INTRODUCTION These are the Terms of Reference (ToR) for the Mid-Term Evaluation (MTE) for the project entitled “Enhancing the resilience of communities to climate change through catchment based integrated management of water and related resources in Uganda – EURECCCA”, funded by the Adaptation Fund. The project is implemented by the Sahara and Sahel Observatory (OSS) and executed by the Ministry of Water and Environment in Uganda (MWE). The project has started since May 2017 and is on its second year of execution. This evaluation will be conducted as an external evaluation, managed by OSS and conducted by an external evaluator selected in consultation with the MWE country office in Uganda. Key stakeholders, MWE components, OSS and the donor will be consulted throughout the evaluation process. This MTE of the EURECCCA Project is planned for September 2019 with the final report expected to be completed by end of October 2019. This evaluation is being conducted to review the project performance and enhance learning within the MWE, targeted catchments and among key stakeholders. The evaluation findings and recommendations will help guide the EURECCCA Project team in the planning and implementation of the second half of the project and would provide valuable inputs to strengthening MWE’s management capacity, reflecting the changes which have occurred in the operational and administrative environment since May 2017, when the project was officially launched. The M&E officer of the project in the MWE will provide technical backstopping for the evaluation.

2 PRESENTATION OF THE PROJECT TO BE EVALUATED Country: Republic of Uganda Project Title: Enhancing the resilience of communities to climate change through

catchment based integrated management of water and related resources in Uganda- EURECCCA

Donor: Adaptation Fund - AF Implementing Entity: Sahara and Sahel Observatory (OSS) Executing Entity: Ministry of Water and Environment, Uganda Budget: USD 7,751,000 Duration: 2017-2021

The “Enhancing Resilience of Communities to Climate Change through Catchment Based Integrated Management of Water and Related Resources in Uganda” (EURECCCA) Project was designed to support Uganda’s Government efforts to implement Integrated Water Resources Management (IWRM) through Catchment Management Planning and increase the resilience of communities to the risk of floods and landslides in Maziba, Aswa, and Awoja Catchments.

The overall goal of the project is to increase the resilience of communities to floods and landslides in Awoja, Maziba, and Aswa Catchments through promoting catchment based integrated, equitable and sustainable management of water and related resources. The Specific objectives of the project are to:

§ Increase the resilience of ecosystems by supporting the sustainable management ofnatural ecosystems including forests, wetlands, and riverbanks;

§ Increase the resilience of agricultural landscapes by supporting communities todevelop and implement sustainable water harvesting, soil biophysical, and floodcontrol structures;

§ Increase the resilience of other community livelihood systems by supporting incomegenerating activities through facilitating credit and market access;

§ Build the capacity of extension services and institutions at local, catchment, watermanagement zone and national level to better support local stakeholders.

These objectives are intended to be achieved through compliance with the following key components:



Component 1: Establishing Frameworks for Climate Resilient Catchment Management in Awoja, Aswa, and Maziba catchments: This component is expected to strengthen the institutional capacity of the communities to adapt to climate change. Besides, the project will strengthen the existing Catchment management structures or if nonexistent, support their establishment to facilitate the equitable and sustainable management of water and other natural resources; Component 2: Implementing concrete adaptation actions for resilient and sustained ecosystems, agricultural landscapes and diversification of livelihood systems: this component will aim at increasing the resilience of ecosystems, agricultural landscapes and livelihood systems to the impacts of climate change such as heavy rains by reducing the risk of floods, landslides, and mudslides; Component 3: Building capacities of extension services and institutions at sub-catchment, catchment and WMZ level to support local communities and knowledge management. This component is expected to build the capacity of stakeholders at various levels (national, catchment, district, and local levels) to effectively support the implementation of the project. The component will contribute to building capacity of stakeholders with the aim of increasing resilience to climate change impacts in the three catchments (Awoja, Maziba, Aswa).

The project is multi-sectoral and multi-disciplinary and is being implemented in a very participatory and integrated manner right from the national level to the catchment, district, and the community levels.

3 MID-TERM EVALUATION AIM AND OBJECTIVES The objective of the Mid-Term Evaluation (MTE) is to assess progress towards the achievement of the project objectives and outcomes as specified in the Project Document. It will assess early signs of project success or failure in order to identify adjustments to achieve its intended results.

Mid-term evaluation should assess at a minimum:

§ Initial outputs and results of the project; § The quality of implementation, including financial management; § Assumptions made during the preparation phase, in particular, objectives and

agreed upon indicators, against current conditions; § Factors affecting the achievement of objectives, and; § M&E systems and their implementation.

The review will highlight issues requiring decisions and actions and present initial lessons learned about project design, implementation, and management. Findings of the review will be incorporated as recommendations for the second half of the project’s term.

4 MID-TERM EVALUATION APPROACH AND METHODOLOGY The MTE must provide evidence-based information that is trustworthy, reliable and useful. The MTE consultant will review all relevant sources of information including documents prepared during the project preparation phase such as the project document, the PIM, as well as; the project technical and financial reports (quarter and annual), the Aide Memoire, (cf. Annexed documents).

The MTE consultant is expected to follow a collaborative and participatory approach ensuring close commitment with the Project Team, government counterparts, OSS, and other key stakeholders. The commitment of stakeholders is crucial for a successful MTE; their involvement should be also based on interviews. Specific focus should also be ensured towards those who have project responsibilities. The MTE consultant is expected to conduct



field visit missions to some or all the Water Zones and project sites. Accordingly, the consultant should detail in his methodology the approach he plans to put in place for field visits.

Finally, it is worth noting that the final MTE report should describe the full MTE approach adopted.

5 MID-TERM EVALUATION SCOPE The MTE consultant will assess the following four categories of project progress.

1) Project Strategy a) Project design and relevance

- Review the issues addressed by the project and the underlying assumptions. Review the impact of any incorrect assumptions or changes to the context of achieving the project results as outlined in the Project Document.

- Evaluate the relevance of the overall approach in relation to the Project's objectives. - Assess the design of the Project and the coherence of its strategies and activities, as

well as the inter-linkages between components. - Review the relevance of the project strategy and assess whether it provides the most

effective way to reach the expected/intended results. Assess if lessons from other relevant projects have been properly incorporated into the project execution.

- Assess if the Project Development and Immediate Objectives, the specific results and the activities carried out by the Project are in line with the needs and expectations of the beneficiaries.

- Review how the project addresses country priorities and country ownership. Review if the project concept is in line with the national sector development priorities and plans.

- Review the extent to which relevant gender issues were raised in the project design. - Review the decision-making processes and mainly if the various stakeholders’

perspectives and opinions are taken into account during project execution. - If there are major areas of concern, recommend areas for improvement.

b) Results Framework/Log frame - Review if the project’s objectives and outcomes or components are clear, practical,

and feasible within its time frame. - Examine if the progress made so far has led to, or could in the future catalyze

beneficial development effects (i.e. income generation, gender equality and women’s empowerment, improved governance, etc...) that should be included in the project results framework and monitored on an annual basis.

- Ensure broader development, environmental & social and gender aspects of the project are being monitored effectively.

2) Progress towards Results - Review the log frame indicators against progress made towards the end-of-project

targets. Compare and analyze the Adaptation Fund (AF) Results Tracker within the Project Performance Report (PPR) at the Baseline with the one completed right before the MTE.

- Identify the remaining barriers to achieving the project objective in the remainder of the project.

- By reviewing the aspects of the project that have already been successful, identify ways in which the project can further expand these benefits.



3) Project Implementation and Adaptive Management a) Management Arrangements

- Review the overall effectiveness of project management as outlined in the Project Document. Have changes been made and are they effective? Are responsibilities and reporting lines clear? Is decision-making transparent and undertaken in a timely manner? Recommend areas for improvement.

- Review the quality of execution of the Executing Agency/Implementing Partner(s) and recommend areas for improvement. b) Work Planning

- Review any delays in project start-up and execution, identify the causes and examine if they have been resolved.

- Assess if work-planning processes are results-based. Otherwise, suggest ways to re-orientate work planning to focus on results.

- Examine the use of the project’s results framework/ log-frame as a management tool and review any changes made to it since project start. c) Finance

- Consider the financial management of the project, with specific reference to the cost-effectiveness of interventions.

- Review the changes to fund allocations as a result of budget revisions and assess the appropriateness and relevance of such revisions.

- Examine if the project has the appropriate financial controls, including reporting and planning, that allow management to make informed decisions regarding the budget and allow for timely flow of funds. d) Project-level Monitoring and Evaluation Systems

- Review the monitoring tools currently being used: Do they provide the necessary information? Do they involve key partners? Are they aligned or mainstreamed with national systems? Do they use existing information? Are they efficient? Are they cost-effective? Are additional tools required? How could they be made more participatory and inclusive?

- Examine the financial management of the project monitoring and evaluation budget: Are sufficient resources being allocated to monitoring and evaluation? Are these resources being allocated effectively? e) Stakeholder Engagement

- Analyze the project management approach, if it has developed and leveraged the necessary and appropriate partnerships with direct and tangential stakeholders.

- Participation and country-driven processes: Do local and national government stakeholders support the objectives of the project? Do they continue to have an active role in project decision-making that supports efficient and effective project implementation?

- Participation and public awareness: To what extent has stakeholder involvement and public awareness contributed to the progress towards the achievement of project objectives? f) Reporting

- Assess how adaptive management changes have been reported by the project management and shared with the Project Board.

- Assess how well the Project Team and partners undertake and fulfill AF reporting requirements (i.e. how have they addressed poorly-rated PPRs, if applicable?)

- Assess how lessons derived from the adaptive management process have been documented, shared with key partners and internalized by partners.



g) Communications - Review internal project communication with stakeholders: Is communication regular

and effective? Are there key stakeholders left out of communication? Are there feedback mechanisms when communication is received? Does this communication with stakeholders contribute to their awareness of project outcomes and activities and investment in the sustainability of project results?

- Review external project communication: Are proper means of communication established or being established to express the project progress and intended impact to the public (is there a web presence, for example? Or did the project implement appropriate outreach and public awareness campaigns?)

- For reporting purposes, write one half-page paragraph that summarizes the project’s progress towards results in terms of contribution to sustainable development benefits, as well as global environmental benefits.

4) Sustainability - Validate whether the risks identified in the Project Document are appropriate and up

to date. If not, explain why. - In addition, assess the following risks to sustainability

a) Financial risks to sustainability - Evaluate the likelihood of financial and economic resources not being available once

the AF assistance ends (consider potential resources from multiple sources, such as the public and private sectors, income generating activities, and other funding that will be adequate financial resources for sustaining project’s outcomes)? b) Socio-economic risks to sustainability

- Analyze the social or political risks that may affect the sustainability of project outcomes. What is the risk that the level of stakeholder ownership (including ownership by governments and other key stakeholders) will be insufficient to allow for the project outcomes/benefits to be sustained? Do the various key stakeholders see that it is in their interest that the project benefits continue to flow? Is there sufficient public/stakeholder awareness in support of the long-term objectives of the project? Are lessons learned being documented by the Project Team on a continual basis and shared/ transferred to appropriate parties who could learn from the project and potentially replicate and/or scale it in the future? c) Institutional Framework and Governance risks to sustainability

- Review the legal frameworks, policies, governance structures and processes that could be a risk of jeopardizing sustenance of project benefits. While assessing this parameter, also consider if the required systems/ mechanisms for accountability, transparency, and technical knowledge transfer are in place. d) Environmental risks to sustainability

- Evaluate the environmental and social risks that may jeopardize the sustenance of project outcomes.

- Assess the environmental and social risks, impacts, and mitigation actions undertaken by the executing entity with regards to the project activities.



KEYS FINDINGS & RECOMMENDATIONS

The MTE team will include a section of the report setting out the MTE’s evidence-based conclusions, in light of the findings. Recommendations should be concise suggestions for critical intervention that are specific, measurable, achievable, actionable and relevant. A recommendation table should be put in the report’s executive summary (including to whom they are addressed).

SCORING

The MTE consultant will provide the scoring of the project’s results and brief descriptions of the associated achievements in a MTE Ratings & Achievement Summary Table in the Executive Summary of the MTE report.

6 EXPECTED OUTPUTS AND DELIVERABLES • Time lines

Phase Description Days proposed

0 Desk review of the project – related documents 2 1 Drafting and submission of the MTE Inception Report 2 2 Data Collection, Meetings, consultations, and field visits 10

3 Report of key findings and tentative recommendations upon field visits with the MWE

4

4 Draft MTE Report 5 5 Final MTE Report 2

Total 25 days • Deliverables

The following documents/events will be required at the proposed times: 1) MTE Inception Report: Evaluator clarifies objectives and methods of Mid-term

Evaluation. The inception report must be containing the evaluation framework, refined mid-term review objectives, detailed evaluation methodology, work plan and logistical arrangements for the field visits.

2) Prepare report and PowerPoint presentation with main findings and tentative recommendations upon data collection and field visits.

3) Debriefing workshop (1/2 day) with MWE and OSS to discuss the findings, lessons, and proposed recommendations (two days after completing the field trip)

4) Draft mid-term evaluation report in English: Draft report (using guidelines on the content outlined in Annex B) with annexes;

5) Final mid-term evaluation report in English: Finalize the report with comments from stakeholders and management responses.

Some of interview or meeting tasks may be conducted via skype or video conference

All deliverables are subject to the validation by the OSS in respect with the schedule of tasks assigned to the Evaluator.



7 MANAGEMENT ARRANGEMENTS, FORMATTING REQUIREMENTS, AND TIME FRAME

1. Institutional arrangements

The principal responsibility for managing this MTE belongs to the Implementing Entity. The Implementing Entity for this project’s MTE is OSS and it is responsible for contracting the consultant.

2. Quality report requirements

Quality recommendations in the evaluation report must meet the following criteria for drafting quality recommendations in evaluation reports: (1) recommendations are based on findings and conclusions of the report, (2) recommendations are clear, concise, constructive and of relevance to the intended user(s), (3) recommendations are realistic and actionable (including who is called upon to act and recommended timeframe).

3. Timeframe

The work on the MTE should begin on September 2019 with an inception phase followed by intensive data collection (desk review, interviews, and surveys), analysis and report writing. The first draft of the report to be submitted by mid-October 2019 and the final revised evaluation report should be delivered by end October 2019. The total effort is expected to be 25 person days to complete the full assignment.

4. Duty station

Uganda is the location of the assignment which may involve travel to the following project’s relevant geographic sites:

§ Kampala at Directorate of Water Resources Management § Awoja catchment located in Kyoga Basin in the Eastern § Aswa catchment located in Aswa Basin in the Northern § Maziba catchment located in Kagera Basin in the South Western

The detailed location of the project execution sites will be provided during the inception phase.

8 REQUIRED SKILLS AND QUALIFICATIONS Academic Degree

- Master’s degree or equivalent in Agricultural Sciences, Environment, Natural Resource Management, Social Sciences or other closely related fields

- University degree in agricultural engineering or related discipline

Qualifications and Experience - Significant experience (10 years or more) in fields related to agriculture, environment,

climate change, and natural resources management in similar regions - Significant experience (10 years or more) in the design and/or implementation of

projects related to climate change, resilience/adaptation and/or sustainable development projects.

- Significant experience (5 years or more) in projects evaluation/review - Specific experiences that demonstrate to have the knowledge of project cycle of

funds such as the Adaptation Fund, Global Environmental Facility, Green Climate Fund, other is an asset.



- Understanding of the development context of the project country would be a clear advantage.

- No previous involvement in the implementation of activities under review. - Excellent language skills in English (oral communication and report writing).

Competencies - Sensitive evaluation and analysis - Strong analytical skills - Excellent report writing skills - Excellent communication and interview skills - Respect for a diverse working environment - Demonstrated ability to deliver quality results within strict deadlines.

9 PAYMENT MODALITIES AND SPECIFICATIONS The overall level of effort estimated is 25 person/days spread over 45 days. The daily rate is fixed at US$ 600. The payment will be made by OSS to the account specified by the Consultant upon validation of the work required.

The Consultant will travel to Uganda for the purpose of the mission. OSS will take in charge airfare tickets, local travel costs for the mission in Uganda, accommodations and daily allowances.

The OSS and MWE Project Teams will be responsible for liaising with the MTE consultant to provide all relevant documents, set up stakeholder interviews, and arrange field visits.

Schedule of Payments a) 10% of payment upon approval of the MTE Inception Report detailing the adopted

methodology b) 40% of payment upon submission and validation of the draft MTE Report c) 50% of payment upon finalization of the MTE Report

5. Proposals Presentation

The application package must include the following:

Signed Curriculum vitae (template provided by OSS) with contact details of 3 clients for whom you have rendered preferably the similar service : [OSS CV Model];

- Methodological note (3 pages maximum) describing the approach to be used by the consultant for the mission execution including a work schedule that specifies the activities, dates, and timeframe.

- Two writing samples/reports in English. - Minimum of three letters of professional references, contracts, certificates, etc.

ImportantNote1- The consultant cannot have participated in the project preparation, formulation, and/or implementation

(includingthewritingoftheProjectDocument)andshouldnothaveaconflictofinterestwithproject’srelatedactivities.

2- The project document is downloadable via Adaptation fund website : https://www.adaptation-fund.org/project/enhancing-resilience-of-communities-to-climate-change-through-catchment-based-integrated-management-of-water-and-related-resources-in-uganda/



10 APPLICATION MODALITIES AND DEADLINE Complete applications should be submitted by email to the following address: [email protected], no later than Thursday, August 25, 2019, at 3 pm, Tunisia time with the following reference in the subject line:

[AO/OSS/EURECCCA/190710: Consultant for EURECCCA Project MTE].

Interested applicants must submit all documents as described in the item entitled " 5. Proposals Presentation " for the eligibility of their applications.

Requests for clarifications should be sent to the same e-mail address ([email protected]).



ToR ANNEX A: List of documents to be provided to the project mid-term evaluation mission

- Project document - Maps of the project sites - Project Inception report - Project Performance Report (PPR Year 1 and 2) - Supervision mission Aide-memoire (Year 1 and 2) - Quarterly and annual reports and work plans of the implementation task team - Project M&E framework and Monitoring reports - Preliminary baseline studies on environmental and social impact assessment,

gender and vulnerability - ToR developed for project activities execution (wetland action plans, catchment

Management guidelines)

ToR ANNEX B: Guidelines on Contents for the MTE Report (suggested outline)

i) Basic Report Information (for opening page or title page)- Title of AF financed project - OSS ID# and AF project ID# - MTE time frame and date of MTE report - Region and countries included in the project - Executing Agency/Implementing Partner and other project partners - MTE consultant - Acknowledgments

ii) Table of Contentsiii) Acronyms and Abbreviations1. Executive Summary (3-5 pages)

- Project Information- Project Description (brief)- Project Progress Summary (between 200-500 words)- MTE Ratings & Achievement Summary Table- Concise summary of conclusions- Recommendation Summary Table

2. Introduction (2-3 pages)- Purpose of the MTE and objectives- Scope & Methodology: principles of design and execution of the MTE, MTE

approach and data collection methods, limitations to the MTE - Structure of the MTE report

3. Project Description and Background Context (3-5 pages)- Development context: environmental, socio-economic, institutional, and policy

factors relevant to the project objective and scope - Problems that the project will address: threats and barriers targeted- Project Description and Strategy: objective, outcomes and expected results,

description of field sites - Project Implementation Arrangements: short description of the Project Board, key

implementing partner arrangements, etc. - Project timing and milestones- Main stakeholders: summary list

4. Findings (12-14 pages)4.1 Project Strategy

- Project Design



- Results Framework/Log-frame 4.2 Progress Towards Results

- Progress towards outcomes analysis - Remaining barriers to achieving the project objective

4.3 Project Implementation and Adaptive Management

- Management Arrangements - Work planning - Finance - Project-level monitoring and evaluation systems - Stakeholder commitment - Reporting - Communications

4.3 Sustainability - Financial risks to sustainability - Socio-economic risks to sustainability - Institutional framework and governance risks to sustainability - Environmental risks to sustainability

5. Conclusions and Recommendations (4-6 pages)5.1 Conclusions - Comprehensive and balanced statements (that are evidence-based and

connected to the MTE’s findings) which highlight the strengths, weaknesses, and results of the project

5.2 Recommendations 1. Corrective actions for designing, implementing, monitoring and evaluating the

project2. Actions to follow up or reinforce initial benefits from the project3. Proposals for future directions underlining main objectives

6. Annexes

tor midterm eval eureccca project july2019

Documents