monitoring and evaluation - oecd 02 climate finance... · monitoring & evaluation framework ......
TRANSCRIPT
Charles Mulenga
Zambia Institute of Environmental Management
19th September 2013
Climate Charge Expert Group (CCXG Global Forum)
Monitoring & Evaluation Framework
for Tracking the results of adaption
Projects
In Context of Zambia
Overall National Engagement
National Development Plan
JAS II UNDAF MDB
Adaptation projects
Key Policies
•National Policy
Environmental &
Environmental
Management Act
•Zambia National
Adaptation
Programme of Action
•Disaster
Management Act
•National Water
Resource Act
Management
•Urban & Regional
planning
•National Climate
Change Response
strategy
Ministry of Finance and National Planning (MoFNP),
Ministry of Land, Natural Resource and , Environment
Protection (DMMU) . Ministries & Government
Cont.
High level Committees of Permanent Secretaries
and Committee of Ministers chaired by the
Ministry of Finance and National Planning.
National Climate Change and Development
Council (NCCDC) - one-stop shop for all climate
change programmes in Zambia and be
responsible to:
Institutional
Arrangements
National Coordination of Climate Change and Disaster Risk Management
• Implementation by line ministries
Coordination of M&E Framework
• Government-led channel for coordination with MDBs and external Partners
Core Team from Key Sectoral Ministries
• Complemented by contracted staff
Monitoring and evaluation
Framework
The M&EF for Tracking Adaption Result is
subjected to an in-depth internal / external
evaluation process to assess;
1. Overall performance adaptation project, (KPI)
2. Outputs /outcomes produced against its initial
targets, Development Indicators (DI) SNDP
3. Impact it has brought about- Reduction in
emissions, Job creation,
4. Its relevance to the national context and
management efficiency. Governance, Gender
and Transparence
Five Core Indicators
• Changes in budget allocations to climate-smart programs in national budget
National Level Mainstreaming
• Vulnerable districts, wards and communities use improved tools, information and instruments to respond to climate change and variability
Local Adaptive Capacity
• Number of beneficiaries supported directly by the project to adapt to the effects of climate change
Target Beneficiaries
• Evidence of strengthened Government capacity and coordination mechanism to mainstream climate resilience
Institutional Framework
• Climate responsive financial instruments developed and tested
Climate Responsive Investment
Other Indicators –Project
• Change in area of canals with optimal average flows
• Changes in area with sustainable access to reliable canal water
Degree of integration of
climate resilience in local area
planning
• Number of sub-grants approved and completed
• Incremental labor generated through cash-for-works
Strengthened institutional and
financial mechanisms to ensure climate
resilience
Number of relevant climate
information products/services made available
for decision making at various
levels
Sample Results Framework and
Monitoring - Project Development Objective (PDO): To strengthen Zambia's institutional framework for climate resilience and improve the adaptive capacity of vulnerable
communities in the Barostse sub-basin
PDO Level Results
Indicators* Core
Unit of Measure Base-line
Cumulative Target Values** Frequenc
y
Data
Source/
Methodolo
gy
Responsibili
-ty for Data
Collection YR 1 YR 2 YR3 YR 4 YR5 YR6
Indicator One (National Level
Mainstreaming)
Changes in budget allocations to
climate-smart programs in national
budget1
Allocations to climate resilient
programmes increased by 25% in
real terms in vulnerable sectors
by EOP (agriculture,
environment, natural resources,
energy, water, infrastructure,
health and DRM) from 2007-
2012 baseline
118.8
million
ZMW/
Year2
124.7
130.7
136.6
141.3
144.9
148.5
million
ZMW/
year
Annual
Yellow
Book
(budget
allocations)
by Ministry
and program
ZCCN and
MoF
Indicator Two: (Local Adaptive
Capacity)
Vulnerable districts, wards and
communities use improved tools,
information and instruments to
respond to climate change and
variability
% of targeted councils, wards
and community groups assessed
as having developed incremental
decision making capacity and
applied climate information to
adapt to longer-term climate
change and variability 3
0%
--
--
50% of
first
tranche
sub-
projects
--
--
70% of
all sub-
projects
Baseline,
Mid-Term,
Sub-Project
Approval
and EOP
Survey of
Beneficiaries
Baseline,
Midterm and
EOP –
Independent
Evaluation
Sub-Project
Approval:
M&E Team
Indicator Three: (Canal
Operation in Floodplain)
Change in area of canals with
optimal average flows
Average flow velocity of
targeted canals at 80% of
limiting flow standard (0.6
m/s for sandy clay soils)
measured 3-4 months after
floods recede
To be
assessed
by
baseline
study
0.6 m/s 0.5 m/s 0.5 m/s 0.48
m/s
Annual Technical
Survey
Assessment
Study and
M&E Team
Indicator Four:(Target
Beneficiaries)
Number of beneficiaries
supported directly by the
project to adapt to the effects
of climate change
Number of direct
beneficiaries (cumulative)4:
- Total HH
- Women-headed HH
- Other vulnerable HH
- Total no. of people
0
0
0
0
--
--
--
--
375
160
215
1,900
2,600
1,100
1,500
13,100
7,900
3,400
4,500
40,000
16,100
7,000
9,200
81,100
25,800
11,000
14,800
130,00
0
Annual
Records by
M&E
Team
M&E Team
Challenges of M&E
Lack of quantitative baseline data (allowing for monitoring of long term transformational impact)
Limited skilled human resources and capacities
Challenges of M&E Climate Change
Resilience
Difficulties in developing a composite indicator that measures different aspects of community resilience (e.g. observed behavioral change)
Inter-sectoral participatory project in a centralized Government system
Difficult to attribute/distinguish progress achieved through adaptation or sectoral policies and activities
Measures to address Challenges
Capacity building and awareness raising activities
A baseline survey (funded under a Project Preparation Grant) to be undertaken
Composite indicator based on score
card (to be developed)
Engagement of stakeholders at all levels (Secretariat responsible for sharing and “ground-truthing’ the results )
Measures to address Challenges
Inter-ministerial Secretariat established composing of staff from key sector ministries
Clear roles and responsibilities: Secretariat : Overall Program (SPCR) level
monitoring PPUI’s and Provincial Officers : project/sectoral
and sub-basin monitoring Partner NGOs and Private Sector firms: sub-
basin monitoring Beneficiary communities: participatory
monitoring though scorecard system
Will make use of existing M&E systems in districts
SNDP M&E reporting Level
Report Frequency
National Input tracking and implementation Monthly/ quarterly
National, provincial, district Progress report Quarterly
National, provincial, district Annual evaluation Annually
National Mid term evaluation Once