putting order into the scorecard landscape addressing ... (wb, fao, ftf…) the principal scorecards...

1. Putting order into the scorecard landscape

Matching demand with supply

Trying to understand links between different initiatives

2. Addressing technical & coordination questions: improving indicator quality and the M&E governance system

What are the demands? Questions to be addressed Available Scorecards

1. Understanding country

performance and

country needs

Where do countries stand

relative to goals? (Baseline) ▪ MDG or SDG processes

▪ Strategic Objectives of development

agencies (bilateral/multilateral)

▪ Strategic Objectives of resource

partners

▪ Strategic Areas (FtF)

Where are the greatest

needs, regionally and

thematically?

FAO Food security scorecard

FAO SO Scorecards

IFAD ATI

USAID: FtF Progress

scorecard

2. Measuring complex

phenomena and

monitoring progress

How much progress has

been made relative to the

baseline?

At country level

At global level (MDG/SDG)

FAO Food security scorecard

FAO SO Scorecards

IFAD ATI

USAID: FtF Progress

scorecard


3. Understanding Country

Commitments and

Capacities

How much capacity is

available at country level?

Where can Doers start

implementing their

programs?

Country Uptake of Doer

activities

IDS: Hunger Reduction Commitment Index FAO: C&C scorecard for food security and malnutrition FAO: OO scorecards


4. Understanding gaps What are the key gaps in

meeting country needs and

development goals?

• At country level

• At the regional and global

level

Synthesis of Doer and

Donor performance

scorecards

Synthesis of activities and

comparison with country

needs


5. Benchmarking /Evaluation What Doer renders the highest

return pursuing what

development goal? (“biggest

bang for the development

buck”)

What Donor allocates

development dollars most

effectively?

What Country uses the

development dollars most

effectively?

Corporate scorecards

(IOs/bilaterals)

Donor scorecards (bilateral,

multilateral)

Business climate scorecards




2. Addressing technical questions: improving indicator quality and the M&E governance system

The principal scorecards and some key links

2. Donors (funders) 1. Countries

3. Corporate (WB, FAO, FtF…)



Performance scoring

Identification of needs

Development goals

Strategic objectives




Performance scoring

•Capacity & commitment scoring

•Identification of Doer deliverables

and monitoring of Doer outcomes


Development goals





Performance scoring





Development goals



• SO (FAO), HLG (FtF), etc.



Performance scoring





• OO (FAO), 17 Goals FtF


IDS: hunger reduction

commitment index

World Bank: Benchmarking

the Business of Agriculture

FAO: C&C FS scorecard




Performance scoring




• OO (FAO), 17 Goals FtF, etc.



commitment index






National: monitoring within-country

performance of bi-lateral funders

International: coordination of funder

activities, regional and thematic



Performance scoring




• FO (efficiency of internal enablers)


Tier 1

Tier 2

Tier 3







commitment index








Performance scoring




• FO (efficiency of internal enablers)


Tier 1

Tier 2

Tier 3





Donor evaluation of

Doers (RBAs, BWIs,

NGOs, etc.)

Feeds MOPAN,

MAR, CGD-ME, etc.

Evaluation and

auto-evaluation of

Funders


Country evaluation

of Donors (RBAs,

BWIs, NGOs, etc.) IDS: hunger reduction

commitment index









2. Addressing technical & coordination questions: improving indicator quality and the M&E governance system

Function/needs Questions to be addressed Possible solution

1. Coordinating a growing

number of scorecard

activities at national and

international level

How can existing scorecard activities be better coordinated? How can emerging needs be better planned? Is there a need for a “Masterplan”?

3. Collecting, compiling and

disseminating information

How can we M&E stakeholders

effectively share information

on initiatives, data and

indicators?

3. Facilitating technical

discussions, addressing

technical questions

How can technical questions be

better coordinated?

4. Peer review of indicators

and scorecard approaches

How can we provide quality

assurance for data, indicators,

scorecard approaches?

Inter-agency and expert group on agricultural statistics equipped with standards and norms setting - under UNSC (?)

Alliance for Harmonizing Monitoring & Evaluation (?)

Thank you

The big picture: Monitoring and evaluating a rapidly evolving

international development system

“Realizing the Future we Want for All”: MDG and SDG processes Global Goals

RBAs Doers BWIs/IFIs

Countries

UN CGIAR Regions others

MDG1 … 8 SDGs Rio+20

FAO: SO1-SO6 CGIAR: SRF Others …

Org Outcomes

Outputs

Products/Services

Actions

Impacts

But how do we measure our

performance, our accountability? Can

resources be coordinated and targeted

more effectively? Donor accountability?

Normalization

Defining and creating a scorecard

Suites of

indicators

Weights

Synthesis

Aggregation

Scores 1. Country scorecards • Measuring country performance

• food security

• gender biases

• agricultural productivity

• …

• Measuring country capacity and

commitment

• Measuring the business climate in

agriculture

• …

Dimension 1

Indicator 1

…

Indicator n

2. Donor scorecards • Measuring donor performance

• food security

• gender biases


• …

• Coordinating donor efforts

3. Corporate “Doer”

scorecards • Measuring doer performance

• food security

• gender biases


• …

• Coordinating Doer efforts

• …

Dimension 2

Indicator 1

…

Indicator n

Dimension 3

Indicator 1

…

Indicator n

Dimension n

Indicator 1

…

Indicator n

An FAO Corporate Scorecard in the context of its Results Chain Model

Elimination of poverty through economic and social progress

Global Goals

Reduction of hunger and malnutrition

Sustainable management and utilization of natural resources

SO1: Eradicate hunger, food

insecurity and malnutrition

SO 4: Enable

more inclusive and efficient

food systems at local, national, regional and

international levels

SO 3: Improve the livelihood

of rural populations, in particular women and

youth, through enhanced

employment opportunities and increased access to

production resources

SO 5: Increase

the resilience of rural

livelihoods to threats

and crises

SO 2: Increase

production inagriculture, fisheries

andforestry in an

economic,

social and environmentally

sustainable manner

Organizational Outcomes



Organizational

OutcomesOrganizational

Outcomes

Outputs Outputs Outputs Outputs Outputs Outputs Outputs Outputs Outputs Outputs

Development outcome

indicators for monitoring progress They measure the medium-term effects

(development outcomes) to which the

Organizational Outcomes contribute.)

Organizational Outcome

indicators for monitoring the result of uptake and use of FAO outputs. OOs are the change produced of use of FAO Outputs by clients

Output indicators for monitoring FAO deliverablesOutputs are the deliverables which result from a development intervention

Activities

PEMS Individual work plans

Individual work plans contribute to activities. Examples: Paper drafted on good practices in the area of capacity development programs on nutrition.

An activity or set of activities implemented by many staff members, and are relevant for achieving Outputs. Examples: A capacity development program developed on the impact of the changes to food systems on nutrition; Guidelines developed for implementation of Capacity Development Program on […]

Results Chain Model (OSP*)

SO s

core

card

sCC

sco

reca

rds

CORP

ORA

TE S

CORE

CARD

*Adapted from “Q:\CommArea\DDK\Scorecard Workshop\Presentations\ Silborn_OSP_Results model for scorecard group.ppt”

putting order into the scorecard landscape addressing ... (wb, fao, ftf…) the principal scorecards...

Documents