project cycle management for international development cooperation indicators teacher pietro celotti...

Project Cycle Management for

International Development

Cooperation

Indicators

TeacherPietro Celotti

Università degli Studi di Macerata

16 December 2011

Agenda

Background

Definition and types of indicators

Monitoring

Quality of the indicator system

Programmes and projects

Programme

Project 1

Project n

Project …

Financial contribution from programmes to projects

Information (e.g. progress reports) concerning the status of implementation

to the authorities responsible for the programme -> support the day to day

management

Agenda

Background

Definition and types of

indicators

Monitoring

Quality of the indicator system

Indicators: what is needed?

Definition

Unit of measurement

Source of information (going from internal to external)

Baseline (i.e. the initial value against which an indicator is subsequently measured)

Refers to local context; or

Refers to activities in previous programmes

Target (combined with baseline information, provides information concerning the importance of the planned interventions)

Current status

Project indicators - Output

Output indicators: direct products of the project

Normally requires information from beneficiaries

Project indicators - Results

Result indicators:

relate to the direct and immediate effect on direct beneficiaries brought about by a project. They provide information on changes to, for example, the behaviour, capacity or performance of beneficiaries.

Project indicators - Output

Indicator type Indicator Name Unit

Output Length of rehabilitated/modernized county roads KM

ResultsIncrease passengers and freight traffic on the rehabilitated, constructed, modernized roads

%

Other examples - Regional and local transport infrastructure :

Project indicators - Output

Indicator type Indicator name Unit

OutputInhabitants benefiting from the implementation of integrated urban development plans

N

Other examples - Sustainable development of urban growth poles:

ResultCompanies established in the “urban action zones”

N

Project indicators - Output

Indicator type Indicator Name Unit

OutputRehabilitated/equipped health care mobile units (total and by type)

N

Other examples - Social Infrastructure:

Result Average response time of mobile units N

Project indicators - Output

Indicator type Indicator Name Unit

Other examples - Regional and local business environment:

Output Micro-enterprises created and supported N

ResultsNew jobs created in the supported micro-enterprises

N

Project indicators - Output

Indicator type Indicator Name Unit

Other examples - Sustainable development and promotion of tourism:

Output Tourism small infrastructures implemented N

Result Increase of overnights-staying %

Core indicators

Core indicators can be used to make comparisons or aggregations of data across similar programmes, priorities or measures.

How does it work? Programme authorities are required to include a number of ‘core’ indicators in their monitoring systems……

Programme indicators - Impacts

Impact indicators:

refer to the consequences of the programme beyond the immediate effects; often available only after a considerable time lag and they often need substantial methodological input in order to be valid.

At which stage of the programming cycle are they used?

during programme design, the ex-ante quantification of impacts clarifies the strategic direction of the programme;

ex-post, it helps understanding if the programme achieved the initial objectives (success or failure?)

Context indicators

Context indicators: reflect the socio-

economic conditions of a programme area

they enable to assess local needs of the programme area, to assess how the general context of a programme is evolving

Not just programme indicators…

Monitoring

Background

Definition and types of indicators

Monitoring

Quality of the indicator system

Indicators – Physical, financial, procedural

Physical indicators: describe the concrete ‘products’ of the programme;

Financial indicators: provide a basic picture for usage of the available resources (i.e. how fast? which priorities?):

Committed/spent; Year/Priority/Source of funding.

Procedural indicators: provide information on the current status of the operational level and forecasts for the next steps.

Physical monitoring

Example of physical monitoring:

Indicator (number of enterprises)

Unit of Measurement

Target Achievement

Micro N 142 91

Small N 133 111

Medium N 39 21

Owner (women) N 50 40

Owner (<30y) N 26 3

Start-up N 54 3

Financial monitoring

Example of financial monitoring:

Priority Expected expenditures

Resources committed

Expenditures

Amount Amount % Amount %

(a) (b) (b/a) (c) (c/a)

P1 133.4 100.4 75.2 71.8 53.9

Procedural monitoring

Most public activities have to follow a more or less rigid schedule in which the different steps are mandated and the deadlines fixed (i.e.). Procedural monitoring usually provides information about how project pipelines are progressing (where and when calls for tenders have been published, contracts have been awarded, …).

Demand

Procedural monitoring

Prio

rity

Ap

plic

atio

ns

Bein

g a

ssessed

Not e

ligib

le o

pera

tion

s

Elig

ible

not c

o-fu

nd

ed

Co-fu

nd

ed

op

era

tion

s

Sta

rted C

an

celle

d

Ren

ou

nced

Tota

l

Com

ple

ted

Bein

g im

ple

men

ted

P1 3,650 156 341 643 2,395 1,769 1,615 154 51 64

Implementation status (number of projects):

Project capacityMortality

Operational efficiency

Monitoring and evaluation

• Monitoring =information about the ongoing situation

• Evaluation = analysis (using monitoring and additional data)

Indicators are not used just for the purpose of day to day management…

Monitoring and evaluation

Quantitative and qualitative data, used as

input in evaluation exercises.

Monitoring Evaluation

Lessons to improve monitoring systems – e.g. identify better

indicators for future projects / programming.

Monitoring: data are collected concerning the progress with respect to

stated objectives.

Evaluation: using monitoring and

additional data, provides policy recommendations.

Surveys of beneficiaries

Stakeholders interviews

Focus Group

Case studies

Participative techniques

Monitoring

Background

Definition and types of indicators

Monitoring

Quality of the indicator system

Quality - individual indicators

Timeliness: information concerning the indicator can be collected and reported in time to influence the managerial decisions.

Sensibility: interventions can influence the valorisation of the indicator. (e.g. supporting exports, better turnover

related to new customers reached through the programme than

general turnover)

Availability: this means that the costs necessary to collect information from sources must be reasonable.

Validity: understanding of the indicator shall be the same for every potential user.and… possible perverse effects…

Quality – indicator system

Coverage: adequate coverage of expected allocation of financial resources;

Balance: among the different categories of indicators;

Selection: capacity of the authorities to absorb data and information is limited!

Relevance: advanced development for indicators related to the most significant themes and interventions.

Thank you

p.celotti@t33.it