introduction to participatory monitoring-evaluation

PARTICIPATORY MONITORING AND EVALUATION (PME) 2012 3

A SIMPLIFIED TRAINER’S GUIDE

INTRODUCTION TO PARTICIPATORY

MONITORING-EVALUATION

PARTICIPATORY MONITORING AND EVALUATION (PME) 20124

Published by West Africa Rural Foundation (WARF)N° 10075, Sacre- Cœur III- VDN - C.P. 13 DAKAR-Fann, SENEGAL

Tel: (221) 33 865 00 60 - Fax: (221) 33 860 66 89 -E-mail: [email protected] - Web site: www.frao.org

Many thanks to:All IFAD funded projects in West and Central Africa for their contribution, WARF staff and

consultants

© FRAO/WARF - Dakar, September 2012

Design: [email protected]

This publication was made possible by grant from IFAD for the Programme ofSupport for Monitoring and Evaluation Systems of IFAD projects in West and Central Africa.

Its contents are solely the responsibility of the authors and do not necessarily represent the officialview of IFAD.


TABLE OF CONTENTS

ACRONYMS AND ABBREVIATIONS 06

FOREWORD 07

SESSION 1: Introduction to the workshop 08

SESSION 2: Brief overview of the participatory approach 12

SESSION 3: Introduction to participatory monitoring and evaluation (PME) 15

SESSION 4: Importance of PME for IFAD projects 18

SESSION 5: Stages of the PME process 22

SESSION 6: Setting up a pme system 24

SESSION 7: Identifying actors and analyzing their needs 26

SESSION 8: Definition of PME objectives 29

SESSION 9: Choice of PME indicators 31

SESSION 10: Choice of information gathering methods 35

SESSION 11: Information gathering and analysis 37

SESSION 12: Implementing changes 45

SESSION 13: Management and consolidation of the PME system 47

SESSION 14: Monitoring and evaluation of the PME implementation 49


CAS Community Assessment Sheet

IFAD International Fund for Agricultural Development

WARF West Africa Rural Foundation

IED Afrique Innovation, Environment and Development in Africa

MFI Microfinancing institution

NHDI National Human Development Initiative

OVI Objectively verifiable indicator

PRA Participatory Rural Appraisal

MSRE Micro and Small Rural Enterprises

OP Organisation of Producers

IAP Information and Awareness-raising Providers

PROMER Rural Micro-Enterprises Promotion Project

PME Participatory Monitoring and Evaluation

SFPO Success, Failures, Potentials, Obstacles

MES Monitoring and Evaluation System

RIMS Results and Impact Management System

PMU Project Management Unit

6

ACRONYMS AND ABBREVIATIONS


FOREWORD

This simplified guide is addressed to facilitators who pursued the trainers’ training course held in

Toubab Dialao, Senegal in April 2008. These trainers will later be required to train officials in charge

of Monitoring and Evaluation of IFAD projects in Participatory Monitoring and Evaluation (PME).

These skills should enable the latter to assist beneficiaries of their interventions to set up a Participatory

Monitoring and Evaluation system. Thus, the grassroots communities are the final beneficiaries of this

capacity building process. For this reason, the content of this guide has been simplified; with emphasis

essentially placed on the aspects that are of practical relevance for the establishment of the PME system

at local level. Of course, facilitators are strongly encouraged to improve on it by drawing on their own

experience or through documentary research.

The design of the training content and guide are based on two fundamental assumptions.

The first is that the selected trainers sufficiently master participatory research tools (PRA, Participatory

Diagnosis) to be able to adapt and/or improve the proposed tools. The second assumption is that the

trainers have a certain experience in educational activities. The document provides trainers with the

basic elements required to prepare the staff of the concerned projects to assist the communities to set

up a PME system.

The document is organized in such a way as to provide (pedagogical) guidelines on the conduct of train-

ing sessions and content on the PME system’s implementation process. Thus, each session is organized

around two sheets.

The first sheet (referred to, by convention, as learning exercise) proposes a pedagogical approach for

the conduct of the session. To effectively apply these pedagogical indications it must be ensured that all

the necessary logistics (including the availability of rooms for group work) are in place. The pedagogical

proposals are indicative. The facilitators can modify them to ensure that they adapt to the context of

each session. They can also be replaced by other techniques considered more appropriate. Each ses-

sion bears a number.

The second sheet (referred to as content sheet) provides a content summary to which the facilitator

may refer to provide additional information. Of course, these sheets are not exhaustive. Facilitators are

therefore strongly urged to enrich them with their own research and additional documentation in their

possession.

7


1. Objectives of the session

• Inform participants about the context of the workshop

• Identity participants

• Determine the workshop objectives

• Define the workshop’s management principles

• Define the working rules (group contract)

2. Proposed technique: Interaction, brainstorming

3. Material and equipment required:

Required materials and equipment: Padex paper, padex board, markers of different colours, wall

sellotape, index cards of different colours

4. Total duration of session: 60 mn

5. Educational progression

• Prior to participants’ arrival and installation, the facilitator should check the state of preparation of

the room, the learning facilitation system and the equipment installed the day before.

• The room should be arranged in U-form or in staggered rows depending on the space available

• The tables should be mobile for the organization of group work

• The order in which participants will intervene is determined before the start of the session

Expression of expectations:

• Provide each participant with three index cards on which he/she is required to state what he/she

expects from this workshop (ex: Achievements to be consolidated, constraints/difficulties to be

removed, needs to be met).

• The cards are then collected, analyzed and classified according to category.

• These expectations are analyzed on the basis of the objectives predefined by the organizers.

• The workshop agenda is presented to participants, discussed and adopted

• The draft group contract is presented to participants, amended and validated

(Content card 1a)

6. Information provided by the facilitator

The facilitator introduces the learning from experience approach which will guide the teaching facilitation

approach (CONTENT CARD1b). The session’s work is summarised.

8

SESSION 1 INTRODUCTION TO THE WORKSHOP

LEARNING EXERCISE 1

PRINCIPLES AND PEDAGOGICAL PROTOCOL


1. Group contract

• Switch off or set mobile phones on vibration mode

• Answer telephone calls outside the room

• Ask for the floor before speaking

• Listen to one another

• Avoid repeating what others have already said

• Be brief to facilitate effective time management

• Limit going in and out of the room

2. Workshop principle

• Learning based on experience

• Allow participants to express their expertise

• Diversify the interventions

• Progress together on the basis of consensus

3. Organization of discussion sessions

• Exchanges and discussions on salient points

• Diversify teaching techniques

• Production of ideas or experience acquisition to be listed on an index card

• Plenary to present the outcome and collective analysis

• Designation of a rapporteur for the day

4. Management of group work

• Individual reflection based on past experience

• Pooling

• Write the ideas discussed on the index card

• An idea per card

• Write legibly, preferably in block letters

9


CONTENT CARD 1A


Stage 1: Sharing the participant’s experience (or a similar experience)

The facilitator can use different tools or techniques such as case studies, simulation or role playing,

group work, showing a documentary film, brainstorming during which participants talk about their expe-

riences, etc. There is however need to underline that regardless of the technique used by the facilitator,

prior preparation is essential.

This can be very time-consuming. For example, if the facilitator wants to use case studies, he should

gather and organize the information long before the training. He can use case studies already prepared

but should examine them thoroughly himself in order to be able to answer questions that participants

could ask him. In case he wants to introduce a role playing exercise, he should prepare his scenario

beforehand with a clear definition of the different roles, the definition of adapted profiles to play the roles,

etc.

Stage 2: Reflection, conceptualization

After presenting the experience/experiment, the facilitator invites participants to share their views about

this experience. To properly organize the discussions, the facilitator prepares a certain number of key

questions beforehand? For example: What are the key observations? How do they explain them? What

are the lessons learnt? etc. All the ideas are written, as and when required, on the board or cards to be

displayed on a notice board prepared beforehand.

Stage 3: Conclusions, generalization

During the third stage, the facilitator establishes the link between the analyses made by participants

and the concepts or theory he wants to introduce. He will seize this opportunity to introduce any other

idea or concept which had not been mentioned by participants. It will be discovered that most of the

concepts which the facilitator wants to introduce during this session would have been mentioned by par-

ticipants. This stage thus provides the facilitator with the opportunity to show participants that they al-

ready have a real-life experience and an experience with these concepts; since the facilitator’s role is

to help them express their knowledge. In short, help them to discover the knowledge hidden in each of

them. This approach has another advantage because it helps to build the participant’s confidence, since

there is little space for theoretical presentations.

10


CONTENT CARD 1B


Application

The last stage consists of the practical application of these new concepts. This application is generally

made after the training, when the participant returns to his/her working environment. It is therefore ex-

tremely important to evaluate the training application. This evaluation is generally done by the trainee’s

structure of origin. But the introduction of a practical application stage in the training provides participants

with the opportunity to test some of the concepts introduced during the training.

11


CONTENT CARD 1C

Experience

Application Reflection

GeneralConclusion



• Ensure that all participants have basic knowledge of participatory research principles, techniques

and tools

• Provide participants with additional information, if necessary

2. Proposed technique: Show a film on « Question of Differences» : Gender and PRA or another film

(the film is among the distributed resources; the technique can therefore be applied by trainers).

3. Material and equipment required: Television, Cameoscope VHS, portable computer, padex paper,

padex board, DVD/CD or pen drive.

4. Duration of session: 60 mn


• Before showing the film, the facilitator informs participants that they should take note of the different

parts (the principles, tools, recommendations, etc.)

• Show the first part of the film on the principles of communication and introduction to PRA.

• After the film show, open a discussion in plenary to ask participants to share the essential points

they have identified. It will be appropriate to proceded by theme by theme to facilitate the discussions

and the organization of information.

• Ask one of the participants to write the ideas on the padex board as they are given.

• When the discussion focuses on tools, ask participants whether they are all familiar with these tools

and/or whether they know others (to be noted on the table).

• At the end of the discussion, the facilitator can provide documentation sources to participants re-

quiring additional training. To that end, it will be useful to prepare a small documentation for distribu-

tion.


In case the facilitator has no film to show, he may use another teaching method.

For example, he can organize a brainstorming session around the following key questions:

- What is participation?

- What are its main principles?

- What conditions are absolutely necessary for its implementation?.

- Which participatory tools do you know?

- What are the constraints and difficulties linked to the implementation of such participation?

NB : This session is not meant to provide in-depth training on participatory research; since being

well-versed in the participatory approach principles, techniques and tools is among the criteria on

which the selection of trainers is based. The purpose of the session is thus to recall these

principles, techniques and tools.

12

SESSION 2BRIEF OVERVIEW OF THE

PARTICIPATORY APPROACH

WORKSHEET 2


What is participation?

Participation is an active process in which the initiative is taken or «jointly taken» by the people, guided

by their own ideas and using means and processes over which they have no effective control

(Guèye,1999).

Participation therefore means taking an active and decisive part in decisions concerning what should

be done, how it is done, profit sharing, monitoring and evaluation.

On the effectiveness of participation in development projects

Different projects apply the principles of participation in different ways. Some involve the populations

fully during the identification of problems and the planning of actions; but they quickly return to their old

practices during the implementation stage.

Other projects define their priorities and choose actions without the population’s participation and try to

« catch-up » by entrusting a few responsibilities to beneficiaries.

Others limit themselves with involving the populations in the monitoring and evaluation stage.

Of course, none of these three situations is to be encouraged because the beneficiaries’ participation

should be pursued at all stages of a programme’s life cycle.

Question: How do you perceive the effectiveness of

participation in your project ?

13



CONTENT CARD 2

ON PARTICIPATION

Poor

Planning

Implementation

Monitoring and

Evaluation

Average High

Project’s internalfactors

that encourage the

populations participation

The project’s internal

constraints and limits

restricting the popula-

tions participation


Conditions of participation

To ensure effective participation, the following three conditions should be simultaneously met:

• All groups, particularly the so-called vulnerable ones, should be present

• Such participation should not be limited to physical presence during decision-making; it should

rather translate into an effective influence on the decisions and the monitoring of their implementation

• It should not be limited to a specific stage of the project cycle but should be effective at all stages.

Some principles to be respected?

• The adoption of an interdisciplinary approach to better take into account the diversity of situations

and perspectives in the analysis of local situations. However, interdisciplinarity supposes the inte-

gration, in the team, of resource persons from the local community.

• Making optimum use of local knowledge and capacities in the analysis of problems and the choice

of solutions. The institution of PME provides a good opportunity for the application of this principle

since the beneficiaries become key actors of the system while the facilitator/presenter plays the fa-

cilitating role.

• The adoption of an iterative approach, which makes it possible to better link the reflection and the

action and immediately apply, in the field, ideas generated through collective reflection and action

research.

• The adoption, by project agents, of attitudes and behaviours that recognize the populations’ central

position in the analysis, planning, implementation, monitoring-evaluation process and their prepared-

ness to establish a relationship of partnership and mutual learning with the populations.

• Emphasis to be placed on visualization tools which facilitate communication and everyone’s partic-

ipation including those who can neither read or write.

14



WORKSHEET 2B



• Define monitoring, evaluation and participatory monitoring and evaluation notions

• Identify the main characteristics of participatory monitoring and evaluation

• Analyze the differences between PME and conventional monitoring and evaluation

2. Proposed technique: Group work

3. Material and equipment required: Kraft paper, markers in sufficient

numbers,cards of different colours

4. Duration of the session: 70 mn


• Form groups of 5 to 7 people

• Give 5 cards of the same colour to each group

• Ask the following focal question: «What are the main characteristics of participatory monitoring and

evaluation? »

• Give 10 mn to groups to identify the main characteristics of participatory monitoring and evaluation

• Prepare an area (kraft paper pinned on the wall, boards, etc.).

• Ask the rapporteurs of different groups to present the results of their reflection

• Classify the cards by regrouping those relating to the same idea in order to obtain a group of key

points (ask a participant to do this classification)

• Make a summary of the main characteristics of participatory monitoring and evaluation

• Get participants to identify the similarities and differences in the definitions and propose a summary

definition (5 mn).

• The definition retained is written on padex paper and displayed in the room

6. Additional information provided by the facilitator:

It is at this stage? Which one? that the facilitator may, if necessary, provide additional information, but

if the proposed definitions take into account most of the elements contained in CONTENT CARD N° 3,

it is recommended that emphasis be laid on the quality of the proposed definitions.

15

SESSION 3INTRODUCTION TO PARTICIPATORY

MONITORING AND EVALUATION (PME)

WORKSHEET 3


Introduction to PME: Definition of concepts

Basic Concepts (a few definitions drawn from the training)

Monitoring:

• Thorough and regular appraisal of resources, accomplishments and results of the intervention. Ap-

proach consisting in ensuring that the planned activities have been carried out

• Systematic and ongoing process for the collection of information on a programme or an activity to

observe the changes that occurred and propose measures to guide the decisions to be taken

Evaluation:

• Specific judgement on the programme process,

• Assessment of the level of accomplishment of results at the end of the project,

• Judgement on the value of an intervention with reference to criteria and standards,

• Reflection on the match between actions undertaken and initial objectives

• Action of making judgement such as the progress towards meeting the objectives (effectiveness) of

a programme or an activity, comparing results and costs (efficiency), or the sustainable changes gen-

erated (impact). The initial objective may be formative to help the programme improve its perform-

ance. However, other evaluations may lead to more radical decisions: Continue or stop (summative

evaluation)

Participatory monitoring-evaluation

• An ongoing and regular process which actively involves stakeholders in all the stages of collecting,

analyzing and using information on an intervention with a view to assessing the processes and results

and making recommendations (provide information about decision-making).

• It is a process to support the implementation of a development project/programme by grassroots

communities and stakeholders which strengthens appropriation, mutual responsibility, transparency

and knowledge of interrelations between the results, implementation factors and the environment.

16



CONTENT CARD 3

Source : Guèye, B

CONVENTIONAL MONITORING-EVALUATION (CME)

PARTICIPATORY MONITORING-EVALUATION (PME)

Who designs the system? Generally the projects orprogrammes

Generally the projectagents

The populations participateactively in the analysis

The diversity of view points ishighlighted

Poor, standardized indicatorsand collection tools Iterative process

Indicators often selectedat the start of the project andgenerally remains unchanged

More often criteria than indicatorswhich are reviewed as time goes onWhen to select indicators?

Who analyzes the information?

What types of information? Essentially quantitative Pivotal role of the qualitative analysis

Poor, standardization

Degree of flexibility

Taking the different perspectivesinto account

The beneficiaries with projectorprogramme agents and other actors

Differences between conventional monitoring-evaluation and PME


Importance of the PME

• The PME contributes to improving transparency in the management of supported programmes sup-

ported through the beneficiaries’ direct and ongoing control over decisions concerning resource al-

location and the definition of priorities.

• At the same time, it contributes to creating a reflex for the accountability reflex and the feeling of re-

sponsibility towards beneficiaries.

• It strengthens the relevance of programmes and the performance of actions initiated thanks to the

populations’ enhanced participation in monitoring their implementation.

• It strengthens the feeling of ownership of actions initiated among beneficiaries, and can thus en-

courage them to be more involved.

• The improvement of transparency in decision-making has led to strengthened confidence between

beneficiaries and agents in charge of implementing the programmes

• It strengthens the populations’ negotiation, planning and organizing capacities.

The effective implementation of PME considerably improves the performance of programmes and

the creation of longer lasting impacts.

17



WORKSHEET 3



Show the importance of Participatory Monitoring-Evaluation for IFAD projects

2. Proposed technique: Group work, plenary

3. Material and equipment required:

Padex paper and board, sellotape, markers, video-projector, portable computers,

Well-lit room, rooms for group work



• The facilitator introduces group work.

• Divide participants into 2 groups.

• Ask the focal question below to which participants should respond: «What improvements could

the PME bring about in the monitoring-evaluation system being implemented by IFAD

projects»?

• Give 40 minutes to the groups.

• Ask the different groups to present the results of their reflections.

• Open the discussions by asking speakers to lay emphasis on the contributions that may enrich

the groups’ proposals.


The facilitator draws the key lessons based on CONTENT CARD N° 4:

18

SESSION 4IMPORTANCE OF PME FOR

IFAD PROJECTS

WORKSHEET 4


1. Objectives

Satisfy the needs relative to core functions in the life of a project

• A sound planning of activities

• Monitoring results and

• Evaluating the project’s impact.

These three functions structure the system’s architecture:

• Planning

• Monitoring results

• Evaluating the impact

The discharge of these functions facilitates the project’s supervision, mid-term review and final evalua-

tion.

The key actors of MES at the Branch and Local levels.

At branch level

Two MSE actors are present at this level: Professional organizations and chambers of commerce.

The branch represents the PMU and, in that capacity, constitutes a level of the project’s operational

oversight.

To achieve this, it is actively involved in the design and implementation of the MES through:

• the validation of teaching materials and methods of the MES;

• the collection, consolidation of MES data;

• the use of MES products for monitoring (Trend charts);

• data transmission at the PMU level;

• support to MES actors at branch level;

The same activities will be carried out by the SAFIR with respect to component B.

PO and Chambers of commerce

Professional organizations (PO) and chambers of commerce of which the MSRE are members, will pro-

vide information about the support received and transmitted to MSRE within the framework of the proj-

ect.

At local level

At this level, two key actors are present, support service providers and the MSRE which are the project’s

main targets

Support service providers

The project has two categories of providers: information and awareness providers (IAP), specialist/gen-

eralist non-financial service providers.

19


IFAD PROJECTS

CONTENT CARD 4


These service providers are involved in the collection, analysis and use of data concerning the services

they provide to MSRE; the said data is then forwarded to the head of PMU monitoring-evaluation through

the branches.

The MSRE (micro, very small and small Enterprises), as well as AGR and PIE in the rural areas),

These MSRE express their needs for support received from the various providers and MFI; they provide

information concerning such support through the various providers. At this level, the type of beneficiaries

(enterprise) makes it fundamental to collect process and use data to ensure better management in order

to maximize the benefits.

Logical Framework

The logical framework is the main source for indicators of the monitoring-evaluation system. It helps to

define the project objectives more clearly, and determine the expected causal connections - the « pro-

gramme logic » - between the various elements of the chain of events that should lead to the achieve-

ment of results: providing resources, implementation terms, outputs, results and impact.

In this logical framework, the objectively verifiable indicators are the key tools for monitoring the progress

registered in the achievement of objectives. The hierarchy of indicators follows that of objectives: The

results achieved by the project and the anticipated effects can be accessed through some indicators,

while other indicators are interested in assessing specific objectives.

The monitoring mechanisms specify the data sources and the publication systems which will be used

to verify the state of each indicator. They should show what has been achieved in terms of input, results,

specific objectives and overall objective. The monitoring mechanisms and information system should

provide evidence that the objectives have been achieved.

The guidelines for a results and impact management system (RIMS) require the monitoring-evaluation

system of IFAD-funded projects to fill in a certain number of key indicators; however, these are not ex-

clusive, since a wider range of indicators (OVI of the logical framework) continue to be filled by the MES,

a range in which the RIMS first and second level performance indicators and impact indicators take an

important position.

The identification report presents the logical framework with indicators per level of objectives (overall

objective, specific objectives) as well as results indicators per component.

20


IFAD PROJECTS

CONTENT CARD 4


Why a Participatory Monitoring and Evaluation System (PME) ?

The purpose of the participatory approach in a monitoring-evaluation system is to guarantee:

• that all project actors, particularly the direct beneficiaries, take ownership of the results to ensure

that there are more effects and impacts

• the involvement of these actors (MSRE, providers of non-financial support services, privileged part-

ners) as much as other actors in the collection and analysis of results.

• the facilitation of interaction, the development of synergy and consistency in the implementation of

activities of the entire IFAD programme. It will therefore take into account the level of IFAD actors,

projects and programmes in Senegal.

• take into account the specificity of results and their indicators for the different categories of actors

• enable direct beneficiaries to generate and participate in collecting data and information on the

progress of the project and the achievement of results.

Implementing the participatory approach in the monitoring-evaluation system

Considering the need to collect data on the indicators, actors of the system can be classified into two

major groups:

• illiterates (the majority of RME managers, individual initiative developers) ;

• literates (other actors)

The collection system should therefore be adapted to the specific or different situation by taking the il-

literate target into account, notably at the MSRE level, without changing the data quality.

There is thus need to provide illiterate beneficiaries with the appropriate collection materials to enable

them to monitor and evaluate their activities and results.

Regardless of its simplicity, this system has to be buttressed by a results collection and analysis capacity

building process. This capacity building process will be continuous and iterative in order to adapt better

to the monitoring-evaluation system.

21


IFAD PROJECTS

CONTENT CARD 4



Identify the main stages for the setting up of a results-based PME system.

2. Proposed technique: group work, role playing, plenary

3. Material and equipment required: Padex paper and board, sellotape, markers, video-projector,

portable computers, well-lit room, rooms for group work


5. Learning approach

Introduction

Introduce the theme of the session:

• Divide participants into groups of 5 to 6 people, and ensure that the composition of groups alternates

to avoid having the same people in the same groups all the time

• Give a set of 10 cards to each group

• Explain to the groups that they are required to identify the main stages which, in their views, are

needed to set a participatory monitoring-evaluation system. They have a maximum of 10 cards. The

number of stages should not be more than 10.

• They have 15 minutes to discuss and identify the main PME stages

• Prepare a space (kraft paper pinned on the wall, ZOPP boards, etc.).

• At the end of the allowed time, ask the rapporteurs of different groups to present the cards on the

PME stages

• Choose a voluntary participant to classify the cards by regrouping those relating to the same stage

in order to obtain a group of key points

• Start a discussion to enable participants to draw a picture of the main stages

• The main stages are written on a padex paper


At this stage, the facilitator may, if necessary, provide additional information. On the basis of CONTENT

CARD N° 5, he should check whether there are any missing key stages. If any, he can again provoke

the participants’ reflection to get them to identify the missing stage(s).

22

SESSION 5 STAGES OF THE PME PROCESS

WORKSHEET 5


SESSION 5 STAGES OF THE PME PROCESS

WORKSHEET 5

STAGES OF THE PME PROCESS

1

2

3

45

6

7

Managementand consolidation

of PME system

Identify the actors

Identify the Criteriaand Indicators

Decide to setup the system

Implement actionsfor change

Collect andanalyze information

Chose the informationcollection methods

and tools

Define the Expectationsand Objectives

Bara Guèye: Introduction to Participatory Monitoring and Evaluation



• Provide participants with information system, suggestions about the setting up of a PME

• Share analysis tools in the process for the setting up of a monitoring-evaluation system

• Provide participants with additional methodological guidance, if necessary

2. Proposed technique: brainstorming

3. Material and equipment required: Cards, padex paper and boards, markers, sellotape,



• Organize brainstorming based on the following focal questions:

In the specific context of your project or organisation, what reasons or factors motivated the decision

to set up a PME system?

What are the constraints and opportunities generated by the setting up of PME in your projects

• The answers are noted on the index cards and then organized and discussed

• The facilitator then introduces CONTENT CARD N° 7

• He asks representatives of different projects participating in the workshop to fill aide-mémoire card

7 (if a project has several representatives, they form a group).

• At the end of this exercise, the groups present their results.

• These results are discussed


At the end of the discussions, the facilitator invites participants to make suggestions and draw conclu-

sions by referring to CONTENT CARD N° 6.

24

SESSION 6 SETTING UP A PME SYSTEM

WORKSHEET 6


SESSION 6 SETTING UP A PME SYSTEM

CONTENT CARD 6

Stage 1: DECIDE TO SET UP THE MONITORING SYSTEM

ANALYSIS WORKSHEET ON THE CONDITIONS OF PME IN IFAD PROJECTS

What institutional conditions/preconditions

are required to successfully implement the

PME?

The PME is perceived by the project as an or-

ganizational need

Within the concerned IFAD project, there is a

decentralized decision-making system which

allows communities to take into account the

results emanating from the application of the

PME

All members of the project have a clear reading

of the change of attitude which the PME

involves and are ready for these changes

Participation is perceived as a democratic and

non extractive process

Groups who need the system most were

identified

There is an institutional context that facilitates

community participation

There are good facilitators within the project,

who can assist the communities

Existence, within the community, of people

(presenters, community facilitators) who

can possibly facilitate the process

factors

Favourable

factors

Unfavourable

Depending on the

reply, what

measures should

be taken?



• Provide participants with the necessary tools and skills to identify actors

2. Proposed technique: Role playing, brainstorming, presentation, group work,

3. Material and equipment required: Kraft paper, markers in sufficient number, cards of different

colours

4. Duration of session: 90mn


• Choose 2 to 3 IFAD projects whose representatives in the training will act as resource persons. It

is recommended to select (if possible) projects intervening in different sectors or having different

components.

• Divide the rest of the group equitably between the selected projects (group work)

• The exercise consists in identifying key actors who have an influence on the project or are affected

by it: The focal question « who are the different actors affected by the project or with direct or indirect

influence on its functioning ? » (Brainstorming) duration

• Give 10 minutes to draw up the list of actors

• At this stage, the facilitator introduces the actors’ analytical grid (see CONTENT CARD N°7)

• After presenting the tool, the groups are requested to pursue the exercise by filing the grid on the

basis of the list of identified actors. Duration: 20 minutes

• At the end of the allocated time, ask each group rapporteur to present the results of its group

• Open a discussion on the different presentations. Duration: the remaining 50 minutes?

• The facilitator makes recommendations /gives advice on how to use and take advantage of the grid

within the framework of their work.

When will the simulation announced in the proposed techniques be made?


Based on CONTENT CARD N° 7, the facilitator informs participants of the existence of other authors’

analysis tools. He may thus request participants to propose tools which may be listed on padex paper.

The facilitator may request those making proposals to prepare summary sheets for the presentation on

the use of these tools.

These sheets could be improved, if necessary, and distributed to participants

The facilitator can also present the power-interest grid explaining that it is complementary to the actors’

analysis grid presented earlier on. In general, the power-interest grid is applied first to classify actors

according to their interest and power. The actors’ analysis grid can then be applied to better understand

the nature of these interests and powers.

26

SESSION 7IDENTIFYING ACTORS AND

ANALYZING THEIR NEEDS

WORKSHEET 7


Who are the actors?

The actors are those who have an influence on or are affected by the project or programme concerned

by the participatory monitoring-evaluation.

The identification and analysis of actors are an important phase in the establishment of the PME sys-

tem.

The PME is set up to meet the concerns of these actors, particularly those directly affected by the inter-

vention of the project or programme (direct and indirect beneficiaries).

Some actors are more visible because of the positions they occupy and the roles they play in the com-

munity or project. But there are also less visible actors who generally belong to so-called vulnerable

groups and are most affected by the activities undertaken. These groups, which constitute the primary

beneficiaries of the project, should play a central role in the design and management of the PME sys-

tem.

It is therefore important to have an appropriate approach and tools to identify them and examine their

interests and what they expect from the project, the type of influence they can exert on the project ac-

tivities and the arrangements to be made.

How to conduct the actors’ analysis?

There are several tools for that purpose. They include:

The power-interest grid:

It is used to make a simple mapping of actors by taking into consideration the interest that each of them

could have for the PME system to be set up, as well as the influences (positive or negative) that he/she

could have on the system. To apply it, one should first, identify all the project actors and second, prepare

a typology by placing each actor in one of the 4 spaces of the grid, corresponding to its interest and the

importance of his/her influence. Of course such a classification should be justified. At the end of the

classification, one should examine the actions to be undertaken for each of the 4 categories of actors

identified for the success of the PME system to be set up.

The actors’ analysis grid:

It facilitates the identification of the different actors, their interest for the system, their influence on the

system, and the actions to be taken to improve their participation. As can be observed, this grid makes

it possible to produce the same type of information as those generated by the power-interest grid, the

only difference being that the former is used to classify actors.

The two grids are also complementary since the actors’ analysis grid can be used as a back-up for the

organization of information generated by the reflection which accompanies the preparation of the power-

interest grid. But, for reasons of simplicity, one can choose to use only one of them. One should not

lose sight of the fact that this process is, first and foremost, meant for the local populations and that, as

a result, one should avoid using a variety of tools which would complicate the process even more.

27



CONTENT CARD 7

Stage 2: IDENTIFICATION AND ANALYSIS OF ACTORS




CONTENT CARD 7

POWER-INTEREST GRID

INTEREST

POWER

LOW

HIGH

HIG

H

Low

Keep them informed about the

conduct of the programme

Important actors!

Do everything to maintain this

group in the process

Generally key beneficiaries

People or groups living

in the community but

not directly affected by the

Programme. If they are potential

beneficiaries, they should, if possi-

ble, be associated in some

actions in order to prepare them

Step up their level of information

and training

Need for negotiating capacity

THE ACTORS’ ANALYSIS GRID

Actors

What interest do

this group of

actors have in

the PME?

What positive

influence can this

group have on the

PME system ?

What negative

influence can

this group have

on the PME

system?

How to step up

the participation

of this group

of actors?



Improve the participants’ knowledge of PME to strengthen their capacity to assist the populations in

identifying PME objectives

2. Proposed technique: Case study, role playing


colours



• Choose 2 IFAD projects whose representatives in the training will simulate the role of direct

beneficiaries. It is recommended to choose (if possible) projects intervening in different sectors or

having different components.

• Train as many groups as selected projects, if the number of participants allows it.

• Explain that the exercise consists in putting oneself in the shoes of beneficiaries to identify the

monitoring-evaluation objectives in the selected project. Other members of the group should ensure

that the objective is clearly stated.

Ask the following focal question « What are we trying to know or pursue through our participatory

monitoring-evaluation system? »

• Ask each group to formulate a maximum of two (2) objectives

• Give each group a padex paper to list the objectives

• At the end of the allotted time, ask each group rapporteur to present the objectives set for the IFAD

project he/she represents

• Open a discussion on the different presentations. Focal questions to guide the discussions:

- Are the objectives well formulated?

- Are they effectively PME objectives?

- If not, what other reformulations can be proposed?

6. Information provided by the facilitator Drawing inspiration from Content Card N° 8, the facilitator

provides the necessary additional information about the formulation of objectives.

29

SESSION 8 DEFINITION OF PME OBJECTIVES

WORKSHEET 8


For simplicity, the objective of PME specifies what the key beneficiaries seek to monitor and evaluate.

Who defines the PME objectives?

Within the framework of PME, the objectives are those of key beneficiaries. The project is meant to

assist the latter to identify the objectives they intend to assign to their PME system. The facilitator should

build on the analysis previously conducted by actors to identify all persons or groups who should par-

ticipate in the identification of objectives.

A few rules

• Since it is a PME system essentially meant for the communities, one should avoid being dogmatic

in the formulation of these objectives

• The populations should be provided with the opportunity to present their ideas (objective) clearly,

regardless of the method they use. For example, the populations may formulate their PME objectives

as follows:

- we would like to know whether women participate effectively in the meetings held by our group-

ing;

- we would like to see whether the decisions taken concerning the management of financial re-

sources allocated to the project are transparent,

- we would like to see whether the quality of services provided by the project effectively meets

our expectations

• Ensure that the populations do not select many PME objectives. The more objectives there are, the

more indicators one has to pursue. This makes the system more complex and more difficult to man-

age

• When the PME is launched for the first time, one should be limited to one or two simple objectives;

and as the populations understand the system, new objectives can be added

• For example, in view of the current situation of the project, is the monitoring of service quality the

most important? Or the participatory monitoring-evaluation of the different actors’ participation? Or

the PME of the achievement of project objectives?

30

SESSION 8 DEFINITION OF PME OBJECTIVES

CONTENT CARD 8

Stage 2: DEFINITION OF THE OBJECTIVES OF PME

SYSTEM TO BE SET UP

Define the monitoring objective.



• Enable participants to understand what a monitoring-evaluation indicator is

• Define the main characteristics of the indicator

• Describe the process for the participatory definition of indicators with target groups

2. Proposed technique: Brainstorming, Group work

3. Material and equipment required: Padex, padex paper, markers, sheets,

video projector, computer

4. Total duration of session: 90 mn


• Ask participants to form pairs

• Give 3 sheets to each group and ask them to write a key word describing the indicator, on each

sheet

• In plenary, ask each group to designate a rapporteur to present their results;

• The sheets are displayed on the board or on a wide Kraft paper as they are presented;

• The facilitator asks a participant to classify the sheets in homogenous clusters; • The list of key

words is written on a padex paper

• Building on content card n° 9, the facilitator completes the results produced, where relevant

After this, the facilitator requests the working groups to come together around the PME objectives

defined during the preceding session (session 8)

• Ask the groups to define indicators in relation to the objectives defined

• Ask the groups to present their results

• Ask participants to discuss the results: question to guide the discussion: are the indicators clearly

defined?

• Write down the different comments on paper

• Then ask in plenary: What characteristics are common to the different criteria defined?

• The answers are written on padex paper


The facilitator draws a conclusion on the main characteristics of the indicator

What is an indicator?

• A revealer,

• A marker,

• A set of measures

• A describer,

• A simplifier of a more complex reality

What is it used for?

To measure the progress made during a given period of time in relation to a monitoring objective defined

beforehand. Since each indicator provides information concerning only one part of the objective to be

monitored, it is naturally necessary to have several indicators for each objective. For example, if the

members of a grouping participate regularly in meetings, the different indicators should be identified.

31

SESSION 9 CHOICE OF PME INDICATORS

WORKSHEET 9


What are the types of indicators

• Resource indicators concern the budget allocated at every level of the intervention, the human

resources mobilized, etc. The measurement of these indicators provides information about the

efficiency of the project’s intervention.

Example

• Grants

• Annual Budget

• Borrowings

• Labour

• Input costs

• Etc.

• Activities indicators: to achieve the project objectives, a certain number of activities are

implemented. The monitoring system may focus on the level of achievement of these activities

• Meetings

• Training

• Visits

• Etc.

• Process indicators: They relate to the decision-making process and makes it possible to

determine, for example, the inclusion and/or participation of actors, the regularity of meetings, the

regularity of reports, etc.

• Existence of reporting rules

• Degree of women’s participation in decisions

• Frequency of debriefing meetings

• Etc.

• Product indicators: When an activity is carried out, it generally generates a tangible or non tangible

product. For example, at the end of a training, the number of people trained (product) can be

assessed. The product is the immediate and tangible result of the combination of a resource

(expenditure) and an activity (training): product: number of trainees

• Trainees

• Number of text books produced

• Number of credit received

• Etc.

• The results indicators reflect behaviour. For example, a few months after the training, one can

assess how many participants have applied what they learnt. Or if a project distributes equipment

(product) one can assess how many beneficiaries use this equipment.

Results indicators also assess the scaling down of women’s working hours following the introduction of

a new activity or equipment.

• Number of people who applied the training received

• Use of credit obtained

• Number of people who use the text books

• Etc.

32


CONTENT CARD 9

Stage 4: CHOICE OF MONITORING INDICATORS


• Impact indicators assess the long-term consequences of an intervention, beyond the immediate

effects. However, it is very difficult to evaluate an impact and link its cause to a given project.

Actually, the impacts are generally the product of several unrelated interventions in time and space. This

explains why, in PME, emphasis Is particularly laid on the other levels and, in particular, on the effects.

A few principles

• Avoid being dogmatic: the criteria can also serve as a basis

• Different groups may have different criteria or monitoring indicators

• Since the process is iterative, the number and type of indicators may be readjusted as time goes

on

• At the beginning, choose a limited number of relevant indicators to foster learning

• It is essential to have a certain balance between the different levels of criteria/indicators (associate

criteria related to the activities and others related to the process);

Example

33


CONTENT CARD 9


• Number of people expressing satisfaction

• Number of unsatisfied people

• Etc.

We would like to know

whether women participate

effectively in the meetings

held by our grouping

• Number of meetings held

• Number of participants

• Number of women

• Number of decisions taken

• Types of services offered

• Total number of beneficiaries

• Number of female beneficiaries

• Number of districts or villages

• Number of women beneficiaries per

district/village

We would like to see

whether the quality of

services provided by the

project effectively meets

our expectations

Our objective Indicators


What characteristics are common to these different indicators?

They are

• Simple: Each indicator refers to only one thing and is free of ambiguity

• Measurable: These indicators are formulated in such a way that they would be measurable:

Thus the changes made can be measured from one participation monitoring-evaluation session

to another

• Achievable/accessible: The populations may have access to information required to assess

the changes

• Effectively reflect the objective (relevancy): the indicator should measure what it is supposed

to measure and not another reality

• Temporally measurable: When a monitoring periodicity is defined, it should be ensured that it

helps observe the expected developments in the indicator measurement.

It is worth noting that the measurement notion does not necessarily refer to numbers and quantities.

Less tangible indicators like perception can be measured using the appropriate measurement tools.

Be careful to: Make a distinction between the criterion and the indicator

The criterion refers to general values accepted by the community and serving as a beacon that

guides the community’s view: ex, women’s participation in decision-making, the poor’s access

to services. Very often, in the PME exercises, the populations mention the criteria first. The fa-

cilitator, through probing questions, should be able to get them to identify the indicators. For

example, if the group says it wants to evaluate women’s participation, the facilitator can ask its

members what measures they intend to use for that (number of women participating in meet-

ings, number of women in the office, number of participations at meetings, etc.) and which refer

to indicators.

A few steps for the participatory definition of indicators:

• Bring together all the groups whose participation in the monitoring exercise in necessary

• Identify what the success of the initiative means for each group, and this results in criteria

• On the basis of the criteria, define indicators either in plenary, or in small groups

• Define the units of analysis and the sampling procedure

• The indicators are likely to change, depending on the progress of the project, the

context, partners

34


CONTENT CARD 9




Familiarize participants with the PME’s results-based participatory data collection tools and techniques

2. Proposed technique: Brainstorming, group work, presentation, case study

3. Material and equipment required: Kraft paper, padex paper, markers in sufficient number, cards of

different colours

4. Duration: 65 mn


• Brainstorming on participatory monitoring evaluation data analysis tools at the projects’ level (15mn)

«What data analysis tools do you use in projects? »

• If necessary, the list of tools is completed by the trainer/ facilitator (5 mn)

• The participants are divided into small groups of 3 to 4 people and the facilitator assigns to each

group 1 or 2 tools with which participants are familiar

• The conditions of use of the listed tools are analyzed (favourable conditions, limits) 30mn

• The groups present the results of their reflection (15 mn)


• Insist on the fact that in a participatory process, data collection and analysis are done simultane-

ously

• Based on CONTENT CARD N° 10, the facilitator provides the additional information required

Before closing this session, he announces the presentation of the video on the use of the Evaluation

Form by the Community as an example of an appropriate PME tool for the monitoring of qualitative

indicators.

SESSION 10CHOICE OF INFORMATION

GATHERING METHODS

WORKSHEET 10


SESSION 10

Several participatory tools can be used within the PME framework. However, the choice of a specific

tool depends on the system that has been put in place. In fact, the PME application scale, the types of

actors involved, the targeted objectives and the PME indicators influence the choice of tools. However,

regardless of the types of tools chosen, an important principle, namely the demand for PME simplicity

should be taken into consideration. In this perspective, a few rules should be complied with:

• The tools should be chosen in close collaboration with the local actors entrusted with managing the

system to be set up;

• Limit the number of tools as much as possible. The greater their number, the more complex the

PME system is;

• To facilitate the involvement of everyone, and make the PME tool more user-friendly, there is need

to promote visualization, as far as possible. It would be a mistake to believe that visualization is only

meant to facilitate access to information for illiterates. Today, visualization has become a key dimen-

sion of modern communication, and it is increasingly preferred to facilitate learning;

• As regards visualization, illustrations should be chosen by /with the actors themselves (avoid having

the consultant decide the forms of illustrations) ;

• Need to translate the key concepts in local languages

Proposed tools: The form for evaluation by the Community Assesment Forum (CAF)

Advantages of the FEC

• It is a tool that makes it possible to take into account, in an integrated manner, the different PME

stages

• Its application is based on the participation of all the groups

• Its application provides IFAD project managers with immediate feedback on how beneficiaries

perceive the quality of services and on measures to be taken

• Actions to be implemented result from a collective reflection that takes the views of all actors into

consideration

• It is simple and accessible to all because it is based on visualization

• The information is generated through focus groups, which facilitates the participation of groups

with difficulties to express themselves during mixed group discussions

Source : Guèye, B (INDh, 2008)

CONTENT CARD N° 11 describes the Community

Assessment Form (FEC) application process

CHOICE OF INFORMATION

GATHERING METHODS

CONTENT CARD 10

Stage 5: CHOICE OF INFORMATION GATHERING METHODS

AND TOOLS


SESSION 11


Provide participants with the ability required for data collection

2. Proposed technique: Video projection, group work

3. Material and equipment required: video on the use of the form for evaluation by the community,

Kraft paper, markers in sufficient number, cards of different colours



• Introduce the video application context

• Before starting the projection, ask participants to note the different stages of the Community

Assessment Form (FEC) application (meaning of the acronym)

• After the presentation, open a discussion session for a summary of the main stages;

• The facilitator then proposes to participants to apply the Community Assessment Form (FEC) in

their evaluation of the application of the participatory approach within IFAD projects

• To that end, it is proposed that participants be divided into 2 groups representing field workers

of IFAD projects (group of actors 1) and the populations beneficiaries of IFAD projects (group of

actors 2). Choose an IFAD project

• The two groups meet first to identify the indicators that will enable them to assess the

effectiveness and quality of the application of the participatory approach by IFAD projects

• Limit the number of criteria to no more than 5 (it is an educational exercise)

• Follow the stages described in the card for the completion of the exercise

• Following the presentation of results, the methodological observations are noted (difficulties,

questions, etc.).

6. Facilitator’s information input

• On the basis of CONTENT CARD N° 11, the facilitator tries to provide answers to the questions

asked. He also provides all other necessary information on the use of the form,

• He should however explain that the Community Assessment Form (FEC) was the tool preferred for

the training, but that other tools exist. He gives examples of monitoring tools contained in CONTENT

CARD 11. He may also ask participants to share other tools they know or use. The facilitator lists

them on a padex paper

INFORMATION GATHERING

AND ANALYSIS

WORKSHEET 11


SESSION 11

Information gathering

Presentation of the process on the use of the Community Assessment Form (FEC)

FEC application process

Session for acquaintance, mutual understanding, presentation of the objectives of the visit and the pro-

ceedings of the session. During the presentation session, insist on the importance of the local actors’

commitment as an emerging approach to strengthen the performance of public programmes; but espe-

cially on the need for local actors to acquire the capacities required to ensure monitoring and evaluation.

Such a mechanism should be positively perceived, because the way in which beneficiaries perceive the

services provided by the programme gives signals to officials and grassroots representatives that would

enable them to improve the quality and performance of their services on a daily basis.

Identify the key stakeholder groups. These groups benefit from the actions of the programme, those in

charge of providing these services, or those in charge of controlling the implementation, etc. In reality,

this identification has already been done (see session 8);

Focus groups: division of team members into homogeneous sub-groups whose number is equal to that

of the stakeholder groups. The criteria for the composition of these focus groups may vary from one

PME system to another; it may be a criteria related to gender, residence, types of services received,

etc.

Ensure the proper distribution of skills, profiles and sex. A facilitator will be attached to each group to

assist the latter to evaluate the indicators to be identified. There is need to ensure optimal time man-

agement (moderation, reporting, in particular).

Organize a brainstorming session regrouping all stakeholder groups to discuss and choose the most

relevant monitoring-evaluation indicators. Avoid having too many indicators. In some cases, each stake-

holder group chooses its indicators separately. But the advantage of having the same criteria lies in the

fact that this facilitates comparisons; the evaluations made by through the differences relative to the

same aspects;

Before initiating the following stage, and in the event that the process is applied for the first time, the fa-

cilitator assists the group to design the monitoring-evaluation medium. The latter is composed of a grid

adjusted for the qualitative type indicators. The grid facilitates the measurement of the levels of satis-

faction in relation to services received/rendered, actors’ involvement, management, etc. Below is a model

of the assessment form:


AND ANALYSIS

CONTENT CARD 11

Stage 6: INFORMATION GATHERING AND ANALYSIS


SESSION 11

• On the basis of the selected indicators, the different groups work separately to carry out the

evaluation with the help of the evaluation form. In each group, explain clearly the principle of the

exercise and the results expected:

- copy the evaluation grid on padex paper;

- Explain the grid filling principle and, in particular, the fact that participants vote individually (each

participant should give a score for each criteria). It is even preferable for each participant to record

his/her vote directly on the grid;

- Regardless of the score given, the reasons for such a choice should be well argued and as one

goes on, scored in the « comments » column by the facilitator;

-When all the individual scores are recorded next to the corresponding criterion, these scores

should be converted into percentage. The most significant observations are recorded in the cor-

responding box (comment)

• After collecting the scores given for all the evaluation criteria, start a discussion to collect all

additional observations on the final results of the exercise.

• Interface between actors. This is an important stage. It consists in regrouping the different

stakeholder groups to compare the respective analyses. The exercise is not meant to build a

consensus but to understand the factors that explain the differences in perception. It can be

structured around key questions like: What are the differences/similarities observed in the

perceptions and analyses by the different groups? How does the extended group interpret these

differences and/or similarities ? What are the causes of these differences?

What are the changes to be made? All this information shall be carefully noted on padex paper. The

facilitator shall then help the group to organize this information into key thrust areas or themes.

• Negotiation: On the basis of the results of the interface session, the actors identify the different

actions to be implemented in order to improve the situation.


AND ANALYSIS

CONTENT CARD 11

1. 2. 3.Moderatelysatisfied

- 4. Satisfied 5.Very satisfied

Ooooooo (16%)

Ooooooo(14%)

Ooooooooooo(24%)

Oooooooooo(22%)

Ooooooooooo(24%)

Etc.

INDICATOR

INDICATOR

INDICATOR

INDICATOR

INDICATOR

INDICATOR

Project Village or Zone:Nature of the monitored component:Stakeholder group:

Dissatis-fied

Poorlysatisfied

COMMENTS: jot downthe reasons justifyingthe scores given


SESSION 11

Move from evaluation to monitoring

To simplify things, monitoring can be considered as a regular succession of evaluation sessions con-

cerning the same objectives and indicators. Thus, the monitoring process entails repeating the sessions

at regular intervals to assess the different indicators that have been identified. After each session, the

results will be recorded in the monitoring table (see model below). However, after recording the results

in the monitoring table, the facilitator should get the group to compare these results with those obtained

during the preceding monitoring session. The grid for the analysis of changes occurring between ses-

sions may be used to gather the various information emanating from this analysis.

Monitoring-evaluation of quantitative indicators

A diverse range of simple tools may be used to monitor quantitative indicators. However, given the spe-

cific situation of each participatory monitoring-evaluation system, the creativity and innovation of local

actors are required to develop suitable tools. This also has the advantage of facilitating the appropriation

of tools by the populations. For this reason, it is always strongly recommended to facilitators working

with the communities- after identifying the indicators- to invite the actors of the system to create simple

tools to measure these indicators by taking into account some principles discussed earlier, namely sim-

plicity and the use of visualization to represent the indicators and quantities. The facilitator should avoid

proposing his own tools from the onset. He should first invite the populations to explore their own cre-

ativity potential before showing them the tool(s) at his disposal. Actually, it might not even be necessary

for him to present his own tools if the populations succeed in developing a simple and efficient tool to

measure the selected indicators.


AND ANALYSIS

CONTENT CARD 11


SESSION 11INFORMATION GATHERING

AND ANALYSIS

CONTENT CARD 11

A few examples of PME tools

Example 1: Labour utilization monitoring form

Type of beneficiary Period Period Period

Initiative developing RME Number of jobs created

Number of apprentices

Composante BNumber of loans received

Amount of loans

Amount repaid

Composante C

Training received



AND ANALYSIS

CONTENT CARD 11

Example 2:

Programme CES 2, Burkina Faso.

This tool may be adjusted to serve as a monitoring-evaluation medium. To

that end, instead of daily intervals, one can adopt intervals that are more in

line with the selected indicators (monthly, quarterly monitoring, etc.).

Full

workday

Half

workday

Day of the

weekLocal

currency

LEGEND

Source: Hien, Fidèle et Ouédraogo, Ali

Farming Activity

Days in the

week

Day 1

1 symbol

Duration of

work

Labor input

manLabor input

woman

Labor input

child

Exaternal

labor input

Cash expenses

on hired labor

Day 1

1 symbol

Day 1

1 symbol

Day 1

1 symbol

Day 1

1 symbol

Day 1

1 symbol

Day 1

1 symbol

X W


SESSION 11

Example 3: The evaluation wheel used to assess local governance in Fissel (Senegal). The use of this

tool at regular intervals can show the Rural Council and other participants of the process, how the as-

sessment of citizens can change following actions taken after each PME session.

This tool can be used within the framework of any IFAD project to monitor and evaluate other qualitative

indicators.


AND ANALYSIS

CONTENT CARD 11

Source : Guèye, B (2005)

DOXINU CONSEY RIIRAL

Caytub alal jiLimu jëf yi

Limu ndaje yi

Limu dogal yi

Limu wayjapalé yi

Bookiinu ndawci dogal yi

Dayoobjumtukaayyi

Jaapandik tasukaayi xabaar yi

Jaapandikjumtukaayi tétëlin

Téewayundaw yi cindaje yi

Japandik tënkukaayi dogal yi

Xeeti kom-kom yi

10

10

10

10

10

10

1010

10

10

10

10

10



AND ANALYSIS

CONTENT CARD 11

Monitoring table model

Indicators

Indicators

Indicators

Indicators

Indicators

Indicators

Compared to the precedingmonitoring session, did theevaluation of the indicatorreveal (1) a positive change,(2) a negative change or(3)No change at all?

Factors explainingthe positivechange in theevaluationof thecriterion

Factors explainingthe negative change in the evaluationof thecriterion

What actions needto be taken?

Grid for the analysis of changes occurring between

two monitoring sessions

1 2 3 4 5 1 2 3 4 5 1 2 3 4 5

XXXXXXX

35%

XXXX

20%

XXXX

X 15%

XXxxxx

30%0%

Xxx

15%

Xxx

15%

XXxxxx

30%

XXxxxx

30%

Xx

10%

dissatis-fied

Poorly satis-fied

Modera-tely satisfied

satisfied Very satis-fied

dissa-tisfied

Poorly satis-fied

Mode-rately satis-fied

Satis-fied

Very satis-fied

Dis-satis-fied

Poor-ly satis-fied

Mode-rately satisfied

Satis-fied

Very satis-fied

Indicator

Indicator

Indicator

Indicator

Indicator

Criterion

Monitoring session of:............. Monitoring session of:………. Monitoring session of:……


SESSION 12

1. Objectives

• Provide information about the process for the activation of changes

• Discuss with participants about tools and techniques for the introduction of changes

2. Proposed technique: Group work, role playing

3. Material and equipment required: Padex, padex paper, wall sellotape, markers,

4. Duration of session: 30mn


• Maintain the same groups as those of the preceding session

• Ask them to pursue the exercise by identifying and planning, on the basis of the evaluation

results, the actions to be undertaken with a view to strengthening the resolve to take into

consideration the participatory approach within IFAD projects

• Introduce the tool (planning table below) which will be used to organize information:

• Each group draws its table, fills it and puts it on padex paper

• The results of the work are presented and discussed in plenary

• The facilitator provides other clarifications or further details, if necessary (adopting a name)

6. Additional information provided by the facilitator:

The facilitator draws inspiration from the substance of CONTENT CARD N° 12 to conclude the session.

IMPLEMENTING CHANGES

WORKSHEET 12

What? How? When? How many? Who pays?Who?


SESSION 12


Review the different actions proposed in the cards during preceding stages on the evaluation of indica-

tors. The facilitator should however ensure that the actions scheduled fulfil a certain number criteria:

• They should be realistic and achievable within reasonable time

• The capacities and means required to achieve them should be available

• Actors are firmly committed to implement them.


CONTENT CARD 12

The table below can be used to plan the

implementation of actions

By whom? How? When?How much and

who pays ?What?


SESSION 13


• Identify the key elements of the results-based management of the PME system

• Determine the measures and actions to be taken to ensure the sustainability of the system

2. Pedagogical approach: Brainstorming, Group work

3. Duration: 60 mn


colours


• Ask participants to divide themselves into groups of 6 to 8 persons.

• Explain the purpose of the exercise: It consist in identifying the key elements to be taken into con-

sideration in the management of a system.

• Give 5 Bristol cards to each group and ask them to write the results by putting only one idea on

each card

• At the end of the allocated time, ask the group rapporteurs to reconstitute the results of their pro-

ceedings,

• As they go along, the cards are affixed on a board in an appropriate space prepared beforehand

• Request a voluntary participant to organize the different cards by putting together those that talk

about the same idea

• After this work, write on a padex paper, the key elements of PME management as they emerge

from the group work


On the basis of CONTENT CARD N° 13, the facilitator provides any other additional information and

clarifications required.

MANAGEMENT AND CONSOLIDATION

OF THE PME SYSTEM

WORKSHEET 13


SESSION 13

The management of a PME system consists in:

1. Mobilizing the actors;

• Inform the populations about the different activities related to the PME system

• Raise their awareness about the importance of the system and the need for their participation

• Organize sessions to reconstitute the results of monitoring sessions and collect their feedback

• Ensure the regular participation of all the groups, particularly the vulnerable groups

• Etc.

2. Facilitate the PME sessions (Facilitation, Appropriation and Sustainability of the system) :

• Plan and organize the different PME sessions

• Prepare the pedagogical materials

• Organize the different focus groups

• Facilitate the monitoring and evaluation sessions

• Organize information emanating from monitoring sessions

• Prepare reports

• Disseminate information to the different actors

3. Resource management (media and other resources).

• Manage the PME medium. It is suggested that the PME grid be reproduced on a solid and detach-

able medium (Wooden table, for example) and place it in an accessible place (office of the monitoring

committee)

To enable everyone to be regularly informed

• Manage all the reports and documents produced within the framework of the system

3. Follow-up the implementation of recommendations from the PME sessions;

• Be in contact with the project and other actors to ensure the implementation of recommendations

from the PME sessions

• Evaluate the implementation of the PME system itself

To play these different roles effectively, there is need to institute a simple, flexible but efficient orga-

nizational mechanism. Generally, a body in charge of managing and coordinating the PME system

is set up for that purpose. Regardless of the appellation (monitoring committee, PME system coordi-

nation committee, etc.), the institution of this body should fulfil a certain number of criteria :

• It should be representative of key stakeholders concerned by the programme on which the PME is

focussed

• It should have a reasonable size (between 5 and 8 people) to avoid cumbersomeness

• The profile of members should be in line with the roles assigned to them and mentioned earlier.

They should have complementary profiles: Some members have mobilization and/or facilitation skills,

others are more skilled in management and logistic organization, while others are more comfortable

in the monitoring of activities, etc.

• Even though project representatives can be included in the organ responsible for coordinating the

process, it is important to keep in mind that it is above all, a PME system.

The main beneficiaries should be at the heart of the mechanism and should discharge the different mo-

bilization, leadership and facilitation functions.

Of course, the role played by the project staff at the beginning of the process may be relatively more

significant, but should be progressively reduced as and when the beneficiaries acquire the necessary

skills.

MANAGEMENT AND CONSOLIDATION

OF THE PME SYSTEM

CONTENT CARD 13

MANAGEMENT AND CONSOLIDATION OF THE PME SYSTEM


SESSION 14


Define a simple approach to monitor and evaluate the implementation of the PME system

2. Proposed technique: Individual work but in case of a big group (more than 15 people) the partici-

pants can be arranged in groups of two or three.

3. Material and equipment required: Kraft paper, markers in sufficient numbers, cards of different

colours

4. Duration: 45 minutes

5. Pedagogical progression

• Give 3 cards to each participant

• Ask each participant to propose 3 monitoring indicators for the PME system based on the following

focal question: What are the indicators that can provide us with information about the functioning and

quality of our PME system?

• Give them 5 minutes to fill the cards. The rule is known to all: a card, a criterion or indicator

• When all the participants have finished filling their cards, ask a volunteer to collect and display them

[haphazardly) on the board or on the space provided for that purpose

• Then ask the volunteer to regroup the different cards according to the key ideas

• Write these ideas on a Padex paper


• Using Content Card N° 14, the facilitator may come up with other criteria. He may propose them

but lay emphasis on the fact that the criteria defined by the main actors themselves are more

important. For the record, the facilitator should be prepared to direct and possibly provide some points

for the discussion on the PME success or failure indicators.

• The community evaluation sheet may also be used in the evaluation of the results-based PME

implementation.

MONITORING AND EVALUATION

OF THE PME IMPLEMENTATION

EDUCATIONAL EXERCISE 14


SESSION 14

The institution of the PME system should be monitored on a continuous and regular basis. This is all

the more important since it is a learning process concerning a tool that is new for most actors.

Methodological and institutional difficulties will emerge at the beginning and will continue to impede

the system for a while. There is thus need to establish a monitoring mechanism in order to correct

these difficulties as and when necessary. The Monitoring and Evaluation of the system may concern

several aspects, including:

The governance of the PME system:

• Which actors participate?

• What is their degree of participation?

• How are the decisions taken?

• Are the sessions held regularly?

• Is the generated information shared between the project and the other actors?

Technical knowledge of the System

• Do all the beneficiary groups have a sound understanding of the system?

• What do you think about the quality of the sessions’ facilitation?

• Is the generated information properly collected?

• Is there a monitoring medium accessible to all?

Effects of the system

• Are the recommendations emanating from the different sessions implemented?

• Does the project adequately support the management of these recommendations?

• Did the system improve the participation of the populations [the vulnerable groups in particular)?

• Has the populations’ role in the monitoring of activities been effectively stepped up?

• Etc.

Some quantitative indicators

• Number of PME sessions held

• Changes initiated

• Frequency of sessions

• Number of participants per session (per sex, village or district, etc.)

• Duration of monitoring sessions

• Amounts/ costs of PME sessions

• Amounts/ costs of initiated changes

• Etc.

Tools

The Community evaluation sheet may also be used in the evaluation of indicators concerning some

(evaluation) issues raised. However, the sheet can also be combined with other tools like the SFPO

(Success, failures, potentialities, obstacles) analysis grid or the matrix of criteria which can be used in

the form of focus group to see the differences in perspective between the various actors (including the

project staff). Once again, it is up to the facilitator to help beneficiaries develop or find the most adapted

evaluation tools.

MONITORING AND EVALUATION


CONTENT CARD 14

MONITORING AND EVALUATION OF THE PME SYSTEM


SESSION 14MONITORING AND EVALUATION


CONTENT CARD 14

MONITORING AND EVALUATION OF THE PME SYSTEM

PME SFPO (approach and not a particular experience)

SUCCESS FAILURES

- Built from local indicators;

- encourage participation;

- focus on the beneficiaries needs;

- those who generate the information are its

users.

- Option with a greater shift towards

participation and citizen control;

- development of approaches.

- Takes a lot of time to put in place;

- power relationships often unfavourable to the

weak groups;

- difficult scaling process;

- subjectivism?

- Often perceived as a mere exercise.

- Bureaucratic inertia for a large-scale

application;

- various resistances;

- short planning cycle.

POTENTIALS OBSTACLES

introduction to participatory monitoring-evaluation

Documents