monitoring & evaluation - yousuf kasujee

Islamic Relief Worldwide Monitoring & Evaluation in Development

Yousuf Kasujee

© Islamic Relief Worldwide

15th March 2014

Tunis

Yousuf Kasujee

Islamic Relief Worldwide

Monitoring & Evaluation

in Development


Yousuf Kasujee


We want to move him from here… … to here …

…with available resources…

…how do we find the most appropriate solution…

…and how do we know we have met our

goals/outcomes/ outputs?

M&E

Monitoring & Evaluation in a Nutshel


Yousuf Kasujee


What is Monitoring?

Monitoring is the collection and analysis of information

in order to:

1) Examine progress

2) Track compliance to establish standards

3) Make informed decisions for project management


Yousuf Kasujee


Monitoring addresses the following questions:

1. To what extent are planned activities actually realized? Are we making

progress toward achieving our objectives?

2. What services are provided, to whom, when, how often, for how long,

and in what context?

3. How well are the services provided?

4. What is the quality of the services provided?

5. Is project/programme undertaken consistently with each design or

implementation plan?

6. Is project/programme directed toward the specified target group?


Yousuf Kasujee


Why Monitoring?

Monitoring helps the organisation by:

• Providing constant feedback

• Identifying potential problems

• Showing need for mid-course corrections

• Monitor the accessibility of the project

• Provide guidelines for future projects

• Improve project design

• Incorporate views of stakeholders


Yousuf Kasujee


24 March 2014

1. Process (activity) monitoring

- use of inputs and resources

- the progress of activities

- the delivery of outputs.

Example: A water and sanitation project may monitor that targeted households receive septic systems according to schedule

2. Results monitoring

- Determine if the project/ programme is

on target towards its intended results

(outputs, outcomes, impact)

- Determine if there may be any

unintended impact (positive or

negative).

Example: A psychosocial project may monitor that its community activities achieve the outputs that contribute to community resilience and ability to recover from a disaster

3. Compliance monitoring

Ensures compliance with - Donor regulations and expected results - Grant and contract requirements - Local governmental regulations and laws - Ethical standards

Example: A shelter project may monitor that shelters adhere to agreed national and international safety standards in construction

Types of Monitoring


Yousuf Kasujee


24 March 2014

3. Context (situation) monitoring

- Tracks the setting in which the project/ programme operates. - It also tracks unexpected considerations that may

arise. It includes the field as well as the larger political, institutional, funding, and policy context that affect the project/programme.

Example: A project in a conflict-prone area may monitor potential fighting that could not only affect project success but endanger project staff and volunteers

4. Beneficiary monitoring

- Tracks beneficiary perceptions of a project/programme through complaint and feedback mechanism.

- It includes beneficiary satisfaction or complaints with the project/programme, including their participation, treatment, access to resources and their overall experience of change.

Example: A cash-for work programme assisting community members after a natural disaster may monitor how they feel about the selection of programme participants, the payment of participants and the contribution the programme is making to the community

5. Financial monitoring - Accounts for costs by input and activity within

predefined categories of expenditure. It is often conducted in conjunction with compliance and process monitoring.

Example: A livelihoods project implementing a series of micro-enterprises may monitor the money awarded and repaid, and ensure implementation is according to the budget and time frame.


Yousuf Kasujee


What is Evaluation?

Evaluation is a systematic assessment of the strengths

and weaknesses of the design, implementation and

the results of completed or ongoing interventions.


Yousuf Kasujee


Evaluation explores the following issues:

• Does a program bring the expected change,

which won’t happen without it?

• For every 1 TND spent on the program, how

big is the change?

• Are there other, cheaper options with similar

results?

• Does a program bring unintended

consequences?

• Are people happy with the program?

• Is a program being implemented correctly?

24 March 2014


Yousuf Kasujee


Why Evaluation?

Improve our work and ultimately our mission

to help those in need

Contribute to organizational learning

Uphold accountability and transparency

Promote and celebrate our work


Yousuf Kasujee


Dissemination,

use of lessons

and possible

longitudinal

evaluation

ONGOING

REPORTING,

REFLECTION

AND LEARNING

Final evaluation

(endline survey)

Project

Start

Project

Middle

Project

End

M&E Within the Project Cycle


Yousuf Kasujee


Monitoring Questions

24 March 2014

What is causing

delays or unexpected

results?

Is there anything happening

that should lead management

to modify the operation’s

implementation plan?

Are activities being implemented on schedule

and within budget?

Measuring changes at goal-level requires a longer time frame, and is

therefore dealt with by evaluation and not monitoring.

Are finance, personnel and materials available

on time and in the right quantities and quality?

Are outputs leading to achievement of the

outcomes?

How do beneficiaries feel about the work?

Are activities leading to the expected outputs?

GOAL

OUTCOMES

OUTPUTS

ACTIVITIES

INPUTS

LOGFRAME OBJECTIVES


Yousuf Kasujee


Evaluation Questions

24 March 2014

Effectiveness

Were the operation’s objectives

achieved?

Did the outputs lead to the

intended outcomes?

LOGFRAME OBJECTIVES

GOAL

OUTCOMES

OUTPUTS

ACTIVITIES

INPUTS

Efficiency

Were stocks of items available on time and in the right quantities and

quality?

Were activities implemented on schedule and within budget?

Were outputs delivered economically?

Sustainability

Are the benefits likely to be

maintained for an extended period

after assistance ends?

Relevance

Were the operation’s objectives consistent

with beneficiaries’ needs and with IR

policies?

Impact

What changes did the project

bring about?

Were there any unplanned or

unintended changes?


Yousuf Kasujee


Complementary Roles of Monitoring and

Evaluation

Monitoring Evaluation 1 Clarifies program

objectives 1 Analyzes why intended results were

or were not achieved

2 Links activities and their resources to results

2 Assesses specific causal contributions of activities to results

3 Translates objectives into performance indicators and set targets

3 Examines implementation process

4 Routinely collects data on these indicators, compares actual results with targets

4 Explores unintended results

5 Reports progress to managers and alerts them to problems

5 Provides lessons, highlights significant accomplishment or program potential, and offers recommendations for improvement


Yousuf Kasujee


Importance of M&E

24 March 2014


Yousuf Kasujee


Words of Wisdom

• If you do not measure results, you cannot tell success from failure

• If you can not see success, you cannot reward it

• If you cannot reward success, you are probably rewarding failure

• If you cannot see success, you cannot learn from it

• If you cannot recognise failure, you cannot correct it

• If you can demonstrate results, you can win public support

24 March 2014


Yousuf Kasujee


monitoring & evaluation - yousuf kasujee

Social Media