rbm learning module 3 - indicators - draft 8

Results Based Management: Working with

Indicators

By Will Postma

& Dwayne Hodgson

http://www.savethechildren.ca/

http://www.learningcycle.ca/

Contents

1. What are Indicators?

2. Examples of Indicators

3. SMART ++ Indicators

4. Making Indicators Useful & Accessible

1. What Are Indicators?

Indicators tell us how well our project is working.

They can describe both the activities that we’re doing, and whether we are achieving our expected results in a community project.

Indictors can include both…

Numbers that describe how much things have changed…..

Conversations or Stories that describe what the change is like and how it helped the community.

Example: If we were taking a trip…

Our indicators could include…

the speed we’re driving at. the number of kilometers

we’ve traveled The sign posts along the

side of the road that announce the towns we’ve passed through

Photos of the natural landmarks --- hills, mountains, rivers – we see.

A story describing the highlights of our trip

Example: If we were playing football…

Our indicators could include… The number of goals

scored A play by play commentary

of a great goal The number of red and

yellow cards The number of goals

scored The stories of the coach

and players about what the winning the game meant for them.

2. Examples of IndicatorsIn the next slides, we will show some examples of indicators for outputs, and immediate, intermediate and ultimate outcomes for the following types of projects:

1. Education2. Children’s Participation3. HIV/AIDS4. Water & Sanitation

A Word of Caution!

Please note that these are only examples of indicators from other projects.

You will need to develop your own indicators that make sense locally.

1. Education

Education

Outputs Indicators

Teachers trained in new methods of education

# of teachers trained

School supplies and uniforms provided

# of children (boys & girls) who received new school supplies and uniforms

School buildings repairs # of school buildings repaired

Parent-Teacher Associations (PTAs) Mobilized

# of PTA’s organized

Education

Immediate Outcomes Indicators

Primary schools have improved, safe infrastructure and/or equipment to accommodate and retain increased enrolment.

# of primary schools that meet minimum standards for space, sanitation, and structure.

Improved capacity of teachers to provide active and relevant learning environment for girls and boys.

# of teachers and/or on inclusive teaching methodologies, participatory learning techniques, gender equality in education and child friendly school model

Increased access to good quality of education.

% boys and girls living within 10 km who can attend schoolQuality of education as assessed by supervisors

Education

Intermediate Outcomes Indicators

Increased numbers of socially excluded girls and boys who complete a full cycle of primary schooling.

Annual school retention rates of socially excluded boys and girls in SCC targeted schools (versus control schools).

Civil society groups and networks advocate effectively for boys’ and girls’ rights to education.

# and description of advocacy actions by right to education groups and networks.

Education models developed by SCC implemented by relevant duty bearers (Government, NGOs, CBOs).

# of duty bearers (Gov’t, NGOs, CBOs) implementing education models developed by SCC.

Education policies, laws and programs increasingly reflect gender equality and girls’ and boys’ rights to education.

# and significance of changes to existing/new laws, policies, programs addressing children’s right to education.

Education

Ultimate Outcomes Indicators

Literacy in community increases % change in number of youth literacy levels for youth graduating from school (vs. baseline)

The spirit and intent of the Convention on the Rights of the Child (UNCRC) is reflected in governments’ child-related policies, regulations, programs and services.

Examples from country reports to UN Committee on the Rights of the Child demonstrating increasing application of CRC articles.

Level of fulfillment of the recommendations of the Committee on the Rights of Children by Government.

Socially excluded girls and boys realize their inherent rights.

Annual increase in the percentage of the public budget assigned to the National Action Plan for Children and Adolescents 002-2011

Your Turn: EducationRecall, that one of the education immediate

outcomes level results was: Improved capacity of teachers to provide active

and relevant learning environment for girls and boys

An indicator of this immediate outcomes result could be:

• # of teachers using inclusive teaching methodologies, participatory learning techniques, gender equality in education and child-friendly school models.

Your Turn: EducationPerhaps other, complementary indicators could

be:

• # of students looking forward to going to school each morning

• # of parents of students sensing greater interest among students in learning

• # of students sharing stories at home about new learning during the day.

What other complementary indicators might community members choose?

Your Turn: EducationIn small groups, name three results of a good education project.

For each result, name one way that you would know if the result had been achieved and that the community is benefiting?

Would these indicators be helpful for the community to measure, report on, learn from?

Would partners, other stakeholders such as donors also find these indicators helpful in knowing the level of progress taking place?

2. Children’s Participation

Children’s Participation

Outputs IndicatorsChildren’s clubs established. # of children’s clubs established and

trained on child rights issues

Girls and boys trained on child rights, harmful child work, the needs of working children and the importance of education

# of girls and boys trained on child rights, harmful child work, the needs of working children and the importance of education

Representatives from children’s clubs participated in quarterly CCPN meetings

# of children’s representatives per community participate in the quarterly CCPN meetings.

Children’s clubs supported to implement action plans.

# of children’s clubs that receive regular support to implement their action plan.


Immediate outcomes Indicators

Increased ability to communicate CP messages

# children clubs that organize regular recreational activities (at least one activity per week) to stimulate and communicate CP messages

Increased awareness of CRC amongst children

# of children in targeted communities are aware of the CRC

Enhanced capacities of girls, boys and youth to demand their right to quality, relevant education.

% of boys and girls participating in school child rights clubs or other spaces for children to meet, organize and act.

Level of understanding of boys, girls and youth of what their right to education means

Children’s ParticipationIntermediate outcomes Indicators

Children’s groups advocate for rights to be free from exploitative child work

Increased communication and interventions by children, parents, child protection agencies and communities regarding harmful child work, the nature of the violation of their rights and mechanisms to protect child workers

Stories of how children, parents, child protection agencies and community members explain the importance of preventing harmful child work.

Examples of where children, parents, child protection agencies and community members intervened to protect child workers

Harmful child work in SCC-targeted areas reduced.

# of child graduates from SCC programs returning to the worst forms of child work.

# and description of children’s rights campaigns undertaken by chidlren’s groups


Ultimate outcome Indicators

Increased realization of inherent rights by socially-excluded girls and boys as per the spirit and intent of the Convention on the Rights of the Child (UNCRC).

• Country reports to UN Committee on the Rights of the Child demonstrating increasing application of CRC articles.

• Level of fulfillment of the recommendations of the Committee on the Rights of Children by Government.

• Annual increase in the percentage of the public budget assigned to the National Action Plan for Children and Adolescents 2002-2011

Your Turn: Children’s Participation

Recall, that one of the child participation immediate outcomes level results was:

Enhanced capacities of girls, boys and youth to demand their right to quality, relevant education.

An indicator of this immediate outcome could be:

• # of child-friendly groups and spaces for children to meet, organize and act.

Your Turn Children’s Participation

Perhaps other, complementary indicators could be: • Level of satisfaction of girls, boys and youth with

contributions of government to their education • # of examples of billboards, posters and other IEC

materials, produced by the government and promoting the right of children to education

• # of actions or events where girls, boys and youth feel they have increased the community’s understanding of quality education


Your Turn: Children’s ParticipationIn small groups, name three results of a good child

participation project.

For each result, name one way that you would know if the result had been achieved and that the community

is benefiting?


Would partners, other stakeholders such as donors also find these indicators helpful in knowing the

level of progress taking place?

3. HIV/AIDS

HIV/AIDS

Outputs Indicators

CBOs established and strengthened to provide counseling, care and support services to children affected by HIV/AIDS.

# of community based organizations established and strengthened to provide quality counseling, care and support services for children affected by HIV AIDS

Children sensitized on ways to protect themselves from HIV/AIDS and avoid high risk situations and behaviours

# of children, including sales girls, sex workers, child workers and school children sensitized on ways to protect themselves from HIV/AIDS and avoid high risk situations and behaviours

Peer educators trained. # of girls and boys trained as peer educators to reach children in their communities

PLWHA support groups formed. # of PLWHA support groups formed.Average size of PLWHA groups.

HIV/AIDS

Immediate Outcomes Indicator

Increased knowledge among children about ways to protect themselves from HIV/AIDS and avoid high risk situations and behaviours

Scores on simple verbal knowledge test re: ways to protect themselves from HIV/AIDS and avoid high risk situations and behaviours

Improved access to essential services for Orphans and Vulnerable Children (OVCs).

# of OVCs receiving quality counseling, psycho-social support, medical care and referral services by trained partners and caregivers. # of linkages established between OVCs and health care providers.

Improved perception of duty bearers on means to protect children affected by HIV/AIDS.

# of government representatives and community leaders, parents, legal guardians and community leaders fulfilling their responsibilities to protect children affected by HIV/AIDS.

HIV/AIDS

Increased and more effective advocacy for children’s right to a healthy sexuality and to be protected from HIV/AIDS.

# of civil society groups/networks addressing HIV/AIDS.

Examples of their effective advocacy.

Intermediate Outcomes Indicators

Improved social and legal frameworks, including services, to protect boys and girls affected by HIV/AIDS .

# of changes to existing/new laws, policies or programs addressing children vulnerable to HIV/AIDS.

Adoption by relevant duty bearers of HIV/AIDS prevention and care and support models.

# of duty bearers (Gov’t, NGOs, CBOs) adopting HIV/AIDS prevention and care models

HIV/AIDS

Ultimate Outcome Indicator

Reduction of HIV/AIDS in target communities.

Change in % of children living with HIV/AIDS in target communities

Improved quality of life for PLWHA in targeted communities.

Stories of improvement in quality of life for PLWHA.

Your Turn: HIV/AIDS

Recall, that one of the HIV/AIDS intermediate outcomes level results was:

Adoption by relevant duty bearers of HIV/AIDS prevention and care and support models.

An indicator of this intermediate outcomes level result could be:

• # of duty bearers (Gov’t, NGOs, CBOs) adopting HIV/AIDS prevention and care models

Your Turn: HIV/AIDSOther complementary indicators might be:

• # of examples in the community where community members benefited from improved HIV/AIDS care models

• # of visits from government health staff (home care workers, nurses) to patients

What other complementary indicators could there be, that may also be indicators chosen by community members?

Your Turn: HIV/AIDS

In small groups, name three results of a good HIV / AIDS response project.

For each result, name one way that you would know if the result had been achieved and that the

community is benefiting?




4. Water & Sanitation

Water & Sanitation

Outputs Indicators

Water purification packets distributed. # of water purification packets distributed# of households receiving a water purification packet

Community health workers trained on necessary skills and knowledge to mobilize communities on sanitation, hygiene promotion and child protection

# of CHW who complete training course and pass test of knowledge and skills.

Water sources including wells and hand pumps, cleared, repaired and/or installed.

# of water sources cleared, repaired and/or installed

Water & Sanitation

Immediate Outcomes Indicators

Water sources operational and maintained.

# of water sources that are operational at least 80% of the time

More convenient access to clean water.

# of households with access of up to 20 litres / person / day of clean water within 100 metres of their house.

Increased access to clean water for boys and girls in schools

# schools with functioning, clean water sources

Increased knowledge and skills of Community Health Workers have to mobilize communities on sanitation, hygiene promotion and child protection

# of CHW who pass a basic test on necessary skills and knowledge to

Water & Sanitation

Intermediate outcomes Indicator

Increased use of clean water for cleaning, cooking, bathing and other household uses.

# of people using clean water for cleaning, cooking, bathing and other uses.

Water sources protected and maintained by local management committees.

# of water sources protected and maintained monthly by local management committees.

Citizens advocate local government to ensure their right to water.

Description of advocacy efforts by citizens to ensure their right to water.

Water & Sanitation

Ultimate Outcome Indicator

Improved health for families Stories that illustrate changes in quality of life as a result of provision of water and sanitation facilities.

Children realize their right to clean water.

Examples of where children realize their right to clean water. % of children in target area who can realize this right.

Your Turn: Water & Sanitation

If one of the Water and Sanitation immediate outcomes level results was:

Increased access to clean water for drinking, personal hygiene and cooking needs.

An indicator of this intermediate outcomes level result could be:

• # of individuals in 100 communities able to access clean water for drinking, personal hygiene and cooking needs.

Your Turn: Water & Sanitation

Other complementary indicators could be:

• # of women and men who can say that women’s work load has been made easier

• Level of satisfaction among community members that water is fairly and equally accessible to all in the community


Your Turn: Water & SanitationIn small groups, name three results of a good water

and sanitation project.

For each result, name one way that you would know if the result had been achieved and the community

is benefiting?




For our projects, we want to use indicators that will be SMART but also people-focused, user-friendly

and community-empowering

3. SMART++ Indicators

7 Characteristics of a Good Indicator (Part 1)Characteristics Questions to Ask… Very Much Somewhat Little

Simple Will this indicator be easy to collect?Will the information be simple to analyze?Can you collect the data at an affordable, reasonable cost?

Measurable Does the indicator really measure the result? Can the indicator be measured and analyzed by different people consistently? Can the indicator be used to compare results across different communities or groups?

Achievable Will this indicator help us to know whether or not the result is being achieved?

Relevant Is the information from this indicator relevant for managing the project and for decision-making?

Time-bound Is the indicator sensitive to change, over the life of a project? Can a baseline and a a target be established for this indicator?

7 Characteristics of a Good Indicator (continued)Characteristics Questions to Ask… Very Much Somewhat Little

ParticipatoryWill local staff and community members (not just leaders or those more formally educated) be able to participate in the measurement of this indicator?

EmpoweringAre local staff and communities empowered by choosing, using and reporting on this indicator?

Does it allow them to celebrate change and reflect critically on this change?

4. Making Indicators Useful & Accessible

Donors

OtherStakeholders

Community

Useful to Everyone!

A plant growing (seed, sprout, sapling, tree)

Traveling down a road (1st, 2nd, 3rd and 4th destination)

Other local measurement examples used by other organizations:

Steps in the preparation of a food such as maize,

with the end product being the cooked meal



A spider web, from Cambodia, used to

indicate progress and which areas still need to

be developed

What other suggestions do you have for developing and tracking indicators that are SMART++… and useful to everyone??

Conclusion: Proverbs from Africa

A boat does not know who is the leader; when it turns over, everyone gets wet.

A boat cannot go forward if each rows his own way

If you wish to go fast, walk alone; if you wish to go far, walk together

Contact Us

We’d love to hear your feedback and suggestions on how to improve this module. Please write us @

Will [email protected]

Dwayne [email protected]

http://www.savethechildren.ca/

http://www.learningcycle.ca/