designing for behaviour change desk review desk... · ethiopia nepal tajikistan ghana nicaragua...

21
March 2016 Authors: Shannon Gibbs, MPH Student University of South Florida John Collett Senior Advisor, Hygiene Promotion and Behaviour Change World Vision International Designing for Behaviour Change Desk Review

Upload: others

Post on 04-Jul-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

March 2016

Authors:

Shannon Gibbs, MPH Student

University of South Florida

John Collett

Senior Advisor, Hygiene Promotion and

Behaviour Change

World Vision International

Designing for Behaviour Change

Desk Review

Page 2: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

2

© World Vision International 2016

Authors and contributors: Shannon Gibbs, John Collett, Kristie Urich

All rights reserved. No portion of this publication may be reproduced in any form, except for brief

excerpts in reviews, without prior permission of the publisher.

Published by the Water, Sanitation and Hygiene department on behalf of World Vision International

For further information about this publication or World Vision International publications, or for

additional copies of this publication, please contact [email protected].

World Vision International would appreciate receiving details of any use made of this material in

training, research or programme design, implementation or evaluation.

Cover photo © World Vision/Jon Warren

Page 3: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

3

CONTENTS

INTRODUCTION TO DBC .......................................................................................................................................... 4

PURPOSE OF THE DBC DESK REVIEW .................................................................................................................... 6

METHODS .......................................................................................................................................................................... 6

FINDINGS & RECOMMENDATIONS ......................................................................................................................... 6

TRAINING ..................................................................................................................................................................... 6

TRAINING APPROACH ........................................................................................................................................ 7

TRAINING RESOURCES ....................................................................................................................................... 9

TRAINING REQUIREMENTS ............................................................................................................................... 9

TIMING AND FUNDING ........................................................................................................................................ 10

LEADERSHIP SUPPORT & ORGANISATIONAL CAPACITY........................................................................ 11

MONITORING & EVALUATION .......................................................................................................................... 12

OTHER BARRIERS ..................................................................................................................................................... 13

LANGUAGE BARRIERS ....................................................................................................................................... 13

CHALLENGES DEVELOPING EVIDENCE-BASED BEHAVIOUR CHANGE ACTIVITIES ................. 13

SUMMARY AND CONCLUSIONS ............................................................................................................................ 14

APPENDIX 1: ONLINE SURVEY QUESTIONS ...................................................................................................... 16

APPENDIX 2: TERMS OF REFERENCE ..................................................................................................................... 18

Page 4: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

4

INTRODUCTION TO DBC

With the realisation that improved knowledge and awareness alone usually do not result in

behaviour change, systematic efforts are being made to apply successful practices from the

field of social and behavioural change (SBC) in order to achieve better and more sustainable

behaviour change results and the desired improved health impacts from the investment in

programming. Development practice has typically focused on pre-awareness and knowledge

about why certain behaviours are important, but has been much less adept at moving people

toward the habitual practice of the focus behaviours. The Designing for Behaviour Change

(DBC) Framework, which is based on the social and behavioural theory of change model

‘Stages of Change’ (Prochaska,1991), is a 5-step process that assists behaviour change agents to organise existing information and to gather new information needed to design effective

behaviour change strategies. It requires the user to clearly state the desired behaviour and

to describe the priority group and the context in which the behaviour will be practiced. The

power of the DBC Framework lies in the formative research using the Barrier Analysis (BA)

Survey1, which requires the designer to dialogue with people from the priority group using a

scripted questionnaire to identify the reasons why some people find it difficult to practice

the behaviour being studied. From there, the designers formulate the Bridges to Activities

and finally select or design behaviour change activities that are purposefully designed to

address the significant barriers and motivators discovered through the formative research.

The DBC Framework is used to design behaviour change strategies in any sector including

health, nutrition, food security, water and sanitation, agriculture, natural resource

management, civil society and gender equity; and for any audience, such as mothers, youth,

farmers and pastoralists.

Photo: World Vision International

1 While the BA survey is the formative research method most commonly used in the DBC Framework, other formative research

methods such as Trials of Improved Practices may be needed when BA surveys are impractical – for example when the desired behaviour (or close to the desired behaviour) is not yet being practiced by anyone.

Page 5: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

5

Training on how to use the DBC Framework requires five days, and an additional four days

are required to complete the full BA training (or seven days total if the DBC and BA

trainings are combined). To develop a behaviour change strategy using the DBC Framework

requires following the five steps shown in the figure below.

Figure 1

DESIGNING FOR BEHAVIOUR CHANGE FRAMEWORK

Step 1:

Behaviour

Statement

Step 2:

Priority

Group and

Influencing

Groups

Step 3:

Significant

Determinants

Step 4:

Bridges to

Activities

Step 5:

Activities

To promote this

behaviour

Among this

audience

Priority Group

Influencing

Group

The latter can

only be

determined

through

formative

research

We will focus on

these

determinants

These can only be

determined through

formative research

Comparing the

perspective of doers

and non-doers

And

promote

these

bridges to

activities

By implementing

these activities

Outcome

Indicators Process

Indicators

Step 1: Formulation of a clear and unambiguous behaviour statement which targets the priority group

Step 2: Description of the priority group [and influencing group(s) if identified by the

priority group during Step 3

Step 3: Formative research using the BA Survey which investigates up to 12 common behavioural determinants: 1) Perceived self-efficacy/skills; 2) Perceived social norms; 3)

Perceived positive consequences; 4) Perceived negative consequences; 5) Perceived

access; 6) Perceived susceptibility/risk; 7) Perceived severity; 8) Perceived action efficacy;

9) Cues for action/reminders;10) Perception of divine will; 11) Policy; and 12) Culture.2

Step 4: Formulation of the Bridges to Activities for the determinants found to be

significant in Step 3.

Step 5: Formulation of the behaviour change activities purposefully linked to the Bridges to Activities and the corresponding significant determinants and responses.

2 A final determinant ‘Universal Motivators’ is often included.

Page 6: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

6

PURPOSE OF THE DBC DESK REVIEW

There are at least 25 development organisations known to be using the DBC Framework to

develop behaviour change strategies for targeted behaviours in sectors such as food

security, livelihoods, health, nutrition, education, and water, sanitation and hygiene (WASH).

While continuing to apply the DBC Framework for developing behaviour change strategies,

World Vision and several other organisations believe that now is a good time to take stock

of experience from the application of DBC Framework and BA by practitioners around the

world. This desk-based review will support the documentation of existing DBC strategies

and BAs and provide insight into how organisations are equipped and how they are utilising,

monitoring and evaluating their current DBC activities. It will also produce key recommendations to support the continued strengthening of the DBC Framework.

METHODS

To learn about the current state of Designing for Behaviour Change and Barrier Analysis

across multiple organisations, an external consultant was engaged to conduct an initial desk

research, involving a review of documents from multiple organisations. She then conducted

a qualitative desk review by using an online survey (see Appendix 1). Thirty-five responses

to the survey from 16 different organisations were received. The consultant followed up

with additional key informant interviews with 17 people from 10 organisations who had

responded to the online survey. Online survey results were analysed using the survey analytics software, and key informant interviews were analysed manually. Information from

both the surveys and the interviews were analysed to identify key findings and produce

recommendations.

FINDINGS & RECOMMENDATIONS

The review revealed that the DBC Framework is being used in 38 countries in more than a

dozen sectors. The major sectors using the Framework are maternal, newborn and child

health; nutrition; WASH; and agriculture. The results confirm that the DBC Framework is

applicable to a wide variety of sectors and behaviours. However, the survey revealed that 84

per cent of respondents had challenges when applying the DBC Framework. The research

highlighted some key findings that provide opportunities to strengthen DBC training, implementation and activity monitoring.

TRAINING

To become proficient in the use of the DBC Framework, most non-governmental

organisations (NGOs) arrange for their staff to participate in a five-day DBC training. Some

NGOs opt to combine this course with the four-day Barrier Analysis course in order to get

a more comprehensive understanding of how to implement a BA survey. A combined

course is typically seven days long. More than 90 per cent of respondents reported having

been trained in DBC, and more than 80 per cent reported receiving additional training in

Barrier Analysis. The quality of the training is critical in determining the successful use of the

DBC Framework in practical applications. Only slightly over 50 per cent of trained

respondents felt that they were fully knowledgeable in the DBC/BA process after receiving

Page 7: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

7

training. This shows that the training covers a depth of knowledge, but many respondents

feel a need for more time or adjustments in the training to fully grasp the concepts to apply

adequately later.

Figure 2: Countries using the DBC Framework

COUNTRIES USING THE DBC FRAMEWORK

Afghanistan Kenya Philippines

Bangladesh Lebanon Rwanda

Bolivia Liberia Senegal

Burkina Faso Madagascar Sierra Leone

Burundi Malawi Somalia

Cambodia Mali South Sudan

DRC Mozambique Sudan

Ethiopia Nepal Tajikistan

Ghana Nicaragua Tanzania

Guatemala Niger Timor L’Este

Haiti Nigeria Uganda

Honduras Pakistan Zambia

India Peru Zimbabwe

Indonesia

TRAINING APPROACH

A majority of respondents felt that the training is often a rushed and hurried event that tries

to compress too much information into a short time span. While five days may seem like a

long time, the training curriculum is long and the concepts new to most attendees. The rush

to complete the training in the allotted time leaves the participants not feeling fully

comfortable with the concepts. This also leaves little time for sufficient practical application

within the training. Survey respondents expressed the wish to have more time for practical application of concepts. The most difficult part of the process is developing the behaviour

change activities -- the last step in the process. Because this step happens on the last day of

the training, there is sometimes less time to practice the skill of developing these activities,

which is exacerbated by the fact that participant’s energy levels are low after four days of

intense learning. More than 50 per cent of respondents expressed wanting more time during

the training devoted to field-based practice. While the existing training already includes one

day devoted to fieldwork practicum, respondents expressed the need for more time. Many

respondents felt the need for additional coaching and mentoring in order to be able to apply

the principles learned during training into their fieldwork and to come up with appropriate

Page 8: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

8

behaviour change activities for the Bridges to Activities and the corresponding significant

determinants and responses.

The majority of respondents said that they received no follow-up training. Once training is

complete there is little follow through to make sure that the Framework is being

implemented properly.

Recommendations:

Pre-reads and e-learning

Since the DBC/BA learning material is very dense and relatively new to most participants, it

is recommended to provide opportunities for pre-reading or e-learning before attending the

training. Assuming the participants studied the material provided, they might be better

prepared for training and more prepared for practical application. To ensure that attendees

review the provided material a pre-test could be a prerequisite to participating in training.

This could help to serve as an incentive as well as a tool to help solidify learning.

Mentors

One way to support staff in internalising and effectively utilising the concepts learned during

training is with the use of mentors. Pairing new learners with people who have successfully

used the DBC Framework or conducted a BA survey in the field provides an opportunity

for continued growth and learning.

Additional participatory elements

One way to build confidence among participants would be to expand existing participatory

elements already provided in the training. If some of the content is covered through pre-

reading or e-learning, this could potentially open up space in the training for additional

practical learning opportunities.

Follow-up or refresher training

Another way to strengthen the training approach would be to provide follow-up or

refresher trainings to those who have already received an initial training. This second

training should be offered to those who have already tried to apply what they learned in the

first training and have proven that they intend to use what they learn. This would provide

those who are not as comfortable with the process, or those who have encountered

obstacles, to strengthen their knowledge of the practice. This could also be a time to share

lessons learned and document good DBC practices. There are currently DBC practitioners’

share-and-learn webinars (co-hosted by World Vision) taking place that could serve as a

potential platform for continued learning.

Focused activity training

Since many respondents cited a perceived lack of ability to create evidence-based activities

and implement them in the field, perhaps a focused activity training session would help in

this area. This additional training could help solidify the concepts and help participants feel

more comfortable applying DBC principles in their day-to-day work.

Page 9: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

9

TRAINING RESOURCES

The training for DBC and BA covers a lot of new concepts and ideas. One common thought

amongst the respondents is that the training curriculum is large and difficult to reference for

later use. While the manual was never intended as a reference tool, many respondents

recommended organising and indexing the training manual for easier future reference. The

new information and concepts from DBC can be difficult to internalise and immediately

apply, so a reference guide is important to solidify DBC and BA concepts.

Key informant interviews revealed that training is perceived to lack adaptability to cultural

contexts, specifically learning styles and cultural environment -- including language, local

customs and communication norms. Each culture will learn differently and having one set training programme makes it difficult to adapt to an areas’ particular cultural environment.

It is important to note that it is not realistic to adapt each training contextually, but this

perception must be taken into account during training and to consider ongoing support for

implementers.

Recommendations:

Developing a DBC practitioners’ field guide

One idea to overcome some of the issues with the existing training resources is to revise

the current manual into a field guide. A manual for field use should be a well-indexed and

easy-to-use guide for implementation. It may be beneficial to include input from field

workers when developing this guide.

Multi-cultural review of training

While it may not be possible to create a training approach that is relevant to every cultural

context, it is advisable that the cultural and organisational context be taken into

consideration when reviewing the training manual. One way to do this may be to consider

having a multi-cultural panel when revamping the current training materials. Another idea

would be to have pre-planning with local staff before a training session to assure that

essential cultural adaption is addressed – such as local language, norms and customs that

may have an impact on DBC field application.

TRAINING REQUIREMENTS

Training covers a large amount of material in a short amount of time, and those who attend should be prepared to fully understand the concepts presented to them. Currently there

are no defined minimum requirements on who can attend the training and there are few

preparatory materials. It is imperative that the right people receive the training – those who

are best equipped and empowered to grasp and apply the concepts.

Recommendations:

Trainee vetting

Attendees should have the ability to apply the DBC process once it is learned. Sending

people who are unable to follow through with the training is a waste of time and resources.

Before accepting people to attend the training, their capacity to use the training in their

Page 10: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

10

work should be verified. One way of doing this could be to require a commitment in writing

from a manager or supervisor to confirm that the attendee will be able to apply the DBC

Framework in their work. The supervisors of prospective trainees could also be provided

with a list of recommended prerequisite competencies to help assure that the most

appropriate staff are selected to participate.

Leadership endorsement

Respondents also noted that their leaders often do not understand the importance of the

DBC Framework for behaviour change. Facilitating leadership buy-in should be an important

part of introducing DBC to the organisation. This could be done through a short training for

leaders within the organisation, or by ensuring that all DBC trainees have the full support of

their managers (see more on leadership buy-in below). The latter could be done by

requiring a manger or supervisor’s signature in advance of training, as well as a commitment

to support the attendee after the DBC training.

TIMING AND FUNDING

Respondents perceive the DBC process as rigorous and time consuming. After conducting

this desk review, at least three respondents indicated that their organisations are not finding

the time to develop and implement activities. This shows a need for more adequate planning

and time allotted to the DBC process. These interviewees noted that there is a perceived

reluctance to change programming after the DBC Framework is completed.

Funding is also a challenge. Once research is complete, it can be difficult to find funds to implement activities or redesign a programme. As a result, at least three organisations

surveyed have started the DBC process, but have not fully implemented activities. The

trainings are useful, but the DBC approach is not always being put fully into practice.

Recommendations:

Assure adequate planning time

It is important that all participants in the training understand the amount of time they will

need to implement DBC/BA in their own programmes. They must be willing to commit the

time and energy to developing and implementing DBC/BA in their own programmes. After

the training, the attendees should meet with their supervisor and map out how they will use

what they learned. They will need to work together to ensure that the attendee has adequate time to plan and implement these new approaches. Leadership buy-in prior to the

training is critical to ensure this empowerment occurs post-training.

Starting the process early

Many respondents attended the training and tried to implement DBC/BA even though their

organisation already had interventions in place. It is important that organisations start the

DBC process as early as possible in the programme cycle, working with stakeholders early

on to ensure buy-in. It is highly recommended to arrange for the DBC/BA training during

the first year of a new project.

Clear funding guidelines

Page 11: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

11

Many participants have completed their DBC training and then discovered they cannot apply

what they have learned because there is no funding to implement the proposed behaviour

change activities. If an organisation cannot guarantee funding for full DBC implementation

prior to DBC training, it would be better to delay training until they have the funding in

place. It is also important that attendees realise that the new activities are intended to

replace old activities that are ineffective. Hence there could be cost-savings or minimal

change to their behaviour change programming budget. Funding guidelines should include

proof points showing that the application of DBC can result in cost-saving because the

behaviour change strategy specifically targets only those determinants found to be

significant.

Staffing considerations

Having a behaviour change advisor post hired within the implementing organisation would

bridge the gap between training and implementation, providing on-site support and

mentoring for staff seeking to utilise DBC. (See more on staffing in following section.)

LEADERSHIP SUPPORT & ORGANISATIONAL CAPACITY

A key component to having successful implementation of the DBC Framework is leadership

support. Respondents noted the importance of having one person responsible for

overseeing the behaviour change process from beginning to end. Respondents also cited

that DBC champions amongst supervisors and leaderships are a significant factor in creating

a favourable environment for DBC implementation. Without support and understanding from managers and supervisors, DBC will likely not be implemented effectively. Having

managers who understand the DBC process and the positive effect it can have on

programme outcomes is vital, and they can be an ally to advocate to the leadership for the

necessity of evidence-based behaviour change programming.

The need for organisational capacity building was a common theme amongst those

interviewed. Not everyone implementing DBC activities will participate directly in the

training, so it is important that DBC staff champions are equipped to train and empower

implementing staff to facilitate DBC activities well.

Recommendations:

Provide leadership training

Provide a shortened training on DBC/BA to help develop champions for DBC amongst

organisational leaders. A one-day training currently exists to help organisation leaders

understand DBC/BA.

Designated project leader

Having one person who will follow the project through from beginning to end is critical to

the success of implementing DBC. With one person acting as a project leader, there is more

likely to be follow-through on the implementation of the activities. However, it is important

that whoever takes on this role has a clear understanding of the expectations of the role

and that relevant activities are reflected in job descriptions and/or performance agreements.

Hiring a behaviour change specialist

Page 12: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

12

When possible, an organisation should invest in hiring a behaviour change specialist to help

guide the direction and implementation of behaviour change activities. Having a dedicated

staff person should help to build capacity with the NGO.

Champions

When it is not possible to have a paid staff person, or when organisational size and reach

requires additional support, clearly identified DBC champions can support organisational

capacity and advocate for the use of the DBC Framework. Having one person nominated as

the focal point of an office who can be in charge of DBC implementation, progress follow-

up, and sharing learning will help to build capacity within an office. Again, champions should

have a clear understanding of the expectations of the role, and this should be reflected in

their performance agreements.

MONITORING & EVALUATION

To date, monitoring and evaluation of DBC/BA activities and programmes has not been

consistent. While 70 per cent of respondents indicated that they were currently monitoring

their behaviour change programming activities, only 29 per cent had conducted any

assessments or evaluations of DBC and/or BA activities.

The lack of proper evaluations and assessments leaves the process open to uncertainty

about its benefits. Without proper documentation of evaluation, many will not be persuaded

to use the DBC Framework or see its value.

Recommendations:

Investing in monitoring and evaluation

Ongoing monitoring throughout the implementation activities should not be neglected. As in

any project, it is critical to track the progress of implementation and the initial results, and

to make necessary adjustments. Evaluations are also important for each individual

programme, as well as for the success of the DBC in general. Organisations should be

encouraged to invest the time and energy required for evaluating the effectiveness of their

behaviour change strategy. This should be emphasised during training, and organisations

should plan on allocating sufficient resources for both monitoring and evaluation.

Sharing of monitoring and evaluation outcomes

A step to helping with the evaluation process would be to emphasise a discussion of

monitoring and evaluation during the training. This could be done as part of the training, or

could simply be included in the field guide. Another idea would be to create a space where

organisations can share how they are evaluating the process and what the findings have

been, or to pool resources, in partnership with other DBC implementing organisations and

an academic institution, to conduct a field-evaluation of the effectiveness of the DBC

Framework approach on achieving sustainable behaviour change.

Page 13: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

13

OTHER BARRIERS

LANGUAGE BARRIERS

Over 50 per cent of the people interviewed noted the difficulty of translating the BA

questionnaire into local languages. Finding staff that can accurately translate documents from

their original form into the local language is often difficult. Sometimes, things don’t translate

appropriately and important pieces can be lost during this process.

Recommendations:

Working groups

One idea to overcome this challenge is to form a working group to explore the issues and

develop guidelines to mitigate translation challenges. Also, during the training process, trainees should be made aware of these issues so that they can plan for the costs associated

with hiring a local translator. A generic BA questionnaire could be created in the local

language so that the essence of the research questions are standard. Generic questionnaires

already exist in Haitian Creole, DRC Swahili, Hausa and Tetun.

CHALLENGES DEVELOPING EVIDENCE-BASED BEHAVIOUR

CHANGE ACTIVITIES

A common theme from respondents in the online survey, as well as interviewees, was the

difficulty of coming up with appropriate behaviour change activities when applying the DBC

Framework in field projects after training. There was difficulty noted in the matching

activities to the Bridges to Activities, as well as difficulty in being creative when it came to

developing the activities. Developing activities is a critical part of the process and it is vital

that users of the DBC Framework be able to develop and describe appropriate behaviour

change activities.

Recommendations:

Training modifications

The lessons on activities in the current DBC curriculum could be strengthened. Also, the

training schedule could be organised such that the day focused on activities occurs after a

short rest period during training so trainees’ minds are fresh. Finally, it is worthwhile to

explore whether to design a stand-alone course on how to design evidence-based activities.

Team Work

Working with a small group of people to develop these activities (and Bridges to Activities)

is one way to help overcome this problem. It is easier to get creative when there is a safe

space to share ideas and work together to determine the best solutions.

Using the FSN Network Behaviour Bank

One way to help this process is to bolster the use of the FSN Network’s Behaviour Bank.

Twenty-four per cent of respondents were unaware of the bank and another 24 per cent

were aware of it but had never visited it. Only 10 per cent of respondents have ever

Page 14: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

14

uploaded their BA’s to the bank. An intentional discussion should be held among

stakeholders, with a potential working group, to explore how to better leverage the

Behaviour Bank as a learning, sharing and collaboration space for DBC and BAs, with

particular focus on activity planning.

Mentors

Having someone experienced in creating and implementing activities mentor a new trainee

would be a good way to help them learn how to develop activities. The DBC trainer’s scope

of work could include additional days post-training to provide remote support to the

trainees to develop BA questionnaire, answer questions, interpret BA results, review

bridges to activities, and the behaviour change activities. This could also be done by hired

behaviour change staff when possible.

SUMMARY OF FINDINGS

This desk review reveals that the DBC Framework has been used and/or is in use by

approximately 25 organisations in 38 countries. Respondents confirm that, in spite of

challenges, the DBC Framework and the accompanying BA survey has the potential to be a

highly effective and impactful method for developing evidence-based behaviour change

activities. Although the review did not set out to compare DBC with other new and

emerging behaviour change approaches (e.g. Communication for Behaviour Impact

(COMBI), Evo-Eco, FOAM & SaniFOAM, IBM-WASH, and RANAS), from the limited

information available on the application of these approaches, it appears that DBC has been

more widely applied.

Figure 3: Survey respondents rank the perceived impact that DBC and/or BA

have had on their organisation's behaviour change programming.

The DBC Framework can be applied in any sector and to a multitude of behaviours.

Furthermore, DBC training materials are freely available in the public domain and there are

qualified and experienced trainers. The possibilities for the use of DBC/BA are expanding

too early

to know

19% no impact

7%

some impact

44%

high impact

30%

Perceived Degree of Impact

Page 15: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

15

and people working in various sectors (education, peace building, gender-based violence

reduction, civil society building, and disaster risk reduction) are using the DBC Framework.

As a desk review, there are obvious limitations to this review, and the findings show that

there is a need for further evaluation. The next step in the process would be to follow up

with more definitive evaluation and research, ideally as a field-based research project.

Even though impact evaluations are not consistently conducted on DBC activities, the ones

that have been done provide evidence that determinant-based activities have a positive

impact on target behaviours. With over 70 per cent of users acknowledging at least some

impact, the DBC approach is providing a new way to effect behaviour change. The challenge

is to make sure that people are using the approach correctly to ensure its success. There

are elements of the approach that can be bolstered or added to in order to create more

impact. This includes modification to training materials and activities, and looking more

closely at funding and timing, leadership endorsement, capacity building, and monitoring and

evaluation. For those that choose to use the DBC Framework, and work to apply it in an

effective manner, there is great potential to create long-lasting behavioural change.

Page 16: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

16

APPENDIX 1: ONLINE SURVEY QUESTIONS

1. Please provide the following information, as it will help us in analysing how different organisations

have applied DBC, and will provide us with the information we need to follow up with you for a

more in-depth interview, should it be needed. Organisation Name, Your Name, Your Email

2. Has your organisation used the Designing for Behaviour Change (DBC) Framework and/or Barrier

Analysis (BA) for designing any behaviour change strategies? yes no

3. In what countries has your organisation used DBC and/ or BA?

4. In what sector(s) has your organisation used DBC and/or BA?

5. When did your organisation begin applying the DBC and/or BA?

6. Are you still using DBC and/or BA? yes no

7. Have you ever received training in DBC? yes no

8. When and where were you first trained?

9. Who trained you?

10. Did your training focus only on DBC theory, or did you begin to apply the theory to your work?

Theory only Theory and practical application

11. How many days did your training last?

12. How many others from your organisation received this training (either at the same time as you

or separately)?

13. Did you have any later follow-up training? yes no If yes, indicate the nature of the follow-up

training

14. Please rank your knowledge, skills and experience of DBC

None Little Some Full (able to supervise, train and mentor others)

15. Have you trained others in the DBC Framework? yes no if yes, who have you train and what

materials did you use?

16. Have you ever received training in Barrier Analysis (either along with your DBC training or at

separate time)? yes no

17. When and where were you first trained?

18. Who trained you?

19. Did your training focus only on DBC theory, or did you begin to apply the theory to your work?

Theory only Theory and practical application

20. How many days was your first training?

Page 17: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

17

21. How many others from your organisation received this training (either at the same time as you

or separately)?

22. Did you have any later follow-up training? yes no If yes, indicate the nature of the follow-up

training

23. Please rank your knowledge, skills and experience of BA

None Little Some Full (able to supervise, train and mentor others)

24. Have you trained others in BA? yes no if yes, who did you train and what materials did you

use?

25. For how many different behaviours has your organisation used DBC and/or BA to design

behaviour change strategies?

None Few 1-3 Many 3 or more

26. Have you ever visited the Food Security and Nutrition (FSN) Network Behaviour Bank? (The

website where people post the results of their BA studies)

Yes, I have visited it

Yes, and I have entered my organisation's BA results in the Behaviour Bank

NoI'm not aware of the Behaviour Bank.

27. Please can you provide a list of behaviours studied, including the location and date of completion

of the DBC Framework and BA survey?

28. Rank the impact that DBC and/or BA have had on your organisation's behaviour change strategy.

Too early to know Negative Impact No Impact Some Impact High Impact

Can you describe this impact?

29. What recommendations would you make to strengthen DBC and/or BA?

30. Are you currently monitoring your behaviour change programming activities? yes no If yes,

what monitoring tools do you use?

31. Have you conducted any assessments or evaluations of DBC and/or BA activities? yes no If

yes, when and what kind of evaluation?

32. Were there any challenges applying DBC and/or BA? yes no If yes, please explain the

challenges and how they were resolved?

Page 18: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

18

APPENDIX 2: TERMS OF REFERENCE

Desk review of experience with the application of the Designing for Behaviour Change Framework

Description of assignment

An estimated 20 to 30 development organisations are thought to be using the Designing for

Behaviour Change (DBC) Framework to develop behaviour change strategies for targeted

behaviours in sectors such as food security, livelihoods, health, nutrition, education and water,

sanitation and hygiene (WASH). The formative research stage in the DBC process typically uses the

Barrier Analysis (BA) Survey to discover the significant determinants for behavioural change.

In 2013, with help from Bonnie Kittle (DBC Master Trainer and co-author of the DBC and BA

training curriculum), World Vision started training WASH staff from 17 African countries on DBC

and BA. To date World Vision has completed about 30 DBCs with another 20 or so planned or in

progress. GOAL International has made similar progress with DBC for WASH and other sectors. If

other organisations have made this kind of progress there could be a few hundred completed BA

surveys and DBC Frameworks to date.

The Food Security & Nutrition Network has a Behaviour Bank where DBC/BA practitioners can

post their completed BA and Doer/Non-Doer survey results. As of 27 April 2015, there were 68

entries from 8 organisations and 11 countries, covering 35 behaviours. Behaviours that had multiple

BAs were hand washing, exclusive breast feeding, complementary feeding, antenatal care visits, and

safe storage of drinking water. For hand washing (probably the most studied of WASH-related

behaviours), World Vision has found at least 25 BAs - about half of these not yet posted in the

Behaviour Bank (including those from World Vision).

While continuing to apply DBC for developing behaviour change strategies, World Vision and

several other organisations believe that now is a good time to take stock of experience from the

application of DBC and BA by practitioners around the world. This desk-based review will support

the documentation of existing DBCs strategies and BAs and help us understand how organisations

are equipped, utilising, monitoring and evaluating their current DBC activities.

Goal and objectives

Goal: Assure the quality of DBC and BA processes and strengthen it into the future.

Objectives:

1) Assess current capacity and application of DBC and BA across multiple organisations

2) Collect and compile by country and subject, completed DBC Frameworks, BA

questionnaires and data tabulation spread sheets

3) For the completed DBC Frameworks and BA surveys, identify for the significant

determinants which responses and bridges to activities are the same

4) Identify how organisations are monitoring and evaluating the effectiveness of behaviour

change activities developed with the aid of the DBC Framework

5) Develop recommendations to strengthen DBC and BA moving forward

Roles and responsibilities

Shannon Gibbs, MPH GDM (expected May 2016), University of South Florida: Fulfil duties

per ToR

World Vision International:

Page 19: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

19

Overall coordination

Managerial supervision and mentorship

Provision of materials and contacts for review and interview

Review, input and sign-off on final report

Partner organisation: GOAL International -- Provision of materials and contacts for review and

interview, input into review progress, and input into final report

Stakeholders

Bonnie Kittle, Independent DBC consultant

Cathy Stephen, WASH Adviser, Plan UK

Emily Bostick, East Africa Regional Technical Adviser for Health, Catholic Relief Services

Etsegenet Hailu, Health and Nutrition Programme Director, Food for the Hungry, Ethiopia

Franck Flachenberg, Environmental Health Technical Adviser, Concern Worldwide

Gillian McKay, Global Behaviour Change Adviser, GOAL International

John Collett, Senior Adviser, Hygiene Promotion & Behaviour Change, World Vision

International

Mary DeCoster, TOPS Senior Specialist for Social & Behavioural Change Programmes, Food

for the Hungry

Action plan

Conduct desk review of journals and publications for existing research on WASH-related

behaviours using BA

Contact and interview all organisations known to be or thought to be using DBC and BA in

their behaviour change programming to know what they’ve done, what’s worked well (good

practices), lessons learned (recommendations about any changes they made), and what

difference DBC has made to their programme outcomes. An interview guide/ prompt will be

developed beforehand for review and approval (letter of introduction to be provided)

Compile the following for collections of DBC Frameworks and BA surveys on the same or

similar behaviour

o BA survey questionnaires (with date and location where BA was carried out)

o For significant determinants record the percentage points difference between Doers

and Non-Doers for each significant response

o Bridges to Activities for similar significant responses

o Activities for similar Bridges to Activities

o Significant influencing groups

o Behaviour change monitoring and evaluation results

Liaise with the FSN Network Behaviour Bank to enter BA and Doer/Non-Doer survey

results that have not been included in the Bank

Produce a final report covering background, methodology, findings, conclusions and

recommendations (detailed outline to be provided)

Prepare a presentation for sharing the findings of the review with interested parties

Expected deliverables

Summary of key findings from desk review

Collection of significant determinants, significant responses, bridges to activities, activities

and significant influencing groups for common behaviours

Collection of DBC/BA good practices and lessons learned

Collection of DBC/BA monitoring tools and evaluations

Final report covering background, methodology, findings, conclusions and recommendations

Page 20: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

20

Presentation

Timeline

Start date: 1 August 2015

End date: 10 December 2015

August September October November December

1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4

Project orientation and

work plan detail

development

X X X

Literature review X X X X

Schedule interviews X X X

Conduct interviews X X X X

Interview analysis X X X X

Report writing X X X

Report review X X

Final revisions, review

and presentation X

X

Page 21: Designing for Behaviour Change Desk Review Desk... · Ethiopia Nepal Tajikistan Ghana Nicaragua Tanzania Guatemala Niger Timor L’Este Haiti Nigeria Uganda Honduras Pakistan Zambia

21

FOR FURTHER INFORMATION, PLEASE CONTACT:

WVI Offices WVI Regional Offices

World Vision International

Executive Office

Waterview House

1 Roundwood Avenue Stockley Park

Uxbridge, Middlesex UB11 1FG, UK

World Vision Brussels & EU

Representation ivzw

18, Square de Meeûs

1st floor, Box 2

B- 1050 Brussels, Belgium

+32.2.230.1621

World Vision International

Liaison Office

7-9 Chemin de Balexert

Case Postale 545

CH-1219 Châtelaine

Switzerland

+41.22.798.4183

World Vision International

United Nations Liaison Office

919, 2nd Avenue, 2nd Floor

New York, NY 10017, USA

+1.212.355.1779

East Africa Office

Karen Road, Off Ngong Road

P.O. Box 133 - 00502 Karen

Nairobi, Kenya

Southern Africa Office

P.O. Box 5903

Weltevredenpark, 1715

South Africa

West Africa Office

Hann Maristes

Scat Urbam n° R21

BP: 25857 - Dakar Fann

Dakar, Senegal

East Asia Office

Bangkok Business Centre

13th Floor, 29 Sukhumvit 63 (Soi Ekamai)

Klongton Nua, Wattana, Bangkok 10110

Thailand

South Asia & Pacific Office

750B Chai Chee Road #03-02

Technopark @ Chai Chee

Singapore 469002

Latin America and Caribbean Regional Office

P.O. Box:133-2300

Edificio Torres Del Campo, Torre 1, piso 1

Frente al Centro Comercial El Pueblo

Barrio Tournón

San José, Costa Rica

Middle East and Eastern Europe Regional Office

P.O Box 28979

2084 Nicosia, Cyprus

© World Vision International 2016

World Vision is a Christian relief, development and advocacy organisation dedicated to working with children,

families and communities to overcome poverty and injustice. Inspired by our Christian values, World Vision is

dedicated to working with the world's most vulnerable people. World Vision serves all people regardless of

religion, race, ethnicity or gender.