Communicating Synthesised EvidenceMichelle Burns – Evidence Broker (DFID)Melanie Punton – Graduate Placement (DFID)

Aim of Session

Insight into Research and Evidence Division – Who are RED and what does it mean for me?

Insight into how we as Evidence Brokers have managed communicating synthesised evidence – Who are Evidence Brokers?

Exercise on what to do with Evidence

Who are RED and what does it mean for me?

Research and Evidence Division Structure

Chris WhittyDirector and Chief Scientific Adviser

DCSA Tim WheelerHead of Research office

RED Research Teams and SRFs

AgricultureClimate & EnvHuman DevGrowthGovernance, Conflict & Social Development

Evidence & Evaluation

Alan WintersOffice of Chief Economist

Evidence Into ActionEvidence BrokersOutreach AnalystsUptake Managers

2 Chief Professional Officers (human Dev and

Climate and Env), Chief Statistician,

Head of Evaluation and5 HoPs

HealthEducation

Livelihoods, Climate & Env and

infrastructure

2 Chief Professional Officers, (Growth and

private sector, Governance and society)

and4 HoPs

Economists Private Sector

Governance and Social Development

Evaluation

Global Stats partnership

Professional Cadres

RED: Mission statement

RED mission is to support DFID to become world class in using evidence for development impact while ensuring VFM, to influence other donors to be the same and provide better evidence to all decision makers in development.

Evidence Brokers- who and what?Aim: Assist advisers and programme managers make better informed decisions by:1.Providing Evidence Products on a variety of strategically positioned subjects2.Building capacity within the organisation to search, appraise and apply different types of evidence in programme and policy development settings

What do we mean by Evidence Products Rapid Review Literature

Review Evidence Paper Systematic Review

What is it Quick review of key easily accessible evidence

Review of main literature in the field including all major research studies

Extensive overview and synthesis of most evidence in the field

Comprehensive search for all evidence related to the question and a synthesis of high quality studies

Inform Policy? No but may inform specific decision

Yes but limited to one or two questions

Yes Yes

Peer Reviewed Optional Internal Internal and Peer Internal and Peer at both protocol and final report stage

Systematic and replicable approach to sourcing evidence

No Partial Partial Yes

Quality of evidence appraised and or documented

Limited Yes Yes Yes

What do Evidence Brokers do in Practice

Aim of the Evidence Brokers

SEARCH APPRAISE APPLY/SYNTHESIS

Production of evidence products

Overseeing ToR that are commissioned by colleagues in research and policy

Appraising different variety of evidence and research

Evidence PapersLiterature ReviewsRapid ReviewsSystematic Reviews

Capacity Building

CAS training: How to ensure that you develop an appropriate search strategy to ensure you get all the evidence you need

CAS training: Appraising Peer Reviewed EvidenceAppraising Bodies of EvidenceAppraising robustnessAppraising the Value of Methods

CAS training:Appraising evidence for Business CasesAppraising Evidence in Policy Development

Service Approach Reasons for approach Evidence tells us Reference

Strengthening supportive supervision

Enhanced social interaction with clients increases client satisfaction with service

(Promising) Small service provider training studies from Ghana, Mexico and Guatemala have highlighted the importance of service provide in improving client satisfaction with service provision

Combray P, Newman C, Glover K et al. Study of the effects of technical supervision training on cbd supervisors, performance in 7 regions of Ghana. Technical Report 7. Chapel Hill: PRIME II; 1999. Vernon R, Stauton A, Garcia M et al. A test of alternative supervision strategies for family planning services in Guatemala. Stud Fam Plann. 1994: 25 (4): 232-238

Improving system readiness

Improve Client-provider interactions and quality of care that influences uptake and return rates

(Promising) Small country focused studies from Bangladesh and Tanzania report community perceptions of quality of care are important determinants on contraceptive use

Koenig M, Hossain M, Whittaker M. The influence of quality of care upon contraceptive use in rural Bangladesh. Stud Fam Plann. 1997: 28 (4): 278-289 Mroz T, Bollen K, Speuzer I, Mancini D. Quality, accessibility and contraceptive use in rural Tanzania Demography. 1999: 36 (1): 23-40

Examples of Evidence Synthesis Products: Robustness of Evidence Maternal Health Care

Examples of Evidence Synthesis Products: Narrative Analysis Empowerment and Accountability

Information dissemination Interventions have

variable impactdeoending on

context and typeOne study

A number of isolated studies, or

one or more

review Micro credit increases women's empowerment in

market place Education, employment and changes in legal status of

women positive influences female empowerment and

access to services

Training and education can increase

self confidence and skillsImpact of education

interventions on jobs for

men as well as womenunknown

Improve access to

market place

Improve confidence and social

involvement

Increase capabilities and assets

Improve service delivery

Improve governance outcomes

Transform political

dynamics

Small group actionwas more successful

than large group action

interventions(Banjeree et al 2010)

Isolated evidence of positive effects of

Citizen Score Cards.

Mixed and contingent evidenceon community interventions

for social cohesionand participation(eg Moehler 2010)

Isolated evidence of positive effects of

electoral Interventions

Some evidence of long-termchange in perceptions of women

leaders due to female quotas(Beamann et al 2010)

Many studies note the key impact of political

dynamics on success or failureof interventions.

In a study of 52 aid Projects, participation

built community capacityand project effectiveness.

Simpler technologies were more successful

(Finsterbusch et al 1989)

Community based better than local

government(eg Mansuri & Rao 2003)

Two studies or more One study shows

significant PETS impact, others more mixed on PETS and

QSDS

Systematic case study review of 121 water supply project evaluations in 49 countries

provides statisticalevidence that participation

Improves performance(Narayan 1995)

effective

contested

ineffective

weak fair strong

PFM

SAIS

ACAs

NACS

AC Laws

FIUs

Judicial reform

Police reform

Civil service reform

procurement

Tax reform

decentralisation

Parliament

Ombuds-person

Judicial independence

Budget support

Corruption condition-

alities

Donor systems

Int. agreements

Strength of the Evidence

Examples of Evidence Synthesis Products: Anti-Corruption Interventions – Summary of the Evidence

Private sector

Media

NGOs/community monitoring

- Jesper Johnsøn, Nils Taxell, and Dominik Zaum 2012

Key to evidence themes

Examples of Evidence Synthesis Products: Map of evidence on media and conflict

Methodology

Exercise • Review small amount of evidence in front of you• Develop a different approach to telling key messages/findings

Area Key Theme General Direction

Details/Worth Knowing

Geographical Distance to source of contraception services influences ability to use/access

Mixed Improved access can have an effect on contraceptive prevalence – Bangladesh (6a) and Ghana (6b)

Inadequate access to services not most predominant cause in addressing unmet need – Cross National Review