philip davies - introduction to impact evaluation
DESCRIPTION
Presentation at "Impact Evaluation for Financial Inclusion" (January 2013) CGAP and the UK Department for International Development (DFID) convened over 70 funders, practitioners, and researchers for a workshop on impact evaluation for financial inclusion in January 2013. Co-hosted by DFID in London, the workshop was an opportunity for participants to engage with leading researchers on the latest research methods of impact evaluation and to discuss other areas on the impact evaluation agenda.TRANSCRIPT
www.3ieimpact.org Philip Davies
Introduction to Impact Evaluation
Philip Davies International Initiative for Impact Evaluation [3ie]
CGAP Retreat - Impact Evaluation for Financial Inclusion DfID, London 10th January 2013
www.3ieimpact.org Philip Davies
Impact evaluation should be driven by: What’s the Question?
www.3ieimpact.org Philip Davies
Evidence for Policy
Theories of Change
How is the policy supposed to work?
Logic Model
www.3ieimpact.org Philip Davies
Evaluation: Theory of Change/Logic Model
• How is a policy/programme supposed to work? • What activities, mechanisms, people have to be in place?
• And in what sequence – what is the causal chain? • What resources are required – and are available?
• What data are required – and are available?
• Is the policy/programme feasible/achievable?
www.3ieimpact.org Philip Davies
www.3ieimpact.org Philip Davies
Evidence for Policy
Theories of Change
How is the policy supposed to work?
Logic Model What is already known about this issue?
Harness Existing Evidence
Research Synthesis
www.3ieimpact.org Philip Davies
Evidence for Policy
Theories of Change
How is the policy supposed to work?
Logic Model What is already known about this issue?
Harness Existing Evidence
Research Synthesis
What is the nature, size and dynamics of the problem?
Administrative Data Surveys Census Data Qualitative Research
Descriptive and
Experiential Evidence
www.3ieimpact.org Philip Davies
Evidence for Policy
Theories of Change
How is the policy supposed to work?
Logic Model
What is already known about this issue?
Harness Existing Evidence
Research Synthesis
What is the nature, size and dynamics of the problem?
Evidence of Proven
Effectiveness
Experimental and Quasi-
Experimental Evidence
Descriptive and
Experiential Evidence
Administrative Data Surveys Census Data Qualitative Research
What policy initiatives are
effective?
www.3ieimpact.org Philip Davies
Evidence for Policy
Theories of Change
How is the policy supposed to work?
Logic Model What is already known about the problem/policy?
Harness Existing Evidence
Research Synthesis
What is the nature, size and dynamics of the problem?
Evidence of Proven
Effectiveness
Experimental and
Quasi- Experimental Evidence
How do we make the policy work?
Implementation Evidence
Case Studies Interviews
Focus Groups Ethnography Operations Research
Descriptive Analysis and Experiential
Evidence
Administrative Data Surveys Census Data Qualitative Research
What policy initiatives are
effective?
www.3ieimpact.org Philip Davies
Evidence for Policy
Theories of Change
How is the policy supposed to work?
Logic Model What is already known about the problem/policy?
Harness Existing Evidence
Research Synthesis
What is the nature, size and dynamics of the problem?
Evidence of Proven
Effectiveness
Experimental and
Quasi- Experimental Evidence
How do we make The policy work?
Implementation Evidence/
Case Studies Interviews
Focus Groups Ethnography Operations Research
What are the costs and benefits of the
policy ]
Economic and Econometric
Evidence Cost-Benefit/ Effectiveness/
Utility Analysis Descriptive Analysis and Experiential
Evidence
Administrative Data Surveys Census Data Qualitative Research
What policy initiatives are
effective?
www.3ieimpact.org Philip Davies
Evidence for Policy
Theories of Change
How is the policy supposed to work?
Logic Model What is already known about the problem/policy?
Harness Existing Evidence
Research Synthesis
What is the nature, size and dynamics of the problem? Descriptive
and Experiential
Evidence
Evidence of Proven
Effectiveness
Experimental and
Quasi- Experimental Evidence
How do we make The policy work?
Implementation Evidence/
Case Studies Interviews
Focus Groups Ethnography Operations Research
What are the costs and benefits of the
policy ]
Economic and Econometric
Evidence Cost-Benefit/ Effectiveness/
Utility Analysis
What are the ethical implications of
the policy?
Ethical Evidence
Social Ethics Public
Consultation
Administrative Data Surveys Census Data Qualitative Research
What policy initiatives are
effective?
www.3ieimpact.org Philip Davies
Impact Evaluation – One Tool in the M & E Toolkit
DAC/OECD Definition The positive and negative, primary and secondary long-
term effects produced by a development intervention, directly or indirectly, intended or unintended.”
Two underlying premises – attribution “effects
produced by” and counterfactural
www.3ieimpact.org Philip Davies
Thank you Philip Davies
Email: [email protected] +44 (0)207 958 8350
Visit www.3ieimpact.org