impact evaluation in the sector of social entrepreneurship: integrating gis with inductive methods
TRANSCRIPT
Impact evaluation in the sector of Social Entrepreneurship: Integrating
GIS with inductive methods
1. Introduction to the Knowledge Transfer Partnership (‘KTP’) project
2. Outline current strategies in impact evaluation
3. The KTP method and progress
4. Summary of conclusions
Aim of the session
Knowledge Transfer Partnership: Designing and implementing a longitudinal impact evaluation strategy
Design and implement a strategyto evaluate the kinds of socialimpact being made by UnLtd
Award Winners
The foundation for Social Entrepreneurs
Department of Geomatic Engineering
The landscape of impact evaluation
Evidence-based research
-use of both qualitative and quantitative methods
Markers of success -used to measure impact
Deductive methods -common practice in impact evaluation
Current impact evaluation strategies: the deductive approach
Hypothesis
Observation
Confirmation/rejection of hypothesis
Deductive approach: An approach to developing or confirming a theory that begins with abstract concepts and theoretical relationships and works toward more empirical evidence (Neuman, 2006, pp.59)
1.
2.
3.
The problem…
Hypothesis
-Reliant on what we understand about Social Entrepreneurs
-Reliant on what we understand about impact
Observation-Methods are designed to gather evidence to support of reject hypothesis
Confirmation/rejection of hypothesis
-Knowledge of social entrepreneurs is specific and limited
Mapping Social Entrepreneurs: an example of deductive approaches to evaluation
Source: UnLtd research, 2005
Inductive approach to impact evaluation
Observation
Pattern/Trend
Tentative hypothesis
Theory
Inductive approach: An approach to developing or confirming a theory that begins with concrete empirical evidence and works toward more abstract concepts and theoretical relationships (Neuman, 2006, pp.60)
Qualitative interviews
Questionnaires/ Surveys
Combining GIS and qualitative methods
Qualitative research: To observe and gather information
about social entrepreneurs’ experience of creating
social impact
Geographic Information Systems/Science:
Provides ‘a tool for representing and visualizing environments
beyond the scope of everyday life’ (McLafferty, 2002, pp.265)
A more comprehensive and more critical view of
social impact
Inductivedirection
The project stages
STAGE 1: Review of literature
STAGE 2: Research tool design
STAGE 3: Field work
STAGE 4: Data analysis
STAGE 5:Results
Pilot Study
In depth interviews, focus groups,
online surveys, mappingATLAS.ti, SPSS, GIS
Introducing GIS
Geographical Information Systems and Science
-Computer systems that can capture, store, analyse and manage any data with a spatial reference-Is recognised for its ability to support qualitative research that that seeks to understand the socio-spatial contexts of individual experiences
-can teach us how to enhance social impact
Data analysis and impact mapping
Coding of qualitative
data
Categories of impact
Further testingon broader population
Impact maps
Impact Maps
Source: UnLtd research, 2005
No’ of jobs created through projects
>10080-9960-7940-5920-3910-19
5-90-4
Projects run by those aged 25-30
Pilot study results
Award Winners identify social
impact as:
Changes to attitude
Change to behaviour
Skill provisionRemoving barriersto social inclusion
Improvingcommunitycohesion
Reducing crime
Providing support
“Impact for me is making people sit up and listen… and about creating a difference”
“think that we’ve given a lot of grooms a little boost, a bit of confidence…”
“If you’re making 50,000 pounds or if
you’re on limited income support…you
should have the benefit of being
treated as a client and not as a service user. And that’s the
whole idea behind wanting to run [this
project]”
“…the BGA can make them feel a bit more inclusive, socially inclusive in the area that they’re in”
Summary of conclusions
• Deductive approaches to impact evaluation provide partial knowledge about social impact
• By adopting an inductive approach we can develop a more comprehensive understanding about social impact
• Incorporating GIS with inductive/qualitative methods encourages a more in-depth and critical approach to understanding impact
Laura FryKnowledge Transfer Associate, UCL, [email protected]
Mordechai (Muki) HaklaySenior Lecturer, [email protected]
Lea EsterhuizenHead of Research, [email protected]