equitable evaluation - integrating cultural competence and equity
TRANSCRIPT
EQUITABLE EVALUATION - INTEGRATING CULTURAL
COMPETENCE AND EQUITY
Jara Dean-Coffey Jill Casey
jdcPartnerships Impact of Intention: Determine Where You Are Now
3
! & ?
…*
jdcPartnerships
1. Introduce two frameworks:
§ equitable evaluation frame (EE) § capacity building approach for philanthropy to practice
equitable evaluation (EECB)
2. Dialogue about strengths as well as challenges and solutions re: EE and EECB
3. Identify opportunities to
§ Continue research to expand EE capacity building approach § Implement EE in the field
5
Our Hopes For Today
Strong Evaluation Reflects
¡ Understanding of context
¡ Engagement of clients/community engaged/ involved start to finish
¡ Sensitivity to and awareness about power differentials and diversity
¡ Focus on strengths
¡ Findings/ data shared and used
¡ Recommendations/next steps informed by community
6 December 2013
7
Culturally Responsive Evaluation Process
Prepare for Evaluation
Engage stakeholders
Identify evaluation purpose
Frame questions
Design evaluation Select/adapt data collection methods
and tools
Collect data
Analyze data
Disseminate/ use findings
Hopson, R. K. (2003). Overview of multicultural and culturally competent program evaluation: Issues, challenges and opportunities. Woodland Hills, CA: The California Endowment.
Culture and
context
Equitable Evaluation
A judgment made of the relevance, effectiveness, efficiency, impact, and sustainability – and, in
humanitarian settings, coverage, connectedness, and coherence – of policies, programs, and projects
concerned with achieving equitable development results.
1 Bamberger & Segone, 2011, p. 9
Evaluative Inquiry Cycle
jdcPartnerships
FRAMING the Inquiry: • Clarify purpose • Surface assumptions • Articulate goals & objectives • Assess organizational capacity • Identify key questions
FOCUSING the Inquiry: • Prioritize key questions • Determine data collection methods • Review/revise, develop data
collection tools and administration protocols
• Integrate data collection with organizational culture/program practice
CONDUCTING the Inquiry: • Pilot tools/administration and modify as needed • Collect information • Communicate preliminary ideas about how
findings will be communicated and utilized
APPLYING the Learning: • Analyze and interpret data • Use findings to:
- Inform program development - Modify organizational systems and structure - Make decisions around future investments and strategies - Contribute to individual growth and educate the field - Inform further evaluative inquiry activities
Adapted from Preskill and Torres 1999
Evaluative Inquiry Informed by Culture & Context
jdcPartnerships
CONTEXT
CULTURE
11
EMERGING EQUITABLE EVALUATION
CAPACITY BUILDING FRAMEWORK
Readiness (Competencies) 12
Individual
• Recognize as fundamental and “mission critical”
• Shift from personal to structural
• Address general attitudes about evaluation
• Build internally on processes and practices
• Expand EE practice among grantees
Sustained Practice (Capacities) 13
Organizational
• Leverage opportunities to build internal and external competencies and capacities
• Recognize/adopt/resource practices appropriate to equitable evaluation
• Mitigate barriers to authentic practices
• Establish policies that reflect centrality of equity in outcomes and performance measure
• Stronger competencies
• Increased capacities
Individual + Organizational
Equitable Evaluation Capacity Building Approach
15
CONTEXT
CULTURE
Questions, Discussion
• What comes up for you?
• How do you see this integrating this in your work?
Opportunities, Next Steps 17
•
To What End: http://www.jdcpartnerhips.com/ToWhatEnd/
Twitter: http://twitter.com/jdeancoffey http://twitter.com/jill_casey
www.jdcpartnerships.com
18
BUILDING A COMMUNITY OF PRACTICE