we work with you to create the change you envision, planning progress through knowledge and action
TRANSCRIPT
We work with you to create the change
you envision, planning progress through
knowledge and action
2
Federal Evaluation of Linkages:
Supporting Sustainability
Prepared For
CFPIC
October 16, 2007
3
Sustainability Starts with a Theory of Change
4
Linkages P
articip
atio
n
Linkagesv1
Linkagesv2
Linkagesv3
No linked services
ServiceCoordination (TDM)
Outcomes
Org
aniza
tional C
han
ge
Family to Family or
similar
Alternative
Impact
Local CBO
assistance
programs
CFPIC suppo
rt Privately-
funded
changes
Privately-
funded
changes
Child Welfare policy
changes
Otherpolicy chang
es
CalWORKs policy changes
Economic
changes
Linkages Theory of Change
Precursors Implementation Outputs Outcomes External Factors to Implementation
5
6
Sustainability Built in to Evaluation Design
7
Three-Pronged Design Retrospective Evaluation
Outcome-focused for existing programs Provides justification for sustainability
Prospective Evaluation Links rigorous process evaluation with outcomes
Supports sustainability by investigating what org change and implementation elements are needed for maintaining successful outcomes over time
Case Studies Detailed description of three county Linkages programs
Elaborates on sustainability process of existing programs
8
Retrospective Design Timeframe
Historical data from 1999-2006
Sample Del Norte, Calaveras, Merced, Orange,
San Francisco, Santa Barbara, Stanislaus “Historical” comparison group
Measures Organizational change Implementation Outcomes External factors
Data Sources State and County databases: CWSCMS, ISAWS, Leader, C-IV, CalWIN,
EDD Historical documents describing program development and
implementation
9
Prospective Design Timeframe
2007- 2011
Sample Selected Pioneer, Phase II, and Phase III Counties Comparison counties with no Linkages-like programs
Measures Rigorous process and implementation evaluation Outcomes External factors
Data Sources State and County databases: CWSCMS, ISAWS, Leader, C-IV,
CalWIN, EDD Surveys of Linkages staff
10
Case Studies Timeframe
2007-2011
Sample (proposed) Stanislaus, Los Angeles, Santa Clara
Research Questions How is Linkages implemented? How do Linkages activities produce outcomes?
Data Sources Interviews with Linkages staff Focus groups with Linkages clients
11
Contact
Paul Harder
Erika Lehmann, Ph.D.
530.757.8420
harderco.com
12
Organizational Change Elements
Culture
Leadership
Policy
Administration
*
13
Implementation ElementsConfidentiality
Data Sharing
Coordinated Services
Co-location
Training
Accountability
Staff Support
*
14
Outcomes
Children experience less abuse
Children safe in their homes
Parents have resources to support their children
Children in foster care achieve permanency
*