arizona systems
DESCRIPTION
System Change PresentationTRANSCRIPT
Early Learning
Health, Mental
Health and Nutrition
Family Support
Special Needs/ Early Intervention
Source: Early Childhood Systems Working Group
Early Childhood Development System
What is systems building?
2.
3.
Three Questions
What are the implications for evaluation?
What are elements of system building?
System Building Sequence
System Building Activities
Better Child and Family Outcomes
Better Early
ChildhoodSystem
1) Context
Policies Funding
2) Components
Family Support Early Intervention
Health, Mental Health, NutritionPreK
3) Connections
Early Learning
Health, Mental
Health and Nutrition
Family Support
Special Needs/ Early
Intervention
Source: Early Childhood Systems Working Group
4) Infrastructure
• Governance• Training• Quality• Data
5) Scale
• Spread• Breadth• Depth• Ownership
Scale
Infrastructure
Connections
Components
ContextImproving the political context that surrounds the system so it produces the policy and funding changes needed to create and sustain it
Establishing high-performance programs and services that produce results for children and families
Creating strong linkages across system components that further improve results for children and families
Developing the supports systems need to function effectively and with quality
Ensuring a comprehensive system is available to as many people as possible
Five Elements of Systems Building
ScaleInfrastructureConnectionsComponentsContext
• Shared vision
• Leadership
• Public engagement
• Media coverage
• Public will
• Political will
• Policy changes
• New system programs or services
• Expanded program reach or coverage
• Improved quality
• Increased operational efficiency
• Shared goals
• Shared standards
• Shared competencies or skills standards
• Seamless services
• Cross-system governance
• State-local connections
• Shared data systems
• Cross-system training and professional development
• System spread
• System depth
• System sustainability
• Shifts in system ownership
Expected System-Level Outcomes
Initiatives typically are not expected to demonstrate how context-related outcomes causally connect to child- or family-level impacts
Initiatives typically are not expected to demonstrate how infrastructure outcomes causally connect to child- or family-level impacts
Better impacts for children and families related to specific programs or practices
Better impacts for children and families where or when connections are made compared to when they are not
Better impacts for beneficiaries across a broad spectrum of domains and on a system-wide population level (e.g., on community or state indicators)
ScaleInfrastructureConnectionsComponentsContext
Expected System-Level Impacts
ScaleInfrastructureConnectionsComponentsContext
• Theory of change evaluation
• Case studies
• Public polling
• Policy tracking
• Key informant surveys
• Coalition analysis
• Policymaker interviews
• Media tracking
• Program evaluation methodologies (including experimental/ quasi)
• Program monitoring
• Quality assessments
• Efficiency analyses
• Customer surveys
• Program evaluation methodologies (including experimental/ quasi)
• System mapping
• Network analysis
• Customer surveys
• Theory of change evaluation
• Case studies
• Performance audits
• Management information systems
• Practitioner data collection
• Population-based demographic and service analysis
• Program evaluation methodologies (including experimental/ quasi)
• System/program monitoring
• Results-based accountability
Methods
Once the relevant areas have been defined, use the framework to help define which expected outcomes and impacts are relevant and realistic.
Finally, use the framework to define suitable evaluation approaches to capture those outcomes and impacts. Evaluation approaches can be “mixed and matched” across the relevant areas as appropriate.
Systems initiatives are different. It is important to define what the initiative is doing so that expectations about results are realistic. The framework can be a guide. Use it to identify which of the five focus areas are relevant.
Framework Uses