Evidence-Based Evidence-Based Assessment ToolAssessment Tool

A Guide for Family Support Providers and Funders

HistoryHistory

• Developed in 2005

• Original purpose was to assist funders in making the best investment possible

• Reviewed by the Family Support Leadership group

Who should Use this tool?Who should Use this tool?

• Funders, such as local empowerment boards

• Program staff that wish to improve their program

• Community members that are interested in better results

Evidence Based DefinitionEvidence Based Definition

• The Level of evidence that supports the efficacy and generality of a practice as indicated by research.

Types of EvidenceTypes of Evidence

• Type One: Empirical Evidence• Type Two: Evaluation reports analyzed by an

outside source• Type Three: Evaluation reports analyzed by the

system developer• Type Four: Survey research published in peer-

reviewed journals• Type Five: Multi-authored consensus documents

published by a professional organization

Caution!Caution!

• Be cautious with reports and evidence that are developed by the program developer or provider and not reviewed by an outside organization or a peer review journal.

• Reports should document positive outcomes for children and families

What does that mean for us?What does that mean for us?

• It is challenging to find a program in Iowa that meets the evidence-based definition

Why Should We Use This Why Should We Use This Assessment?Assessment?

1. Informed Decision Making2. Better Programs3. Better Results for Children and Families

Implementation For FundersImplementation For Funders

• Use the Assessment to interview your contractors

• Include elements of the assessment in your request for proposals

• Ask your evidenced based contractors to cite the supporting research in their request for proposals

Implementation for ProgramsImplementation for Programs**Review a few questions a week with staff Review a few questions a week with staff during your regular staff meetingsduring your regular staff meetings*Complete the Assessment as a *Complete the Assessment as a planning/program improvement activityplanning/program improvement activity*It is important to include direct service staff. *It is important to include direct service staff. They are the ones responsible for service They are the ones responsible for service delivery.delivery.

Program ImprovementProgram Improvement

• Be honest

• Be willing to hear the good, the bad and the ugly

• Pick a place to start

Key Question: With limited financial resources, what can we do to improve our services?

Program Model FidelityProgram Model Fidelity

• Understanding the logic behind the model helps service delivery staff understand what the program should be doing, what their role is and what are the expected results.

• Regular reviews of the program model with all staff help keep the program on course.

Program Model FidelityProgram Model Fidelity

• Why was the program chosen?

• What evidence supports the decision?

• Is the model based on essential researched based components?

• Are the program’s goals appropriate for the intended population?

Program StaffProgram Staff

The decisions that staff make on a daily basis can make a difference as to whether the child or family receives services that

are scientifically proven to have a positive impact.

Program StaffProgram Staff

1. The staff at all levels have professional development opportunities to ensure a level of competency prior to serving children and families.

2. The caseloads of staff reflect the program model recommendations and are monitored periodically.

3. Different types of supervision and monitoring are provided on a regular basis.

Program Model MonitoringProgram Model Monitoring

• Program Model fidelity provides standards for replication.

• Attention to fidelity is critical for successful program replication. 

• Many organizations fall short when attempting to implement an evidenced based model without adequate funding.

Program Model MonitoringProgram Model Monitoring

1. The frequency and intensity of the program is being provided at the program model recommendations.

2. The program is reaching the intended population of the program.

3. There is process for continuous improvement for staff and management.

For More Information:For More Information:

Quality Services and Programs Co-Chairs:Gretchen Hageman, 515-281-7585 ghageman@idph.state.is.us

or

Ruth Krueger, 641-648-5036rkrueger@micaonline.org

www.earlychildhoodiowa.org

This product was developed by:This product was developed by:

Quality Services and ProgramsA component group of Early Childhood Iowa