Logic ModelsHandout 1

Morehouse’s Logic Model [handout]

Handout 2

YRBS 2009 Key FindingsHandout 3

YRBS 2009 Key FindingsHandout 4

University of Wisconsin-Extension, Program Development and Evaluation

Social-economic-environmental improvements

Hierarchy of Effects

Source: Bennett and Rockwell, 1995, Targeting Outcomes of Programs

Reactions

Learning

Actions

Number and characteristics of people reached; frequency and intensity of contact

Degree of satisfaction with program; level of interest; feelings toward activities, educational methods

Changes in knowledge, attitudes, skills, aspirations

Changes in behaviors and practices

Participation

Handout 5

Pulling it Together

Theory Base

InputsResources available

to operate a program; personnel, fiscal and

other resources

Activities/StrategiesThings that

the program is doing. List

processes, tools, events and actions

Output:What is

delivered? services,

types, levels,

Output:Who is served?

Short-Term/

ImmediateOutcomes1-3 years; focuses on change in

knowledge, attitudes, and skills

Inter-mediate

Outcomes3-5 years;changes in behavior,

norms, and/or policies

Long-Term

Outcomes4-6 years;changes in organiza-tions and systems

Data sources to document accomplishment

Handout 6

University of Wisconsin-Extension, Program Development and Evaluation

Logic model and common types of evaluation

Needs/asset assessment: What are the characteristics, needs, priorities of target population?What are potential barriers/facilitators?What is most appropriate to do?

Process evaluation: How is program implemented? Are activities delivered as intended? Fidelity of implementation?Are participants being reached as intended? What are participant reactions?

Outcome evaluation: To what extent are desired changes occurring? Goals met?Who is benefiting/not benefiting? How? What seems to work? Not work?What are unintended outcomes?

Impact evaluation: To what extent can changes be attributed to the program? What are the net effects?What are final consequences? Is program worth resources it costs?

Handout 7

Typical Activity Indicators to Track

Activities Outcomes Measures

SAC Interventions Improved Grades GPA Student interview Parent Interview Report Card

Improved Attendance UA school and class

Reduced Disciplinary Infractions

ODRsPolicy Violations

Increased Coping Skills Student Survey Pre-Post

Increased Resiliency Student Survey Pre-Post

Increased Perceived Social Support

Student Survey Pre-Post

Decreased or delayed substance use

State Risk Survey

Handout 8

University of Wisconsin-Extension, Program Development and Evaluation

Staff

Money

Partners

Parents increase knowledge of child dev.

Parents better understand their own parenting style

Parents use effective parenting practices

Improved child-parent relationsResearch Facilitate

support groups

Parents gain skills in new ways to parent

Parents identify appropriate actions to take

To what extent is stress reduced?To what extent are relations improved?

To what extent did behaviorschange? For whom? Why? What else happened?

To what extent did knowledge and skills increase? For whom? Why? What else happened?

Who/how many attended/did not attend? Did they attend all sessions?Supports groups? Were they satisfied – why/why not?

How many sessions were held? How effectively?#, quality of support groups?

What amount of $ and time were invested?

Parents of 3-10 year- olds

Deliver series of 8 interactive sessions

EVALUATION QUESTIONS

# Staff$ used# partners

# Sessions held

Quality criteria

INDICATORS

#,% attended per session

Certificate of completion

#,% demonstrating increased knowledge/skills

Additional outcomes

#,% demonstrating changes in behavior

Types of changes

#,% demonstrating improvements

Types of improvements

Develop parent ed curriculum

Reduced stress

Parents gain confidence in their abilities

Strong families

Parent Education Example: Evaluation Questions, Indicators Handout 9

Logic Model Resources

Document DeveloperBibliography: Logic Models in Program Evaluationhttp://www.cdc.gov/eval/logic%20model%20bibliography.PDF

CDC Evaluation Working Group

Everything You Wanted to Know About Logic Models But Were Afraid to Askhttp://www.insites.org/documents/logmod.pdf

Connie C. Schmitz and Beverly A. Parsons

Learning from Logic Models: An example of a Family-School Partnership Programhttp://www.gse.harvard.edu/hfrp/projects/afterschool/resources/learning_logic_models.html

Harvard Family Research Project

Making Logic Models More Systemic: An Activityhttp://www.insites.org/documents/lmact.pdf

Beverly A. Parsons

Source: CDC Evaluation Working Group

Handout 10

More Resources

Document Developer

Logic Model Development Guide http://www.wkkf.org/pubs/tools/evaluation/pub3669.pdf

W.K. Kellogg Foundation

Some Practical Tools for Planning and Evaluation http://www.innonet.org/index.php?section_id=64&content_id=185InnoNet

Innonet

Successfully Enhancing Program Performance Through Logic Models http://www.uwex.edu/ces/lmcourse/

Logic Model Toolshttp://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html

Univ. of Wisconsin Cooperative Extension

Source: CDC Evaluation Working Group

Handout 11