learning to love logic models kathryn l. braun, drph [email protected]
TRANSCRIPT
Learning to Love Learning to Love Logic ModelsLogic Models
Kathryn L. Braun, DrPHKathryn L. Braun, DrPH
[email protected]@hawaii.edu
What is Logic Model?What is Logic Model?
A “boxy” graphicA “boxy” graphic It summarizes…It summarizes…
A whole picture of the programA whole picture of the program What it providesWhat it provides What it aims to accomplishWhat it aims to accomplish
Logic Model Logic Model Senior Walking ProgramSenior Walking Program
OutputsOutputsActivitiesActivities ImpactImpactInputsInputs OutcomesOutcomesNumber of Number of sites that sites that participate participate (10)(10)
Number of Number of seniors that seniors that enroll (120)enroll (120)
Number that Number that complete the complete the program (100)program (100)
Number that Number that join in, even join in, even though they though they didn’t enroll didn’t enroll (20)(20)
Number that Number that meet goals (70)meet goals (70)
Number that Number that exceed goals exceed goals (20)(20)
Hire staffHire staff
Get incentives and Get incentives and pedometerspedometers
Train site leaders Train site leaders (10)(10)
Recruit seniors Recruit seniors (120)(120)
Get baseline data.Get baseline data.
Help seniors set Help seniors set goals for walking goals for walking and fruit/veg and fruit/veg consumption, and consumption, and train them to use train them to use pedometer and pedometer and logbooks.logbooks.
Lead 10-week Lead 10-week program of program of walking and nutri walking and nutri ed ed
Collect followup Collect followup datadata
To improve To improve the health of the health of older adults older adults (60+) in (60+) in Honolulu by Honolulu by increasing increasing their level of their level of physical physical activity and activity and consumption consumption of fruits and of fruits and vegetablesvegetables
AARP AARP (pedometers, (pedometers, incentives)incentives)
Lanakila Lanakila nutrition nutrition support staff, support staff, meal site meal site leaders, and leaders, and the new staff the new staff personperson
Experience of Experience of the successful the successful pilot site, pilot site, Pohulani, and Pohulani, and Joyce, the Joyce, the managermanager
Inkind support Inkind support from Honolulu from Honolulu County and County and Hawaii State Hawaii State offices on offices on agingaging
HMSA HMSA Foundation Foundation fundsfunds
Increase from baseline Increase from baseline in number of steps in number of steps walked per week and walked per week and number of F/V number of F/V consumed (70)consumed (70)
Increase from baseline Increase from baseline in feelings of energy, in feelings of energy, endurance, strength, endurance, strength, and sound sleep (70)and sound sleep (70)
Improvements from Improvements from baseline in attitude baseline in attitude toward exercise (50)toward exercise (50)
Number of seniors that Number of seniors that commit to continue commit to continue walking after the walking after the program is over (30)program is over (30)
Components of a Logic Components of a Logic ModelModel
The components of Logic Model The components of Logic Model (column titles)(column titles)
InputsInputs ActivitiesActivities OutputsOutputs OutcomesOutcomes ImpactImpact
Components of Logic ModelComponents of Logic Modelcompared to grant proposalcompared to grant proposal
Logic ModelLogic Model
InputsInputs
ActivitiesActivities
OutputsOutputs
OutcomesOutcomes
ImpactImpact
Grant ProposalGrant Proposal
GoalGoal
ObjectivesObjectives
Process objectivesProcess objectives
Outcome Outcome
objectivesobjectives
ActivitiesActivities
ResourcesResources
Logic ModelLogic ModelOutputsOutputsActivitiesActivities ImpactImpactInputsInputs OutcomesOutcomes
PROCESS PROCESS OBJECTIVEOBJECTIVE
SS
ACTIVITIES, ACTIVITIES, PROCESSES, PROCESSES,
TASKSTASKS
GOAL(S)GOAL(S)RESOURCERESOURCESS
OUTCOME OUTCOME OBJECTIVESOBJECTIVES
Inputs – Inputs – aka Resourcesaka Resources
Resources, such asResources, such as Funding Funding FacilitiesFacilities StaffStaff VolunteersVolunteers
Inputs - ResourcesInputs - ResourcesOutputOutputActivitiesActivities ImpactImpactOutcomeOutcome
The needs for needs The needs for needs assessment/listening assessment/listening session’s training are session’s training are identifiedidentified
Number of partners, Number of partners, trainees, sessions, trainees, sessions, materials, and participantsmaterials, and participants
Number of conducted Number of conducted needs needs assessment/listening assessment/listening sessions, hours of sessions, hours of sessions, and hours of sessions, and hours of conducting need conducting need assessment /listening assessment /listening sessionssessions
Listed the activities that Listed the activities that older adults can share, older adults can share, and want to learnand want to learn
Number of activities that Number of activities that older adults can share, older adults can share, and want to learnand want to learn
Identified role model for Identified role model for needs needs assessment/listening assessment/listening sessionssessions
Number of partners Number of partners complete program designcomplete program design
Number of partners Number of partners implement program action implement program action planplan
Number of partners Number of partners complete evaluation plancomplete evaluation plan
Number of program still Number of program still existing by 2007existing by 2007
Conduct statewide training Conduct statewide training onon
conducting needsconducting needs
assessment /listeningassessment /listening
sessionssessionsDetermine training needsDetermine training needsIdentify partners/traineesIdentify partners/traineesPlan training sessionPlan training sessionDevelop training materialsDevelop training materialsConduct and evaluate Conduct and evaluate trainingtraining
Conduct needs Conduct needs assessment /listening assessment /listening sessionssessionsLearn what activities olderLearn what activities older
adults can share (teach adults can share (teach themselves)themselves)Learn what older adults want Learn what older adults want toto
learnlearnIdentify role models for Identify role models for futurefuture
project implementationsproject implementations
Set up, implement, and Set up, implement, and evaluate programevaluate programDesign program Design program incorporating perspectivesincorporating perspectives Implement programImplement programEvaluateEvaluateSustainSustain
..75% of partners will gain knowledge75% of partners will gain knowledge
about needs assessment approaches.about needs assessment approaches.
By December 2004By December 2004
75% of partners will be able to apply75% of partners will be able to apply
knowledge gained by conductingknowledge gained by conducting
needs assessment/listening sessionsneeds assessment/listening sessions
with various groups.with various groups.
By March 2005By March 2005
75% of partners will be able to75% of partners will be able to
incorporate appropriate practices inincorporate appropriate practices in
the healthy aging project.the healthy aging project.
By May 2005By May 2005
75% of partners complete program75% of partners complete program
designdesign
75% of partners implement program75% of partners implement program
action planaction plan
50% of partners complete evaluation50% of partners complete evaluation
planplan
By May, June, August 2005By May, June, August 2005
25% of partners continue to conduct25% of partners continue to conduct
the programthe program
By May 2007By May 2007
Senior CentersSenior Centers
FundsFunds
Staff (new and Staff (new and existing)existing)
EquipmentEquipment
InputsTo improve To improve the health the health of older of older adults (60+) adults (60+) in Honolulu in Honolulu by by increasing increasing their level their level of physical of physical activity and activity and consumptioconsumption of fruits n of fruits and and vegetablesvegetables
Activities Activities aka Processes aka Processes or Tasksor Tasks
Events or actions of the program, Events or actions of the program, such assuch as Recruiting seniors Recruiting seniors Running the programRunning the program Collecting dataCollecting data
Activities - ProcessesActivities - ProcessesOutputOutput ImpactImpactOutcomeOutcome
The needs for needs The needs for needs assessment/listening assessment/listening session’s training are session’s training are identifiedidentified
Number of partners, Number of partners, trainees, sessions, trainees, sessions, materials, and participantsmaterials, and participants
Number of conducted Number of conducted needs needs assessment/listening assessment/listening sessions, hours of sessions, hours of sessions, and hours of sessions, and hours of conducting need conducting need assessment /listening assessment /listening sessionssessions
Listed the activities that Listed the activities that older adults can share, older adults can share, and want to learnand want to learn
Number of activities that Number of activities that older adults can share, older adults can share, and want to learnand want to learn
Identified role model for Identified role model for needs needs assessment/listening assessment/listening sessionssessions
Number of partners Number of partners complete program designcomplete program design
Number of partners Number of partners implement program action implement program action planplan
Number of partners Number of partners complete evaluation plancomplete evaluation plan
Number of program still Number of program still existing by 2007existing by 2007
To improve To improve the health of the health of older adults older adults (60+) in (60+) in Honolulu by Honolulu by increasing increasing their level of their level of physical physical activity and activity and consumption consumption of fruits and of fruits and vegetablesvegetables
75% of partners will gain knowledge75% of partners will gain knowledge
about needs assessment approaches.about needs assessment approaches.
By December 2004By December 2004
75% of partners will be able to apply75% of partners will be able to apply
knowledge gained by conductingknowledge gained by conducting
needs assessment/listening sessionsneeds assessment/listening sessions
with various groups.with various groups.
By March 2005By March 2005
75% of partners will be able to75% of partners will be able to
incorporate appropriate practices inincorporate appropriate practices in
the healthy aging project.the healthy aging project.
By May 2005By May 2005
75% of partners complete program75% of partners complete program
designdesign
75% of partners implement program75% of partners implement program
action planaction plan
50% of partners complete evaluation50% of partners complete evaluation
planplan
By May, June, August 2005By May, June, August 2005
25% of partners continue to conduct25% of partners continue to conduct
the programthe program
By May 2007By May 2007
InputInput
Partnership; Partnership;
Hawaii Hawaii Department ofDepartment of
Health Health (Community(Community
Health Division, Health Division, ExecutiveExecutive
Office on Aging, Office on Aging, HawaiiHawaii
District Health District Health Office, etc.)Office, etc.)
County County agenciesagencies
Other public Other public and private and private agenciesagencies
Funding; Funding;
State State
($ 10,000 per ($ 10,000 per year)year)
ActivitiesActivitiesRecruit seniors (120)Recruit seniors (120)Lead 10-week Lead 10-week walking programwalking programCollect dataCollect data
Outputs Outputs aka Process aka Process ObjectivesObjectives
Direct products of the program, such Direct products of the program, such asas Number of seniors recruitedNumber of seniors recruited Number of seniors retainedNumber of seniors retained
OutputsOutputsImpactImpactOutcomeOutcome
To improve To improve the health of the health of older adults older adults (60+) in (60+) in Honolulu by Honolulu by increasing increasing their level of their level of physical physical activity and activity and consumption consumption of fruits and of fruits and vegetablesvegetables
75% of partners will gain knowledge75% of partners will gain knowledge
about needs assessment approaches.about needs assessment approaches.
By December 2004By December 2004
75% of partners will be able to apply75% of partners will be able to apply
knowledge gained by conductingknowledge gained by conducting
needs assessment/listening sessionsneeds assessment/listening sessions
with various groups.with various groups.
By March 2005By March 2005
75% of partners will be able to75% of partners will be able to
incorporate appropriate practices inincorporate appropriate practices in
the healthy aging project.the healthy aging project.
By May 2005By May 2005
75% of partners complete program75% of partners complete program
designdesign
75% of partners implement program75% of partners implement program
action planaction plan
50% of partners complete evaluation50% of partners complete evaluation
planplan
By May, June, August 2005By May, June, August 2005
25% of partners continue to conduct25% of partners continue to conduct
the programthe program
By May 2007By May 2007
ActivitiesActivities
Conduct statewide training Conduct statewide training onon
conducting needsconducting needs
assessment /listeningassessment /listening
sessionssessionsDetermine training needsDetermine training needsIdentify partners/traineesIdentify partners/traineesPlan training sessionPlan training sessionDevelop training materialsDevelop training materialsConduct and evaluate trainingConduct and evaluate training
Conduct needs assessment Conduct needs assessment /listening sessions/listening sessionsLearn what activities olderLearn what activities older
adults can share (teach adults can share (teach themselves)themselves)Learn what older adults want Learn what older adults want toto
learnlearnIdentify role models for futureIdentify role models for future
project implementationsproject implementations
Set up, implement, and Set up, implement, and evaluate programevaluate programDesign program incorporating Design program incorporating perspectivesperspectives Implement programImplement programEvaluateEvaluateSustainSustain
InputsInputs
AARPAARP
Lanakila Lanakila NutritionNutrition
ProgramProgram
Pohulani Site andPohulani Site and
JoyceJoyce
Honolulu County Honolulu County andand
Hawaii State Hawaii State offices onoffices on
agingaging
HMSA HMSA FoundationFoundation
fundsfunds
OutputsOutputs•Number of seniors that enroll (120)
•Number that complete the program (100 out of 120)
OutputsOutputsActivitiesActivities OutputsOutputs
Recruit seniors (120) Number of seniors that enroll (120)
Number that complete program (100 out of 120)
Outcomes Outcomes aka Outcome aka Outcome ObjectivesObjectives
Desired effects of the program, such Desired effects of the program, such asas Increase in physical activityIncrease in physical activity Increase in benefits of physical activityIncrease in benefits of physical activity
ActivitiesActivities
OutcomesOutcomes
ResourcesResources
AARPAARP
Lanakila Lanakila NutritionNutrition
ProgramProgram
Pohulani Site andPohulani Site and
JoyceJoyce
Honolulu County Honolulu County andand
Hawaii State Hawaii State offices onoffices on
agingaging
HMSA HMSA FoundationFoundation
fundsfunds
Conduct statewide training Conduct statewide training onon
conducting needsconducting needs
assessment /listeningassessment /listening
sessionssessionsDetermine training needsDetermine training needsIdentify partners/traineesIdentify partners/traineesPlan training sessionPlan training sessionDevelop training materialsDevelop training materialsConduct and evaluate Conduct and evaluate trainingtraining
Conduct needs Conduct needs assessment /listening assessment /listening sessionssessionsLearn what activities olderLearn what activities older
adults can share (teach adults can share (teach themselves)themselves)Learn what older adults want Learn what older adults want toto
learnlearnIdentify role models for Identify role models for futurefuture
project implementationsproject implementations
Set up, implement, and Set up, implement, and evaluate programevaluate programDesign program Design program incorporating perspectivesincorporating perspectives Implement programImplement programEvaluateEvaluateSustainSustain
ImpactImpact
ShareShare
AppropriateAppropriate
healthy aginghealthy aging
practices withpractices with
older adults.older adults.
In the future:In the future:
Improve healthImprove health
status of olderstatus of older
adults by adults by startingstarting
or continuing or continuing toto
exercise andexercise and
eating fruits eating fruits andand
vegetables.vegetables.
OutputOutput
The needs for needs The needs for needs assessment/listening assessment/listening session’s training are session’s training are identifiedidentified
Number of partners, Number of partners, trainees, sessions, trainees, sessions, materials, and participantsmaterials, and participants
Number of conducted Number of conducted needs needs assessment/listening assessment/listening sessions, hours of sessions, hours of sessions, and hours of sessions, and hours of conducting need conducting need assessment /listening assessment /listening sessionssessions
Listed the activities that Listed the activities that older adults can share, older adults can share, and want to learnand want to learn
Number of activities that Number of activities that older adults can share, older adults can share, and want to learnand want to learn
Identified role model for Identified role model for needs needs assessment/listening assessment/listening sessionssessions
Number of partners Number of partners complete program designcomplete program design
Number of partners Number of partners implement program action implement program action planplan
Number of partners Number of partners complete evaluation plancomplete evaluation plan
Number of program still Number of program still existing by 2007existing by 2007
OutcomesOutcomes
•Increase from baseline in number of steps walked per week (70 out of 100)
•Increase from baseline in feelings of energy, endurance, strength, and sound sleep (70 out of 100)
OutcomesOutcomesOutcomesOutcomesActivitiesActivities
Lead program for 10 weeks.
Collect data.
Increase from baseline in number of steps walked per week.
Impact Impact aka Goal(s)aka Goal(s)
Mission or purpose of the programMission or purpose of the program Such asSuch as
Improved conditions, Improved conditions, Increased capacity, andIncreased capacity, and Reduce mortality.Reduce mortality.
ImpactImpactOutputOutputActivitiesActivities OutcomeOutcome
The needs for needs The needs for needs assessment/listening assessment/listening session’s training are session’s training are identifiedidentified
Number of partners, Number of partners, trainees, sessions, trainees, sessions, materials, and materials, and participantsparticipants
Number of conducted Number of conducted needs needs assessment/listening assessment/listening sessions, hours of sessions, hours of sessions, and hours of sessions, and hours of conducting need conducting need assessment /listening assessment /listening sessionssessions
Listed the activities that Listed the activities that older adults can share, older adults can share, and want to learnand want to learn
Number of activities that Number of activities that older adults can share, older adults can share, and want to learnand want to learn
Identified role model for Identified role model for needs needs assessment/listening assessment/listening sessionssessions
Number of partners Number of partners complete program complete program designdesign
Number of partners Number of partners implement program implement program action planaction plan
Number of partners Number of partners complete evaluation complete evaluation planplan
Number of program still Number of program still existing by 2007existing by 2007
Conduct statewide Conduct statewide training ontraining on
conducting needsconducting needs
assessment /listeningassessment /listening
sessionssessionsDetermine training needsDetermine training needsIdentify partners/traineesIdentify partners/traineesPlan training sessionPlan training sessionDevelop training materialsDevelop training materialsConduct and evaluate Conduct and evaluate trainingtraining
Conduct needs assessment Conduct needs assessment /listening sessions/listening sessionsLearn what activities olderLearn what activities older
adults can share (teach adults can share (teach themselves)themselves)Learn what older adults Learn what older adults want towant to
learnlearnIdentify role models for Identify role models for futurefuture
project implementationsproject implementations
Set up, implement, and Set up, implement, and evaluate programevaluate programDesign program Design program incorporating perspectivesincorporating perspectives Implement programImplement programEvaluateEvaluateSustainSustain
75% of partners will gain knowledge75% of partners will gain knowledge
about needs assessment approaches.about needs assessment approaches.
By December 2004By December 2004
75% of partners will be able to apply75% of partners will be able to apply
knowledge gained by conductingknowledge gained by conducting
needs assessment/listening sessionsneeds assessment/listening sessions
with various groups.with various groups.
By March 2005By March 2005
75% of partners will be able to75% of partners will be able to
incorporate appropriate practices inincorporate appropriate practices in
the healthy aging project.the healthy aging project.
By May 2005By May 2005
75% of partners complete program75% of partners complete program
designdesign
75% of partners implement program75% of partners implement program
action planaction plan
50% of partners complete evaluation50% of partners complete evaluation
planplan
By May, June, August 2005By May, June, August 2005
25% of partners continue to conduct25% of partners continue to conduct
the programthe program
By May 2007By May 2007
InputsInputs
AARPAARP
Lanakila Lanakila NutritionNutrition
ProgramProgram
Pohulani Site Pohulani Site andand
JoyceJoyce
Honolulu County Honolulu County andand
Hawaii State Hawaii State offices onoffices on
agingaging
HMSA HMSA FoundationFoundation
fundsfunds
ImpactImpactTo improve the health of older adults (60+) in Honolulu by increasing their level of physical activity.
What’s New? – What’s New? – Federal funding agencies nowFederal funding agencies now
Requiring applicants to provide Requiring applicants to provide Logic Model with their proposalLogic Model with their proposal
Requiring awardees in multi-site Requiring awardees in multi-site programs to adhere to the same programs to adhere to the same Logic Model Logic Model
Examples on HandoutsExamples on Handouts
Hawaii Youth Services NetworkHawaii Youth Services Network Funded by CDC initiative: Funded by CDC initiative: COALITION COALITION
CAPACITY BUILDING TO REDUCE CAPACITY BUILDING TO REDUCE TEEN PREGNANCYTEEN PREGNANCY
Imi Hale Native Hawaiian Cancer Imi Hale Native Hawaiian Cancer NetworkNetwork Funded through National Cancer Institute Funded through National Cancer Institute
initiative: initiative: COMMUNITY NETWORK COMMUNITY NETWORK PARTNERSPARTNERS
CDC NATIONAL ORGS
STATE ORGS & REGIONAL TRAINING CENTERS
NATIONAL & STATE ORGS & REGIONAL TRAINING CENTERS
.
State orgs will have increased capacity to
help others
Local orgs with intensive training demonstrate:
•Increased knowledge & skill
•Greater motivation
•Strengthened org structures & processes
ActivitiesShort-TermOutcomes
IntermediateOutcomes
Orgs offering science-based programs
Youth exposed to science-based programs
Long-TermOutcomes
Teen Preg rates
STD & HIV rates
Not evalu-ated!
CDC’s Capacity Building Initiative
Antecedent Goals and Objectives
Inputs Activities OutcomesOutputs
Contextual Variables
• Colors help you track across the page, so you see which outputs and outcomes should result from each goal
• This is just Phase II. There are other Logic Models for Phases I and III.
NCI’s Community Network Partners
DiscussionDiscussion
Lots of variation in logic modelsLots of variation in logic models Time consuming to prepareTime consuming to prepare BUTBUT
Can standardize activities and outcomesCan standardize activities and outcomes Great guide for evaluation (just develop Great guide for evaluation (just develop
data collection around the outputs and data collection around the outputs and outcomes)outcomes)
ConclusionsConclusions If the feds like logic models, you should too.If the feds like logic models, you should too. Learn them Learn them
Online tutorialsOnline tutorials Kellogg Foundation book Kellogg Foundation book
http://www.wkkf.org/Pubs/Tools/Evaluation/Pub366http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf9.pdf
Half-day workshopsHalf-day workshops PH 765 – Spring 2007 - Outreach CollegePH 765 – Spring 2007 - Outreach College
Kathryn L. Braun, DrPHKathryn L. Braun, DrPH
kbraunkbraun@@hawaiihawaii..eduedu