so you need to do an evaluation! bob hamblen, colorado state university
Post on 19-Dec-2015
215 views
TRANSCRIPT
So you need to do an So you need to do an evaluation!evaluation!
Bob Hamblen, Colorado State UniversityBob Hamblen, Colorado State University
What outcomes do you want What outcomes do you want to measure?to measure?
How many people attendedHow many people attendedHow you improved your How you improved your
programprogramWhat people learnedWhat people learnedWhat practices were adoptedWhat practices were adoptedAny changes or impacts that Any changes or impacts that
occurred as a result of the occurred as a result of the programprogram
Who are you targeting Who are you targeting with your program?with your program?
Examples:Examples: Small-acreage ownersSmall-acreage owners RealtorsRealtors Decision makersDecision makers VolunteersVolunteers AgenciesAgencies
Things you need to do to Things you need to do to get desired outcomesget desired outcomes
Examples:Examples:WorkshopsWorkshopsClassesClassesOne-on-one trainingsOne-on-one trainingsNewslettersNewslettersQuestionnairesQuestionnairesTestingTesting
What resources do you need What resources do you need to make your program to make your program
happen?happen?
Examples:Examples:Staff timeStaff timeAudiovisual equipmentAudiovisual equipmentMeeting locationMeeting locationInstructional materialInstructional materialInstructorsInstructorsPartnershipsPartnershipsPossibly volunteersPossibly volunteers
Evaluation process reviewEvaluation process review
Start with what you want the Start with what you want the learner to do or learnlearner to do or learn
Steamboat Creek pre/post Steamboat Creek pre/post test datatest data
% Correct% Correct
Before Before (1996)(1996)
% Correct% Correct
After (1998)After (1998)
Program Program participantsparticipants 65%65% 76%76%
Non-Non-participantsparticipants 50%50% 49%49%
Washoe Valley pre/post Washoe Valley pre/post test datatest data
% Correct % Correct Before Before (1998)(1998)
% Correct % Correct After (2000)After (2000)
Random Random sample of sample of target target audienceaudience
63.8%63.8% 72.3%72.3%
Satisfaction with programSatisfaction with program
Steamboat Creek, 1998
Knowledge gainKnowledge gain
Steamboat Creek, 1998
Steamboat Creek, 1998
Behavior changeBehavior change
Septic system Septic system maintenancemaintenance
64% of respondents to a 64% of respondents to a survey (n=53) had pumped survey (n=53) had pumped their septic tanks within the their septic tanks within the past three yearspast three years
Water quality dataWater quality data
Before Before projectproject
After After diverting diverting
waterwater
Total Total phosphorusphosphorus 2.1 g/day2.1 g/day 0.5 g/day0.5 g/day
Suspended Suspended sedimentsediment 238.7 g/day238.7 g/day 11 g/day11 g/day
Example: A weed program Example: A weed program for for ssmallmall-a-acreage ownerscreage owners
You need resources such as:You need resources such as:InstructorsInstructorsAudiovisual equipmentAudiovisual equipmentWeed mountsWeed mountsHandoutsHandoutsMeeting facilityMeeting facilityAdvertising to get participantsAdvertising to get participantsPossibly volunteersPossibly volunteers
Action items:Action items:
Conduct the educational program Conduct the educational program (class, workshop, field (class, workshop, field demonstration, etc.)demonstration, etc.)
Teach weed curriculumTeach weed curriculumSupply weed identification books, Supply weed identification books,
mounts, etc.mounts, etc.Provide noxious weed samples for Provide noxious weed samples for
participants to identifyparticipants to identifyInvite participants to bring in their Invite participants to bring in their
own weed samplesown weed samplesPractice identification skillsPractice identification skills
• Short-term outcome: Be able Short-term outcome: Be able to correctly identify 8 of 10 to correctly identify 8 of 10 noxious weed samplesnoxious weed samples
• Medium-term outcome: Medium-term outcome: Change grazing practices to Change grazing practices to reduce weedsreduce weeds
• Long-term outcome: Reduce Long-term outcome: Reduce noxious weed population in the noxious weed population in the homeowner association by 90%homeowner association by 90%
Select the right evaluation Select the right evaluation tools to measure the desired tools to measure the desired outcomeoutcome
ReviewReview
Do the evaluation activityDo the evaluation activity
Evaluation processEvaluation process
Make the evaluation process the Make the evaluation process the first step in your program first step in your program planning!planning!