why evaluate? benefits of program evaluation. yd as eval: webinar agenda why evaluate? so what is...
DESCRIPTION
What happened at the fairTRANSCRIPT
![Page 1: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/1.jpg)
Why evaluate?Benefits of program evaluation
![Page 2: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/2.jpg)
YD as EVAL: Webinar Agenda
• Why evaluate?• So what is evaluation?• How does evaluation fit youth development?• How can evaluation benefit a YD program?
• What resources are available to learn about evaluation?
![Page 3: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/3.jpg)
What happened at the fair
![Page 4: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/4.jpg)
What difference did the volunteer make?
![Page 5: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/5.jpg)
Benefits of Informal Evaluation
• Building relationships• Gathering facts• Offering support, recognition• Troubleshooting problems• Offering guidance
![Page 6: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/6.jpg)
Evaluation by the ‘net
![Page 7: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/7.jpg)
What difference did it make?
![Page 8: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/8.jpg)
Where was evaluation happening?
![Page 9: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/9.jpg)
Where was evaluation happening?
![Page 10: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/10.jpg)
Where was evaluation happening?
![Page 12: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/12.jpg)
Where –else-- was evaluation happening?
![Page 13: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/13.jpg)
Benefits of Formal EvaluationCompleting Organizational Evaluation
• Targeted outcomes and tools• Efficient reporting process• Data for funding proposals• Feedback for improving programs
![Page 14: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/14.jpg)
Who needs to know?
StakeholdersIndividuals and
groups with interest in a program
![Page 15: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/15.jpg)
Rethinking EvaluationRevitalizing Programs
Ask the right questions…
…in a user-friendly way…
…and put the answers to good use…
![Page 16: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/16.jpg)
So what is Evaluation?
EvaluationCritical examination of a program’s resources, activities, and outcomes to judge effectiveness, improve quality and results, and inform decisions. (Patton, 1997)
![Page 17: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/17.jpg)
Evaluation Activities
• Assessment: Investigating needs and assets
• Monitoring: Tracking processes and progress
• Evaluation: Documenting quality and outcomes
![Page 18: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/18.jpg)
Merit: Program Quality and Potential
Merit:Quality, Best Practices, potential to promote outcomes
•Overall: Traits that promote positive development(safety, support, skill-building, self-efficacy…
•Particular: Afterschool, Camps, Science, Horsemanship
Formative Evaluation: Is the program working as planned?Summative Evaluation: What program components contribute to positive outcomes
![Page 19: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/19.jpg)
Worth: Program Outcome and Impact
WorthValue of a program, grounded in outcomes that accrue to targeted units (individuals, groups, organizations)
•Short-term: Knowledge, Attitudes, Skills, Aspirations•Mid-term: Practices, Knowledge Application, Behaviors•Long-term: Sustained impact of the program on Social, Economic, and Environmental conditions
![Page 20: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/20.jpg)
Significance: Importance and priority
Significance:Importance of change to program partners
•Overall: Importance to a broad range of stakeholders•Particular: Importance to a particular individual or unit
![Page 21: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/21.jpg)
Evaluation Cycle
Preparation•Planning--Setting goals, matching strategies•Focusing--Refining plans, identifying sources•Designing--Developing strategies for collecting data•Selecting Methods--Identifying tools to measure for goals
![Page 22: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/22.jpg)
Evaluation Cycle
Implementation•Collecting Data—gathering info from diverse sources•Analyzing Data—reviewing and interpreting data
![Page 23: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/23.jpg)
Evaluation Cycle
Utilization•Communicating and Using Results—Sharing data about quality and impact; applying findings to improvement
![Page 24: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/24.jpg)
Positive Youth Development and Evaluation(Formal and Informal)
• Life skill and life-blood of program management– Goal Setting/Project Management– Communication– Problem Solving
![Page 25: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/25.jpg)
Positive Youth Development and Evaluation
(Formal and Informal)
• Life skill and life-blood of program management– Goal Setting/Project Management– Communication– Problem Solving
• Key strategy in positive youth development– Experiential Learning = Action & Reflection
![Page 26: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/26.jpg)
Youth Development as Evaluationbased on Hamilton, Hamilton, & Pittman, 2004
• Processes: Child Development knowledge base
• Principles: Program Theory and Philosophy
• Practices: Strategies for Programming…and Evaluation
• Products: Results of PYD Programming
![Page 27: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/27.jpg)
Youth Development as Evaluationbased on Hamilton, Hamilton, & Pittman, 2004
Processes: Child Development knowledge base
DomainsPhysicalCognitive
Social-Emo StagesEarly Child
Middle ChildAdolescence
DynamicsMaturationInteractionAdaptation
![Page 28: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/28.jpg)
Youth Development as Evaluationbased on Hamilton, Hamilton, & Pittman, 2004
Principles: Program theory and philosophy
Integrated across EcosystemsTheories of Change
Theories of Action
Developmentally Appropriate
Universal and Inclusive
Intentional and Iterative
Holistic and Communal
Ongoing in Engagement
Strengths-based, Risk-aware
![Page 29: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/29.jpg)
Youth Development as Evaluationbased on Hamilton, Hamilton, & Pittman, 2004
Practices: Strategies for program implementation
ExperientialLearning
•Project-based•Inquiry-based•Problem-based•Adventure-based•Participatory•Service-learning
Youth-led/Y-A partnership
SafetySupport
Skill-OpportunitiesSelf-efficacy-
buildingQuality
PracticesSocial Norms
Social InclusionStructureSynergy
choiceslevels
teamwork
active listening
buddy system
![Page 30: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/30.jpg)
YD as EVAL: Authentic Assessmentbased on Hamilton, Hamilton, & Pittman, 2004
Practices: Strategies for program implementation…and evaluation
SafetySupport
Skill-OpportunitiesSelf-efficacy-
buildingQuality
PracticesSocial Norms
Social InclusionStructureSynergy
choiceslevels
teamwork
active listening
buddy system
Skills cardExpert obs/intx
RubricTrained obs/intx
Skills cardExpert obs/intx
Skills cardCheck-in/Obs
Photo evidence
Physical evidence Demo/Confirmation
![Page 31: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/31.jpg)
Youth Development as Evaluationbased on Hamilton, Hamilton, & Pittman, 2004
Products: Outcomes of programs
Character
ConfidenceCompetence
Caring
Contribution
Connection
![Page 32: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/32.jpg)
Youth Development as Evaluationbased on Hamilton, Hamilton, & Pittman, 2004
Processes: Child Development knowledge base
DomainsPhysicalCognitive
Social-Emo StagesEarly Child
Middle ChildAdolescence
DynamicsMaturationInteractionAdaptation
![Page 33: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/33.jpg)
Youth Development as Evaluationbased on Hamilton, Hamilton, & Pittman, 2004
Principles: Program theory and philosophy
Integrated across EcosystemsTheories of Change
Theories of Action
Developmentally Appropriate
Universal and Inclusive
Intentional and Iterative
Holistic and Communal
Ongoing in Engagement
Strengths-based, Risk-aware
![Page 34: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/34.jpg)
YD as EVAL: Minimum Effort
Outdoor Skills
Program Quality
Cabin Group Life Skills
FocusIntegrate
Document
FrequencyIntensityDuration
![Page 35: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/35.jpg)
YD as EVAL: Maximum Effort
Cabin Group Life Skills
Outdoor Skills
Registration
Program QualityParentSurvey
AgentFocus Groups
![Page 36: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/36.jpg)
Benefits of Evaluation
• Systematic planning, implementation• Monitoring risks, opportunities• Accountability and reporting• Improving and expanding quality• Sustaining, growing funding• Support and recognition of partners• Recruiting, training new partners• Sharing with peers• Building broader support, insight
![Page 37: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/37.jpg)
Barriers to Evaluation
“We’re too busy…
“Evaluation can only hurt us…
“We just don’t have the goods….
“We don’t know what to evaluate…
![Page 38: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/38.jpg)
Resources for Evaluation
https://youthdevelopment.ces.ncsu.edu/
E-Basic BasicsFactsheets
![Page 39: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/39.jpg)
A difference that counts
How evaluation makes a fairer fair…•Safety…Support…Skill-building•Typical/Exceptional care for animals•Problem solving about projects, careers•Individual resilience and group teamwork
Connectedness Competence Confidence
![Page 40: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/40.jpg)
So…Why evaluate?
• Satisfy our own curiosity…
• Track quality and impact…
• Use results to improve, show impact, inform partners, and invite new participants
• Make the most of our method: action and reflection, learning by doing
![Page 41: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/41.jpg)
Youth Development as Evaluation: Application
SafetySupport
Skill-OppsSelf-efficacy-building
Social NormsSocial Inclusion
StructureSynergy
Cabin Group Life Skills
Outdoor Skills
Program Quality
Registration
Program Quality
ParentSurvey
![Page 42: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/42.jpg)
“What I do doesn’t make that much difference…”
A Fair Appraisal
•How did the volunteer promote youth development best practices (safety, support, skill-building, etc.)?
•How would these qualities over time promote connectedness, competence, confidence, character, caring, and contribution?
![Page 43: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/43.jpg)
Behold the Benefits
Professional LevelFormal Evaluation Functions
•Reporting achievements to sponsors and decision-makers
•Sustaining, improving upon, or enhancing program activities
![Page 44: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/44.jpg)
…and evaluation is experiential learning!
![Page 45: Why evaluate? Benefits of program evaluation. YD as EVAL: Webinar Agenda Why evaluate? So what is evaluation? How does evaluation fit youth development?](https://reader035.vdocuments.mx/reader035/viewer/2022070606/5a4d1b697f8b9ab0599b2773/html5/thumbnails/45.jpg)
Eval benefits at the Professional Level(Formal evaluation)
•Accountability to program stakeholders
•Improvement efforts with staff and volunteers