mesi principles-focused evaluation 2017 [read-only] · 2. youth voice principle support youth to...
TRANSCRIPT
![Page 1: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/1.jpg)
1
Principles-FocusedEvaluation
Michael Quinn PattonAnd
Charmagne E. Campbell-PattonMESI
March 22, 2017
![Page 2: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/2.jpg)
The Niche ofPrinciples-Focused Evaluation
• Unit of analysis (evaluand)
• Approach to programming
• Way to navigate complex dynamicsystems
• Approach to evaluation
• Fundamental to DevelopmentalEvaluation
2
![Page 3: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/3.jpg)
Evaluation
TraditionalEvaluating…
• Grants
• Projects & Programs
• Clusters of grants
• Goal attainment
• Outcomes
• Implementation
Generating...
• Lessons
• Recommendations
Nontraditional &
New Directions:
Evaluating…• Mission fulfillment
• Strategy
• Advocacy campaigns
• Policy change
• Systems Change
• Complex dynamicinterventions
3
![Page 4: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/4.jpg)
Innovations & Challenges:Evaluating…
• Community impacts
• Regional initiatives
• Environmental ecosystem sustainability
• Networks and collaborations
• Leadership
• Inclusiveness and diversity
• Innovation
• Collective impact
• Scaling
• PRINCIPLES 4
![Page 5: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/5.jpg)
Principles-driven programs andinterventions• Vibrant communities
• Project Spirit
• Global Alliance for the Future of Food
• Paris Declaration for Development Aid
• Programs serving homeless youth
• Centre for Global Pluralism
• Peacekeeping and conflict mitigation
5
![Page 6: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/6.jpg)
Effectiveness Principles
6
![Page 7: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/7.jpg)
How are principles useful?
7
![Page 8: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/8.jpg)
What difference do principlesmake?
8
![Page 9: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/9.jpg)
9
![Page 10: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/10.jpg)
10
![Page 11: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/11.jpg)
11
![Page 12: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/12.jpg)
Your ????
12
![Page 13: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/13.jpg)
GUIDEFor Effectiveness Principles
13
![Page 14: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/14.jpg)
SMART Goals
14
![Page 15: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/15.jpg)
GUIDE Framework
15
![Page 16: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/16.jpg)
RECIPES vs PRINCIPLES
REPLICATION RECIPE
Add 1/4 teaspoon ofsalt
ADAPTIVE PRINCIPLESeason to taste &situation
16
![Page 17: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/17.jpg)
Managing email
17
![Page 18: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/18.jpg)
Exercise
Rule:30 minutes ofaerobic exerciseeach day
Principle:Exercise regularlyat a level thatsupports healthand is sustainablegiven yourhealth, life style,age, and capacity.
18
![Page 19: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/19.jpg)
19
![Page 20: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/20.jpg)
20
![Page 21: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/21.jpg)
21
![Page 22: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/22.jpg)
22
![Page 23: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/23.jpg)
U-FE Principle
Focus on Intended Use
by
Intended Users
23
![Page 24: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/24.jpg)
24
![Page 25: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/25.jpg)
25
![Page 26: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/26.jpg)
26
![Page 27: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/27.jpg)
Principles-focusedstrategy and evaluationshould inspire as well as providedirection
27
![Page 28: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/28.jpg)
28
![Page 29: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/29.jpg)
29
![Page 30: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/30.jpg)
Principles
“I am a man of fixed and unbending principles, thefirst of which is to be flexible at all times.”
U.S. Senator Everett Dirksen
30
![Page 31: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/31.jpg)
31
![Page 32: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/32.jpg)
32
DE Purposes
Purpose Challenge Implications
1Ongoingdevelopment
Implemented incomplex & dynamic
environment
No intention of becomingfixed;
identifies effective
principles
2Adaptingeffectiveprinciples to newcontexts
Innovative initiatives:Develop ‘their own’
version
Knowledge interpreted,adapted to context
through DE.
![Page 33: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/33.jpg)
DE Principles
1. Developmental purpose
2. Evaluation rigor
3. Utilization focus
4. Innovation niche
5. Complexity perspective
6. Systems thinking
7. Co-creation
8. Timely feedback
33
![Page 34: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/34.jpg)
34
![Page 35: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/35.jpg)
SYSTEMS THINKING andCOMPLEXITY THEORY
Getting to Maybe
35
Transformativesocialmovements wereproblem-focusedand principles-driven
![Page 36: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/36.jpg)
Evidence-based Practice
Evaluation grew up in the “projects”testing models under a theory ofchange that pilot testing would lead toproven models that could bedisseminated and taken to scale:
The search for best practices
and evidenced-based practices
36
![Page 37: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/37.jpg)
Fundamental Issue:How the World Is Changed
Top-down scaling of
“proven models” with
Fidelity Evaluation
versus
Bottoms-up adaptive management
and
Developmental Evaluation37
![Page 38: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/38.jpg)
Models vs. Principles
Identifying proven principles foradaptive management
(bottoms-up approach)
versus
Identifying and disseminating
proven models
(top down approach)
38
![Page 39: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/39.jpg)
CONTEXTUAL SCALING
• Options by context
• Principles-based adaptation
• DE documents and assesses adaptation
versus
HIGH FIDELITY REPLICATION
39
![Page 40: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/40.jpg)
40
![Page 41: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/41.jpg)
Three kinds ofevidence-based interventions
• Summative evaluation of a single program, grant, ormodel.
• Meta-analysis of results for several programs/grantsusing the same model aiming at the same outcomes.
• Synthesis of effective principles: Diverseinterventions adhering to shared evidence-basedprinciples.
41
![Page 42: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/42.jpg)
"Principles are likeprayers. Noble, ofcourse, but awkwardat a party."
Lady Crawley, the DowagerCountess, Downton Abbey
42
![Page 43: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/43.jpg)
Principles…
• Unit of analysis (evaluand)
• Approach to programming
• Way to navigate complex dynamic systems
• Approach to evaluation
• Fundamental to Developmental Evaluation
43
![Page 44: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/44.jpg)
44
![Page 45: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/45.jpg)
Your ????
45
![Page 46: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/46.jpg)
ChildFund International
Distinguishing Overarching Principles
from
Operational Principles
Operation Shoestring - provides year-roundacademic, social and emotional support to
elementary, middle and high school children inJackson, Mississippi.
46
![Page 47: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/47.jpg)
• In the development of principles “many youthseemed inspired by the idea that they were rightsholders.”
• Youth Civic Engagement Defined
ChildFund defines civic engagement as an organizedaction by a person or group that benefits thecommunity and leads to the realization of youthrights and youth leadership as having and using skillsto organize or influence a group of people to reach acommon goal.
47
![Page 48: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/48.jpg)
Principles Overarching Principle
defined
Operating principles to implement
overarching principles
1. Youth vision
principle
Support youth to dream of
a better reality for
themselves, their
community and the world.
Provide young people with
opportunities to reflect on and explore
their own identity, situation and
community.
Support skills and competence in
meaningful and inspirational vision
statements.
Create an inclusive process that ensures
broad representation of youth from
different backgrounds and a feedback
loop where a core group of youth takes
back their ideas and plans to larger
group of youth.48
![Page 49: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/49.jpg)
2. Youth voice
principle
Support youth to develop
and express their own
perspective and voice.
Create spaces for young people to
associate and develop their voice.
Build community openness to and
valuing of youth perspectives.
Create interactive opportunities for the
community to hear from youth people
Ensure that young people have the
opportunity express their unique needs
and interests and speak as a group
distinct from adults
49
![Page 50: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/50.jpg)
3. Youth
authentic
inclusion
principle
Create opportunities
for active and
meaningful
participation of young
people in the daily life
of the community.
Create a community environment
that includes and values the
involvement and contributions of
youth.
Promote authentic and ongoing
inclusion of youth in any process
or institution that affects their
lives or that of their families.
Support youth to identify and take
action to benefit themselves and
their community.
50
![Page 51: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/51.jpg)
51
4. Community
valuing youth
principle
Promote a view of
youth as assets to the
community who can
make a positive
contribution towards
social change.
Ensure young people have access to
information to enhance their civic
knowledge and inform their
participation.
Create opportunities for youth and
adults to build relationships based
on mutual understanding and
respect.
![Page 52: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/52.jpg)
52
5. Youth development
principle
Provide opportunities for
youth to develop knowledge
and skills for effective civic
participation and leadership
that will benefit them
throughout their lives.
Reduce barriers for youth from different
backgrounds to come together and work
together.
![Page 53: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/53.jpg)
53
![Page 54: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/54.jpg)
54
![Page 55: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/55.jpg)
55
![Page 56: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/56.jpg)
Examples of Principles
Science
Evaluation
56
![Page 57: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/57.jpg)
“Science isn't about authority
or white coats; it's about following
a method. That method is built
on core principles:
• precision and transparency
• being clear about your methods
• being honest about your results, and
• drawing a clear line between the results, on theone hand, and your judgment calls about howthose results support a hypothesis.”
57
![Page 58: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/58.jpg)
58
American Evaluation Association GuidingPrinciples For Evaluators
Resulting Principles. Given the diversity of interestsand employment settings represented on the TaskForce, it is noteworthy that Task Force membersreached substantial agreement about the followingfive principles. The order of these principles doesnot imply priority among them; priority will vary bysituation and evaluator role.
![Page 59: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/59.jpg)
Evaluation Principles
AEA guiding principlesParticipatory evaluation principlesUtilization-Focused Evaluation
principlesCulturally competence evaluation
principlesIndigenous peoples’ research and
evaluation principles
59
![Page 60: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/60.jpg)
Principles
• Provide direction but not detailed prescription• Are grounded in values about what matters• Are based on evidence about how to be
effective• Must be interpreted and applied contextually,• Require judgment in application• Inform choices at forks in the road• Are the rudder for navigating complex dynamic
systems• Point to outcomes and impacts• Can be evaluated for both process
(implementation) -- and results60
![Page 61: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/61.jpg)
Vibrant communities, Canada
In April 2002, fifteen communities and thethree national sponsors met for a three day forum inGuelph, Ontario to create Vibrant Communities. Theyjointly developed an experiment designed to test a“new” way to tackle poverty in a way thatacknowledged the complex nature of poverty andthe challenge of achieving scale in poverty reductionefforts. The new way was not a model, but rather aset of five core principles that local communitiesagreed to follow in mounting locally uniquecampaigns:
61
![Page 62: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/62.jpg)
Each community was represented by someone fromthe private, public and non-profit sector, as well assomeone with experience living in poverty.
62
![Page 63: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/63.jpg)
Principles
1. Poverty Reduction – a focus on reducing poverty asopposed to alleviating the hardships of living in poverty2. Comprehensive Thinking & Action – addressing theinter-related causes of poverty rather than its individualsymptoms3. Multisectoral Collaboration – engaging individuals andorganizations from at least four key sectors – business,government, non-profit and persons who’ve experiencedpoverty – in a joint effort rather than one sector4. Community Asset-Building – building on communitystrengths rather than focusing on its deficits5. Learning & Change – embracing a long term process oflearning and change rather than simply undertaking aseries of specific interventions
63
![Page 64: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/64.jpg)
64
![Page 65: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/65.jpg)
65
MāoriHe OrangaPoutamaInitiative
![Page 66: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/66.jpg)
66
Māori Health Initiative Example
The story of He Oranga Poutama, evaluators KateMcKegg and Nan Wehipeihana
• DE book, pages 274-279
TO Māori
WITH Māori
AS Māori
![Page 67: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/67.jpg)
Overarching Principle
Engage in health and recreationAS Māori
67
![Page 68: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/68.jpg)
Core principles were developedand adapted in various localsettings along with a system ofnational coordination and supportto facilitate local effort.
HOP initiative set out todevelop a practical,grounded understanding ofwhat as Māori looks like indiverse activities.
He Oranga Poutama DevelopmentalEvaluation
68
![Page 69: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/69.jpg)
What wasdeveloped
69
![Page 70: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/70.jpg)
AES Best Evaluation Policy and SystemsAward
2013 Award Winners: Nan Wehipeihana, Kate McKegg and Kataraina Pipi ofResearch Evaluation Consultancy Limited (a member of the Kinnect Group), andVeronica Thompson from Sport New Zealand) for Developmental Evaluation – HeOranga Poutama: what have we learned?
KateVeronica Nan Kataraina 70
![Page 71: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/71.jpg)
Your ????
71
![Page 72: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/72.jpg)
72
Principle:Nurturecommittedconnections
BlandinFoundation
![Page 73: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/73.jpg)
Reflective practice:Senior leadership team
• Strong committed connections cases
• Weak committed connections cases
• Cross-case analysis
• Examined pending program and initiative proposalsthrough the lens of committed connections.
• Board reflective practice
• All-staff reflective practice
• High dosage/high impact partners RP
73
How does being a committed connector inform andaffect the Foundation’s work in local communities?
![Page 74: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/74.jpg)
Lessons: 2013 Report to the Board
Principle: Nurture committed connections.
• “What we learned was that in each of our strongcommitted connections, the relationship with theFoundation was key. Where staff were more deeplyengaged, connections were stronger and impactswere greater.
• Another insight learned was that while contributingfunds was very important, it wasn’t always aboutthe money. In other words, there were a numberof successful committed connections, for whichfunding was minimal, that yielded positive impacts,as well as where financial contributions weresignificant.” 74
![Page 75: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/75.jpg)
Key insights gained that help informour work on committed connections
• Committed connections are core to theFoundation’s work.
• Connections of the Foundation can take manyforms, and the most impactful are those thatare committed – those that last. For example:
75
![Page 76: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/76.jpg)
• Connecting people to each other (individually, small groups)
• Connecting people to networks
• Connecting people to knowledge
• Connecting people to issues
• Connecting issues to issues (breaking down silos betweenissues)
• Connecting people to resources
• Connecting people to opportunities
• Connecting people to action (from talk to action)
• Connecting people to organizations
• Connecting organizations to each other
• Connecting people to communities
• Connecting communities to each other
• Connecting communities to regions
• Disconnecting people from ineffective or dysfunctionalconnections 76
![Page 77: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/77.jpg)
Committed connections insights
4. Bringing people together doesn’t necessarilylead to committed connections.
5. Being an effective connector is a pre-requisite forthe Foundation to be effective at inclusion.
6. Committed connections is BOTH PROCESS andOUTCOMES, and the two are linked
77
![Page 78: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/78.jpg)
7. The internet offers emerging opportunities for virtualconnections:
• This is an important area for future development anddevelopmental evaluation already underway with theBroadband Initiative and Foundation communicationsand information systems infrastructure. Inquiryquestions going forward include: What are theopportunities for committed connections using webplatforms? Youth virtual communities? Social media?Connecting former Itasca residents to home area? BCLPalums? How does Blandin continue to stay on top ofthese new developments and directions?
78
![Page 79: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/79.jpg)
8. In addition to engaging in deep reflection(developmental evaluation) on our external work, wealso conducted reflective practice on how we couldget better at connecting with each other as theSenior Leadership Team in order to share learningand better leverage our work. Our focusing questionwas:
“What is shared learning?”
79
![Page 80: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/80.jpg)
Committed connections insights
• We learned that we only know something when weknow it together. As a result of this we committedto regular check-ins at SLT meetings to cross-fertilize connections being made and knowledgebeing gained.
• We asked ourselves what we needed to knowtogether and decided that we needed to watch fortrends and themes emerging in common from ourseparate spheres, and to better capture impacts asthey occur. One way to do this is develop somesimple processes for “after action reviews.”
• Monitoring these issues together is a core part ofstrengthening the team’s development.
80
![Page 81: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/81.jpg)
81
![Page 82: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/82.jpg)
82
![Page 83: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/83.jpg)
83
![Page 84: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/84.jpg)
84
![Page 85: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/85.jpg)
85
![Page 86: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/86.jpg)
Your ????
86
![Page 87: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/87.jpg)
87
![Page 88: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/88.jpg)
• Threeemergencyshelters
• Two drop-incenters
• One streetoutreachcollaborative
• Two countiesin the TwinCities metro
![Page 89: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/89.jpg)
Principles-focused evaluation
1. Identified principles in draft form
2. Collaboratively identified fourteen youth
3. Interviewed youth, reviewed their case file,interviewed a nominated staff person
4. Synthesized information and wrote case stories
5. Reviewed stories with the youth
6. Analyzed stories, looking for principles andemergent themes
89
![Page 90: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/90.jpg)
True caring by staff is profoundly
important to youth.
Build relationships by interacting with youth inan honest, dependable,authentic, caringand supportive way
90
![Page 91: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/91.jpg)
And you be like, “Okay, I have all this on my plate. Ihave to dig in and look into [the choices I’m making] tomake my life more complete.” And I felt that on myown, I really couldn’t. Not even the strongest person onGod’s green Earth can do it. I couldn’t do it. So I endedup reaching out to [the youth shelter], and theyopened their arms. They were like just, “Come. Just gethere,” and they got me back on track.
-Pearl
91
![Page 92: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/92.jpg)
If I was to sit in a room and think about, like,everything that happened to me or I’ve beenthrough, I’ll get to cryin’ and feelin’ like I don’twanna be on Earth anymore—like I wanted to die.When I talk to somebody about it, it makes mefeel better. The people I talk to about it give megood advice. They tell me how much they like meand how [good] I’m doin’. They just put good stuffin my head, and then I think about it and realize Iam a good person and everything’s gonna workout better.
-Maria
92
![Page 93: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/93.jpg)
• [Rahim’s] not going to send me to the next man, putme onto the next person’s caseload. He just alwaystook care of me.[…]I honestly feel like if I didn’t haveRahim in my corner, I would have been doing a wholebunch of dumb shit. I would have been right back atsquare one. I probably would have spent more time injail than I did. I just felt like if it wasn’t for him, Iprobably wouldn’t be here right now, talking to you.
-Thmaris
93
![Page 94: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/94.jpg)
The opposite of this principle (trusting adult-youthrelationships) is to;
focus on the transaction (ex: help withGED preparation, help with resume writing,
help applying for housing) while minimizingopportunities for relationships to develop.
How this is different
94
![Page 95: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/95.jpg)
Journey Oriented
Interact with youth to help them understand theinterconnectedness of past, present and future asthe decide where they want to go and how to getthere
The oppositeImmediate outcomes focus:housing
95
![Page 96: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/96.jpg)
Trauma-Informed
Recognize that most homeless youth haveexperienced trauma; build relationships, responses,and services on that knowledge
The oppositeStandards of behavior; compliancewith rules
96
![Page 97: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/97.jpg)
Non-JudgmentalInteract with youth without labeling or judging them
on the basis of background, experiences,choices or behaviors
Contain the effects of risky behavior in the short-termand seek to reduce its effects in the long-term
The opposite: Zero tolerance97
![Page 98: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/98.jpg)
Your ????
98
![Page 99: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/99.jpg)
99
2001
2012
PRINCIPLES
![Page 100: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/100.jpg)
“It is critical toget theprinciples ofaction rightbeforeacting.”
100
![Page 101: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/101.jpg)
“A Leader's Framework for DecisionMaking” by David J. Snowden andMary E. Boone, Harvard BusinessReview,
November, 2007:
Wise executives tailor their approach tofit the complexity of the circumstancesthey face.
101
COMPLEXITY
![Page 102: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/102.jpg)
102
![Page 103: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/103.jpg)
![Page 104: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/104.jpg)
![Page 105: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/105.jpg)
105
![Page 106: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/106.jpg)
106
![Page 107: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/107.jpg)
107
![Page 108: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/108.jpg)
108
![Page 109: MESI Principles-Focused Evaluation 2017 [Read-Only] · 2. Youth voice principle Support youth to develop and express their own perspective and voice. Create spaces for young people](https://reader030.vdocuments.mx/reader030/viewer/2022040903/5e76c451024e970eb01c0900/html5/thumbnails/109.jpg)
Your ????
109