research au slide deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v p v ] } v o...
TRANSCRIPT
![Page 1: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/1.jpg)
5/29/2019
1
Building a Culture of Assessment that Supports the Fraternity & Sorority Experience
Wednesday, May 29, 2019 from 2-3:30pm ET
#AdvanceU
Technical Difficulties?
• Attempt the alternate audio option provided
• Send us a question through the GoToWebinarcontrol panel
• Contact GoToWebinarSupport Center at (888)259-8414
![Page 2: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/2.jpg)
5/29/2019
2
#AdvanceU
Presenter Information & Introductions
• Dr. Brian Joyce, Director, Office of Greek Life, Dartmouth College
• Michael A. Goodman, Assistant Director for Programming and Advising, Department of Fraternity& Sorority Life, University of Maryland (@mi_good)
• Dr. Emily Perlow, Assistant Dean of Students, Worcester Polytechnic Institute (@eperlow)
#AdvanceU
About The Program
• Learning Outcomes for Today's Program– Define key assessment terms– Identify sources of data available to you– Confidence in deciding what to measure and articulating
how it matters– Identify stakeholders and who can support you– Identify steps to develop an assessment plan
![Page 3: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/3.jpg)
5/29/2019
3
#AdvanceU
What to Expect from Today's Program
• Lots of real-world examples
• Use the provided worksheet to think about how you'll apply this on your campus
• We will pause during the webinar for reflection or group discussion time
#AdvanceU
Assessment 101
![Page 4: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/4.jpg)
5/29/2019
4
#AdvanceU
At it’s heart: organizational learning is core
Assessment Mindset
Reflecting:
Connecting:
Deciding:
Doing:
observing the environment and oneself
hypothesizing about possible reasons and solutions
choosing a method to determine the best course of action
Performing your work with an experimental frame
(Love & Estanek, 2004)
#AdvanceU
What’s the difference between
assessment and evaluation?
![Page 5: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/5.jpg)
5/29/2019
5
#AdvanceU
• Assessmentis the work of collecting the data
• Assessmentasks: How effective is this?
Assessment vs. Evaluation
• Evaluationis what we do with the data
• Evaluationasks: How can we be more effective at this?
#AdvanceU
• Fraternity/sorority recognition standards
• Changing alcohol consumption behaviors
• Determining if students are learning intended outcomes from hazing education training
• Accountability
• Problem solving
• Outcomes
Three Purposes
(Barber, 2015)
![Page 6: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/6.jpg)
5/29/2019
6
#AdvanceU
The Assessment and Evaluation Cycle
https://www.nacada.ksu.edu/Events/Assessment-Institute/The-Assessment-Cycle.aspx
#AdvanceU
Assessment and evaluation are often seen as extrait is fundamental to the work we do
• Assessment efforts MUST:– align with vision/goals/mission– contribute to strategic goals– have administrative support– involve partners– have dedicated resources– be ongoing– be open to new discovery– be tailored to the institution– result in response—no good if it sits on a shelf
Assessment vs. Evaluation
(Love & Estanek, 2004)
![Page 7: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/7.jpg)
5/29/2019
7
#AdvanceU
Types of Assessment
Satisfaction Needs
of Student Populations
Success
Enrollment, Retention, Graduation
Engagement
ThroughPrograms and
Services
Learning
Outcomes Achievement
• Programmatic
• Demographic
• Climate
• Effectiveness
#AdvanceU
Discussion Time
Schlechty & Noblit (1982) suggest that being a good researcher means • Making the obvious obvious• Making the obvious dubious• Making the hidden obvious
What are examples of questions about your work that fall into each of the three categories?
![Page 8: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/8.jpg)
5/29/2019
8
#AdvanceU
Deciding What to Measure and How to
Measure It
#AdvanceU
What are your strategic goals?
• Existing Strategic Plans– Are you meeting goals?– What/Are you comparing?– When do you reassess?– Do you have another
organization or institution you can grow from/compare?
![Page 9: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/9.jpg)
5/29/2019
9
#AdvanceU
What are your strategic goals?
• Existing Strategic Plans– Are you meeting goals?– What/Are you comparing?– When do you reassess?– Do you have
anotherorganization or institutionyou can growfrom/compare?
• Creating Strategic Goals– Set Learning Outcomes as a
division or department– Ask how you want students
and community to develop (or change)
– Tie to institution or umbrella department goals
#AdvanceU
Using Data to Assist with Advocacy
• Capturing bias-related data could lead to staffing or programming opportunities (CISI: Commitment to Interracial Social Interaction)
• Capturing demographic data could lead to understanding who is missing from programs and events (user statistics; compare across years)
• Utilizing an existing instrument (e.g., McMahon & Farmer, 2011; rape myth acceptance)
![Page 10: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/10.jpg)
5/29/2019
10
#AdvanceU
Connect to Student Development
Discussion Questions to Participants• How are students developing in their various identities?• What student development theories do you engage with in
your work?• In what ways do you partner to better explore this area (e.g.,
IR office, student affairs academic program, divisional research teams/expectations)?
#AdvanceU
Results Based on Accountability
(Friedman, 2005)
![Page 11: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/11.jpg)
5/29/2019
11
#AdvanceU
Know and Address What You are Seeking to Measure
• UMD Advising Survey Example
-promoted diverse ideas-challenged our thinking-advocated for our group-was available for consultation-served as a mentor
#AdvanceU
Identifying Partners and Tools
![Page 12: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/12.jpg)
5/29/2019
12
#AdvanceU
Tools at Your Fingertips
• Institutional Research• Alcohol Education• Campus Police• Student Conduct• Foundation Team/Reports• Leadership • Student Activities• Academic Advising• Career Development• Campus Registrar• Umbrella Groups
Potential Stakeholders
#AdvanceU
Tools at Your Fingertips
• Fraternity and sorority experience survey
• National survey of student engagement
• CIRP Surveys
• CAS Standards
• Campus satisfaction or climate surveys
Existing Assessments
![Page 13: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/13.jpg)
5/29/2019
13
#AdvanceU
Real Life Example: WPI
•
#AdvanceU
Tools at Your Fingertips
Data visualization software
![Page 14: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/14.jpg)
5/29/2019
14
#AdvanceU
Discussion Time
• Who are the stakeholders you can partner with on your campus?
• What tools are available to you that you could use?
• What skills or expertise do you need and who can help you?
#AdvanceU
Putting Your Plan Into Action
![Page 15: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/15.jpg)
5/29/2019
15
#AdvanceU
Creating an action plan
What do you want to assess?
Is it measurable?
A case study looking at alcohol data from Dartmouth College
#AdvanceU
Discussion Time
1) What are your next steps to get started on assessment?
2) What are some helpful strategies you can share with the group that utilize best practices?
3) What are the barriers to assessment in your work? How can you overcome these?
![Page 16: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/16.jpg)
5/29/2019
16
#AdvanceU
Resources
#AdvanceU
References
Barber, J. P. (2015). Tenet two: Commit to student learning as a primary focus. In R. Phillips Bingham, D. A. Bureau, & A. Garrison Duncan (Eds.),Leading assessment for student success (pp. 22-37).Sterling, VA: Stylus.
Friedman, M. (2005). Trying hard is not good enough: How to produce measurable improvements for customers and communities. Charleston, SC: BooksurgePublishing.
Love, P., & Estanek, S. M. (2004). Developing an assessment mindset. In P. Love & S. M. Estanek(Eds.), Rethinking student affairs practice (pp. 83-117). San Francisco, CA: Jossey-Bass.
Maki, P. L. (2004). Assessing for learning: Building a sustainable commitment across the institution. Sterling, VA: Stylus.
McMahon, S., & Farmer, G. (2011). An updated measure for assessing subtle rape myths. Social Work Research, 35: 71-81.
Schlechty, P., & Noblit, G. W. (1982). Some uses of sociological theory in educational evaluation. Research in Sociology of Education and Socialization, 3, 283-306.
![Page 17: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/17.jpg)
5/29/2019
17
#AdvanceU
Questions and Answers
Thank You for Participating
![Page 18: Research AU Slide Deck · 2019. 5. 30. · ñ l î õ l î ì í õ í ñ · À v h ] v P v ] } v o v t Z } Ç } µ Á v } M / ] u µ o M µ Ç o } } l ] v P o } Z } o ( } u](https://reader034.vdocuments.mx/reader034/viewer/2022051804/5feead9e75067e236b79c7dc/html5/thumbnails/18.jpg)
5/29/2019
18