beyond surveys - george washington university€¦ · methods might you use, beyond surveys? big...
TRANSCRIPT
![Page 1: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/1.jpg)
BEYOND SURVEYS
![Page 2: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/2.jpg)
HELLO!
We are Emily Kane and Kaitlyn Schmitt We are here because we love assessment.
![Page 3: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/3.jpg)
LEARNING OUTCOMES
Participants will be able to... ▸ Identify limitations to surveys ▸ Describe at least 3 alternate
assessment methods ▸ Identify the best assessment method
for their purpose
![Page 4: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/4.jpg)
1. WHY SURVEYS AREN’T ALWAYS BEST
But they’re so easy!
![Page 5: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/5.jpg)
SURVEY FATIGUE
![Page 6: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/6.jpg)
LIMITATIONS OF SURVEYS
▸ Nonresponse error ▸ Correlation, not causation ▸ Inflexibility ▸ Lack of explanations ▸ Time-intensive - building your own instrument ▸ Others?
![Page 7: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/7.jpg)
When You Want: ▸ Quantitative data ▸ To answer “What?”
or “How Many?” ▸ To understand
surface-level opinions
▸ Large number of participants
WHEN TO DO A SURVEY
Not: ▸ Qualitative data ▸ To answer “Why?”
or “How?” ▸ To understand in-
depth opinions
▸ Small number of participants
![Page 8: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/8.jpg)
2. OTHER DATA COLLECTION METHODS
So… what do we do instead?
![Page 9: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/9.jpg)
FOUND DATA
▸ What is it? ▹ Already existing information
▸ Benefits ▹ Sustainable practice ▹ Makes assessment a collaborative process
▸ Limitations ▹ Does the data meet all of your needs? ▹ Will it be time intensive to “mine”?
![Page 10: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/10.jpg)
FOCUS GROUPS AND INTERVIEWS ▸ What is it?
▹ Focus Group: Discussion based, one-time occurrence, focused
▹ Interviews: 1:1 meeting, series of questions to collect data
▸ Benefits ▹ Multiple perspectives- Efficient data collection ▹ Data with depth! ▹ Follow-up questions
▸ Limitations: ▹ Groupthink ▹ Perception vs. reality
![Page 11: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/11.jpg)
BENCHMARKING ▸ What is it?
▹ On-going, systematic approach, evaluate best-practices
▸ Three varieties: ▹ Internal benchmarking ▹ Competitive benchmarking ▹ Functional or generic benchmarking
▸ Benefits ▹ No need to reinvent the wheel! ▹ Spark ideas! ▹ Useful for strategic planning and budget decisions
▸ Limitations
![Page 12: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/12.jpg)
RUBRICS A scoring guide with criteria to evaluate student performance
![Page 13: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/13.jpg)
OBSERVATION
▸ We do this constantly - the key is to formalize it
▸ Take notes, collect evidence
![Page 14: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/14.jpg)
3. CASE STUDIES Let’s practice!
![Page 15: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/15.jpg)
EVENT PUBLICITY Soliciting feedback from students about the best method to publicize events
![Page 16: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/16.jpg)
PROGRAM CREATION Implementing a new program with first year students on time management
![Page 17: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/17.jpg)
RESOURCE USAGE Measuring usage of the Student Organization Resource Desk for student leaders
![Page 18: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/18.jpg)
SUPERVISING SKILLS A supervisor gathering feedback on their supervising skills
![Page 19: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/19.jpg)
INTERVIEWING SKILLS Learning what GW students are most struggling with related to interviewing
![Page 20: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/20.jpg)
YOUR IDEA HERE What are you working on? What collection methods might you use, beyond surveys?
![Page 21: BEYOND SURVEYS - George Washington University€¦ · methods might you use, beyond surveys? BIG CONCEPT Every method has benefits and limitations Select the method that works best](https://reader034.vdocuments.mx/reader034/viewer/2022042406/5f1fa915a839cd445d43b914/html5/thumbnails/21.jpg)
BIG CONCEPT ▸ Every method has benefits and limitations ▸ Select the method that works best for your project!
📌