![Page 1: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/1.jpg)
“Closing the Loop”: Interpreting and Reporting
Results
@CampusLabsCo #labgab Like us on Facebook!www.campuslabs.com/blog
![Page 2: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/2.jpg)
Assessment isany effort to gather, analyze, and
evidence which describes institutional, departmental, or agency effectiveness.
INTERPRET
![Page 3: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/3.jpg)
The Assessment Cycle
Share and use results to inform
decisions and practices; make improvements
to student learning
Review assessment
results
Determine assessment method(s)
Develop or revise divisional, departmental, or program goals, objectives, and outcomes
Identify or develop and administer
measure(s); collect data
Provide experiences (programs, services, activities, classes)
1
2
3
6
5
4
![Page 4: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/4.jpg)
Give yourself a head start!
![Page 5: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/5.jpg)
Consider what kind of data you need
Quick snapshots
(KPI’s)
Stories
(Rubrics/Coded data)
Numbers
(Export a saved view)
Narratives
(Export Open Responses)
Internal comparisons
(Comparative reports)
External comparisons
(National benchmarks)
![Page 6: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/6.jpg)
Developing questions• Be clear.
• Avoid biased, loaded or leading questions.
• Avoid making significant memory demands.
• Keep the question short.
• Don’t make assumptions.
• Define terms and concepts.
• Consider whether the respondents will feel comfortable answering honestly.
• Let participants admit they don’t know or can’t remember.
• Multiple questions (double-barreled)
• Socially desirable responses
![Page 7: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/7.jpg)
Note the reason for each data point
• Bubble next to question
• Compare against purpose to identify gaps
• Look for overlap
• Eliminate “nice to know”
• Help with ordering
• Retain for analysis step
![Page 8: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/8.jpg)
![Page 9: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/9.jpg)
![Page 10: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/10.jpg)
![Page 11: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/11.jpg)
Comparison reports
![Page 12: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/12.jpg)
Closing the loop requires…
• Context
• Ability to analyze data (or access to someone who does)
• Time
• Ability to translate/explain
![Page 13: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/13.jpg)
CLOSING THE LOOP
Analyze data
Make recommendations
Share results
Document action
Step 1
Step 2
Step 3
Step 4
![Page 14: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/14.jpg)
Writing recommendations
• Explain your rationale
• Reference, don’t repeat the findings
• Avoid introducing new material
• Include context
• Be specific
• Be realistic
• Give them options: Include many levels of recommendations (short-term and long-term, low budget and high budget)
• Consider what you can do
![Page 15: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/15.jpg)
![Page 16: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/16.jpg)
![Page 17: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/17.jpg)
![Page 18: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/18.jpg)
![Page 19: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/19.jpg)
![Page 20: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/20.jpg)
Improve it!
As a result of the survey, in the future the hazing awareness program needs to cater to the specific challenges and needs of the different councils. Based on the survey, less than 200 student responded that the hazing awareness ads were moderately beneficial or higher. The cost for the ads was $2,450 spending approximately $2.42 per students who actually responded. As a result, ads should continue. A round table discussion of the results with the students after all data has been gathered will be scheduled.
![Page 21: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/21.jpg)
Improve it!
Tier 1 intramural groups are amongst the few organizations participating in off-season training and would therefore like to see more opportunities for strength and conditioning. The large number of responses reflecting dissatisfaction likely stems from a lack of an organized strength and conditioning program, something we may explore further.
![Page 22: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/22.jpg)
Improve it!
These results illustrate the range of critical transferable skills that are typically available for a student to develop through participation in a student employment experience. These results will be shared with students to help them take full advantage of their work experiences to enhance their professional future. They also establish a baseline so the Career Center can measure the impact of future efforts to assist students to further develop the learning potential of these experiences.
![Page 23: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/23.jpg)
For your consideration:
• Length and depth of your recommendations will depend on the situation
• Use others for brainstorming
• Ask for feedback on your first draft
• Practice makes perfect!
![Page 24: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/24.jpg)
CLOSING THE LOOP
Analyze data
Make recommendations
Share results
Document action
Step 1
Step 2
Step 3
Step 4
![Page 25: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/25.jpg)
Step 3: Share results
Why do we do this?
Recognition/validation
Responsibility/Accountability
Increases participation
Reinforces importance
of assessment
Promotes institutional
transparency
Helps others be more educated
Combats survey fatigue
Reduces chance of redundant
data collection
![Page 26: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/26.jpg)
Sharing results begins with…
•Clear objective/purpose to your project
•Idea of audience (who cares about the results)
•Appropriate analysis of data
•Effective reporting/presentation of results
•Role modeling…you use the data, others will follow!
![Page 27: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/27.jpg)
Policymakers are more likely to read information if:• Information is in short bulleted paragraphs, not
large blocks of type
• Charts or graphs are used to illustrate key points
• It’s provided in print rather than electronically (67%), but 27% indicate reading electronic materials more often.
• Recommendations and implications are presented
![Page 28: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/28.jpg)
Matching Format to AudiencesWITH STUDENTS
WITH INTERNAL CAMPUS PARTNERS
WITH EXTERNALCONSTITUENTS
WITH STAFF
• Email invitations
• PR campaign (flyers,
newspaper, TVs)
• Student gov’t meetings
• Roadshows
• Brief emails
• Newsletters
• Retreat
• Full Reports
• Cabinet meetings
• Elevator speech
• Exec. Summary
• Annual Reports
• Presentations
• Website
• Press releases
![Page 29: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/29.jpg)
Executive Summary
Why?
Who?
What?
So what?
![Page 30: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/30.jpg)
Annual Report
http://www.albany.edu/studentaffairs/assessment/docs/Briefing%20Book%2008-09/index.html
![Page 31: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/31.jpg)
PR or Advertising Campaign
![Page 32: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/32.jpg)
![Page 33: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/33.jpg)
St. Louis University Infographic on Student Involvement
![Page 34: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/34.jpg)
Annual Report
![Page 35: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/35.jpg)
Annual Report
![Page 36: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/36.jpg)
Websites
![Page 37: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/37.jpg)
Websites
![Page 38: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/38.jpg)
Sharing Internally
![Page 39: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/39.jpg)
Presentation
![Page 40: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/40.jpg)
Symposiums
![Page 41: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/41.jpg)
Did you know email
![Page 42: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/42.jpg)
Newsletters
![Page 43: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/43.jpg)
![Page 44: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/44.jpg)
![Page 45: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/45.jpg)
Flyers
![Page 46: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/46.jpg)
Flyers
![Page 48: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/48.jpg)
![Page 49: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/49.jpg)
Performance Indicators
![Page 50: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/50.jpg)
Survey Finish Page
![Page 51: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/51.jpg)
Survey Invitation
![Page 52: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/52.jpg)
Poster Proposal Tree (and Repository)
http://studentaffairs.duke.edu/ra/assessment/2nd-annual-assessment-and-evaluation-poster-fair
![Page 53: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/53.jpg)
Other ideas…
Student facing website (perhaps even interactive)
Knowledge-sharing day (invite students too!) Lesley University
Videos UTEP
Tweets or Facebook Posts
![Page 54: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/54.jpg)
Reporting Advice
1. Seek out example reports/methods for sharing
2. Consider adopting a consistent style for reports/sharing
3. Develop an electronic template for reports/sharing
4. Adopt an “Assessment Spotlight” at staff meetings
5. Figure out how (not if!) to share results with students
Overall goal:
Share your results in a variety of ways with a variety of audiences in ways that are meaningful
![Page 55: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/55.jpg)
Step 4: Document Action Taken
Answer the questions:
What did we do differently?
What did we continue to do the same?
How were students (or others) impacted?
![Page 56: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/56.jpg)
Make the most of your data.
See the impact on students.
CLOSE THE LOOP.
![Page 57: “Closing the Loop”: Interpreting and Reporting Results€œClosing the Loop”: Interpreting and Reporting Results ... to student learning Review assessment ... (flyers, newspaper,](https://reader031.vdocuments.mx/reader031/viewer/2022020214/5b0b76ea7f8b9a99488de869/html5/thumbnails/57.jpg)
Jenna Ralicki
Consultant, Campus Success
716.270.0000
QUESTIONS?