“bottoms up:” institutional collaboration and creation of an assessment culture
DESCRIPTION
“Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture. 8th Annual Texas A&M Assessment Conference February 17-19, 2008. “Bottoms Up!”. Michael Herzog Christina Geithner Daniel Bubb Patricia Terry. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/1.jpg)
“Bottoms Up:” Institutional Collaboration
and Creation of an Assessment Culture
8th Annual Texas A&M Assessment ConferenceFebruary 17-19, 2008
![Page 2: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/2.jpg)
“Bottoms Up!”
Michael Herzog
Christina Geithner
Daniel Bubb
Patricia Terry
![Page 3: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/3.jpg)
Michael Herzog, Ph.D.Professor of English
Senior Faculty Advisor to the Academic Vice President
Overview of Outcomes Assessment and
Accreditation
![Page 4: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/4.jpg)
NWCCU Accreditation Visits
• 1994: Accreditation mandates outcomes assessment
• 2004: Failure to demonstrate real progress
• Two-year focused visit
![Page 5: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/5.jpg)
Responses
• Administrative response:
“Top down” mandates
• Faculty response: Resistance
• “Bottoms up” approach - recommended by faculty to demonstrate value of assessment
![Page 6: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/6.jpg)
“Bottoms-Up” Approach
Components• Faculty-driven assessment committee
• Texas A&M University Assessment Conference
• Resources
• Student Learning Outcomes Day (SLOD)
• Experts reshape the conversation
![Page 7: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/7.jpg)
“Bottoms Up” Approach (Components…)
• Institutional research/Coordinator of Outcomes Assessment hire
• Faculty members with OA experience
• Data-gathering and rubrics
• Successful accreditation site visit
![Page 8: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/8.jpg)
2007 Accreditation Site Visit
New mandate:• Core Curriculum assessment
Our responses:• Overall “Bottoms up” approach• Campus-wide conversations• Mission statement: Gonzaga
graduate characteristics
![Page 9: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/9.jpg)
2007 Accreditation Site Visit(Our responses…)
• Teagle Grant • Continuous work on student learning
outcomes• SLOD activities
– Faculty as a whole– Departments– Sharing experiences
• Teagle Grant: Qualitative assessment of social justice education
![Page 10: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/10.jpg)
Desired Outcomes
• Faculty ownership of assessment:– Changing the language– Frustrations– Overall high degree of success
• Success resulted from:– Administrative/faculty cooperation– Conditions on the ground– Multipronged approach
![Page 11: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/11.jpg)
Christina Geithner, Ph.D. Professor of Exercise Science
Chair, Academic Council Assessment Committee
Assessment CommitteeStudent Learning Outcomes Day
(SLOD)
![Page 12: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/12.jpg)
Overview of Responses to Accreditation Reports
• Academic Council Assessment Committee• Outside experts• Student Learning Outcomes Day (SLOD)• Funding for implementation of outcomes
assessment (OA)• Hiring of a Coordinator for Outcomes
Assessment
![Page 13: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/13.jpg)
Academic Council Assessment Committee
• Formal vehicle for faculty involvement
• Peer review of faculty-generated OA reports
• Recommendations re: OA activities
![Page 14: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/14.jpg)
Outside Experts
• John Bean, Seattle University
(Fall ‘06, Winter ‘07)
– Rich faculty discourse– Expert insider prose– Manageable workload - one focus/yr
• John Webster, University of Washington
(Spring ‘07)
– Rubrics for discipline-specific writing
![Page 15: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/15.jpg)
Student Learning Outcomes Day (SLOD)• Half-day of structured time• Continental breakfast• Focus
– Outside speaker– In-house/Faculty presentations
• Two hours for faculty work in depts.• Reconvene and share• Lunch
![Page 16: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/16.jpg)
Pitfalls
• Scheduling challenge
• Getting Deans and Chairs on board
• Faculty resistance
![Page 17: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/17.jpg)
What We’ve Learned
• Scheduling challenge– No universally acceptable time
hold on alternate days, one half-day/yr
– Advance notice and repeated reminders
– Publicize in a variety of ways/media
![Page 18: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/18.jpg)
What We’ve Learned
Getting Deans and Chairs on board• Meeting of AVP, Deans, and
Assessment Coordinator prior to SLOD
• Deans as advocates
• Active involvement of Deans and Chairs
![Page 19: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/19.jpg)
What We’ve Learned
• Faculty resistance– Use different levels of appeal:
• threat, personal, logical, ethical
– Provide structure to productivity
– Feed them
– Make them laugh
– Thank them
![Page 20: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/20.jpg)
What We’ve Learned(Faculty resistance…)
– Allow for conversations within and across departments/disciplines
– Listen and be responsive to faculty feedback
– Provide support for OA activities
– Focus on the positive
![Page 21: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/21.jpg)
What We’ve Learned
Other• Not a quick process• Choose outside experts to fit your
campus culture and climate
• Depts. not in same place at same time, and progress at different rates
![Page 22: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/22.jpg)
What We’ve Learned(Other…)
• A faculty-driven, “Bottoms up” process creates engagement, builds ownership, and shifts the culture (’s resistance…)
• Prominent role of faculty leadership has been a key to success
![Page 23: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/23.jpg)
Funding for Implementation of Outcomes Assessment• Assessment Committee proposal, Academic
Council endorsement, AVP approval• Identification of needs for moving OA forward
by Departments/Faculty• Assessment Committee recommendations• Several departments funded for OA initiatives in
2007-08
![Page 24: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/24.jpg)
Hiring of a Coordinator of Outcomes Assessment
• Need for administrative support and direction for comprehensive OA
•
• Hiring of Daniel Bubb - January 2007
![Page 25: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/25.jpg)
Daniel Bubb, M.A. Ph.D. Candidate
Adjunct Instructor of History/Political Science
Coordinator of Outcomes Assessment Office of Institutional Research
Direction and Coordination of Outcomes Assessment
![Page 26: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/26.jpg)
Introduction
Hiring of Coordinator of Outcomes Assessment, Office of Institutional Research - January 2007
• Centralized point-person, full-time position
• Assist University in development of its outcomes assessment program
• Assist academic departments
![Page 27: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/27.jpg)
Responsibilities• Provide support for faculty - design tools:–Student Learning Outcomes Table (SLOT)–SLOT/OA Review Table and Criteria–Assessment Handbook for Faculty–Surveys (Alumni)–Implementing the NSSE (Freshman and
Senior Years), CIRP, and other surveys
![Page 28: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/28.jpg)
Responsibilities• Conduct research
• Provide knowledge and experience re:– Assessment terminology– Prolific volume of publications in the
discipline, and other relevant materials
• Understand the complexities of assessment as a faculty member
![Page 29: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/29.jpg)
Pitfalls
• Getting ahead of the faculty (driving the process “Top down”)
• Expecting all departments to be in the same place at the same time
• Lack of availability of and access to resources for outcomes assessment work, including academic and financial
![Page 30: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/30.jpg)
What We’ve Learned
A successful Coordinator of Outcomes Assessment:
• Understands current needs• Understands the campus culture• Identifies faculty with experience in OA• Has the requisite resources and
support from administration• Utilizes creativity in program
development
![Page 31: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/31.jpg)
What We’ve Learned…A successful Coordinator of Outcomes
Assessment:
• Provides information and access to it via a website (in development):– Definition of assessment and importance– University’s comprehensive assessment
program– Department Annual Reports/Evaluations– Links to individual academic departments
![Page 32: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/32.jpg)
What We’ve Learned…A successful Coordinator of Outcomes
Assessment:
• Finds and seeks support for assessment work:– $25,000 Teagle Foundation Grant -
Gonzaga University and Seattle University
– Integration of a discourse approach to assessment within the majors
– Focus on mission-related goal of student engagement in social justice through the University’s Core Curriculum
![Page 33: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/33.jpg)
Patricia Terry, Ph.D.Associate Professor of English
Associate DeanCollege of Arts and Sciences
Core Curriculum Review
![Page 34: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/34.jpg)
Introduction
• What we have done
• How “Bottoms up” approach has directed our efforts
• What we are learning
![Page 35: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/35.jpg)
Introduction
• What we have done– Scheduled meetings with
departments, professional schools
– Reported to Assessment Committee
![Page 36: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/36.jpg)
“Bottoms Up” and Department Meetings
• Reassurances
• Develop open-ended questions– (Not) How does the Core help students
develop, or see relationships?
– (Instead) What should be the characteristics of the ideal Gonzaga graduate?
![Page 37: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/37.jpg)
Other Open-Ended Questions
• Please consider the attached Gonzaga Mission Statement and extract from it the most important values for our students.– What role does our Core play in
inculcating these values?– What role should it play?
![Page 38: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/38.jpg)
Other Open-Ended Questions…
– Are you satisfied generally with our current Core and its role in the formation of students?
– If you could do so, what would you change about our current Core?
![Page 39: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/39.jpg)
What We’ve Learned
• Need authority
• Need for continued shaping of the discussion
• Departmental politics are alive and well
• Coordinating efforts is important
• “Bottoms up” approach does result in outcomes assessment
![Page 40: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/40.jpg)
Examples of Core Curriculum Assessment
Positive faculty assessment:• Yes, the current Core gives us a
multidimensional, interdisciplinary critical reflection on the human condition. I would like to see better integration of what we have.
• Yes, the Core is introducing people to the conversation of humankind and introducing them to the literature of that conversation. We are teaching critical thinking, respect for others, and action flowing from this.
![Page 41: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/41.jpg)
Examples of Core Curriculum Assessment
Issues to be addressed:• We need more language study. Students
need to recognize there’s more than one language out there.
• The Core shouldn’t be owned by departments, but should show students the connections among disciplines.
• We claim to create the “whole student,” but we teach the Core in fragmentary blocks.
![Page 42: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/42.jpg)
Examples of Core Curriculum Assessment (Issues to be addressed…)
• The Core should expose students to major modes of thinking.
• We should have the Core throughout the curriculum.
• What comes from the Core is ways to think and look at questions. Something in the whole process has this result. But students don’t seem to be able to report what they’re doing in Core classes.
![Page 43: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/43.jpg)
Sample Student Learning Outcomes Identified in Core Conversations
Gonzaga University graduates should:• Be capable of critical thinking• Have certain literacies (social, religious,
scientific, media, linguistic, mathematical, artistic)
• Have an understanding of their own tradition and those of other cultures
• Possess the ability to make connections among ways of knowing
![Page 44: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/44.jpg)
What Remains
• Cross-curricular discussions to be held
• University-level committee for Core Curriculum assessment to be established
• Core models to be developed for faculty consideration
![Page 45: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/45.jpg)
Michael Herzog
Summary
and
LAST THOUGHT
![Page 46: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/46.jpg)
SPECIFICS
• Importance of planning
• Continuous, multi-pronged effort
• SLOD activities
• Core assessment
![Page 47: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/47.jpg)
SPECIFICS
• Collaboration– Across the institution
– With other institutions (Teagle Grant with Seattle University)
– Peer feedback
![Page 48: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/48.jpg)
SPECIFICS
• Faculty ownership– No resting on laurels– Scholarship of Teaching and Learning
![Page 49: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/49.jpg)
SPECIFICS
• Better acronym than SLOD
![Page 50: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/50.jpg)
LAST THOUGHT
![Page 51: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/51.jpg)
Time is on our side …
… but there is no reason to wait!
![Page 52: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/52.jpg)
A Toast…
![Page 53: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/53.jpg)
“BOTTOMS UP!”________
“BOTTOMS UP!” “BOTTOMS UP!”
![Page 54: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/54.jpg)
Questions
• Biggest obstacles to assessment?
• Pitfalls, past and present?
• What have you learned?
• Does/would a “Bottoms Up” approach to assessment work for you?
![Page 55: “Bottoms Up:” Institutional Collaboration and Creation of an Assessment Culture](https://reader035.vdocuments.mx/reader035/viewer/2022062721/5681384e550346895d9ffab2/html5/thumbnails/55.jpg)
THANK YOU!
GO ZAGS!!!GO ZAGS!!!