culture of assessment creating a culture of assessment dean kenneth b. roberts, ph.d. heidi m....
TRANSCRIPT
![Page 1: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/1.jpg)
Culture of AssessmentCulture of Assessment
CREATING A CULTURE OF ASSESSMENT
Dean Kenneth B. Roberts, Ph.D.Heidi M. Anderson, Ph.D.
Eleanora Bird, M.S.Jeff Cain, M.S.
Office of Education InnovationUniversity of Kentucky College of Pharmacy
Closing the Loop
![Page 2: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/2.jpg)
Culture of AssessmentCulture of Assessment
2
Outline Literature “Creating a Culture of
Assessment” UKCOP Case Study
Created an office to handle the College assessment efforts
Faculty development and involvement Student involvement Documenting current assessment efforts
Future Directions at UKCOP
![Page 3: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/3.jpg)
Culture of AssessmentCulture of Assessment
Creating a Culture
of
Assessment 3
![Page 4: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/4.jpg)
Culture of AssessmentCulture of Assessment
4
Culture of Assessment1. Leadership must be ‘on board’
Mission, resources, use results for improvement
2. Involve all stakeholders Faculty Students Alumni
![Page 5: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/5.jpg)
Culture of AssessmentCulture of Assessment
5
Culture of Assessment3. Make assessment relevant
Course reviews Surveys, rubrics
4. Focus on teaching and learning rather than assessment Focus conversations not on
assessment, but on helping students learn
![Page 6: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/6.jpg)
Culture of AssessmentCulture of Assessment
6
Culture of Assessment5. Provide opportunities to learn about
assessment6. Minimize the burden of assessment on
faculty and students Provide centralized leadership,
coordination and support for assessment Provide resources Keep paperwork to a minimal
![Page 7: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/7.jpg)
Culture of AssessmentCulture of Assessment
7
Culture of Assessment7. Start small, Set up clear expectations and be
flexible8. Celebrate and reward assessment efforts
Give faculty and staff written recognition Encourage leaders to commend publicly Provide special funding Honor faculty and staff who obtain external
grants that will strengthen assessment
![Page 8: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/8.jpg)
Culture of AssessmentCulture of Assessment
8
Culture of Assessment9. Use assessment results appropriately
Keep faculty, students and staff informed
Don’t penalize faculty whose assessments results are less than positive
10. Don’t expect everyone to get on board
![Page 9: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/9.jpg)
Culture of AssessmentCulture of Assessment
(UKCOP)
9
![Page 10: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/10.jpg)
Culture of AssessmentCulture of Assessment
10
Vision Office of Education Innovation (OEI)
was developed to assist faculty Teaching Learning ASSESSMENT Technology Scholarship of Teaching
Today
![Page 11: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/11.jpg)
Culture of AssessmentCulture of Assessment
11
Mission The mission of the “Office of Education
Innovation” (OEI) is to provide assistance to faculty in developing and evaluating the professional pharmacy and graduate programs within the University of Kentucky, College of Pharmacy (UKCOP).
![Page 12: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/12.jpg)
Culture of AssessmentCulture of Assessment
12
Community Dean’s Leadership Team Office of Academic Affairs Office of Education Innovation (4 FTEs)
Assistant Dean Assessment Coordinator Information Technology Officer Administrative Assistant
Faculty Students Other Participants
TEAM
![Page 13: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/13.jpg)
Culture of AssessmentCulture of Assessment
13www.mc.uky.edu/Pharmacy/oei
![Page 14: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/14.jpg)
Culture of AssessmentCulture of Assessment
14
Who the office works with? The “Office of Education Innovation” (OEI)
works closely with: UKCOP Course Coordinators/Directors UKCOP Individual Faculty UKCOP Departments UKCOP Students External Constituents to College
![Page 15: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/15.jpg)
Culture of AssessmentCulture of Assessment
15
OEI Activities and Services Curriculum
Assessment Instructional Technology Faculty Development (Enrichment) Scholarship of Teaching
Today
![Page 16: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/16.jpg)
Culture of AssessmentCulture of Assessment
UKCOP Faculty Development: How, What and
Why of Assessment?
16
![Page 17: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/17.jpg)
Culture of AssessmentCulture of Assessment
17
Why do assessment? Accountability
ACPE Accreditation University Review Curriculum committee requirements
Enhance student’s educational development Decision-making
![Page 18: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/18.jpg)
Culture of AssessmentCulture of Assessment
18
Accreditation July 2000 accreditation standards require
assessment activities to be aligned with mission and goals: achievement indicators, formative and summative formats, outcomes assessment, and systematic assessment plan.
![Page 19: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/19.jpg)
Culture of AssessmentCulture of Assessment
19
Assessment ProcessDriven by Mission
Used forImprovement Ongoing
Use Multiple Measures
![Page 20: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/20.jpg)
Culture of AssessmentCulture of Assessment
20
What is the Assessment Process? “Systematic collection, review and use of
information about educational programs undertaken for the purpose of improving student learning and development”
Palumbo and Banta, 1999, p. 3
![Page 21: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/21.jpg)
Culture of AssessmentCulture of Assessment
21
Levels of Assessment Institutional
Academic CURRICULUM COURSES Teaching-
learning Methods Assessment
Methods
Individual STUDENTS:
Learning Performance Attitudes Behaviors Skills Satisfaction
![Page 22: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/22.jpg)
Culture of AssessmentCulture of Assessment
22
Levels of Assessment Institutional
UNIV REVIEW ACCREDITATION
Individual Faculty
SELF Teaching Portfolio
Peer Observation
Scholarly Productivity
![Page 23: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/23.jpg)
Culture of AssessmentCulture of Assessment
23
What is Assessed? Student
Student Learning Outcomes
Performance Faculty
Contribution to teaching Scholarly productivity National visibility
Program Graduation rates Licensure pass/fail Curriculum Courses Teaching-Learning
Methods
![Page 24: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/24.jpg)
Culture of AssessmentCulture of Assessment
24
Difference: Student Assessment vs. Program Assessment
Student Assessment is a teaching process designed to improve learning
Program Assessment is an institutional process designed to improve the program
![Page 25: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/25.jpg)
Culture of AssessmentCulture of Assessment
25
Student Assessment Carefully define your student learning
outcomes If you don’t know what you’re looking for,
you will have a difficult time measuring it. Outcome statements should describe
student learning or behavior Outcome: “the result”
![Page 26: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/26.jpg)
Culture of AssessmentCulture of Assessment
26
Student Assessment Start simple. Choose a limited number
of outcomes to measure at first. Begin modestly so that the data
collected can help to define and refresh accomplishments
![Page 27: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/27.jpg)
Culture of AssessmentCulture of Assessment
Faculty Involvemen
t
27
![Page 28: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/28.jpg)
Culture of AssessmentCulture of Assessment
28
Faculty Involvement Faculty learning about assessment:
Website developed to keep them abreast of activities
Faculty participation on committees: Assessment committee Curriculum committee
![Page 29: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/29.jpg)
Culture of AssessmentCulture of Assessment
29
Faculty Involvement Self-study reports
Curricular purposes Curricular Outcomes Course Review (online submission) Course Evaluation (online)
Survey developmentPS Graduate Program
Requested peer evaluation of teaching
![Page 30: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/30.jpg)
Culture of AssessmentCulture of Assessment
30
UKCOP General Outcomes
Foundation Knowledge Critical Thinking Information Management Communications Professionalism Social Interaction, Citizenship, Leadership Life-long Learning
![Page 31: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/31.jpg)
Culture of AssessmentCulture of Assessment
31
UKCOP Professional Outcomes Patient Care
Medication Distribution Human Resources Management and
Operations Research Teaching
![Page 32: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/32.jpg)
Culture of AssessmentCulture of Assessment
32
Faculty Involvement Focus on Teaching/Learning
Generate the appropriate assessment questions
Determine appropriate ways to measure outcomes
Decide on when to assess the students Prepare and utilize the reports
![Page 33: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/33.jpg)
Culture of AssessmentCulture of Assessment
33
Faculty Involvement
Developing Questions to Ask: What do we want students to know, and do? How will we know they are learning what we
hope they will? What is the effect of our curricula, courses,
teaching, styles and educational tools? Did our changes bring about the effect we
desired?
![Page 34: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/34.jpg)
Culture of AssessmentCulture of Assessment
Student Involvemen
t
34
![Page 35: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/35.jpg)
Culture of AssessmentCulture of Assessment
35
Student Involvement Incoming orientation:
Explain the College’s assessment, rationale relating to accreditation standards, role of OEI
Review IRB protocol and informed consent Assessments throughout their 4 years Anonymous (code for tracking) Reports in aggregate fashion
![Page 36: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/36.jpg)
Culture of AssessmentCulture of Assessment
36
Student Participation Curriculum Committee
Student Liaison Committee (SLC) meets 3x per semester
Assessment Committee Course
Performance Assessments Other
Accreditation Visit, Program Review
![Page 37: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/37.jpg)
Culture of AssessmentCulture of Assessment
UKCOP Case Study:Documenting Current Effort
37
![Page 38: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/38.jpg)
Culture of AssessmentCulture of Assessment
38
Documenting Current Efforts
Purpose Determine what assessments were already
taking place within the College
Develop an assessment inventory list and appropriate questions about student learning
![Page 39: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/39.jpg)
Culture of AssessmentCulture of Assessment
39
Self-assessment of outcome abilities Attitudes towards peer/self assessment Performance records from courses CAPP results (integrated abilities) Student portfolios Yearly interviews Post-graduation surveys
Goal:
Develop a Complete Student Profile
![Page 40: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/40.jpg)
Culture of AssessmentCulture of Assessment
40
Three Phases Phase 1: Needs Analysis
Phase 2: Recommendations and Plan Development
Phase 3: Align Assessment Plan, Outcome Indicators
![Page 41: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/41.jpg)
Culture of AssessmentCulture of Assessment
41
Research Literature review was conducted to
determine types of assessment data that might be useful to gather for the program’s assessment functions Student records Program evaluations Student performance and competencies
Needs Analysis
![Page 42: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/42.jpg)
Culture of AssessmentCulture of Assessment
42
Data Audit Class of 2002-2005: Student and educational
outcomes records Data obtained from various offices and files within
the college: Demographic Entry-exam scores Learning styles GPAs
Needs Analysis
![Page 43: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/43.jpg)
Culture of AssessmentCulture of Assessment
43
Data Audit Data portfolios for several student cohorts
were examined Faculty Other sources:
Institutional Research Office Boards of Pharmacy State/local pharmacy associations
Needs Analysis
![Page 44: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/44.jpg)
Culture of AssessmentCulture of Assessment
44
Data Audit Report
![Page 45: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/45.jpg)
Culture of AssessmentCulture of Assessment
45
Success External IR officer requested to use the
college audit form as a model for the campus
Data are being collected from all audiences in a wide variety of venues
Some data are being disseminated in meaningful way
Data AuditNeeds Analysis
![Page 46: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/46.jpg)
Culture of AssessmentCulture of Assessment
46
Lessons Learned from Data Audit
Amount & breadth of information was considerable
Gaps/Duplication
Some areas require more or different data
![Page 47: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/47.jpg)
Culture of AssessmentCulture of Assessment
47
Lessons Learned from Data Audit
Length and frequency of surveys Faculty engagement Incorporate findings into College
assessment plan Reassess
![Page 48: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/48.jpg)
Culture of AssessmentCulture of Assessment
48
Phase 2Recommendations about research
questions to assessment committee
I-E-O data management model used to classify student and program data (Astin, 1993)
I=inputs E=environments O=outcomes
![Page 49: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/49.jpg)
Culture of AssessmentCulture of Assessment
49
Phase 2A. Content Analysis
B. Educational Impact
Which educational experiences/environments maximize student learning during the first year of pharmacy school?
![Page 50: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/50.jpg)
Culture of AssessmentCulture of Assessment
50
Phase 2Ho: Structured Clinical Instructive Models
(SCIMs), prior to students participating in EPPE, statistically improve student critical thinking skills.
Ho: Videotaped counseling sessions statistically improve student communication skills during the first year of pharmacy school.
![Page 51: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/51.jpg)
Culture of AssessmentCulture of Assessment
51
PHASE 3
Align and map curricular outcomes
Disseminate reports and use for improvement
![Page 52: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/52.jpg)
Culture of AssessmentCulture of Assessment
Future Assessment Directions
52
![Page 53: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/53.jpg)
Culture of AssessmentCulture of Assessment
53
Next Steps OEI reviewing literature Formulating appropriate research questions Prioritization and approval of research
questions by assessment committee Identifying appropriate measures Conducting the analysis Reporting and using the results for
improvement
![Page 54: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/54.jpg)
Culture of AssessmentCulture of Assessment
54
Assessing Faculty Teaching
Classroom teaching Portfolio
Student advising Scholarship of
Teaching Publications Presentations
Supervision of clinical experiences
Supervision of graduate students
Consultation about teaching
Next Step:
![Page 55: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/55.jpg)
Culture of AssessmentCulture of Assessment
Other Activities of the Office of
Education Innovation (OEI)
55
![Page 56: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/56.jpg)
Culture of AssessmentCulture of Assessment
56
Instructional Technology Introduce and foster the use of
innovative technologies that enhance teaching, learning and assessment
Consultation and chair side assistance Remove obstacles
![Page 57: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/57.jpg)
Culture of AssessmentCulture of Assessment
57
Assessment Software CourseEval
TrueOutcomes
![Page 58: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/58.jpg)
Culture of AssessmentCulture of Assessment
58
Technology Smart classrooms Blackboard Audience Response System PDAs FLASH animations Assessment hardware/software
![Page 59: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/59.jpg)
Culture of AssessmentCulture of Assessment
59
Faculty Enrichment Education Research Focus Group (2002)
Seminars Technology (primary focus) Teaching (Forthcoming)
Learning (Forthcoming)
Assessment (Forthcoming)
Website: primer materials
![Page 60: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/60.jpg)
Culture of AssessmentCulture of Assessment
60
Scholarship of Teaching Publications Presentations
AACP Annual Meeting poster, presentation Other Presentations
Syllabus International Education Conference Assessment Institute
![Page 61: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/61.jpg)
Culture of AssessmentCulture of Assessment
61
Summary Assessment evaluates the effectiveness of the
program in terms of measurable outcomes The plan consists of:
Student learning outcomes Measures of student achievement of the
outcomes (and objectives) Methods of collecting data Process for using and reporting the results Assessment of the process
![Page 62: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/62.jpg)
Culture of AssessmentCulture of Assessment
62
Summary Fostering a culture of assessment:
Takes time and commitment Is challenging Involves various stakeholders at some
levels Requires resources Continuous
![Page 63: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/63.jpg)
Culture of AssessmentCulture of Assessment
63
http://www.mc.uky.edu/Pharmacy/oei/faculty_assessment.asp
![Page 64: Culture of Assessment CREATING A CULTURE OF ASSESSMENT Dean Kenneth B. Roberts, Ph.D. Heidi M. Anderson, Ph.D. Eleanora Bird, M.S. Jeff Cain, M.S. Office](https://reader036.vdocuments.mx/reader036/viewer/2022062515/56649cd65503460f9499d976/html5/thumbnails/64.jpg)
Click to edit Master title style
Click to edit Master text styles Second level
Third levelFourth level
Fifth level
04/18/23 1 64Culture of AssessmentCulture of AssessmentCulture of AssessmentCulture of Assessment
Questions ?
64