![Page 1: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/1.jpg)
Session Number: S403Assessing Student Learning & Program PerformanceKim Cavanagh, DHSc, MPAS, PA-C, Duke Olivia Ziegler MS, PA, PAEA
![Page 2: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/2.jpg)
Today’s goals• Review PAEAs current assessment tools & how to use them for
student and program assessment
• Discuss how to remediate & assess struggling students
• Describe an analytical approach to remediation for a failed end of rotation examination
• Recommend a standardized process & efficiencies for remediation at PA programs
• Discuss options for reassessing student knowledge after remediation as occurred
![Page 3: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/3.jpg)
PACKRAT• 225-question exam
• Emphasis on student self-assessment & engagement in the learning process
• Used by 90% of programs
• Delivered >12,000 times a year
• 20th anniversary
![Page 4: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/4.jpg)
End of Rotation exams• 7 exam topics
• 2 equated forms
• 120 questions
• Version 3 in publication
• Used by over 100 programs
• Delivered >20,000 times a year
![Page 5: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/5.jpg)
Exam resources• Websites:
• www.PACKRATexam.org
• www.endofrotation.org
• Blueprints & Topic lists
• Core Tasks & Objectives
• Sample exam
• Score report guidelines & Statistics
• Tutorials & Technical support
![Page 6: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/6.jpg)
![Page 7: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/7.jpg)
Sample exam
![Page 8: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/8.jpg)
Student performance reports
![Page 9: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/9.jpg)
Program performance reports
![Page 10: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/10.jpg)
ExamDriver enhancements• Add raw score to composite report
• Pricing change
• Add explanatory verbiage
• Exam webpage and tutorials
• Web chat
• Proctor survey
• Update proctor schedule
• Eliminate the 1-hour wait for newly scheduled exams
• Allow back to back delivery
• Allow proctors to review proctor history after exams are complete
• Add fail-safe features to non-proctored PACKRAT exams
• Add student honor code
![Page 11: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/11.jpg)
Feedback driven
![Page 12: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/12.jpg)
The struggling learnerand a failed exam
![Page 13: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/13.jpg)
What is remediation?‘heal again’
![Page 14: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/14.jpg)
Why is remediation important?
![Page 15: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/15.jpg)
Practitioners who exhibit poor judgement, knowledge and/or skills may pose a risk to the public
Deficiencies don’t resolve without intervention
Our shared goal is to help students overcome their deficiencies and not simply eject them from the program
![Page 16: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/16.jpg)
Barriers to remediation
![Page 17: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/17.jpg)
Faculty are not confident in how to remediate
It can take considerable resources
Methods are not standard
Little evidence to guide best practices
![Page 18: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/18.jpg)
The standards of accreditation
The program defined and applied process for addressing deficiencies in a student’s knowledge and skills, such that the correction of these deficiencies is measurable and can be documented. (ARC-PA)
![Page 19: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/19.jpg)
A formal approach
![Page 20: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/20.jpg)
1- Identify area(s) of concern
2- Construct individualized remediation program
3- Implement program and monitor
4- Reassess
![Page 21: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/21.jpg)
How to remediate multiple choice examinations
![Page 22: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/22.jpg)
• Organizing large amounts of information
• Integrating large amounts of information
• Time management
• Test taking anxiety
• Stress or anxiety not associated with testing
Most common causes of failure:
![Page 23: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/23.jpg)
Potential tools
![Page 24: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/24.jpg)
• Review expectations
• Check-ins
• Independent assignments
• Work on test taking strategies
• Direct observation
• Review charts and patient logs
• OSCEs
• Special elective
• Repeat rotation
![Page 25: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/25.jpg)
Case study
![Page 26: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/26.jpg)
How does your program remediate failed MCEs after supervised clinical
practice experiences?
![Page 27: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/27.jpg)
Summary• This is hard
• Develop a standard “defined” process, to include
• How to approach and help the student
• How to review & evaluate the course
• How to measure the outcomes
• Be as specific as possible
• Normalize & de-stigmatize
![Page 28: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/28.jpg)
Remediate then
Reassess
![Page 29: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/29.jpg)
Remediation Pando™ Workshop
March 2016
![Page 30: Assessing Student Learning & Program Performance](https://reader031.vdocuments.mx/reader031/viewer/2022012300/61e14bcbc8ff6c2f927e8858/html5/thumbnails/30.jpg)
Questions?