1ExamSoft Assessment Conference | #ASSESS2015

ExamSoft Assessment Conference

#ASSESS2015

2ExamSoft Assessment Conference | #ASSESS2015

Jason Yamaki, Pharm.D., Ph.D.Assistant Director of Assessment

Assistant Professor – Infectious Disease Department of Pharmacy Practice

Chapman University, School of PharmacyCalifornia. USA

Siu Fun Wong, Pharm.D., FASHP, FCSHPAssociate Dean of Assessment and Scholarship

Professor – OncologyDepartment of Pharmacy Practice

3ExamSoft Assessment Conference | #ASSESS2015

Objectives

Participants will be able:

1. To develop a personalized exam blueprint (Integrated vs Traditional)

2. Design an ExamSoft category system to align with the exam blueprint

3. Create, maintain and optimize the use of the an ExamSoft examination question bank

4ExamSoft Assessment Conference | #ASSESS2015

Chapman University School of Pharmacy (CUSP)

– 3-year accelerated program (T1-T6 didactic with introductory experiential, T7&8 experiential)

– Inaugural class 9/2015– 60 students– “Flipped Classroom” andragogy– Curriculum course mappings include cognitive level

dimensions (1Foundational – 4Mastery)– Integrated examinations via ExamSoft

Introduction

5ExamSoft Assessment Conference | #ASSESS2015

Integrated Examinations

• Every 3-week summative assessment• Total of 5 integrated exams during each of the six trimesters• Integrated examinations cover content materials from all

courses offered in the trimester• Integrated exam #5 is cumulative• Prepares students for the Pharmacy Board exams, less stress,

streamlined exam scheduling• Questions submitted by faculty to ExamSoft• OAS creates assessments according to Exam Blueprint

6ExamSoft Assessment Conference | #ASSESS2015

Examination Blueprint

• Important for:– Breadth, depth, and content – Guidance for composition of questions to match

lesson objectives at the intended cognitive levels (1F – 4M)

• Challenges and Considerations– Appropriate allocations of questions for each

course– Time issue with higher cognitive level questions– Point distributions– Allotted length of exams vs examinee fatigue

7ExamSoft Assessment Conference | #ASSESS2015

Exam Blueprint Development

^ Depends on course classification (didactic = 4Qs/CH, skills = 2Qs/CH, hybrid = 3Qs/CH)

*

* 15 weeks

^

8ExamSoft Assessment Conference | #ASSESS2015

T1 anticipated mostly 1F

Foundational – Remembering, UnderstandingIntermediate – Applying (examining, connecting)Advanced – Complex analyzing (comparing, organizing); evaluatingMastery - Creating

Exam Blueprint Development

9ExamSoft Assessment Conference | #ASSESS2015

ExamSoft Categories

• Seven categories created in Examsoft• Categories are created to align with

- Curriculum mapping parameters- Exam Blueprint parameters

• Each assessment question is coded to all 7 categories by faculty

10ExamSoft Assessment Conference | #ASSESS2015

11ExamSoft Assessment Conference | #ASSESS2015

12ExamSoft Assessment Conference | #ASSESS2015

• Tagging/coding = easier assessment of exam questions’ content and cognitive level distribution

• Guide for assessment/examination development to comply with Exam Blueprint

ExamSoft Categories

Question Bank Development

14ExamSoft Assessment Conference | #ASSESS2015

Thank You!

Open for further discussion