examsoft implementation at st. george’s university – a recipe for success

1ExamSoft Assessment Conference | #ASSESS2015

ExamSoft Assessment Conference

#ASSESS2015


Session Title

ExamSoft Implementation at St. George’s University – A Recipe for Success


Speaker Introductions

• Sally-Ann Clement, M.Ed.– Educational Technology Specialist

• Leisha Griffith-Mark, MBA– Examinations Services Coordinator

• Teah Cummings, M.S.– Educational Technology Specialist


Contributors

• Avril Best, Ph.D.– Training Supervisor,

Educational Computing Team

• Wayne Radix, M.Sc., PMP– Project Manager


St. George’s University


History and Schools

• School of Medicine (SOM) – 2588 Students

• School of Veterinary Medicine (SVM) – 569 Students

• School of Arts and Sciences – 661 Students

• Graduate Studies – 110 Students


Project Background

Cost Reduction Reduce paper usage

Move to computer based exams


Project Background (2)

Security and integrity of exams

Easy Reporting Use of Categories


Project Management Approach to the Project

• Project plan and Schedule

• Working groups

• Communication to students



• Policies

• Pilot

• Facility upgrades

• Hiring of more proctoring staff



Executives

Champions

StudentsStaff

Faculty

Key Stakeholders


Do you use online testing

1. 2.

0%0%

1. Yes

2. No


Do you currently use ExamSoft?

1. 2.

0%0%

1. Yes

2. No


Is your institution thinking of moving to online testing?

1. 2. 3.

0% 0%0%

1. Yes

2. No

3. Already there


What is your type of institution?

1. 2. 3.

0% 0%0%

1. Two year college

2. Four year university

3. Other


What is your largest class size?

1. 2. 3. 4.

0% 0%0%0%

1. < 100

2. 100-300

3. 300-500

4. > 500


Implementation – Phased Approach

1

•Spring/Fall 2012

•Volunteers (SOM)

2

•Spring 2013

•All SOM, SVM Terms 1 & 2

3

•Fall 2013

•All SOM, All SVM, Optional SAS

4

•Spring 2014

•All SOM, All SVM, Select courses within SAS

Avg. Class Size

0100200300400500600

SOMSVMSAS


Implementation - Training

• Train the trainer program

• Training of pilot users

• Training of other users– Exam Managers, Students and Proctors


Implementation – Pilot

• Long pilot

– Volunteers

– Non high stakes exams attempted first

– Allowed for necessary modifications before go-live

– Feedback informed the process


Implementation - Customization

• System Customization• Identification of unique needs - use of university

credentials for authentication


Challenges

• Loaner laptops• Wireless connectivity• Modification of

physical facilities


Challenges (2)

• Misrepresentation of issues

• Late adopters

• Question Bank Conversion

• Timeline for Creation of Training Materials


Benefits for Faculty & Students

• Use of dynamic images

• More efficient exam creation process

• Scrambling feature


Benefits for Faculty & Students

• Reporting– Track students learning and performance– Inform course redesign based on category

performance

• Immediate results

• Ease of question feedback


Project Successes

• Implementation was completed:– Under budget – Within the allotted time period for the project.


Lessons Learned

Include Stakeholders Early

Structured Project Management

UseChampionsTraining

Support Structure


Guidelines for Successful Implementation

• A Project Management Approach

– Keeping within the timeline

– Keeping within the budget

– Keeping stakeholders focused

– Include persons with alternative views



• Training

– Trainers

– Admin

– Exam Managers

– Students

– Proctors



• Administration

– Policies for providing access

– Careful scheduling of import processes

– Development of other policies

– Making connections with existing ExamSoft clients



• Exam Managers

– Champions – peer support / championing the cause

– Phased pilot

– Timely creation of exams

– Use of mock exams

– Feedback from students



• Students

– Computer with minimum requirements

– Support

• Academic Orientation

• Online Support/Documentation

• Walk-in Support

– Download exam ahead of scheduled sitting


• ExamSoft Champions 2012- Helping Others

• Three faculty members awarded for their selfless contribution – assisting and encouraging their peers through the implementation process

• Awarded an iPad mini from ExamSoft

Highlight!


Guidelines for Implementation

Discovery Activity• Discuss additional guidelines which resulted in

successful implementation at your institutions.• What are some implementation challenges you

anticipate and how would you overcome them?

Report

In 1 minute or less, share the most important discovery made during the discussion.

examsoft implementation at st. george’s university – a recipe for success

Education

assess2015 history

project project plan

pmp project manager

volunteers som

class size som svm sas

students school of arts

schools school of medicine

georges university