2011approaches to assessing students
TRANSCRIPT
Online Course
• Fundamentals of Geneticso Fully onlineo 150 studentso Single summer session (7 weeks)o Not proctored, remote
• Assessmentso Problem Sets, short answer, word problemso Summative assessments, weekly “mid-term”
like exams
Academic Dishonesty
Infractions included:
• Plagiarism from internet sources• Copying answer key (verbatim!!)
provided by other students• Submitting, obtaining the key,
resubmitting with the key (LMS bug)
Suspected many; failed 6 students in 2009, 2010
Pedagogical Best Practices
• Tutorial on academic integrity
• Synchronized assessments
• Question pools• Random delivery of
questions and answers
• Exam review controlled
• Required exam proctoring
Testing center at the University of Central Florida
NY Times July 5, 2010
Comprehensive Remote Proctoring System
Desired System Features1. Authenticates student
identity2. Monitors student
activity3. Secures computer
access4. Compact, portable5. LMS compatible
Desired End User Features1. Flexible2. Cost-effective3. Easy to employ for
faculty and students4. Tech-support5. Customer-support
Securexam Remote Proctoring System (SRPS) Solution
Authenticateso Biometric data
Secures computero Lockdown browser
Monitors studentso 360° camera
Compact & portableo Desktop, USB, disassembles
Records o Video record of exam session
Reportso Exam policy violations
Securexam System: How it Works
• INSERT VIDEO HERE
Remote Proctoring Solutions
Provided students with two options:
• Securexam Remote Proctoring System (SRPS)
• National College Testing Association (NCTA), Consortium of College Testing Centers (CCTC) In-person Proctoring
SRPS vs. Testing Center
Feature SRPS CCTCSystem Authentication X X
Monitoring X X
Browser security X Human
Compact/portable X
End-user
Convenient X
Cost-effective X
User friendly X X
Tech support X N/A
Customer support X N/A
Cost ComparisonTesting Center
Hours Fee CTCC 2011
SRPS
MSU M 8AM-5PM $30/exam
$180
$100
W 12PM-5PMFerris State University
M 9AM-4PM $20/hour $240W 9AM-4PM
Grand Rapids CC M 7:30AM-7:30PM
$10/hour $120W7:30AM-7:30PM
Kalamazoo CC M 8:30AM-9PM $20/test $120W 8:30AM-9PM
Central Michigan University
M 9AM-1AM $30/test $180W 9AM-1AM
Lake Superior State
M 8:30AM-4PM $15/hour $180W 8AM-12PM
Southwestern Michigan College
M 8AM-5PM $20/exam
$120W 8AM-5PM
Remote Proctored Exams
• 86 students opted to use the SRPS• 6 exams over 7 weeks• Semi-synchronous exam periods• 2 hour time limit• Multiple choice, short answer, essay (word
problems)• Survey of proctoring experience delivered for
credit at the end of the course
SRPS Protected Integrity
84%
8%4%4%
Impossible/Dif-ficult to Cheat
Easy to Cheat
Knows someone who cheated
No reponse
CMS Bug
Student Testimony
“It looks like something out of Star Wars!”
“It’s a great way to have the freedom to take the exam on your own time in whatever setting you want”
“It’s easy to use and you can take [the test] when you want”
“The remote proctoring device was easy and convenient…you could take your exam in your own home and at whatever time you wanted.”
“You couldn’t cheat and I took my test in the comfort of my own home.”
“Remote proctoring tech support was VERY NICE and HELPFUL.”
“The lowered cost compared to the in-person proctoring exam was a plus.”
Future Best Practices• Inform students of proctoring requirement (and associated costs) at the
time of registration.
• Deploy device at least 2 weeks prior to the beginning of a course (especially for a short course).
• Institute a required practice assessment the first week of the course with the device to ensure students set it up properly.
• Institute a backup exam plan for students who add the course late.
• Establish good communication with your CMS IT personnel.
• Provide clear instructions for contacting Technical Support for CMS and Software Secure.
• Anticipate some technically challenged students!
Take Home Points• Securexam Remote Proctoring system effectively
protects academic integrity• SRPS was a comprehensive proctoring system
o Authenticates student identityo Monitors student activityo Secures computero Records exam sessiono Reviews and Reports to instructors
• SRPS met the needs of the end usero Easy to use (faculty and students)o Conveniento Cost effectiveo Responsive tech supporto Attentive customer service
Top Three Features
77%
15%7% Flexible (time,
location)
Easy to use
Prevented cheat-ing