exam digitisation - moodle · 2020-01-28 · the way forward is digital… full digital exams...
TRANSCRIPT
![Page 1: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/1.jpg)
Morgan Harris, University of New South Wales
Exam Digitisation
![Page 2: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/2.jpg)
Marking sucks
● Tiring
● Boring
● Stressful
![Page 3: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/3.jpg)
But what makes it even worse…
● Security issues
● Archiving
![Page 4: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/4.jpg)
It’s 2019!
Why are we still marking
exams on paper?
![Page 5: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/5.jpg)
The way forward is digital…
● Full digital exams
○ Projects in the pipeline
○ Not quite there yet
● Exam digitisation is a mid-way solution
![Page 6: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/6.jpg)
Traditional Exam Taken on paper Marked on paper
Digital Exam Taken online Marked online
What is Exam Digitisation?
![Page 7: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/7.jpg)
Traditional Exam Taken on paper Marked on paper
Exam Digitisation Taken on paper Marked online
Digital Exam Taken online Marked online
What is Exam Digitisation?
![Page 8: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/8.jpg)
Why mark online?
● No more sacks of paper
● Highly parallel
● Guaranteed security
○ Secure scanning facility
○ Papers never leave campus
![Page 9: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/9.jpg)
The process
Preparation Printing Exam sat Scanning
ExportUpload to Moodle
MarkingGrades
released
![Page 10: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/10.jpg)
The software: ExamScan
● Home-grown at UNSW
● Handles preparation, scanning
and export
● Individual QR codes on each page
○ Every page on every paper has a
unique, recoverable code
● Bubble-sheet student number
![Page 11: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/11.jpg)
Our first setup
![Page 12: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/12.jpg)
Our first setup
![Page 13: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/13.jpg)
Our first setup
![Page 14: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/14.jpg)
The process
Preparation Printing Exam sat Scanning
ExportUpload to Moodle
MarkingGrades
released
![Page 15: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/15.jpg)
Getting online
How do we use Moodle to
mark these papers?
![Page 16: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/16.jpg)
Assignment does it all
● Edit PDF feedback plugin
● Advanced grading
○ Marking guide
○ Rubric
● Marking workflow
○ Assigned markers
○ Maximise parallelism
![Page 17: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/17.jpg)
With a little secret sauce…
● Bulk-upload plugin
○ Allows many submissions to be
created with a single upload
○ Developed at UNSW
○ Available in plugin directory
http://bit.ly/assignbulk
![Page 18: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/18.jpg)
The process
Preparation Printing Exam sat Scanning
ExportUpload to Moodle
MarkingGrades
released
![Page 19: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/19.jpg)
The result?
● Significantly improved efficiency
● Reduced workload
● Faster turnaround
● Fewer student appeals
Paperdistribution
Data entry Appeals
Rela
tive tim
e
Paper Digitised
![Page 20: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/20.jpg)
We hit a few snags…
● ghostscript is s l o w
○ Added hooks for uploading pre-rendered PDF pages
● Students notified about submissions
○ Bulk upload temporarily disables this admin config setting
● Most scanners are not built for this
○ Daily cycle usually <6000 pages… unless you go BIG
![Page 21: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/21.jpg)
What going big looks like
![Page 22: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/22.jpg)
What going big looks like
![Page 23: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/23.jpg)
What going big looks like
![Page 24: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/24.jpg)
Where to from here?
The future of exam digitisation
![Page 25: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/25.jpg)
Where to from here?
● Assignment isn’t Exam
○ Purpose-built module?
○ External tools?
![Page 26: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/26.jpg)
Where to from here?
● Moving the whole thing online
○ Web-based preparation
○ Set up everything in advance
○ Direct link to Moodle
○ Fully automatic once papers are
scanned
![Page 27: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/27.jpg)
Where to from here?
● AI integration
○ Microsoft Azure AI
○ IBM Watson
○ Digital marking assistant
○ Learns as you mark
![Page 29: Exam Digitisation - Moodle · 2020-01-28 · The way forward is digital… Full digital exams Projects in the pipeline Not quite there yet Exam digitisation is a mid-way solution](https://reader033.vdocuments.mx/reader033/viewer/2022043005/5f8cb34082ca393ad9515526/html5/thumbnails/29.jpg)