multimedia marking rubrics and feedback for clinical ... · the university of sydney page 1...
TRANSCRIPT
The University of Sydney Page 1
Multimedia marking rubrics and feedback for clinical skills assessment
Presented byDr Kate EdwardsFaculty of Health Sciences, Exercise and Sport Science
The University of Sydney Page 2
Who, What, Why?
LARGE (350+), first year undergraduate, Exercise Physiology unit
Practical skills exam (e.g taking a resting blood pressure reading)Multiple examiners (10+)
The University of Sydney Page 3
How do you moderate the marking of 10+ examiners, when examining basic clinical skills?
InterpretationDifferent experience
Different valuesDifferent learning environments
Subjective differences‘Wrong’ vs ‘Not best’
Why is moderating important?
The University of Sydney Page 4
Multimedia rubrics
– Five assessed tasks (one with multiple options)– Seven videos produced
– 5 actors, 8 hrs filming, 3 weeks editing– Infographic of ‘Common errors’ produced from video stills
Each video shows a student exam with 100% achievement– ‘model answer’
Common errors infographic– ‘mistakes that represent a lost mark’
The University of Sydney Page 5
Multimedia rubrics
The University of Sydney Page 6
Infographic feedback sheet
– Moderation tool for staff marking
– FEEDBACK tool for students!
Consent – ask explicitly
The University of Sydney Page 7
2013N=307
Practicals Exam
2014N=296
Practicals Exam
2015N=323
Practicals Exam
GRADES
GRADES
GRADES
2013Mean (/21) 16.61
SD 3.290
201416.902.748
201517.332.954
The University of Sydney Page 8
How do you moderate the marking of 10+ examiners, when examining basic clinical skills?
Video rubric of a ‘model answer’Supplements written, discussed rubric
Infographic of common errorsAlso acts as immediate feedback to student
Given as exam moderation reduced mark variation
Given as teaching moderation increased score
The University of Sydney Page 9
Sonya Corcoran
Phil Goody