transformingexamstransformingassessment.com/sites/default/files/... · candidates can access...
TRANSCRIPT
![Page 1: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/1.jpg)
Pedagogy of e-Exams: Examples and Transition
Dr Mathew Hillier (Monash University), A/Prof Matthew Bower (Macquarie University) Dr Andrew Fluck (University of Tasmania)
e-Exam Symposium 24 Nov 2018 Melbourne, Australia
TRANSFORMINGEXAMS.COM A Scalable Examination Platform for BYOD Invigilated Assessment
Scratch programming task
Multimedia and video
![Page 2: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/2.jpg)
Pedagogical aspirations
Meaningful learning Authentic
(Jonassen et al, 2008)
Meaningful learning is:
Authentic learning involves: 1. Authentic context 2. Authentic activities 3. Expert performance 4. Multiple roles and perspectives 5. Reflection 6. Collaboration 7. Articulation 8. Coaching and scaffolding 9. Integrated authentic assessment 10. Professional learning
(Herrington & Kervin, 2007)
![Page 3: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/3.jpg)
Constructive alignment (Biggs & Tang, 2011)
Outcomes Tasks Assessments
Authentic
Traditional Academic, abstract knowledge and skills
Situated, industry relevant, digital
‘Bookwork’
Software use, modelling, programming
Write essays Answer multiple choice questions
Demonstrate digital and C21st problem solving capabilities
![Page 4: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/4.jpg)
Discussion Question 1:
What would authentic assessment ideally look like
in your discipline area?
![Page 5: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/5.jpg)
Authentic - Writing Tools
Authen'cNot
5
![Page 6: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/6.jpg)
Authentic - Engineering Problem Solving
6
Authen'cNot
![Page 7: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/7.jpg)
http://ta.vu/e-exam-roadmap
Phased implementation strategy Start> > > > >>> >>> >>> >Future>
GetReady Phase 1 Phase 2 Phase 3 Phase 4 Phase 5
Ins'tu'onalapprovals,
researchethics,hardwareandinfrastructure.
Paper equivalent small scale.
Post-paper small to medium.
Medium to large scale.
Whitelisted and logged Internet
Open but fully logged Internet
Basic doc exams to begin.
Expanding the landscape with
apps and media.
Adding the power of an LMS (Moodle).
Network BYOD exam.
Network mixed mode BYOD
exam.
Crawling Walking Running Jumping Flying!
7
![Page 8: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/8.jpg)
8
Scratch SDK
Start! Exam doc Video
Specialist applications
Sims
Start simple and build up!
Spreadsheets as ‘forms’ or as calculation and analysis.
e-Exam Trials: Towards ‘post-paper’ (phase 1 to 2)
![Page 9: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/9.jpg)
Paper equivalent using word documents Suitable format adjustments were made to cater for both paper and screen.
![Page 10: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/10.jpg)
Student’s choice - Macquarie U ICTinEduca'on,80min40%Finalexam
Worddocument:10xMCQand1xEssay.
Phase1~toeinthewater.
10
![Page 11: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/11.jpg)
Language exams – UQ Frenchlanguage.120min30%.Worddocument:ar'cletransla'onandresponseessay.TypeEnglishandFrench.• QWERTYwithaccents• AZERTYlayout
11
Example: Accent agiu é: type a 'single quote' then type the letter e.
![Page 12: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/12.jpg)
Post-paper e-exams at UTAS (Andrew) Word document question and response space – links to e-tools
12
Final exam: 47%, 2 hours. Word doc with short and long text. Constructed response tasks.
Multimedia video prompts. Scratch programming task
Chemistry education software evaluation
Solve a problem in Scratch (block programming for primary school students)
Critique student understanding (video)
![Page 13: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/13.jpg)
Critique student understanding(video) Teaching Secondary Mathematics
Comment on the child’s understanding of symmetry based on her response to this task.
![Page 14: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/14.jpg)
Solve a problem in Scratch Digital Technologies Education
Write a program in Scratch using Felix the cat and a blank stage that: a) Allows Felix to be moved by pressing arrow keys on the keyboard b) Allows the user to draw a picture of a house as they move Felix around the stage.
![Page 15: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/15.jpg)
Spread sheet as a Form Phase 2.5! A form – but with no network. Intro to Chinese (first year): 2017 Semester 2. 22 students at pre-exam practice. 16 typed the exam. Two components: Student XLS file Marking XLS file
![Page 16: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/16.jpg)
Spread sheet as a Form Language tools available according to LOTE selection
Respond in designated cells (other cells are locked).
![Page 17: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/17.jpg)
Mat
hem
atic
s ex
ampl
e
Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside the standard LibreOffice suite (word processor, spread sheet etc), media, plus programming tools such as Python, Scratch etc. Responses via documents or Moodle LMS.
![Page 18: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/18.jpg)
Programming e-Exam – ECU TeachingPythonProgrammingexam:
Worddocument+PythonIDLE
18
![Page 19: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/19.jpg)
Robust Moodle - Monash Monash–Chineselanguage–twounits(1styearand3rdYear)
Moodlequizques'on/responsemediumSelected3rdpartyso_wareincluded.
RobustMoodleworkedtorescuenetworkoutages(doublelayeredbackup!)
Audio data files cached at the start of the exam. Students used headsets to listen.
![Page 20: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/20.jpg)
Third party software included.
This is an offline dictionary tool ‘Dim Sum’ LMS
questions in Safe Exam Browser
![Page 21: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/21.jpg)
Case studies – hand out (double sided!)
UTAS – Post-paper word document based e-exam Monash – ‘robust’ online e-exam in Moodle …. Discussion!
![Page 22: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/22.jpg)
Innovation in education depends on teachers…
Roger’s (2010) Diffusion of Innovation
![Page 23: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/23.jpg)
Barriers to technology integration
First order (external) barriers:
• Resources
• Hardware
• Software
• Training
• Support
Second order (internal)
barriers:
• Confidence
• Beliefs about student learning
• Perceived value of technology in learning & teaching
Ertmer et. al. (2012)
![Page 24: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/24.jpg)
Discussion Question 2:
What are the main barriers that universities/institutions/schools face in order to apply authentic assessment practices, and what are the best ways to overcome
them?
![Page 25: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/25.jpg)
References • Biggs, J., & Tang, C. (2011). Teaching for Quality Learning at University
(3rd Edition) (3rd ed.). Maidenhead, UK: McGraw-Hill. • Ertmer, P. A., Ottenbreit-Leftwich, A. T., Sadik, O., Sendurur, E., &
Sendurur, P. (2012). Teacher beliefs and technology integration practices: A critical relationship. Computers & Education, 59(2), 423-435.
• Herrington, J., & Kervin, L. (2007). Authentic learning supported by technology: Ten suggestions and cases of integration in classrooms. Educational Media International; v44 n3 p219-236 Sep 2007 44(3), 219-236.
• Jonassen, D. H., Howland, J., Marra, R., & Crismond, D. (2008). Meaningful learning with technology: Pearson/Merrill Prentice Hall Upper Saddle River, NJ.
• Rogers, E. (1995). Diffusion of Innovations. New York, NY: The Free Press of Simon and Schuster.
![Page 26: TRANSFORMINGEXAMStransformingassessment.com/sites/default/files/... · Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside](https://reader030.vdocuments.mx/reader030/viewer/2022040816/5e5dffa852e5ef5c831a67c7/html5/thumbnails/26.jpg)
e-Exam Symposium 24 Nov 2018 Monash University Caulfield Campus Melbourne, Australia
TransformingExams.com [email protected]