Digital Ink Technology for e-Assessment

EISTA June 29 – July 2

Wendy FisherTeaching FellowCentre for Open Learning in Mathematics, Science, Computing & Technology (COLMSCT)The Open University

Open University - Supported Open Learning

7000 – 8000 Lecturers geographically widespread.200,000 Students World-Wide.50 % Electronic submission of Assessment.Marking paperless assessment is challengingMaths, Science and Modelling with diagrams.

Evaluation of technology in assessment

How the lecturer marks assignments using technology.

What students thought of lecturers feedback.

Evaluate the intended and unintended interactions of lecturers using technology in assessment.

Data collection and analysis?

Questionnaires, in-depth telephone interviews,focus Group, Expert Forum, virtual ethnographical study.

Paper Assignment 1998

a)studied with the Open University before so, I know through experience that evenings are my best option.Good description here including your preferred study time. You might have been a bit more precise about how you will fit everything in.a)I haven’t had to make any changes to my study plan this time as I have studied with the Open University before. Excellent well organised plan.a)Because I have studied with the Open University before I know that you can’t rely on being able to

Part-QuestionMarks availab

le

Marks

given

Comments

(a) Study plan (weekly timetable, and over course as a whole)

8 7 Good description of your short term / weekly calendar and likely distractions.Preferred study times also mentioned

(b) Modifications from B1

4 4 Good summary of modifications needed for Block 1.

(c) Lessons learned 3 2 Lessons learned discussed.

Total this question:

15 13

Paperless Assignment 1999

Paperless Assessment 1999 - 2005

Pedagogical Annotation Lay-out Pro-forma

Skills Dexterity Technical ICT

Matching a technology to the pedagogy?

Types of Tablet PC, Slate and Clam HP Compaq tc4200

Submission of 600 assignments

Assignment web depository of

University

300 assignments collected by 10

Lecturer’s

Tablet PC Research Project

.doc.ppt.html

.jnt

.mhtml

export

annotate

.pdf

print

print

Printing, annotating and exporting with Tablet PC

VirtualLayer

Paperless Assessment 2006 - 2008

Pedagogical

Annotation Lay-out Pro-forma

Skills Dexterity Technical ICT

80% of students liked the personalized feel.

Colour can be linked to learning outcomes, English.

Eraser enables ease of re-editing.

Can be used to mark in challenging areas.

Lecturers feedback far richer and fuller.

Extends the pedagogy beyond using pen and paper.

Matching the technology to the pedagogy

Other - Outcomes

Lecturers can be challenged by new technology.

Good for reflective staff development.

Speed at which feedback is recorded important.

Speed depends on process and technology used.

Do students learn better with hand-written feedback?

Do students learn better with feedback in colour?

Quality ofFeedback

Studentjudgements

learning

Lecturer

Technology

Learningfrom

feedback

Teaching

ICT SkillsTechnical

CompetencyWeb 2.0 Typing

AnnotationProcess

SpecialSubject

knowledge

StudentEngaged

Annotation Process

Wendy Fisherw.a.fisher@open.ac.uk