www.bournemouth.ac.uk assessment feedback using comment banks: new methods jeff bray dr. miguel...

17
www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement Conference 2009 Continuing to Enhance the Student Experience Bournemouth University, 21 May 2009

Upload: charles-hines

Post on 12-Jan-2016

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Assessment Feedback using Comment Banks: New Methods

Jeff BrayDr. Miguel moital

School of Services Management

Education Enhancement Conference 2009 Continuing to Enhance the Student ExperienceBournemouth University, 21 May 2009

Page 2: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Assessment: What’s the Point?

• Enables tutor to ‘Grade’ performance• Distinguish between students• We have to

• Provide feedback and learning opportunity to the students

Page 3: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Assessment: What’s the Point?

• Formative Assessment

• Summative Assessment

Page 4: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Role of Assessment Feedback

“It is through feedback of assessment that many of it’s functions are performed”

Nicol et al. 1994

Page 5: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Role of Assessment Feedback

“…feedback resulted in positive benefits on learning and achievement across all

areas”Black and Wiliam’(1998)

Page 6: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Reality Check!

• What do our students do with the feedback?• Read it

• Annotate it to gain further understanding• Seek clarification when not clear• Refer back when submitting future work

Page 7: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Reality Check!

• What do our students do with the feedback?• Throw it

“In my first and second year I never really read the feedback, I was only interested in the mark”

Final Year Retail Student

Page 8: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Good and Bad Practice

• Good• Focused around positive statements –

provides ideas about what could be improved

• Clearly written in an accessible manner• A depth of individual feedback is provided• Supplemented with in-text annotation• Generates OWNERSHIP of feedback

Page 9: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Good and Bad Practice

• Bad• Illegible

• Hand written• Written in pencil

• Generic• “doesn’t appear to apply to MY work”

• Unclear – contradictory • Solely negative comments

• Demotivational…

Page 10: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

It’s a tough job!

• How can we most efficiently deliver this high standard of feedback?

• Spend hours doing it?• Not an option & certainly not the answer I set

out to find

Page 11: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Alternative Approaches

• Generic – tick box approach• Highly time efficient• Provides a high degree of objectivity• Students can clearly see what they need to do

in order to progress• Provides clear justification for the mark

Page 12: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

But…

• Does not generate the ‘ownership’ sought

• Lacks depth and capacity to really articulate the key issues

• Crude

Page 13: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Comment Banks

• We do find repetition in our comments

• Each comment can be carefully constructed to ensure they outline possible improvement

Page 14: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Construction

• Based upon previous years’ feedback

• Both general and customised feedback

• Briefly demo the two different methods of construction followed by discussion.• Excel• Waypoint (via MyBU)

• https://mybu.bournemouth.ac.uk/webapps/portal/frameset.jsp

Page 15: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

WayPoint

• My experience - Much more (10 times more & more quality?) feedback using the same time

• Entering data is easy (generating the bank of comments may not)

• Around 6 hours to learn and set up the system (initial investment)

• More enjoyable• Not time saving at the beginning, but as they

experience grew, I became more efficient

Page 16: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

WayPoint

• Basic usage – some benefits not realised (e.g. Send feedback forms via email to students)

• Much of the initial investment is done• Learning how to use the software• Constructing a fairly complete bank of

comments

Page 17: Www.bournemouth.ac.uk Assessment Feedback using Comment Banks: New Methods Jeff Bray Dr. Miguel moital School of Services Management Education Enhancement

www.bournemouth.ac.uk

Any Questions