mission impossible?

24
Excellence in University Assessment: An impossible mission? David Carless University of Hong Kong SRHE, 11 th December 2015 The University of Hong Kong

Upload: david-carless

Post on 14-Apr-2017

320 views

Category:

Education


0 download

TRANSCRIPT

Page 1: Mission impossible?

Excellence in University Assessment: An impossible

mission?David Carless

University of Hong KongSRHE, 11th December 2015

The University of Hong Kong

Page 2: Mission impossible?

Key issues What might good summative assessment

design look like?

How might student uptake of feedback be enhanced?

What are key facilitating / inhibiting factors for learning-oriented assessment?

The University of Hong Kong

Page 3: Mission impossible?

Competing assessment functions The University of Hong Kong

Page 4: Mission impossible?

The University of Hong Kong

Productive assessment task design

Appreciating the nature of quality work

Student engagement with feedback

Learning-oriented assessment framework

Page 5: Mission impossible?

Research process The University of Hong Kong

Page 6: Mission impossible?
Page 7: Mission impossible?

Excellence in University Assessment …

An impossible mission (Barnett, 2007)

The University of Hong Kong

Page 8: Mission impossible?

ASSESSMENT DESIGN: ISSUES & TENSIONS

The University of Hong Kong

Page 9: Mission impossible?

Flexibility & choice

The University of Hong Kong

Page 10: Mission impossible?

Integration and coherence

The University of Hong Kong

Page 11: Mission impossible?

Support students in appreciating quality

The University of Hong Kong

Page 12: Mission impossible?

Incorporate feedback dialogues

The University of Hong Kong

Page 13: Mission impossible?

FEEDBACK DESIGNS

The University of Hong Kong

Page 14: Mission impossible?

Feedback often seems like …a perversely belated revelation of things that should have been made clear earlier (Crook, Gross & Dymott, 2006)

The University of Hong Kong

Page 15: Mission impossible?

Closing feedback loops

It’s only feedback if students take some action

The University of Hong Kong

Page 16: Mission impossible?

Feedback by design Integrated cycles of guidance & feedback - Peer review- Dialogue around exemplars-Calibration of judgments

The University of Hong Kong

Page 17: Mission impossible?

Feedback designs• Task 1 feedback interlinked task 2

• Position students as active feedback seekers & users

The University of Hong Kong

Page 18: Mission impossible?

ISSUES AND CHALLENGES

The University of Hong Kong

Page 19: Mission impossible?

Trust or distrust?Distrust as barrier for assessment change (Carless, 2009)

The University of Hong Kong

Page 20: Mission impossible?

Limited incentivesGood assessment design: difficult, needing effort but may not be rewarded (Norton et al., 2013)

The University of Hong Kong

Page 21: Mission impossible?

Incentives for good practice• Teacher passion & motivation

• QA drivers & pressures

• Teaching awards

The University of Hong Kong

Page 22: Mission impossible?

Student responseStudents interpret assessment tasks based on their own preferences, experiences and motivations

The University of Hong Kong

Page 23: Mission impossible?

Communication about assessment

Rationales

The University of Hong Kong

Potential benefits

Processes

Tackling challenges

Page 24: Mission impossible?

Programme-based approaches

Assessment mapping: Cumulative … coherent

The University of Hong Kong