contradictions in staff and student perceptions of feedback and assessment

18
The discrepancies between staff and students’ perceptions of feedback and assessment practices Monika Pazio Duncan Mckenna “Leave me alone, I’m trying to do my work”

Upload: monikap85

Post on 15-Aug-2015

10 views

Category:

Education


1 download

TRANSCRIPT

The discrepancies between staff and students’ perceptions of feedback

and assessment practices

Monika PazioDuncan Mckenna

“Leave me alone, I’m trying to do my work”

The scope• Institutional research• Data collected as part of TESTA project• Identifying points of tension between staff and

students’ understanding of feedback and assessment practices across the institution

TESTA• Amended version of the original TESTA• Implemented cross-institutionally• Tool for assisting with programme review• Mandatory for 2 faculties, recommended for others• So far 21 programmes

The data

849 questionnaire responses21 focus groups

Quality of feedback analysis (IoE)Programme audits

Contradictions and tensions in perceptions

• Feedback• Assessment loading• Communication of goals and standards• Fairness

SD (24) D (72) N (178) A (377) SA (117)

% 0.03125 0.09375 0.231770833333333

0.490885416666667

0.15234375

5%15%25%35%45%55%65%75%85%95%

Overall I was satisfied with the quality of this course

% T

otal

Res

pons

es

Feedback (quantity, quality, timeliness)

- Regular feedback- Rich and detailed- Within the university policy (15 days)- Students don’t read it, all they want is a

grade

staff

Feedback(timeliness)

SD (77) D (225) N (218) A (167) SA (105)

% 0.0972222222222222

0.284090909090909

0.275252525252525

0.210858585858586

0.132575757575758

5%15%25%35%45%55%65%75%85%95%

Whatever feedback I received on my work came too late to be useful

% T

otal

Res

pons

es

“The feedback on assignments are not prompt. In year 2 we had to wait 9 weeks to get our grades for an assignment. Again in year 3 lecturers are still marking assignments 5 weeks after the deadline, therefore no grades have given.”

“I always find the first term a bit of a guessing game - you don’t know if you’re doing great, or really bad, because all the assessments are at Christmas; so you might be going through a 12 week term, without knowing anything.

students

Feedback(quantity)

“Half the time I don’t ever really get any feedback or even get it marked.”

“There was one lecturer we kept emailing because we wanted feedback and we got one email, the whole group, saying, please leave me alone, I’m trying to do my work.”

SD (49) D (149) N (240) A (227) SA (112)

% 0.0592503022974607

0.180169286577993

0.290205562273277

0.334945586457074

0.135429262394196

5%

15%

25%

35%

45%

55%

65%

75%

85%

95%

Normally, I receive a sufficient amount of feedback on my work

% T

otal

Res

pons

es

“it’s lazy, it’s just what everybody else gets, it’s not personal at all.”

students

Feedback(quality)

“There’s been a couple of assignments where I’ve had a fairly mediocre mark, but then I’ve only had two lines of feedback, and I’m there thinking like, ‘Ok, that’s great, two points, but what can you expand on to tell me how I can improve that?’”

SD (77) D (244) N (214) A (195) SA (62)

% 0.0972222222222222

0.308080808080808

0.27020202020202

0.246212121212121

0.0782828282828283

5%15%25%35%45%55%65%75%85%95%

I didn’t understand some of the feedback on my work

% T

otal

Res

pons

es

“It doesn’t really explain much, it says good, ok but what’s good.”

students

• Student lack of understanding of what feedback is (especially oral, whole class)

• Staff lack of signposting and communication

Feedback (The reason for the tensions)

Quantity of feedbackWritten feedback

Average 6995 words per student per programme (up to 21000)

Oral feedback

On average 40% of feedback is oral

Feedback (The reason for the tensions)

• Lack of acknowledgment of progress

• Minimal advice on how to improve

Assessment (over-)loading

• Appropriate number of assessment linked to objectives

• We only do 1 or 2, sometimes 3 assessments per course

staff

Assessment (over-)loading

SD (18) D (97) N (164) A (148) SA (69)

% 0.0362903225806452

0.195564516129032

0.330645161290323

0.298387096774194

0.139112903225806

5%15%25%35%45%55%65%75%85%95%

I felt overloaded by the number of assessments throughout this programme

% T

otal

Res

pons

es

“I feel like it’s so much work and there’s so much material, and so much content that they’re trying to cover in the 2 semesters that it’s really not even sinking in”

“It’s too much and what’s worse it’s all happening at the same time. E end up having 3 assessments in 2 weeks plus coursework.”

students

Assessment (over-)loading(The reason for tensions)

…the curse of a portfolio

32%

63%

5%

Assessment diet

exam

portfolio

dissertation

11%

11%

16%

5%5%5%2%

18%

5%

18%

2%

Actual assessment dietExamEssayReportWritten CWOnline TaskIn-Class TestPracticalPDPACTArtefactPresentationClass Contribu-tion

19 assessments 55 assessments

Clarity of goals and standardsFairness

https://www.youtube.com/watch?v=CyG5ugFYQ4s

Summary

Lack of understandingLack of understanding

Lack of communicationLack of communication

staff

students

Attributionhttp://www.vinnychany.kiev.ua/!_art/images/674_1.jpg

http://www.freakingnews.com/images/adv-images/magnifying-glass.jpg

http://www.thepowbox.com/wp-content/uploads/2013/12/binoculars-icon.png

http://milwaukeecollegiateacademy.org/wp-content/uploads/2013/08/growing-plant.jpg

http://assets.nydailynews.com/polopoly_fs/1.1397455!/img/httpImage/image.jpg_gen/derivatives/gallery_1200/baskets-bicycle-myanmar.jpg

Thank you

Contact details:Monika [email protected]