jason bohan, maxine swingler, heather woods school of psychology, university of glasgow matching...
TRANSCRIPT
![Page 1: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/1.jpg)
Jason Bohan, Maxine Swingler, Heather Woods
School of Psychology, University of Glasgow
Matching student expectations and staff practices in producing and engaging with
high quality feedback
![Page 2: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/2.jpg)
Introduction• Feedback promotes student engagement with deeper
learning and positively impacts on future learning (Biggs, 1999)
• Effective feedback aids transition from supported school/college environments to independent learning in HE (Poulous & Mahoney, 2008)
• UK NSS scores reveal low satisfaction for feedback• Staff perception is that they provide good quality
feedback, but student’s fail to utilise this (Careless, 2006)
Q. Given the importance of feedback, why is there a difference between student and staff experiences of the feedback process and can we align the process more tightly?
![Page 3: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/3.jpg)
Method
Data Collection – 3 Phases• Student Survey• Focus groups• Staff Survey
Student Survey• 59 (12%) Level 1 psychology
students responded to a survey posted on our VLE (Moodle). Low response but representative of the class:
• Average age = 21 years• 78% Female• Honours students 79%• New to psychology - 59%• Native language – 63%
![Page 4: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/4.jpg)
Method
Data Collection – 3 Phases• Student Survey• Focus groups• Staff Survey
Student Survey – 6 themes1. What is feedback?2. What is good feedback?3. Expectations of assessments
and experience of feedback4. How do you use feedback?5. How do you want to receive
feedback?6. How does the feedback you
receive differ from before university?
![Page 5: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/5.jpg)
Method
Data Collection – 3 Phases• Student Survey• Focus groups• Staff Survey
Focus Groups• Honours student volunteers
ran one focus group• 4 students participated
![Page 6: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/6.jpg)
Method
Data Collection – 3 Phases• Student Survey• Focus groups• Staff Survey
Staff Survey• 10 staff members all involved
in assessing Level 1 feedback were asked:
1. What they believed was important in coursework
2. What type of comments they provided on coursework
3. What type of additional feedback students requested
4. How they liked to give feedback
![Page 7: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/7.jpg)
1. What is feedback? 10 sources of feedback to be rated:
1. Written comments 2. Talking to teachers3. Exam feedback4. Feedback sheets – written comments5. Feedback sheets – generic comments6. Email from tutors7. Lab quiz (automated)8. VLE (Moodle) comments from staff9. VLE (Moodle) comments from student10. Peer discussion
![Page 8: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/8.jpg)
1. What is feedback? • Written comments on coursework and feedback sheets
rated top- 95% and 93% agreed
• Peer communication rated lowest- 19% rated Moodle
comments from other students as feedback
• 69% of students agreed that staff comments on Moodle
were feedback
![Page 9: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/9.jpg)
1. What is feedback? • Compared what students considered to be
feedback with what they found helpful• 3 significant differences (Mann-Whitney)
between….• Student comments on Moodle (p<0.001)
19% agreed as feedback, 47% rated as helpful• Comments written on coursework (p<0.001)
95% agreed as feedback, 76% rated as helpful• Automated feedback from lab quizzes (p<0.05)
74% agreed as feedback, 61% rated as helpful
![Page 10: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/10.jpg)
1. What is feedback?
• So, differences between what students see as feedback and what they find helpful.
• Peer communication is useful but not viewed as feedback – possibly because less reliable information source?
• Written comments seen as feedback, but many don’t find helpful
• Automated feedback (shown correct answer and given score) 39% do not find helpful
![Page 11: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/11.jpg)
What is Feedback? Digging Deeper…• Student led focus group discussion (Level 1
psychology students).
![Page 12: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/12.jpg)
2. What is good feedback?• Improvements for next piece of coursework • Comments on structure • Comments on argument • Comments on the content• Comments on critical analysis • Comments that provide encouragement • Clearly relates to grade • Acknowledges effort• Further resources• Markers overall impression• Points out errors, e.g. spelling
![Page 13: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/13.jpg)
2. What is good feedback?
• Everything!• Direct comments on coursework and
suggestions on improvement rated as most important- 98%
• Points on errors e.g. spelling 14% rated as unimportant but 70% still rated as important
• Comments on effort and providing encouragement also important
![Page 14: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/14.jpg)
What is Good Feedback?
![Page 15: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/15.jpg)
3. Expectations of assessments and experience of feedback
• Research skills
• Knowledge/comprehension
• Structure
• Critical analysis
• Writing style
![Page 16: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/16.jpg)
3. Expectations of assessments and experience of feedback
• No respondents, staff or student, disagreed
that these factors should be in a essay/report
• Different when asked if the students have
received feedback on these factors or staff
had provided feedback….
![Page 17: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/17.jpg)
3. Expectations of assessments and experience of feedback
• Knowledge and comprehension • 100% of staff provided this feedback• 32% of students report not getting it
• Writing style• 80% of staff commented on this• 46% of students did not receive it
![Page 18: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/18.jpg)
4. How do you use feedback?
![Page 19: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/19.jpg)
4. How do you use feedback?
• 97% of students rated the feedback received as useful
• 36% only look at the grade
• 54% look back at comments with new coursework (15%
unsure)
• 49% are unsure how their feedback and grade are
related
• 53% disagreed that feedback helped in understanding
• 22% agreed that they did not understand the comments
on their work (17% unsure)
![Page 20: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/20.jpg)
How do you use Feedback?
![Page 21: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/21.jpg)
5. How do you want to receive feedback?
• 83% students want comments on coursework but 55% have difficulty using and understanding them
• 73% of students said they would be happy with online feedback only
• Staff are split, 50% staff said they would prefer online only and 50% combination of written comments on scripts and structured feedback
![Page 22: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/22.jpg)
How do you want to receive feedback?
![Page 23: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/23.jpg)
6. How does the feedback you receive differ from before university?
• When I understood the feedback it helped with later work
• I paid close attention to the feedback I received
• I received feedback on drafts
• Feedback was provided fast enough to be useful
• I used feedback from my friends to improve my work
• The feedback for one assignment didn’t help later ones
• The feedback I received didn’t help me much
![Page 24: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/24.jpg)
6. How does the feedback you receive differ from before university?
Significant differences found between pre-university and university experiences of feedback
•90% agreed that understanding feedback helped with later work at school- 66% at uni
•68% agreed that they received drafts at school compared to 15% at uni
•83% agreed that feedback was provided fast enough to be useful compared to 44% at uni
•More uncertainty around paying close attention to feedback at uni compared to school
![Page 25: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/25.jpg)
Differences between school and university
![Page 26: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/26.jpg)
Conclusions & Moving Forward• Broadly large agreement between staff and
students on what constitutes feedback, differences in experiences– Many students say they don’t receive comments on
content (knowledge and comp)– Style of writing
• Match structured staff feedback to student expectations more explicitly
• Marking criteria should clearly define the differing assessment criteria (knowledge, critical, writing style etc) that markers use
![Page 27: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/27.jpg)
Conclusions & Moving Forward
• Students view written comments as important feedback but many do not find useful, e.g. don’t understand the comments and/or how they relate to the overall grade
• Many students don’t view peer-interaction as feedback but report finding it useful
• Help students use feedback more when attempting future assignments, e.g. reflective exercises requiring students to return to prior feedback before attempting current assignments, peer discussions…
![Page 28: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/28.jpg)
Conclusions & Moving Forward• University feedback (compared to school/college) is
viewed as:– Less helpful for future work– Slower (mirrors NSS results)– More anonymous (i.e. less connection with staff)
• Ways of delivering feedback– Students like written comments but are agreeable to
online comments– Staff are split between preferences for written and online
delivery
• Online feedback could improve the speed of delivery. But, can we provide high-quality feedback without written comments on coursework?
![Page 29: Jason Bohan, Maxine Swingler, Heather Woods School of Psychology, University of Glasgow Matching student expectations and staff practices in producing](https://reader036.vdocuments.mx/reader036/viewer/2022081513/56649e2b5503460f94b190f5/html5/thumbnails/29.jpg)
THANK YOU FOR LISTENING!