Transcript
Page 1: Student Feedback via Screen Capture Digital Video:

Student Feedback via Screen Capture Digital Video:

Presented by

Page 2: Student Feedback via Screen Capture Digital Video:

Do you want be to in the top 3 of the NSS survey for your

discipline for Satisfaction and Feedback?

These lecturers where in 2010, 2011, 2012, next year it could be you.

Page 3: Student Feedback via Screen Capture Digital Video:

This is an example of their student feedback.

It is one of the techniques they used to support the learning of their students.

Page 4: Student Feedback via Screen Capture Digital Video:

Click here if video not playing

Page 5: Student Feedback via Screen Capture Digital Video:

BEFORE WE REVIEW HOW IT WAS DONE.

What are your initial thoughts?

Page 6: Student Feedback via Screen Capture Digital Video:

Outline of the process

Page 7: Student Feedback via Screen Capture Digital Video:

Submission1 The student prepares their work in

electronic form.

2 The student work is uploaded to the VLE

3. The student receives an electronic submission receipt.

Outline of the process

Page 8: Student Feedback via Screen Capture Digital Video:

Marking4. The lecturer opens the student

work, initiates the capture software, and starts recording the marking session.

5. The lecturer can add…...

- a voice over, move the mouse pointer, highlight text, show other movies and text files, images, type comments

- Pause and re-start the recording

6. When the marking session is finished the lecturer stops the recording and uploads the personalised video to the VLE.

Outline of the process

Page 9: Student Feedback via Screen Capture Digital Video:

Feedback

7. The student downloads the video from the Virtual Learning Environment and can view it on Windows Media Player.

They watch it again and again and again.

Outline of the process

Page 10: Student Feedback via Screen Capture Digital Video:

Other examples

Diagrammatical – Analysis and Design model

Programming

Textual - Reflection Sheet

Page 11: Student Feedback via Screen Capture Digital Video:

Diagrammatical

The marking here includes a discussion of the students model and implications of the choices made.

Click here if video not playing

Page 12: Student Feedback via Screen Capture Digital Video:

Programming

The student’s program is run and the results are discussed, then the program structure and code is explored.

Click here if video not playing

Page 13: Student Feedback via Screen Capture Digital Video:

Textual

The lecturer is reading and at the same time commenting on the students work, pointing out and highlighting sections.

Click here if video not playing

Page 14: Student Feedback via Screen Capture Digital Video:

Student Feedback by Screen Capture has potential?

Does it?

Click here to move onto the demonstration and by pass the research material

Page 15: Student Feedback via Screen Capture Digital Video:

THE RESEARCH TO BACK UP THE CONCEPT

It is not the answer for everyone.

Page 17: Student Feedback via Screen Capture Digital Video:

Abstract

• A new technique of providing assessment feedback to students is demonstrated via a case study of overseas MBA and undergraduate Accounting and IT students. The feedback method uses inexpensive and widely available screen capture digital video technology; it gives the student an impression of being present during the marking process. In addition it enables the tutor to provide a richer range of feedback.  

• Feedback via screen capture digital video takes engagement of the two parties, tutor and student, to a higher level of effective communication and helps avoid “un dialogue de sourds” through its qualities of being rich, natural and personal.

 

Page 18: Student Feedback via Screen Capture Digital Video:

un dialogue de sourds• Students complain of a lack of adequate feedback

• Tutors claim that students fail to heed the advice given.

• The French have an apt phrase: un dialogue de sourds: literally a conversation between deaf people, metaphorically people who cannot, or do not want to understand each other.

Page 19: Student Feedback via Screen Capture Digital Video:

The Method

• The feedback method uses inexpensive and widely available screen capture digital video technologies.

• The student gets the impression that the tutor is present even when the video feedback is played at distance.

 • It enables the lecturer to provide a richer range of

feedback

Page 20: Student Feedback via Screen Capture Digital Video:

Outline

• Background• Description of method• Where it has been used so far• User responses and evaluations• What is required to use it?

Page 21: Student Feedback via Screen Capture Digital Video:

Examples

• Numerical - Spreadsheet• Diagrammatical – Analysis and Design

model• Programming• Textual - Reflection Sheet

Page 22: Student Feedback via Screen Capture Digital Video:

Applications to date• Where it has been used so far

– 5 modules in IT department• Office Applications, Multimedia, Programming, Analysis Design

Techniques, Database• over 800 student assessment

– 1 module for Accountants – 2 modules on MBA (Project Management, Health Informatics)

• Demonstrated in workshops to 30 lecturers at UWIC• Demonstrated to 1 franchise UWIC university • HEA summer seminar attended by over 120 delegates

2010.

Page 23: Student Feedback via Screen Capture Digital Video:

Method evaluation

• From the Undergraduate students• From the MBA students• From the Undergraduate and

Postgraduate Lecturers

Page 24: Student Feedback via Screen Capture Digital Video:

Undergraduate Feedback

Page 25: Student Feedback via Screen Capture Digital Video:

Quantitative findingsRespondents were asked to indicate how, Strongly/slightly

AgreeStrongly/slightly Disagree

Q4. I know what I have to do in order to improve with the information given in the feedback

100% -

Q5. I Could do with some more feedback on the work 33% 67%Q9. I Know what I have done poorly in addition to what I did well with the details given in my feedback

98% 2%

Q10. I found the feedback helpful and clear 100% -Q11. I think that feedback I received reflects my mark 98% 2%Q6. I feel that I deserved the mark I had for this work 90% 10%Q2. It is clear from the video feedback where I have lost marks 96% 4%

Table 1 Perception of Feedback Content

Respondents were asked to indicate how, Strongly/slightly Agree

Strongly/slightly Disagree

Q7. The commentary on the video was more important than the image

82% 18%

Q8. The typed comments clearly told me where I had lost marks 86% 14%Q12. I prefer feedback on paper rather than on-line 2% 98%Q13. The video and sound quality was very good 90% 10%Q14. Listening and watching the video was a bad experience 2% 98%Q3. Downloading the video did not take long to do 96% 4%

Table 2 The Video/Podcast as a Medium

Figures indicate that the medium was positively received.

The only significant split in the respondents was for Question 5. A higher proportion agreed that tutors provided enough feedback.

Page 26: Student Feedback via Screen Capture Digital Video:

Quantitative findings

Written Medium Questions Video/Podcast Written 

Respondents were asked to indicate how, Strongly/slightly Agree Strongly/slightly Disagree

Strongly/slightly Agree

Strongly/slightly Disagree

Q5. I Could do with some more feedback on the work

- 100% 56% 44%

Q12. I prefer feedback on paper rather than on-line

- 100% 33% 67%

Table 3 Feedback Medium Assessment Comparison

Thought sample group is small to generalise, for Question 5 over 50% of those who received written feedback still wanted more, while those who received video feedback clearly did not.

Page 27: Student Feedback via Screen Capture Digital Video:

Qualitative findings

Description of Main Categories Descriptive Categoriesqualities of feedback good feedback

poor feedbackqualities wanted in feedback

control and readiness to use feedback actions after reading or reviewing feedbackpersonalisation of feedbackproblems accessing video feedbackexperience issues feedback types

•Social Anxiety•Control•Personalisation

The tapes of the two groups were analysed using a constant comparative method

Page 28: Student Feedback via Screen Capture Digital Video:

MBA Feedback

Page 29: Student Feedback via Screen Capture Digital Video:

MBA Profile for pilot

The same piece of work: a 500 word reflection sheet for a module on Project Management is e-assessed and also assessed manually. Students are then asked to comment on the two methods.

Population: 119 students, most from India.

Average age: 21

Page 30: Student Feedback via Screen Capture Digital Video:

MBA Student Feedback

Initial results suggest that students enjoy this new form of feedback, and that this encourages the students to learn from the tutor assessment of answers, rather than concentrating only on obtaining marks. There are other advantages: several students mentioned that they felt the presence of the tutor more keenly even if they were interrogating the feedback at distance.

(This can be particularly useful if the student happened to be absent or had returned for a time to their home country in the middle of studies).

Page 31: Student Feedback via Screen Capture Digital Video:

MBA Lecturer’s Feedback

• Students arriving in the UK to study at ‘M’ level in a second language (English) warm to this sort of assessment and assessment feedback.

• The podcast as a channel has the added advantage of the student being more attentive and engaged with the feedback. Before they would look quickly at the comments and pay a lot of attention to the mark. Now they listen and are talked through the comments and their own text in a fun way. It is no longer a chore or necessary evil to receive feedback and advice.

• One future research recommendation is to see if there is evidence of correlation between the new channel and student improvement over the semester i.e. is closer attention to the feedback helping the student to do better?

Page 32: Student Feedback via Screen Capture Digital Video:

Conclusions

Page 33: Student Feedback via Screen Capture Digital Video:

The BenefitsCompared to traditional written annotations on their work:

Students may still require a complement of feedback. The students indicated that they preferred feedback lodged

on the VLE Video feedback medium as a means of communication with

the tutor was positively received. The Lecture’s voice was more important than the images The Lecturer’s workload is not increased, and may be

reduced. There are particular benefits for distant learning students The feedback medium re-enforces learning in a classroom

setting.

Page 34: Student Feedback via Screen Capture Digital Video:

The Issues

• The voice can give “unintended messages”• It is difficult for the tutor discussing the work of student

100 and to be as enthusiastic as that for student 1.• Tutor must be focused and uninterrupted• If the student work is a Fail, the channel may not lend

itself to bad news.• Need to ensure continuity and fluidity in communication

(may need advance preparation)• Security? It can be on YouTube the next day!

Page 35: Student Feedback via Screen Capture Digital Video:

Technical Issues

• Marking sessions over 10 minutes could take time to upload to the VLE if you are marking from home.

• The type of video compression used for this does not handle a large variety of colours well and colours may be altered.

Page 36: Student Feedback via Screen Capture Digital Video:

DEMONSTRATION

Page 37: Student Feedback via Screen Capture Digital Video:

Demonstration work

My name is Nigel Jones I am undertaking research into the experience of scuba divers in the cold waters of the United Kingdom.   I am writing to you to ask you to promote a website to aid me in my research (http:\\www.coldwaterdiving.org\).    You will see on the web site that most research about recreational diving has been undertaken in warm waters, and that diving regularly in the colder UK waters has been overlooked.  I wish to address this oversight and gain an understanding of the cold water diving experience.   My interest in the field extends from my own diving experience, I am no longer a regular diver, but achieved my BSAC instructor qualification in 1999

The first stage of the study requires the determination of any sensation seeking traits of divers compared to the general public.  Divers visiting the site are asked to complete an international psychological test used to establish sensation seeking traits in many other sports and leisure activities.  The 20 forced-choice items takes about 15-20 minutes to complete.   The project has been reviewed and approved by the Research Ethics Committee of UWIC and your confidentiality will be completely safeguarded during and after the course of the research.

Page 38: Student Feedback via Screen Capture Digital Video:

DEMONSTRATIONPlayback work just recorded

Click here to move onto the questions and by pass the practical

Page 39: Student Feedback via Screen Capture Digital Video:

The Practical• Headsets

– Safety - Volume Control Check before playback

• The Screen Capture– Any Screen Capture Software

Page 40: Student Feedback via Screen Capture Digital Video:

• Activity– Using C:\Test to save in– Follow the instructions on the Workshop pages in

teacher.studentpages.org.uk

• Please complete the Questionnaire on the web page as we value your feedback.

• Any Questions

Page 41: Student Feedback via Screen Capture Digital Video:

The Team

Panicos GeorghiadesSenior Lecturer in MultimediaDepartment: Information Systems and International StudiesRoom No: O2.55cTelephone No: +44(0)29 2041 6302Email Address: [email protected] 

John GunsonSenior Lecturer in Information Systems/ Visiting Reader University of Geneva SES/HECMBA Health Sector Management TutorDepartment: Business and ManagementRoom No: O1.41eTelephone No: +44(0)29 2041 6370Email Address: [email protected]

Nigel JonesSenior Lecturer in Information Systems and Research Fellow of UWIC Department: Information Systems and International StudiesRoom No: O2.55eTelephone No: +44(0)29 2041 6395Email Address: [email protected]

Page 42: Student Feedback via Screen Capture Digital Video:

Thank you for watching and listening

Page 43: Student Feedback via Screen Capture Digital Video:

Ala-Mutka, K. (2005). A survey of automated assessment approaches for programming assignments.  . Computer Science Education, 15(2), 83-102.

Charmaz, K. (2006). A pratical guide through qualitative analysis. London: SAGE.

Denzin, N. K., & Lincoln, Y. S. (2005). The SAGE handbook of qualitative research. Thousand Oaks: Sage Publications.

Gipps, C. (2005). What is the role for ICT-based assessment in universities.  . Studies in Higher Education, 30(2), 171-180.

Lamaster, K., & Knop, N. (2004). Improving web based instruction:  using action research to enhance distance learning instruction. Educational Action Research, 12(3), 387-412.

Lin, S. S. J., Liu, E. Z. F., & Yuan, S. M. (2001). Web-based peer assessment: feedback for students with various thinking styles.  . Journal of Computer Assisted Learning, , 17(4), 420-432.

Matsumura, A., & Hann, G. (2004). Computer anxiety and students’ preferred feedback methods in EFL writing.  . The Modern Language Journal, 88(3), 403-415.

Page 44: Student Feedback via Screen Capture Digital Video:

Microsoft (2010a). About the Windows Media Codecs. MSDN Library  Retrieved 2/10/2010, 2010, from http://msdn.microsoft.com/en-us/library/gg153556(v=VS.85).aspx#windows_media_video_9_screen <http://msdn.microsoft.com/en-us/library/gg153556(v=VS.85).aspx>  

Microsoft (2010b). Using the Windows Media Video 9 Screen Codec. MSDN Library  Retrieved 2.10.2010, 2010, from http://msdn.microsoft.com/en-us/library/ff819485(VS.85).aspx

Orrell, J. (2006). Feedback on learning achievement: rhetoric and reality. Teaching in Higher Education, 11(4), 441-456.

Weaver, M. (2006). Do students value feedback?  Student perceptions of tutors’ written responses  Assessment and Evaluation in Higher Education, 31(3), 379-395.

URL to Microsoft Encoder (Expression Encoder 4)http://www.microsoft.com/windows/windowsmedia/forpros/encoder/default.mspx


Top Related