morse project - emerging feedback and assessment issues
DESCRIPTION
Presentation by Dr Richard Hall, De Montfort University and Dr Tim Linsey, Kingston University, at the "Improving Assessment and Feedback Practices in a Technology-Enhanced Teaching and Learning Environment: Theory and Practice" Event, 19th May 2010 at Kingston University. Part of the "Higher Education Academy : Evidence Based Practice Seminar Series 2010"The presentation provides an overview of the Mobilsing Remote Student Engagement (MoRSE) project and some of the emerging findings concerning feedback and assessment.TRANSCRIPT
![Page 1: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/1.jpg)
Mobilising Remote Student Engagement
Dr Richard Hall, De Montfort UniversityDr. Tim Linsey, Kingston University
http://Morse.ac.uk
![Page 2: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/2.jpg)
Afternoon Overview•Project Overview and context•Students on Field trips: assessment
and feedback•Students on Placement : assessment
and feedback•Some questions for you
![Page 3: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/3.jpg)
The MoRSE TeamDr Tim Linsey, Kingston UniversityDr Richard Hall, De Montfort University
Leicester School of Pharmacy, DMU• Dr Malcolm Andrew• Dr Peter Taylor, De Montfort University
School of Geography, Geology and the Environment, KU• Dr Stuart Downward• Dr Ken Field• Dr James O’Brien
Academic Development Centre, KU• Dr Ann Ooms
![Page 4: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/4.jpg)
Project Context
•Joint project between Kingston University and De Montfort University
•Builds on earlier HEA Pathfinder projects at KU and DMU
•To develop a situated understanding of the impact of mobile and personal technologies on student and staff practices, beyond the institution, and on institutional processes▫Work Placements (DMU)▫Field trips (KU)
![Page 5: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/5.jpg)
Assessment and feedback headlines•The disruptive nature of being away from ‘home’
affects the nature of assessment and feedback.•For some staff the use of edtech to support these
students is problematic.•A mix of stakeholders involved in tasks impacts
student assessment: mentors, staff, industry.•Never underestimate the need for induction
linked to both personal edtech and the curriculum.
•The use of students as mentors augmented the quality and types of feedback.
![Page 6: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/6.jpg)
Field Trips
•Centred in the School of Geography, Geology and the Environment.▫Dr Stuart Downward▫Dr Ken Field▫Dr James O’Brien
•GIS and Geography•Field trip locations include the Isle of
Wight, Malta and south-east Spain.
![Page 7: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/7.jpg)
Field Trips: assessment issues
•Integration of fieldwork and other aspects of the curriculum
•Co-ordination and collaboration amongst staff and student groups distributed over a study area.
•Sharing resources/collaborating synchronously and asynchronously
•Access to resources, real-time databases, ‘experts’ and support from the field.
![Page 8: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/8.jpg)
Tools used / trialled
•Specialist ‘Geographical Information Systems’ mobile technologies
•Geo-coded micro-blogging ‘ Cartoblography’ (Twitter mash-up) / Ubertwitter
•SMS for communicating with staff (Txttools)
•Live video / video sharing (Qik.com)•Mobile Skype•Mobile phone voice recording
![Page 9: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/9.jpg)
Photo sharing (Flickr)
Latitude: 50 deg 41' 52.92" NLongitude: 1 deg 5' 54.42" WDate: 2009:10:18 12:41:25Comments: Looking North. Concrete walk / sea defence. Groynes visible with sediment banked on their north side indicating sediment migration southwardsTags: IoW, Duver, Coast, Groynes,
Map of photograph locations
![Page 10: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/10.jpg)
Sharing via many channels including the VLE
![Page 11: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/11.jpg)
Photo sharing: assessment lessons•Enables sharing between students in the field,
and with those at University. (Geo)Tagging and comments extend feedback and understanding.
• Impact on core skills of observation, identification and sketching needs further evaluation.
• Integrating mentor feedback and student/staff commentary into the production of a student’s final summative assessments needs agreement.
![Page 12: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/12.jpg)
Live Tracking (Instamapper)
http://www.instamapper.com/trk?key=2642287017959854978
18/10/2009 12:37 N 50.69961° W 1.09922° 35 0 0
18/10/2009 12:38 N 50.69965° W 1.09904° 49 0 129
18/10/2009 12:39 N 50.69967° W 1.09905° 51 0 49
18/10/2009 12:39 N 50.69922° W 1.09888° 52 6 167
18/10/2009 12:40 N 50.69877° W 1.09872° 51 5 165
18/10/2009 12:40 N 50.69830° W 1.09860° 46 5 173
Altitude Speed Bearing
![Page 13: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/13.jpg)
Synchronising GPS Units with Personal technologies
Using GPicSync &Google Maps
![Page 14: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/14.jpg)
Synchronous tasks: assessment lessons•Enables students back at the institution to
access relevant resources/real-time databases/perform analyses relevant to the location, and give feedback to the field group.
•Confirmation of sampling strategies and gaps in data collection.
•Enabling students to capture and integrate feedback in the production of their final summative assessments needs identification.
![Page 15: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/15.jpg)
Personal technologies
•High level of Laptop usage (83% )•All students possess a mobile (40% PAYG)•Some student usage of dedicated cameras
and MP3 players.•64% of students interested in taking
personal technologies on field-trips•77% of students willing to use their own
text credits for educational purposes
![Page 16: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/16.jpg)
Initial Student FeedbackGenerally positive response to the use of SMS somewhat agree agree
Positive impact on my motivation to study 51% 16% Useful for feedback on my understanding 49% 40% Advise staff to continue using 37% 54%
Positive in using personal technologies
![Page 17: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/17.jpg)
Field-trips: assessment issues
The mix of edtech to be used needs consideration in light of tasks: synchronous, asynchronous etc..
Mentors and induction help develop engagement with real-time feedback. This is crucial where reflective assessment asks are developed.
Students need support in manipulating digital resources that they capture.
![Page 18: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/18.jpg)
“For assessment or for knowledge?”
![Page 19: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/19.jpg)
Placements• Leicester School of Pharmacy
– Dr Malcolm Andrew: HLS e-Learning Co-ordinator
– Dr Peter Taylor: Placements Tutor• Pilot and develop the learning experience of
placement students by aligning structured reflective tasks and web-based technologies
• Tasks and delivery methods planned with students, and trialled with 8 Pharmaceutical and Cosmetic Sciences’ students on Placement
![Page 20: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/20.jpg)
![Page 21: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/21.jpg)
Placements: student social issues
• Structured interactions to overcome isolation
• Structured interactions to maintain connection
• Social networks and socialisation
• Need for sharing of experiences between staff and students, and those preparing for placement.
• Use of returning Placement students as mentors
![Page 22: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/22.jpg)
Placements: student assessment issues
• Ongoing feedback from tutors and peers
• Reflective learning, linked to a portfolio
• Increasing motivation and understanding of students preparing for placement
• The importance of a range of feedback mechanisms, including face-to-face
![Page 23: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/23.jpg)
Placements: edtech-assessment issues
• Before: favour the use of mobiles and social networks for feedback on tasks/experience
• Before: the use of technologies for reflection that might be assessed not favoured
• During: use correlates with academic support/industrial setting demands
![Page 24: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/24.jpg)
Feedback on Placement•Theory-in-practice: future-proofing; resilience;
pressure; team-work; business context•Managing project issues and taking
responsibility•Emergent networking in a range of contexts•Emotive: warm; no regrets; slowly enjoying it•Developing kinaesthetic/physical skills
•Key for the tutor: “can you come and tell the first and second years about it?!”
![Page 25: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/25.jpg)
Placements: staff assessment issues
• Workloads: feedback, communication, reflective learning, portfolio assessment
• The importance of a range of contact mechanisms, including face-to-face visits
• The value of enhanced communication
• Enhancing the role of industrial supervisors/student mentors
![Page 26: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/26.jpg)
Placements: industrial supervisor issues • Support for personal, private tools that are
“low cost”• Recommended formats/structures for concise
and positive outputs: newsletter style• Focus on impact, surprise, originality, learning• Understanding the curriculum and its delivery
• Risk: social tools that have no business benefit• Risk : confidentiality and reflective tasks
![Page 27: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/27.jpg)
Placements – curriculum delivered • Defining a robust curriculum leading to a
UCPD in WBL – enhancing motivation.• Private [blogging, multimedia] and public
[wiki , multimedia] tasks: reflection, theory in practice
• Mix of institutional and external tools• Pre-placement work is key• Input from industrial and academic
supervisors in reflective activities• Share outputs with prospective placement
students
![Page 28: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/28.jpg)
Assessment: lessons learnt
•Pre-work with all staff and students is critical before the start of the placement/fieldtrip▫Tools to be used▫Activities to be undertaken▫Ground rules for collaboration
•Contextualisation, and scaffolding the experience, is the key determinant of technologies to use for assessment.
![Page 29: MoRSE Project - Emerging Feedback and Assessment Issues](https://reader033.vdocuments.mx/reader033/viewer/2022061112/54571185b1af9fc0638b50da/html5/thumbnails/29.jpg)
Afternoon workshopIn small groups, think about one context or learning task in which you might wish to extend the application of mobile and personal technologies for assessment and feedback.
1.What opportunities would there be in this approach for you?
2.What threats or barriers exist?3.What do you need to do, in order to trial or
pilot one intervention?