![Page 1: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/1.jpg)
Streamlined OrchestrationPeer Tutoring OrchestrationStreamlined Technology-driven Orchestration for Peer Tutoring
Lighton Phiri1 · Christoph Meinel2 · Hussein Suleman1
1 University of Cape Town, Cape Town, South Africa2 Hasso Plattner Institute, Potsdam, Germany
CSEDU 2017 · Porto, Portugal · April 21–23 2017
![Page 2: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/2.jpg)
About us (1)
2
https://commons.wikimedia.org
![Page 3: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/3.jpg)
About us (2)
3
Richard Whittemore/Flickr
![Page 4: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/4.jpg)
About us (3)
4
http://ict4d.cs.uct.ac.za
![Page 5: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/5.jpg)
Introduction
5
Formal learning spaces can become effective by supporting educators with orchestration.
http://www.uct.ac.za
![Page 6: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/6.jpg)
Orchestration is extremely challenging
6
Contemporary orchestration is extremely challenging and arguably ad hoc.
Streamlined orchestration—attainable through explicit organisation of enactment activities—could potentially make educators more effective.
Streamlined Orchestration (Computers & Education 2016).Lighton Phiri, Christoph Meinel and Hussein Suleman.
![Page 7: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/7.jpg)
Technology-driven organised orchestration for peer tutoring
7
The objective of this work was to investigate the applicability of technology-driven
organised orchestration when applied to the peer tutoring educational setting.
![Page 8: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/8.jpg)
The case of large-scale peer tutoring
8
Peer tutoring involves smaller manageable groups of students learning with or from each other.
However● Tutors sometimes
lack experience.● Tutorial sessions
are usually lack structure.http://www.uct.ac.za
![Page 9: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/9.jpg)
Peer tutoring model in study context
9
Course Students Tutors Tutorial Groups
CSC1015F 754 38 12CSC1017F 165 9 3CSC1010H 80 6 5CSC1011H 26 2 2
![Page 10: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/10.jpg)
Peer tutoring orchestration toolkit
10
Source: http://simba.cs.uct.ac.za/indefero
Implementation based on IMS Global Simple Sequencing standard. Directed path used for toolkit.
![Page 11: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/11.jpg)
Peer tutoring toolkit functionality
11
Pre-session ManagementActivity
Management
Resource Management
Sequencing
Session Management
Playback Sequence Chain
Access Resources
![Page 12: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/12.jpg)
Instrumentation
12
● Orchestration load and usability measured.
○ NASA Task Load Index (NASA-TLX) used to measure orchestration load.
○ Perceived Usefulness and Ease of Use used to measure usability.
![Page 13: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/13.jpg)
Evaluation setup
13
● Laboratory study involving 24 tutors for first year Computer Science modules.○ One-on-one hour-long sessions.
![Page 14: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/14.jpg)
Participants demographics
14
● Participants’ levels, experience and courses tutored were noted. Tools used in sessions noted.
Level of study
ExperienceTutoring
CoursesTutored
![Page 15: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/15.jpg)
Evaluation procedure
15
Tasks NASA-TLX PUEU
● Three tasks conducted: (1) activity management, (2) resource management and (3) sequencing.
![Page 16: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/16.jpg)
Evaluation procedure
16
Tasks NASA-TLX PUEU
● Pairwise comparison of six NASA-TLX subscales● Rating of each of the six NASA-TLX subscales
![Page 17: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/17.jpg)
Evaluation procedure
17
Tasks NASA-TLX PUEU
● PUEU questionnaire after completing the three experimental tasks.
![Page 18: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/18.jpg)
Organised orchestration imposes acceptable workload
18
![Page 19: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/19.jpg)
Resource managed imposes the most workload
19
![Page 20: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/20.jpg)
Perceived usefulness scores
20
A. Perceived Usefulness 5.12 (1.14)1. Accomplish tasks quickly 4.50 (1.67)2. Improve job performance 5.42 (1.18)3. Increase productivity 5.25 (1.15)4. Enhance effectiveness 5.38 (1.41)5. Easier to do my job 4.71 (1.63)6. I would find system useful 5.46 (1.41)
![Page 21: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/21.jpg)
Perceived ease of use scores
21
B. Perceived Ease of Use 5.80 (0.85)7. Learning system would be easy 6.25 (1.15)8. Easy to do what I want to do 5.46 (1.69)9. Clear and understandable 5.79 (1.10)
10. Flexible to interact with 4.83 (1.40)11. Ease to become skillful 6.33 (0.82)12. I would find system easy to use 6.13 (1.12)
![Page 22: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/22.jpg)
Conclusions and future work
22
● We set out to investigate the effect of technology-driven organised orchestration when applied to peer tutoring.○ Organised technology-driven orchestration for
peer tutoring is potentially feasible.○ Toolkit potentially usable and useful.
● An experiment is scheduled to assess viability of the tool, with a focus on the in-session activities.
![Page 23: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/23.jpg)
23
Thank you for your time!Questions?
![Page 24: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/24.jpg)
Streamlined OrchestrationPeer Tutoring OrchestrationStreamlined Technology-driven Orchestration for Peer Tutoring
Lighton Phiri1 · Christoph Meinel2 · Hussein Suleman1
1 University of Cape Town, Cape Town, South Africa2 Hasso Plattner Institute, Potsdam, Germany
CSEDU 2017 · Porto, Portugal · April 21–23 2017
![Page 25: Peer Tutoring Orchestration - Lighton Phirilightonphiri.org/wp-content/uploads/2018/12/talks-csedu17-peer_orchestration.pdfPeer Tutoring OrchestrationStreamlined Orchestration Streamlined](https://reader036.vdocuments.mx/reader036/viewer/2022062414/5e8bf2dc9d36903cbc7c56a4/html5/thumbnails/25.jpg)
25
Laptop Project@ UCT
ICT4RED in Cofimvaba
Classroom Renewal@ UCT
One Laptop per Child
Backup slides: philosophical argument
25