the impact of learning design on student behaviour, satisfaction and performance - bart rienties |...
TRANSCRIPT
![Page 1: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/1.jpg)
Video Delivery Partner
![Page 2: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/2.jpg)
The impact of learning design on student behaviour, satisfaction and performance: a cross-institutional comparison across 151 modules
@DrBartRientiesReader in Learning Analytics
Lisette ToetenelSenior manager Learning Design
![Page 3: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/3.jpg)
![Page 4: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/4.jpg)
![Page 5: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/5.jpg)
![Page 6: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/6.jpg)
![Page 7: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/7.jpg)
![Page 8: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/8.jpg)
![Page 9: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/9.jpg)
![Page 10: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/10.jpg)
![Page 11: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/11.jpg)
![Page 12: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/12.jpg)
![Page 13: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/13.jpg)
Assimilative Finding and handling information
Communication
Productive Experiential Interactive/
Adaptive
Assessment
Type of activity
Attending to information
Searching for and processing information
Discussing module related content with at least one other person (student or tutor)
Actively constructing an artefact
Applying learning in a real-world setting
Applying learning in a simulated setting
All forms of assessment, whether continuous, end of module, or formative (assessment for learning)
Examples of activity
Read, Watch, Listen, Think about, Access, Observe, Review, Study
List, Analyse, Collate, Plot, Find, Discover, Access, Use, Gather, Order, Classify, Select, Assess, Manipulate
Communicate, Debate, Discuss, Argue, Share, Report, Collaborate, Present, Describe, Question
Create, Build, Make, Design, Construct, Contribute, Complete, Produce, Write, Draw, Refine, Compose, Synthesise, Remix
Practice, Apply, Mimic, Experience, Explore, Investigate, Perform, Engage
Explore, Experiment, Trial, Improve, Model, Simulate
Write, Present, Report, Demonstrate, Critique
![Page 14: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/14.jpg)
![Page 15: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/15.jpg)
Method – data sets• Combination of four different data sets:
• learning design data (189 modules mapped, 276 module implementations included)
• student feedback data (140)• VLE data (141 modules)• Academic Performance (151)
• Data sets merged and cleaned• 111,256 students undertook these modules
![Page 16: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/16.jpg)
Toetenel, L. & Rienties, B. (2016). Analysing 157 Learning Designs using Learning Analytic approaches as a means to evaluate the impact of pedagogical decision-making. British Journal of Educational Technology.
![Page 17: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/17.jpg)
Toetenel, L. & Rienties, B. (2016). Analysing 157 Learning Designs using Learning Analytic approaches as a means to evaluate the impact of pedagogical decision-making. British Journal of Educational Technology.
![Page 18: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/18.jpg)
Constructivist Learning Design
Assessment Learning Design
Productive Learning Design
Socio-construct. Learning Design
VLE Engagement
Student Satisfaction
Student retention
Learning Design151 modules
Week 1 Week 2 Week30+
Disciplines LevelsSize module
Rienties, B., Toetenel, L., (2016). The impact of learning design on student behaviour, satisfaction and performance: a cross-institutional comparison across 151 modules. Computers in Human Behavior, 60 (2016), 333-341
![Page 19: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/19.jpg)
Average time spent per week in VLE
![Page 20: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/20.jpg)
Cluster 1 Constructive (n=73)
![Page 21: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/21.jpg)
Cluster 2 Assessment (n=10)
![Page 22: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/22.jpg)
Cluster 3 Productive (n=38)
![Page 23: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/23.jpg)
Cluster 4 Social Constructivist (n=20)
![Page 24: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/24.jpg)
Week Assim Find Com. Prod Exp Inter Asses Total
-2 -.03 .02 -.02 -.09 .20* -.03 .01 .35** -1 -.17* .14 .14 -.01 .30** -.02 -.05 .38**
0 -.21* .14 .37** -.07 .13 .08 .02 .48**
1 -.26** .25** .47** -.02 .28** .01 -.1 .48**
2 -.33** .41** .59** -.02 .25** .05 -.13 .42**
3 -.30** .33** .53** -.02 .34** .02 -.15 .51**
4 -.27** .41** .49** -.01 .23** -.02 -.15 .35**
5 -.31** .46** .52** .05 .16 -.05 -.13 .28**
6 -.27** .44** .47** -.04 .18* -.09 -.08 .28**
7 -.30** .41** .49** -.02 .22** -.05 -.08 .33**
8 -.25** .33** .42** -.06 .29** -.02 -.1 .32**
9 -.28** .34** .44** -.01 .32** .01 -.14 .36**
10 -.34** .35** .53** .06 .27** .00 -.13 .35**
![Page 25: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/25.jpg)
Model 1 Model 2 Model 3
Level0 -.279** -.291** -.116
Level1 -.341* -.352* -.067
Level2 .221* .229* .275**
Level3 .128 .130 .139
Year of implementation .048 .049 .090
Faculty 1 -.205* -.211* -.196*
Faculty 2 -.022 -.020 -.228**
Faculty 3 -.206* -.210* -.308**
Faculty other .216 .214 .024
Size of module .210* .209* .242**
Learner satisfaction (SEAM) -.040 .103
Finding information .147
Communication .393**
Productive .135
Experiential .353**
Interactive -.081
Assessment .076
R-sq adj 18% 18% 40%
n = 140, * p < .05, ** p < .01 Table 3 Regression model of LMS engagement predicted by institutional, satisfaction and learning design analytics
• Level of study predict VLE engagement
• Faculties have different VLE engagement
• Learning design (communication & experiential) predict VLE engagement (with 22% unique variance explained)
![Page 26: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/26.jpg)
Model 1 Model 2 Model 3
Level0 .284** .304** .351**
Level1 .259 .243 .265
Level2 -.211 -.197 -.212
Level3 -.035 -.029 -.018 Year of implementation .028 -.071 -.059
Faculty 1 .149 .188 .213*
Faculty 2 -.039 .029 .045
Faculty 3 .090 .188 .236* Faculty other .046 .077 .051
Size of module .016 -.049 -.071 Finding information -.270** -.294**
Communication .005 .050
Productive -.243** -.274** Experiential -.111 -.105
Interactive .173* .221* Assessment -.208* -.221*
LMS engagement .117
R-sq adj 20% 30% 31%
n = 150 (Model 1-2), 140 (Model 3), * p < .05, ** p < .01 Table 4 Regression model of learner satisfaction predicted by institutional and learning design analytics
• Level of study predict satisfaction
• Learning design (finding info, productive, assessment) negatively predict satisfaction
• Interactive learning design positively predicts satisfaction
• VLE engagement and satisfaction unrelated
![Page 27: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/27.jpg)
Model 1 Model 2 Model 3
Level0 -.142 -.147 .005
Level1 -.227 -.236 .017
Level2 -.134 -.170 -.004
Level3 .059 -.059 .215
Year of implementation -.191** -.152* -.151*
Faculty 1 .355** .374** .360**
Faculty 2 -.033 -.032 -.189*
Faculty 3 .095 .113 .069
Faculty other .129 .156 .034
Size of module -.298** -.285** -.239**
Learner satisfaction (SEAM) -.082 -.058
LMS Engagement -.070 -.190*
Finding information -.154
Communication .500**
Productive .133
Experiential .008
Interactive -.049
Assessment .063
R-sq adj 30% 30% 36%
n = 150 (Model 1-2), 140 (Model 3), * p < .05, ** p < .01
Table 5 Regression model of learning performance predicted by institutional, satisfaction and learning design analytics
• Size of module and discipline predict completion
• Satisfaction unrelated to completion
• Learning design (communication) predicts completion
![Page 28: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/28.jpg)
Constructivist Learning Design
Assessment Learning Design
Productive Learning Design
Socio-construct. Learning Design
VLE Engagement
Student Satisfaction
Student retention
150+ modules
Week 1 Week 2 Week30+
Rienties, B., Toetenel, L., (2016). The impact of learning design on student behaviour, satisfaction and performance: a cross-institutional comparison across 151 modules. Computers in Human Behavior, 60 (2016), 333-341
Communication
![Page 29: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/29.jpg)
![Page 30: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/30.jpg)
![Page 31: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/31.jpg)
Toetenel, L., Rienties, B. (2016) Learning Design – creative design to visualise learning activities. Open Learning.
![Page 32: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/32.jpg)
![Page 33: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/33.jpg)
The impact of learning design on student behaviour, satisfaction and performance: a cross-institutional comparison across 151 modules
@DrBartRientiesReader in Learning Analytics
Lisette ToetenelSenior manager Learning Design
![Page 34: The Impact of Learning Design on Student Behaviour, Satisfaction and Performance - Bart Rienties | Talis Insight Europe 2016](https://reader035.vdocuments.mx/reader035/viewer/2022081604/587004d51a28ab427f8b5cc9/html5/thumbnails/34.jpg)
Video Delivery Partner