combining vicarious and enactive training in is: does order matter?
TRANSCRIPT
Combining vicarious and enactive training in IS : Does order matter ?
PIERRE-MAJORIQUE LÉGER, Ph.D.Co-director Tech3Lab, HEC MontréalFÉLIX G. LAFONTAINEHEC MontréalÉLISE LABONTE-LEMOYNE, Ph.D.HEC MontréalPATRICK CHARLAND, Ph.D.Université du Québec à Montréal PAUL CRONAN, Ph.D.University of Arkansas
GARTNER PREDICTS :
‘‘By 2017, most business users will have access to technologies that will enable them to prepare and analyze data’’ Source :Parenteau, J., Chandler, N., L. Salam, R., Laney D., D. Duncan, A. Predicts 2015: Power Shift in Business Intelligence and Analytics Will Fuel Disruption (ID: G00270932). Retrieved from Gartner database. (2014, November 21)
Dashboard and user attentional efficiency
© Copyright Tech3Lab 2016
Research goals and hypothesisCombination of enactive learning and vicarious learning leads to greater learning outcomes, but in which order ?
H1 : Vicarious training accelerates the attentional efficiency of the learner.H2 : Order does not impact learning outcome
© Copyright Tech3Lab 2016
Experimental Design
© Copyright Tech3Lab 2016
VICARIOUS TRAINING ▪ 15 minutes demonstration video including a voiceover
explaining the different principles that guided the creations of the different indicators and which of them were useful in the context of a given task.
ENACTIVE TRAINING ▪ 15 minutes enactive training in which the participants
were asked to perform a task in the simulated busi-ness environment, i.e. ERPsim (Montréal, Canada) using an online dashboard and a SAP GUI.
CONDITION 1
CONDITION 2
FIRST TRAINING
SECOND TRAINING
VICARIOUS
VICARIOUS
ENACTIVE
ENACTIVE
© Copyright Tech3Lab 2016
Experimental StimuliERPSIM
ONLINE DASHBOARD
4 Types of Indicators
▪ useful information, well presented
▪ useful information, badly presented
▪ useless in-formation, well presented
▪ useless information, badly presented
Lab Serious games to learn enterprise systems and business analytics
1234
1
2 3
4
Sample indicators for the inventory data
© Copyright Tech3Lab 2016
Tobii EyeTracker X60
© Copyright Tech3Lab 2016
Instruments ▪ ERPsim Simulation Game (Logistics Version)
▪ Tobii X60 EyeTracker
▪ Online Self-Refreshing Dashboard
MeasuresAttentional efficiency (Eyetracking measure)
▪ Average Visit Duration
Learning Outcomes ▪ Learning (Objective and Perceived Knowledge)
▪ Dashboard Self-Efficacy
▪ Satisfaction with the learning process
▪ Enterprise System Management Knowledge
© Copyright Tech3Lab 2016
Pre Questionnaire Post Questionnaire
Pre Questionnaire Post Questionnaire
Vicarious Training(15 minutes)
Vicarious Training(15 minutes)
Enactive Training(15 minutes)
Enactive Training(15 minutes)
Experiment Timeline
Condition 1
Condition 2
T1 (�rst 5m) T3 (last 5m)
© Copyright Tech3Lab 2016
ResultsATTENTIONAL EFFICIENCY
LEARNING OUTCOMES
▪ Average Visit Duration :
▪ Learning (Objective and Perceived Knowledge)
▪ Dashboard Self-Efficacy
▪ Satisfaction with the learning process
▪ Enterprise System Management Knowledge
© Copyright Tech3Lab 2016
Eye fixations Triangulation and machine learning
Visualization of emotion and/or cognitive states at fixation
Next step ENABLING THE VISUALIZATION OF TRIANGULATED ATTENTION, EMOTIONAL, AND COGNITIVE MEASURES.
Courtemanche, F., P.-M. Léger, M. Frédette, S. Sénécal, and A. Dufresne (2015) Method and Product for Visualizing the Emo-tions of a User, Provisional patent application. US 62/121,552 p. 14.
PATENT PENDING
© Copyright Tech3Lab 2016
Dashboard visual efficiency: Bar Chart vs Bubble Chart
BAR CHART BUBBLE CHART
© Copyright Tech3Lab 2016
BAR CHART
BUBBLE CHART
POSITIVE VALENCE AT FIXATION
NEGATIVE VALENCE AT FIXATION
PUPIL DILATION AT FIXATION
Dashboard visual efficiency: Bar Chart vs Bubble Chart
© Copyright Tech3Lab 2016
POSITIVE VALENCE AT FIXATION
NEGATIVE VALENCE AT FIXATION
PUPIL DILATION AT FIXATION
BAR CHART
BUBBLE CHART
Dashboard visual efficiency: Bar Chart vs Bubble Chart
Thank you!