learning analytics - door data gestuurd leren

Learning AnalyticsDoor data gestuurd leren

Joris Klerkx Research Expert, PhD. http://hci.cs.kuleuven.be @jkofmsk

Erik Duval Professor http://hci.cs.kuleuven.be @erikd

Studienamiddag - Learning analytics - HU Brussel - 22 mei 2014

1

Our team:Human-Computer Interaction !

technology enhanced learning music research (personal) health

2

3 http://eng.kuleuven.be/datavislab/

http://www.slideshare.net/jkofmsk

4

About learning…

5

we are teaching students to solve problems we don't know using technologies we don't know

6

we are should be teaching students to solve problems we don't know using technologies we don't know

7

http://www.flickr.com/photos/jonbecker/4625331304/8

http

://w

ww.

yout

ube.

com

/wat

ch?v

=p0w

k4qG

2mIg

http

://w

ww.

lear

ner.o

rg/v

od/v

od_w

indo

w.ht

ml?

pid=

9

9

10

Motivation - empowerment

11

http://www.motivationhacker.com/motivation-is-situational-not-a-personality-trait/

Motivation - empowerment

12

Meten = Weten

13

Ex cathedra - exams

http://www.flickr.com/photos/wolflawlibrary/2417195782/14

Fake learning

15

exams

Judge a man by his questions/actions rather than by his answers…Voltaire

16

Continuous monitoring

exams

before - during - after

17

Learning analytics

18

Collecting traces that learners leave behind and using those traces to improve

learning

http://erikduval.wordpress.com/2012/01/30/learning-analytics-and-educational-data-mining/

Learning analytics

19

What to measure? Depends on the user

20

Analytics for Students access to learning resourcesposts in discussion foralogins to learning management systemsposts of assignmentsreplies to postsvotes in lecture response systemstime on page in electronic textbooklocation of device used to access course(and thus proximity to other users)software lines producedcontributions to shared documents or wikis

etc.

Who? !

!

What? !

!

When?

21

Analytics for professors

22

23

email, twitter, facebook, web reading, physical movement, location, proximity, food intake, sleeping, drinking, emotion tracking, weather info, attention, brainwaves, …

As learning moves online, traces also include…

Relevant? 24

http://bigtablechi13.appspot.com/dashboard.jsp

Learning Dashboards

25

Raw Aggregated

Conceptual process model

26

awareness

(self) reflection

sense making

impact

data

questions

answers

behavior change or new meaning

27

How can data on relevant actions be captured?

Inspiration

28

Inspiration

quantifiedself.com

29

http://www.fitbit.com/

Sensors

30

31

32

https://www.rescuetime.com/

Software Sensors

33

Web Analytics - trackers34

35

https://jawbone.com/up/coffee

Self-reporting

36

http://developer.runkeeper.com/healthgraph

Sharing, Comparing with your friends

37

What else do people track?

38

http://quantifiedself.com/QSLondon_Survey_overview.pdf 39

Making sense of the data

Raise awareness & Reflection

40

http://www.slideshare.net/infoscape41

42

algorithm <>

human

43

Trust?

http://www.demorgen.be/dm/nl/5403/Internet/article/detail/1890428/2014/05/18/Twitteractiviteit-verraadt-je-politieke-profiel.dhtml44

Number crunching <>

Human perception

45

Anscombe’”⁹s quartet ! uX = 9.0 uY = 7.5 sigma X = 3.317 sigma Y = 2.03 Y = 3 + 0.5X

http://en.wikipedia.org/wiki/Anscombe's_quartet

46

Educational Data mining

Data VisualisationVisual Dashboards

<>

47

Example dashboards

48

49

http://www.snappvis.org

50

http://www.engadget.com/2013/01/09/kno-launches-kno-me-interactive-textbook-metrics-lets-you-stu/

51

Khaled  Bachour,  Frederic  Kaplan,  Pierre  Dillenbourg,  "An  Interac:ve  Table  for  Suppor:ng  Par:cipa:on  Balance  in  Face-­‐to-­‐Face  Collabora:ve  Learning,"  IEEE  Transac:ons  on  Learning  Technologies,  vol.  3,  no.  3,  pp.  203-­‐213,  July-­‐September,  2010  

52

http://gigaom.com/2013/06/19/new-augmented-reality-glasses-let-teachers-know-when-their-students-are-falling-behind/

T. Zarraonandia, I. Aedo, P. Dıaz, and A. Montero. An augmented lecture feedback system to support learner and teacher communication. British Journal of Educational Technology, 44(4):616–628, 2013.

53

54

What we do

55

56

57

58

59

60

61

62

63

http

://to

mde

buys

er.u

lyss

is.b

e/to

pija

/Cod

e/Vi

sual

izat

ionV

2_1.

htm

l

64

65

Abundance of data?

http://ariadne.cs.kuleuven.be/LARAe/chi14/67

68

69

70

71Tabletops

J. Santos, S. Charleer, G. Parra, J. Klerkx, E. Duval, and K. Verbert. Evaluating the use of open badges in an open learning environment. In D. Hernandez-Leo, T. Ley, R. Klamma, and A. Harrer, editors, Scaling up Learning for Sustained Impact, volume 8095 of Lecture Notes in Computer Science, pages 314–327. Springer Berlin Heidelberg, 2013.72

73

74

In-class display

75

Measuring sentiment

76

Measuring emotion

Privacy? Control?

77

Fear Uncertainty Doubt

78

http://www.slideshare.net/abelardo_pardo/ethics-and-privacy-in-learning-analytics#

Attention Trust (2005)

Property

Mobility

(Economy)

TransparancyData access policies

79

http://quantifiedself.com/QSLondon_Survey_overview.pdf 80

QS community

When

81

http://www.nmc.org/pdf/2014-nmc-horizon-report-he-EN.pdf82

83

Also: you?

84

what can we measure & how is it relevant? what is relevant & how can we measure it?

85

Thank you for your attention!

joris.klerkx@cs.kuleuven.be

@jkofmsk

86