what if we could observe all events in a learning environment?

What if we could observeall events in alearning environment?

MUI-TIC, Valladolid, April 2012

Abelardo Pardo

www.slideshare.net/abelardo_pardo

@abelardopardo

Auntie

pflick

r.com

www.slideshare.net/abelardo_pardo

@abelardopardo

Journey to 10 years from now

Abelardo Pardo What if we could observe all events in a learning environment? 2

libra

rym

an

flick

r.com


ribarn

ica

flick

r.com

Analyticstoday


http

://blo

g.s

tephenw

olfra

m.c

om

/2012/0

3/th

e-p

ers

onal-a

naly

tics-o

f-my-life

/

Is she pregnant?



http

://hdguru

.com

/is-yo

ur-n

ew

-hdtv

-watc

hin

g-yo

u/7

643

April

2012

Analytics everywhere!


The

Wall

Stre

etJourn

al,

Feb.

22nd

2012


lave

rrue

flick

r.com

No (unwanted) surprises!


http

://seth

godin

.typepad.c

om

/seth

s_blo

g/2

012/0

2/th

e-illu

sio

n-o

f-priva

cy-a

nd-w

hat-w

e-a

ctu

ally

-care

-about.h

tml

Medicalrecords


Reig

hLeB

lanc

flick

r.com


C.E

lleflick

r.com

(Campbell, De Blois, Oblinger 2007)

Collect

Report

Predict

Act

Refine

The five stepsof analytics


ribarn

ica

flick

r.com

Analyticstoday

Potentialinlearning


Shaylo

rflick

r.com

Did they learn?


Joshua

Rappeneke

rflick

r.com


Bik

ing

Niko

nS

FO

flick

r.com

If you can not measure it,you can not improve it.

bencrowe flickr.com

“We need better evaluationto acknowledge and esteem

excellence when it occurs,as it does.”

John Hattie. Visible Learning: A Synthesis of Over 800Meta-Analyses Relating to Achievement.



bodhith

ajflick

r.com

Learning analytics improvethe feedback loop


bodhith

ajflick

r.com

(Jones, 2011)

Administration Students

Teachers Researchers

Marketingfacts flickr.com

Where is learning analytics?


PranceyDog flickr.com

LA as vertical market

Specialized objectives

Specialized audiences

Specialized topic


www.solaresearch.orgAbelardo Pardo What if we could observe all events in a learning environment? 22

www.solaresearch.org


ribarn

ica

flick

r.com

Analyticstoday

Potentialinlearning

Challenges


ljubar

flick

r.com

More detailed observations

Keep the tutor in the loop

A clearly identifiedenvironment within

your computer


Pepe

Ortu

ño

flick

r.com

Automatic discoveryof complementarylearning resources


Sean

Dre

ilinger

flick

r.com

Measure engagement inout-of-class activities


IAN

RA

NS

LE

YD

ES

IGN

+IL

LU

ST

RAT

ION

flick

r.com


Just in time teaching


em

mm

apeelflick

r.com


jfrave

lflick

r.com

Team dynamics

Quick intuitivefeedback


Stakeholders observe, predict and act


How are you?


Joe

Shalo

btn

ikflick

r.com

Moodchanges



::cala

vera

café

::flick

r.com


purp

leja

vatro

llflick

r.com


Dru

!flick

r.com

ScenarioData setmanipulation

Interventions!

• 15 weeks. Sessions X, F 12-13:30

• 100 students

• 7 score tests per student

• Course notes with 30 “nodes” publishedgradually

• 5 events: forum_view, forum_post,visit_node, use_tool_1, use_tool_2

Make it your own course!


net_

efe

ktflick

r.com

Events (events.csv.gz): around 81,000 x 4 matrix

datetime,event_type,user,payload

2011-09-05 15:26:01,use_tool_1,7a869b4d9,block_1

...

Scores (scores.csv.gz): 100 x 7 matrix

user,score_1,score_2,score_3,score_4,...,score_7

7a869b4d9, 6.4, 9.0, 7.9, 7.6, 5.1, 5.5, 6.7

...


jovike

flick

r.com


Let’s explore!


cesara

stu

dillo

flick

r.com

Analyze, propose, discuss

theunquietlibrarian flickr.com

1 What did you observe?

2 Which data is missing?

3 What would you do?

4 What would the system do?

Which challenge for LA do you envision?


script.R

1 Load data into “data frames”

2 Show data summaries

3 Change type of column in data frame

4 View sample histogram

5 Add a column with the mean scores

6 Plot scores for one student

7 Separate events into types

8 Merge event counts with scores

Select command + CRTL-Return (Execute)


para

l_la

xflick

r.com

R cheat sheet

• Data frame: heterogeneous matrix,“events.csv”

• Data frame column: events.csv$event_type

• Arrays: c(’one’, ’two’, ’three’), c(1, 2, 3),c(2:8)

• Sequences: 1:5, seq(1, 6)

• Graphics: barplot(), boxplot(), hist(), plot()

• Functions: length(), rownames(),colnames(), mean()

• cor() (correlation), var() (variance)

• mean(), median(), min(), max(), sum()


Cals

idyro

se

flick

r.com

R tests

• cor.test(v1, v2)

• wilcox.test(v1, v2)

• shapiro.test(v1)

R help

• help(any function name)

• Various cheatsheets included in workspace(cheatsheet_*.pdf)


Cals

idyro

se

flick

r.com

References

The personal analytics of my life

Stephen Wolframhttp://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/

How waiters read your table

Sara NassauerThe Wall Street Journal, Feb. 22nd 2012

The illusion of privacy (and what we actually care about)

Seth Godinhttp://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-what-we-actually-care-about.html

Academic Analytics

Campbell J., DeBlois P., Oblinger D.EDUCAUSE White paper, 2007

Visible learning: A synthesis of over 800 meta-analyses related to achievement

Hattie, J. A. C.Routledge, New York 2009

Learning analytics: Starvation and telling us what we already know?

David Joneshttp://davidtjones.wordpress.com/2012/04/01/learning-analytics-starvation-and-telling-us-what-we-already-know/


http://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/

http://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-what-we-actually-care-about.html

http://davidtjones.wordpress.com/2012/04/01/learning-analytics-starvation-and-telling-us-what-we-already-know/

what if we could observe all events in a learning environment?

Education