personalization & adaptivity

48
Turning Data into Personalized Student Experiences George Siemens, PhD May 14, 2013 Presented to IMS Global

Upload: gsiemens

Post on 06-May-2015

2.096 views

Category:

Education


2 download

DESCRIPTION

Presented to IMS Global Conference, San Diego, 2013

TRANSCRIPT

Page 1: Personalization & Adaptivity

Turning Data into Personalized Student Experiences

George Siemens, PhDMay 14, 2013Presented to

IMS Global

Page 2: Personalization & Adaptivity

Technique: Baker and Yacef (2009) five primary areas of analysis:

- Prediction- Clustering- Relationship mining- Distillation of data for human judgment- Discovery with models

Page 3: Personalization & Adaptivity

Application: Bienkowski, Feng, and Means (2012) five areas of LA/EDM application:

- Modeling user knowledge, behavior, and experience- Creating profiles of users- Modeling knowledge domains- Trend analysis- Personalization and adaptation

Page 4: Personalization & Adaptivity
Page 5: Personalization & Adaptivity

LA approach Example

Techniques 

Modeling Attention metadata

  Learner modeling

  Behavior modeling

  User profile development

Relationship Mining Discourse analysis

  Sentiment analysis

  A/B Testing

  Neural networks

Knowledge Domain Modeling

Natural language processing

  Ontology development

  Assessment (matching user knowledge with knowledge domain)

Siemens 2013: Adapted from Bienkowski et al, 2012, Baker & Yacef, 2009, Baker & Siemens 2013

Page 6: Personalization & Adaptivity

LA approach Example

Applications 

Trend Analysis and Prediction

Early warning, risk identification

  Measuring impact of interventions

  Changes in learner behavior, course discussions, identification of error propagation

Personalization/Adaptive learning

Recommendations: content and social connections

  Adaptive content provision to learners

  Attention metadata

Structural analysis Social network analysis

  Latent semantic analysis

  Information flow analysisSiemens 2013: Adapted from Bienkowski et al, 2012, Baker & Yacef, 2009, Baker & Siemens 2013

Page 7: Personalization & Adaptivity

Context

Page 8: Personalization & Adaptivity

The Conference Board & McKinsey & Co

Page 9: Personalization & Adaptivity

McKinsey Quarterly, 2012

Page 10: Personalization & Adaptivity

Increasing diversity of student profiles

The U.S. is now in a position when less than half of students could be considered fulltime students. In other words, students who can attend campus five days a week nine-to-five, are now a minority.

(Bates, 2013)

Page 11: Personalization & Adaptivity

Increasingly: learning across traditional boundaries (i.e. work, outside of classroom, hobby)

Page 12: Personalization & Adaptivity

Ok, on to adaptivity, personalization

Page 13: Personalization & Adaptivity

LA approach Example

Applications 

Trend Analysis and Prediction

Early warning, risk identification

  Measuring impact of interventions

  Changes in learner behavior, course discussions, identification of error propagation

Personalization/Adaptive learning

Recommendations: content and social connections

  Adaptive content provision to learners

  Attention metadata

Structural analysis Social network analysis

  Latent semantic analysis

  Information flow analysisSiemens 2013: Adapted from Bienkowski et al, 2012, Baker & Yacef, 2009, Baker & Siemens 2013

Personalization as the holy grail of learning

Page 14: Personalization & Adaptivity
Page 15: Personalization & Adaptivity

(btw – this isn’t new)

Rich, 1979All those CMU folks Fischer, 2001

Page 16: Personalization & Adaptivity

How does it work?

Page 17: Personalization & Adaptivity

First, a knowledge domain is mapped

Page 18: Personalization & Adaptivity

http://www.plosone.org/article/info:doi/10.1371/journal.pone.0004803

Page 21: Personalization & Adaptivity
Page 22: Personalization & Adaptivity

http://linkeddata.org/

Page 23: Personalization & Adaptivity
Page 24: Personalization & Adaptivity

(again, not new)

Novak, 1990 (concept mapping)Semantic web: Berners-Lee, Hendler, Lassila, 2001Brusilovsky, 2001

Page 25: Personalization & Adaptivity

Next, the learner is modeled/profiled

Page 26: Personalization & Adaptivity

Cognitive stylesCognitive modelsLearning preferences (by various criteria)Tutors (cognitive, intelligent)

Page 27: Personalization & Adaptivity

(Also, not new)

Anderson, Corbett, Koedinger, Pelletier, 1995That shady learning styles literature Burns, 1989

Page 28: Personalization & Adaptivity

Knowledge domain + learner profile/knowledge +

? = Personalization!

The ? varies: from algorithms to pixie dust to chicken bones

Page 29: Personalization & Adaptivity

State of Wisconsin, 2012

Page 30: Personalization & Adaptivity

State of Wisconsin, 2012

Page 31: Personalization & Adaptivity

So, what about creative processes?

AI/ML/analytics aren’t useful here, are they?

Page 32: Personalization & Adaptivity

“We’ve been interested in pushing computing to a new direction, computational creativity. We’re trying to draw on data sets, not just to make inferences about the world, but to create new things you’ve never seen”

Lav Varshney on Watson

http://www.fastcodesign.com/1672444/try-a-recipe-devised-by-ibms-supercomputer-chef

Page 33: Personalization & Adaptivity

“An Ecuadorian strawberry dessert algorithmically maximized for pleasantness”

http://www.fastcodesign.com/1672444/try-a-recipe-devised-by-ibms-supercomputer-chef

Page 34: Personalization & Adaptivity
Page 35: Personalization & Adaptivity

“For as much as $20,000 per script…a team of analysts compare the story structure and genre of a draft script with those of released movies, looking for clues to box-office success.”

Page 36: Personalization & Adaptivity

The need to sensemake

Page 37: Personalization & Adaptivity

Sensemaking

“Sensemaking is a motivated, continuous effort to understand connections . . . in order to anticipate their trajectories and act effectively”

(Klein et al. 2006)

Page 38: Personalization & Adaptivity

or

“Sensemaking is about labeling and categorizing to stabilize the streaming of experience”

(Weick et al. 2005: 411)

Page 39: Personalization & Adaptivity

We socially sensemake through stories, narratives, knowledge exchange, discourse

Page 40: Personalization & Adaptivity

We turn to technical approaches when the data exceeds our capacity to create social discourse

around it

But, in fairness, once we technically sensemake, we turn to narrative to share

Page 41: Personalization & Adaptivity
Page 42: Personalization & Adaptivity

Adaptivity/Personalization addresses these quadrants

Page 43: Personalization & Adaptivity

The future of work is in these quadrants

Page 44: Personalization & Adaptivity

LA interoperability

Page 45: Personalization & Adaptivity

Open Learning Analytics

Page 46: Personalization & Adaptivity
Page 47: Personalization & Adaptivity

47

Page 48: Personalization & Adaptivity

Twitter/Gmail: gsiemens