introduction to learner analytics session at oslo open forum conferences prior to iso/iec jtc 1/sc36...

18
Learning Analytics and Standardisation – projects and initiatives Tore Hoel Wilbert Kraan Oslo Open Forum 20 June 2014

Post on 19-Oct-2014

239 views

Category:

Education


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

Learning Analytics and Standardisation –

projects and initiatives Tore Hoel

Wilbert Kraan

Oslo Open Forum 20 June 2014

Page 2: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

Creative Commons Attribution-ShareAlike

This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.

Page 3: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

What is Learning Analytics? The measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs

(Society for Learning Analytics Research – SoLAR)

Page 4: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

Not Theoretical Insights!

Not reporting!

Actionable intelligence!

Page 5: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

Learning Analytics Community Exchange (LACE project)

●  European Union Support & Coordination project ●  24 more months to go ●  9 partners (Norway, Sweden, UK, Belgium,

Netherlands and Italy) ●  Focus areas

o  Schools o  Higher Education o  Industry o  Interoperability & Data Sharing

Page 6: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

ISO.. SC36 WG4 Study Period Studies: ●  Korean report on Big Data & LA ●  IMS Caliper Proposal: ●  Should SC36 develop a multi-part standard? ●  What would be the sources?

Page 7: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

Possible parts in a new ISO standard ●  Conceptual Framework ●  System Requirements ●  Privacy Protection Guidelines ●  Accessibility Guidelines ●  Quality Metrics ●  Data Crawling ●  Reference Software ●  Implementation Guide

Page 8: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

ADL et al.

xAPI ●  Basic data model: o  ‘Learner’ ‘created’ ‘activity’

●  High level property vocabulary ●  An API for communicating activity ●  Open source implementation

Page 9: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

IMS Global Caliper: ●  Vocabulary for student activities:

o  “metric profiles” ●  An API for communicating activity data

o  “Sensor API” ●  Designed to work with existing IMS specs:

LTI, QTI ●  Implementation imminent

Page 10: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

Open Learning Analytics (SoLAR) initiative

●  Summit April 2014 (after LAK 14) ●  Identified OLA domains:

o  open research (e.g. open datasets, open predictive models, etc.),

o  institutional strategy and policy issues, and o  learning sciences/learning design and open

standards/open-source software ●  Open Learning Analytics Architecture

Page 11: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

LACE Interoperability work so far... ●  Started a series of Webinars ●  Identified that 'soft issues' are extremely

important from an implementation perspective

●  Consensus needed on privacy issues, access to data, users’ control of their own data, stakeholder responsibilities, etc.

Page 12: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

CETIS conference cultural issues ●  How do we convince management of the return on investment of

analytics? ●  Where do we start: the problem to be addressed or the data available? ●  What information do we not want to know? (privacy law) ●  How do we get out of the deficit model of student achievement? ●  How do we overcome resistance to change? ●  Where do we get statisticians / data scientists from? ●  How do we make insights actionable? ●  How do we deal with the US bias in the data structures of some of our

systems?

Page 13: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

CETIS conference tech issues ●  How do we distinguish correlation from causation? ●  How do we get reliable data / avoid students gaming the system? ●  How do we identify the useful data in the wealth of available data? ●  How do we make sense of raw data; what does "student is in the

building” mean? ●  How do we get relevant data from outside the institution? ●  How do we get data from multiple (legacy) systems to

interoperate? ●  How do we deal with missing longitudinal data? ●  How do we make data comparable between institutions?

Page 14: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

Workshop on LA in Japan Nov/Dec 1st ICCE workshop on Learning Analytics (LA): Leveraging Educational Data for Adaptive Learning and Teaching ICCE 2014 conference in Nara (30 November - 4 December)

Submit your workshop paper!

Page 15: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

And then we have MOOCs... This Monday we got the Norwegian MOOCs Commission’s Report ●  Suggests 2 mill € yearly for Research,

Development and Community Exchange Activities the next few years

Page 16: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

What more…?

Page 17: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

Panel

Page 18: Introduction to Learner Analytics Session at Oslo Open Forum Conferences prior to ISO/IEC JTC 1/SC36 meeting in Oslo June 2014

●  Hans Petter Røkholt, Connexus, Norway ●  Rob Abel, IMS Global, USA ●  Pierre-Julien Guay, GTN-Québec / Vitrine technologie-

éducation, Canada ●  Ingrid Melve, Uninett, Norway ●  Steve Lay, Question Mark, UK ●  Yasu Tamura, Sophia University, Japan

Panelists