proof of concept for learning analytics interoperability

38
Proof of Concept for Learning Analytics - Reference Model based on open source SW - Jaeho Lee, Ph.D (Professor, University of Seoul) Yong-Sang CHO, Ph.D (Principal researcher, KERIS) ISO/IEC JTC1 SC36 Plenary Meeting 2015-06-22, Rouen, France

Upload: yong-sang-cho

Post on 13-Aug-2015

387 views

Category:

Education


4 download

TRANSCRIPT

Page 1: Proof of Concept for Learning Analytics Interoperability

Proof of Concept for Learning Analytics - Reference Model based on open source SW -

Jaeho Lee, Ph.D (Professor, University of Seoul)

Yong-Sang CHO, Ph.D (Principal researcher, KERIS)

ISO/IEC JTC1 SC36 Plenary Meeting 2015-06-22, Rouen, France

Page 2: Proof of Concept for Learning Analytics Interoperability

Table of Contents

• What we know and what we don’t know

• Case study for data flows and exchange - xAPI - IMS Caliper

• Proof of Concept: reference model for learning analytics - Reference architecture for learning analytics service - System deployment using open source SW

• Future works by 2016

• But, keep in mind

Page 3: Proof of Concept for Learning Analytics Interoperability

What we know is …

Page 4: Proof of Concept for Learning Analytics Interoperability

Source: Smart Devices & Cloud Computing http://www.exelanz.com/blogs/smart-devices-cloud-computing/

Page 5: Proof of Concept for Learning Analytics Interoperability

Learning applications

ebook eportfolio collaboration assessment

classroom capture

creation/ delivery …

http://developers.imsglobal.org/catalog.html

Page 6: Proof of Concept for Learning Analytics Interoperability

Source: Big Data Sea Image by Venture Beat

Page 7: Proof of Concept for Learning Analytics Interoperability

What we don’t know is …

Page 8: Proof of Concept for Learning Analytics Interoperability
Page 9: Proof of Concept for Learning Analytics Interoperability

What to measure? How to collect?

Does it connected each other?

Source: http://tincanapi.com/overview/

Page 10: Proof of Concept for Learning Analytics Interoperability

Source: Collegestats.org http://collegestats.org/2013/01/how-can-data-mining-analytics-enhance-education/

Questions expected from data mining & learning analytics

Page 11: Proof of Concept for Learning Analytics Interoperability

Case Study for exploring what we don’t know (Data flow and exchange)

Page 12: Proof of Concept for Learning Analytics Interoperability

xAPI

Transcript/learning data can be delivered to LMSs, LRSs or reporting tools

Experience data

LMS: Learning Management System LRS: Learning Record Store

Page 13: Proof of Concept for Learning Analytics Interoperability

IMS Caliper

Source: New Architect for Learning (Rob Abel, 2014) http://www.slideshare.net/JEPAslide/day3-edupub-tokyoims?qid=76ce5d4a-1ccf-468f-a428-c652584c395a&v=default&b=&from_search=4

Page 14: Proof of Concept for Learning Analytics Interoperability

http://www.coursesmart.com/go/institutions/analytics

Page 15: Proof of Concept for Learning Analytics Interoperability

Proof of Concept: reference model for learning analytics

Page 16: Proof of Concept for Learning Analytics Interoperability

We want to see iceberg below to understand

what we didn’t know before!!!

• What is a general process for analytics?

• Do we define workflows beyond xAPI or IMS Caliper?

• How do we prove the concept?

For exploring

Page 17: Proof of Concept for Learning Analytics Interoperability

Step 1. design reference architecture or learning analytics

Page 18: Proof of Concept for Learning Analytics Interoperability

Step 1. design reference architecture in terms of deployment (in 2014)

Cloudera Impala

HBase HDFS

Cloudera Impala

HBase HDFS

Cloudera Impala

HBase HDFS

JDBC / ODBC Client

Cloudera Manager / HUE HIVE

Metastore Impala Shell

RImpala / RODBC

R Rstudio

(Ploting Library)

Page 19: Proof of Concept for Learning Analytics Interoperability

Step 1. design reference architecture in terms of deployment (in 2015)

Cloudera Impala

Mongo

DB HDFS

Cloudera Impala

Mongo

DB HDFS

Cloudera Impala

Mongo

DB HDFS

JDBC / ODBC Client

Cloudera Manager / HUE HIVE

Metastore Tools for Triple i.e. GraphLab

RImpala / RODBC

R Visualization Tool

(i.e. Chart.js)

Page 20: Proof of Concept for Learning Analytics Interoperability

Step 2. design deployment for the reference model

Page 21: Proof of Concept for Learning Analytics Interoperability

Step 2. design deployment for the reference model - data collection process

Page 22: Proof of Concept for Learning Analytics Interoperability

Step 2. design deployment for the reference model - data storing/filtering process

Page 23: Proof of Concept for Learning Analytics Interoperability

Step 2. design deployment for the reference model - analyzing process

Page 24: Proof of Concept for Learning Analytics Interoperability

Step 2. design deployment for the reference model - visualization process

Page 25: Proof of Concept for Learning Analytics Interoperability

Step 3. design test data and proof of concept for the model

(Basic analytics process)

1. Student open digital textbook on Readium-JS viewer

2. Data is generated through reading activities by student

3. Data capture API crawl the data and send to event store

4. On the analytics platform check collected data

5. See simple dashboard from collected data (without analysis algorithm)

(Advanced analytics process)

6. Design analysis algorithm with data filtering from collected data

7. See advanced dashboard pertaining to customized analysis

8. Calculate personal learning path connected to LOD for curriculum standard

Page 26: Proof of Concept for Learning Analytics Interoperability

DEMO

Page 27: Proof of Concept for Learning Analytics Interoperability

DEMO 1. open digital textbook on Readium-JS viewer

Open sample digital textbook via Readium-JS Viewer

Page 28: Proof of Concept for Learning Analytics Interoperability

DEMO 2. generate reading activities on Readium-JS viewer

Capture the event for page view

Page 29: Proof of Concept for Learning Analytics Interoperability

Call send() function from Sensor API from Endpoint

Captured data in JSON format by sensor API

Result for event data capturing by sensor API: “result=SUCCESS”

Page 30: Proof of Concept for Learning Analytics Interoperability

DEMO 3. show reading activity data generated in RDF format

ViewEvent data in JSON format ViewEvent data in RDF format

Page 31: Proof of Concept for Learning Analytics Interoperability

DEMO 4. show collected data on event store

Page 32: Proof of Concept for Learning Analytics Interoperability

DEMO 5. show simple dashboard using engagement profile

Page 33: Proof of Concept for Learning Analytics Interoperability

Future works by 2017

Page 34: Proof of Concept for Learning Analytics Interoperability

•Complete development for data capture API (beta version) - collaborate with IMS Global * to improve efficiency of data sharing format

• Complete design and development for test-bed of reference model - complete test for open source SWs to organize optimized composition - design interface for analysis algorithm based on R

• Complete design for LOD of achievement standards - to connect digital resources with specific topics of curriculum standards * connected digital resources will be used ISO/IEC 19788 MLR

By February 2017

Page 35: Proof of Concept for Learning Analytics Interoperability
Page 36: Proof of Concept for Learning Analytics Interoperability

But, keep in mind!

Page 37: Proof of Concept for Learning Analytics Interoperability

<Gartner Hype Cycle, 2014>

Page 38: Proof of Concept for Learning Analytics Interoperability

Thank You !!!

Korea Education & Research Information Service

Yong-Sang CHO, Ph.D

[email protected]

FB: /zzosang Twitter: @zzosang