![Page 1: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/1.jpg)
1
How Can AI help MOOCs?
Jie Tang+, Maosong Sun+, Juanzi Li+, Xiao Liu+, and Wendy Hall#+Tsinghua University
#Southampton
The slides can be downloaded at http://keg.cs.tsinghua.edu.cn/jietang
![Page 2: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/2.jpg)
2
Big Data in MOOC
• 149 partners• 2000+ courses• 24,000,000 users
• 1,000+ courses• 8,000,000 users• Chinese EDU association
• host >1,000 courses• millions of users
……
• 110 partners• 1,270 courses• 10,000,000 users• 10+ MicroMaster
• ~10 partners• 40+ courses• 1.6 million users• “nanodegree”
![Page 3: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/3.jpg)
3
launched in 2013
![Page 4: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/4.jpg)
4
Some exciting data…• Every day, there are 5,000+ new students• An MOOC course can reach 100,000+ students• >35% of the XuetangX users are using mobile• traditional->flipped classroom->online degree
![Page 5: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/5.jpg)
5
Some exciting data…• Every day, there are 5,000+ new students• An MOOC course can reach 100,000+ students• >35% of the XuetangX users are using mobile• traditional->flipped classroom->online degree• “Network+ EDU” (O2O)
– edX launched 10+ MicroMaster degrees– Udacity launched NanoDegree program– GIT+Udacity launched the largest online master– Tsinghua+XuetangX will launch a MicroMaster soon
![Page 6: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/6.jpg)
6
However…
• only ~3% certificate rate- The highest certificate rate is 14.95%- The lowest is only 0.84%
• Can AI help MOOC and how?
![Page 7: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/7.jpg)
7
MOOC user = Student?
How to learn more effectively and more
efficiently?
• Who is who? background, where from?
• Why MOOC? motivation? degree?
• What is personalization? preference?
![Page 8: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/8.jpg)
8
MOOC course = University course?
data mining
artificial intelligence
data clustering
machine learning
association rule
Hidden Markov Model
Maximum Likelihood
Probability Distribution
How to discover the prerequisite relations between
concepts and generate the concept graph automatically?
Thousands of Courses
How to leverage the external knowledge?
![Page 9: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/9.jpg)
9
However to improve the engagement?
data mining
artificial intelligence
data clustering
machine learning
association rule
KnowledgeUser
![Page 10: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/10.jpg)
10
LittleMU (小木)
![Page 11: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/11.jpg)
11
What is LittleMU(“小木”)• Not a Chatbot
– “Good morning”, “did you have the breakfast?”—NO• Not a teacher/TA
– “Can you explain the equation for me?” —NO
• Instead,“小木” is more like a learning peer– Tell you some basic knowledge in her mind– Tell you what the other users are thinking/learning– Try to understand your intention– Teach “小木” what you know
![Page 12: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/12.jpg)
12
What is LittleMU(“小木”)
![Page 13: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/13.jpg)
13
What is LittleMU(“小木”)
![Page 14: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/14.jpg)
14
LittleMU (小木)
![Page 15: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/15.jpg)
15
Acrostic Poem: 小木作诗
![Page 16: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/16.jpg)
16
LittleMU (小木)
User Modeling Content AnalysisIntervention
![Page 17: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/17.jpg)
17
LittleMU (小木)
User Modeling Content AnalysisIntervention
![Page 18: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/18.jpg)
18
Dynamic Factor Graph Model
Prediction labels:Activities we are interested in,e.g., assignments performance and getting certificates.
Latent learning states
Every student’s status in at time t is associated with a vector representation
All features: time-varying attributes:1.Demographics2.Forum Activities3. Learning Behaviors
Model: incorporating “embedding” and factor graphs
[1] Jiezhong Qiu, Jie Tang, Tracy Xiao Liu, Jie Gong, Chenhui Zhang, Qian Zhang, and Yufei Xue. Modeling and Predicting Learning Behavior in MOOCs. WSDM'16, pages 93-102.
![Page 19: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/19.jpg)
19
Certificate Prediction
• LRC, SVM, and FM are different baseline models• LadFG is our proposed model
![Page 20: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/20.jpg)
20
Predicting more• Dropout
– KDDCUP 2015, 1,000+ teams worldwide• Demographics
– Gender, education, etc.• User interests
– computer science, mathematics, psychology, etc.• …
![Page 21: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/21.jpg)
21
LittleMU (小木)
User Modeling Content AnalysisIntervention
![Page 22: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/22.jpg)
22
Knowledge Graph
- How to extract concepts from course scripts?- How to recognize (prerequisite) relationships between concepts?
[1] Liangming Pan, Chengjiang Li, Juanzi Li, and Jie Tang. Prerequisite Relation Learning for Concepts in MOOCs. ACL'17.
![Page 23: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/23.jpg)
23
LittleMU (小木)
User Modeling Content AnalysisIntervention
![Page 24: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/24.jpg)
24
• Let start with a simple case– Course recommendation based on user interest
![Page 25: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/25.jpg)
25
Course Recommendation
Course Recommendation: Guess you like
![Page 26: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/26.jpg)
26
Online A/B Test
Top-k recommendation accuracy (MRR)Comparison methods:HCACR – Hybrid Content-Aware Course Recommendation CACR – Content-Aware Course Recommendation IBCF – Item-Based Collaborative Filtering UBCF – User-Based Collaborative Filtering
Online Click-through RateComparison methods:HCACR – Our methodManual strategy
![Page 27: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/27.jpg)
27
• Let start the simplest case– Course recommendation based on user interest
• What can we else?– Interaction when watching video?
![Page 28: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/28.jpg)
28
Smart Jump—Automated suggestion for video navigation
Jump-backNavigationDistribution
0.11 0.260.350.07Personalized Suggestion
Let’s begin with …
The example is that … Next … capital assets … investment property …
First, we introduce …
![Page 29: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/29.jpg)
29
Average Jump
Jump-backNavigationDistribution
0.11 0.260.350.07Personalized Suggestion
Let’s begin with …
The example is that … Next … capital assets … investment property …
First, we introduce …
4
1235
On Average: 2.6 Clicks = 5 seconds
![Page 30: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/30.jpg)
30
Two Numbers
4
123
5On Average: 2.6 Clicks = 5 seconds
According to what we have discussed we find that the fifth activity belongs to cash outflow of a business activity.
5𝑆𝑆 × 8,000,000 𝑢𝑢𝑢𝑢𝑢𝑢𝑢𝑢𝑢𝑢 = 1.3 𝑦𝑦𝑢𝑢𝑦𝑦𝑢𝑢𝑢𝑢
5𝑆𝑆t t+8
![Page 31: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/31.jpg)
31
More
• Let start the simplest case– Course recommendation based on user interest
• What can we else?– Interaction when watching video?– Interaction->intervention
![Page 32: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/32.jpg)
32
Question: What is time complexity?
Active Question
![Page 33: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/33.jpg)
33
Question: What is Random Vector?
Active Question
![Page 34: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/34.jpg)
34
LittleMU (小木)
User Modeling Content AnalysisIntervention
![Page 35: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/35.jpg)
35
Recent Publications• Liangming Pan, Chengjiang Li, Juanzi Li, and Jie Tang. Prerequisite Relation Learning for Concepts in
MOOCs. In ACL'17.• Xia Jing, Jie Tang, Wenguang Chen, Maosong Sun, and Zhengyang Song. Guess You Like: Course
Recommendation in MOOCs. WI'17.• Han Zhang, Maosong Sun, Xiaochen Wang, Zhengyang Song, Jie Tang, and Jimeng Sun. 2017. Smart
Jump: Automated Navigation Suggestion for Videos in MOOCs. In WWW'17 Companion.• Jiezhong Qiu, Jie Tang, Tracy Xiao Liu, Jie Gong, Chenhui Zhang, Qian Zhang, and Yufei Xue. 2016.
Modeling and Predicting Learning Behavior in MOOCs. In WSDM'16. 93–102.• Jie Gong, Tracy Xiao Liu, Jie Tang, and Fang Zhang. Incentive Design on MOOC: a Field Experiment
on XuetangX, Management Science (top in management). Submitted.• Jie Tang, Tracy Xiao Liu, Zhenyang Song, Xiaochen Wang, Xia Jing, Jiezhong Qiu, Zhenhuan Chen,
Chaoyang Li, Han Zhang, Liangmin Pan, Yi Qi, Xiuli Li, Jian Guan, Juanzi Li, and Maosong Sun. LittleMU: Enhancing Learning Engagement Using Intelligent Interaction on MOOCs. submitted to KDD.
• 李曼丽, 徐舜平, 孙梦嫽. MOOC 学习者课程学习行为分析——以 “电路原理” 课程为例[J]. 开放教育研究, 2015, 21(2): 63-69.
• 薛宇飞, 黄振中, 石菲. MOOC 学习行为的国际比较研究--以 “财务分析与决策” 课程为例[J]. 开放教育研究, 2015 (2015 年 06): 80-85.
• 薛宇飞,敬峡,裘捷中,唐杰,孙茂松. 一种在线课程中的作业互评方法:中国,201510531490.2.(中国专利申请号)
• 唐杰,张茜,刘德兵. 用户退课行为预测方法及装置. 201610292389.0 (中国专利申请号)
![Page 36: How Can AI help MOOCs?...• An MOOC course can reach 100,000+ students • >35% of the XuetangX users are using mobile • traditional->flipped classroom->online degree • “ Network+](https://reader034.vdocuments.mx/reader034/viewer/2022052002/6014921a9907e164e975629f/html5/thumbnails/36.jpg)
36
Thank you!Collaborators: Jian Guan, Xiuli Li, Fenghua Nie (XuetangX)
Jie Gong (NUS), Jimeng Sun (GIT)Wendy Hall (Southampton)
Maosong Sun, Tracy Liu, Juanzi Li (THU)Xia Jing, Zhenhuan Chen, Liangmin Pan, Jiezhong Qiu, Han Zhang,
Zhengyang Song, Xiaochen Wang, Chaoyang Li, Yi Qi (THU)
Jie Tang, KEG, Tsinghua U, http://keg.cs.tsinghua.edu.cn/jietangDownload all data & Codes, http://arnetminer.org/data
http://arnetminer.org/data-sna