alex smola , how jing chao-yuan wu , amr ahmed , alex ...cywu/rrn2017_slides.pdfrecurrent...
TRANSCRIPT
![Page 1: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/1.jpg)
Recurrent Recommender NetworksChao-Yuan Wu1, Amr Ahmed2, Alex Beutel2
Alex Smola3, How Jing4
21 3 4
1
![Page 2: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/2.jpg)
Traditional recommender systems
4
3 5 1
3
2
1 ?
2 5
Predict missing values
Observe interactions
2
![Page 3: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/3.jpg)
Traditional recommender systemsassume stationary states
4
3 5 1
3
2
1 ?
2 5
f(vu, vm)u
mUser states
Movie states3
![Page 4: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/4.jpg)
However…, user & movie states should be time-dependent.
4
![Page 5: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/5.jpg)
User preference changes over time
5
?10 years ago
now
![Page 6: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/6.jpg)
Movie reception changes over time
So bad that it’s great to watch
Bad movie6
![Page 7: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/7.jpg)
Exogenous effects“La La Land” won big at Golden Globes
7
![Page 8: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/8.jpg)
Seasonal effects
Only watch during Christmas
8
![Page 9: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/9.jpg)
Traditional MF
![Page 10: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/10.jpg)
Modeling temporal dynamics within each user and movieTraditional MF
10
![Page 11: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/11.jpg)
Also…, we consider real prediction instead of interpolation.
11
![Page 12: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/12.jpg)
Kid started using
Consider a user profile….
12
![Page 13: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/13.jpg)
?
Traditional random split
??
13
![Page 14: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/14.jpg)
Real scenario
?? ??
14
![Page 15: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/15.jpg)
Real scenario
?? ?
In this paper we design and evaluate our model with this real scenario.
?
15
![Page 16: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/16.jpg)
Recurrent Recommender Networks
User RNN
Movie RNN
user
movie16
![Page 17: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/17.jpg)
User Recurrent Neural Network (User RNN)
17
![Page 18: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/18.jpg)
User Recurrent Neural Network (User RNN)
18
Rating
![Page 19: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/19.jpg)
Movie RNN
19
Rating
![Page 20: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/20.jpg)
Recurrent Recommender Networksuser
movie 20
![Page 21: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/21.jpg)
Experiments
21
![Page 22: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/22.jpg)
Rating prediction accuracy
PMF: Salakhutdinov & Mnih NIPS ‘07T-STD: Koren KDD ‘09U-AR & I-AR: Sedhain et al. WWW ‘15
(RMSE)
22
![Page 23: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/23.jpg)
How does the model react to the temporal effects?
23
![Page 24: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/24.jpg)
24
?
![Page 25: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/25.jpg)
Automatically captures exogenous effects
Oscar & Golden globe
25
![Page 26: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/26.jpg)
Automatically captures system-wise effects
Netflix changed the Likert scale
26
![Page 27: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/27.jpg)
Automatically models effects that used to be captured by hand-crafted features
Movie age effects
27
![Page 28: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/28.jpg)
Large improvement when movies have large fluctuations
28
Improvement
Fluctuation
![Page 29: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/29.jpg)
SummaryNovel model
![Page 30: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/30.jpg)
SummaryNovel model Future prediction
? ? ??
![Page 31: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/31.jpg)
SummaryNovel model Future prediction
Accurate prediction
? ? ??
![Page 32: Alex Smola , How Jing Chao-Yuan Wu , Amr Ahmed , Alex ...cywu/rrn2017_slides.pdfRecurrent Recommender Networks Chao-Yuan Wu1, Amr Ahmed2, Alex Beutel2 Alex Smola3, How Jing4 1 2 3](https://reader033.vdocuments.mx/reader033/viewer/2022043021/5f3d18e82a664141f0069352/html5/thumbnails/32.jpg)
32
SummaryNovel model Future prediction
Accurate prediction Temporal dynamics
? ? ??