![Page 1: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/1.jpg)
Online learning and prediction: just play along! A pre-Antaragni talk on online learning!
Purushottam Kar Department of CSE
IIT Kanpur
SIGML Special Interest Group in Machine Learning
![Page 2: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/2.jpg)
Learning Problems
• Portfolio selection:
• Branch prediction:
• Click prediction:
![Page 3: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/3.jpg)
Supervised Learning
coursera.org
Learner Teacher
![Page 4: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/4.jpg)
Passive Supervised Learning
coursera.org
Learner Teacher
, L
, R
, L , L
, R
![Page 5: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/5.jpg)
Online Supervised Learning
coursera.org
Learner Teacher
p2
p1
r1
r2
Corpus = <p1,r1> * <p2,r2> * … <pT,rT>
![Page 6: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/6.jpg)
Online Supervised Learning
coursera.org
Learner Teacher
![Page 7: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/7.jpg)
Active Supervised Learning
coursera.org
Learner Teacher
L
L
R
![Page 8: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/8.jpg)
The Online Learning Model How we assess Online Learning Algorithms
8
![Page 9: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/9.jpg)
The Online Learning Model
9
![Page 10: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/10.jpg)
Making it big in the stock market
10
![Page 11: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/11.jpg)
Simple Online Algorithms What makes online learning click ?
11
![Page 12: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/12.jpg)
Online Linear Classification
12
![Page 13: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/13.jpg)
The Perceptron Algorithm in action
13
![Page 14: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/14.jpg)
Online Regression
14
0
1
2
3
4
-2.5 -2 -1.5 -1 -0.5 0 0.5 1 1.5 2 2.5
Hinge Loss
Mistake Loss
![Page 15: SIGML Purushottam Kar · Online learning and prediction: just play along! A pre-Antaragni talk on online learning! Purushottam Kar Department of CSE IIT Kanpur SIGML Special Interest](https://reader031.vdocuments.mx/reader031/viewer/2022040908/5e803ab10c4cc87eb56aa88b/html5/thumbnails/15.jpg)
Online Regression via Online Gradient Descent
15