more submodular stuff - luthuli.cs.uiuc.edu
TRANSCRIPT
![Page 1: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/1.jpg)
More Submodular stuffD.A. Forsyth, working entirely from Carlos Guestrin’s slides
![Page 2: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/2.jpg)
![Page 3: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/3.jpg)
![Page 4: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/4.jpg)
![Page 5: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/5.jpg)
![Page 6: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/6.jpg)
![Page 7: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/7.jpg)
![Page 8: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/8.jpg)
Active learning
• Hoi et al, “Batch mode Active Learning...”, ICML’08
• Fisher information matrix• - Expected value of Hessian of log-likelihood• Big -> log-likelihood is tightly peaked
• Natural criterion for selecting examples to be labelled• alpha - classifier parameters• p - distribution of labelled examples• q - distribution of unlabelled that are chosen for labelling
![Page 9: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/9.jpg)
Active learning
• By a series of approximations, we get
• Substitute with
![Page 10: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/10.jpg)
![Page 11: More Submodular stuff - luthuli.cs.uiuc.edu](https://reader031.vdocuments.mx/reader031/viewer/2022020910/620052dbcedfcb1ec76331d9/html5/thumbnails/11.jpg)