Teacher:Gianni A. Di Caro

Lecture 30:Latent Variable Models, Gaussian Mixture Models, Expectation-Maximization - 2

Introduction to Machine Learning10-315 Fall ‘19

Disclaimer: These slides can include material from different sources. I’ll happy to explicitly acknowledge a source if required. Contact me for requests.

2

All the following slides are from Piyush Rai (IIT)

3

4

Recap: Generative Classification with GMM, Complete Data

µ1

µ2

µ3

µ1

µ2

µ3

Closed-form solutions

5

Recap: Generative Classification with GMM, Complete Data

6

Recap: GMM Parameter Estimation with InComplete Data

Different!

7

Recap: ALT-OPT as EM

8

Recap: ALT-OPT / EM for GMM by optimizing ℒ(q, Θ)

9

Recap: ALT-OPT / EM for GMM by optimizing ℒ(q, Θ)

10

11

12

13

14

15

16

17

18

19

20

21

22

23