ooo voto - northeastern university€¦ · noun ooo voto.it eo eeeee j ad bo start monsters eat...

4
Noun Ooo Ooo voto.it Eo EEEEE J Ad BO START monsters eat tasty bunnies END t2 Labels States Observation I Can only be in one state at time I Observation 2 By construction we have assumed That We only care about features relating adjacent words and labels Observation 3 Any path Through This trellis corresponds to a unique labeling of X Consider E the edge from Verb Adj b w eat and Tasty weight E w tasty adj verb adj

Upload: others

Post on 24-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ooo voto - Northeastern University€¦ · Noun Ooo voto.it Eo EEEEE J Ad BO START monsters eat tasty bunnies END t2 Labels States Observation I Can only be in one state at time I

Noun Ooo Ooo

voto.itEo EEEEE J

Ad BOSTART monsters eat tasty

bunnies END

t2

Labels States

Observation I Can only be in one state at time I

Observation 2 By construction we have assumed That

We only care about features relating adjacentwords and labels

Observation 3 Any path Through This trellis corresponds

to a unique labeling of X

Consider E the edge from Verb Adj b w eat

and Tasty

weight E w tasty adj verb adj

Page 2: Ooo voto - Northeastern University€¦ · Noun Ooo voto.it Eo EEEEE J Ad BO START monsters eat tasty bunnies END t2 Labels States Observation I Can only be in one state at time I

How does this allow us to compute argmax

Naively if we just considered all unique

Paths it wouldn't

But this structure permits Dynamic Programming

for efficient Computation

Viterbi Algorithm

Define

Qe k best possible output up to

and including l for label K

Max weX ay K Ot denotes

concatenation

in L 1

Consider l 2 Assume we have computed Qs

up to this point

The word at 1 2 is eat

Now we want to derive 03 Adj How To Calculate

this score

Max over possible previous States

03 Adj Max Q2 Nan t WTasty Adjwhom Adj

Q2verb t WTasty Adjt Verb Adj

Q2Adj t WTasty Adjt WAdj Adj

Page 3: Ooo voto - Northeastern University€¦ · Noun Ooo voto.it Eo EEEEE J Ad BO START monsters eat tasty bunnies END t2 Labels States Observation I Can only be in one state at time I

We can generalize this for a recursive definition

CT 49 denote the label at position 1 1 that

achenes The Max

Init

o K 0 the

4 Tkfeature vector for position

Best score l given that we areat coming fromNow kf

Qe mna.xEQE.k.tw e zCxlk kK and

H K going to k

Where to Transitionfrom

4 1 k Same but Erymax

At The end can find best Seg

argmax K K last State

K

and trace backwards

Page 4: Ooo voto - Northeastern University€¦ · Noun Ooo voto.it Eo EEEEE J Ad BO START monsters eat tasty bunnies END t2 Labels States Observation I Can only be in one state at time I

OO O u o O2 z o

features

o 1 I o Pixel Valve face terms1 1 11 O

O o I 20 oOthers Mayber Coordinate into

0 o o Ii Marty featuresTransition to face noT facefrom neighbors

Yci 2 j Il Yei Dj YiLj 1

Dynamic Program

Start from o o proceed