Machine Learning for Language Technology Lecture 7: Hidden Markov Models (HMMs)

Marina SantiniDepartment of Linguistics and Philology

Uppsala University, Uppsala, Sweden

Autumn 2014

Acknowledgement: Thanks to Prof. Joakim Nivre for course design and materials

Hidden Markov Models (1)

Hidden Markov Models (2)

A Simple HMM

Markov Assumptions

Observation Sequences

Problems for HMMs (1)

Problems for HMMs (2)

Viterbi

Forward Algo & Backward Algo

Forward-Backward Algo

Part-Of-Speech Tagging

Modeling (1)

Modeling (2)

Learning

Smoothing

Inference

HMM Applications

The end