hidden markov random fields and direct search methods for medical image segmentation

Introduction HMRF Direct Search Methods Experimental Results Conclusion

5th The International Conference on Pattern Recognition Applications and Methods

EL-Hachemi Samy Dominique RamdaneGuerrout Ait-Aoudia Michelucci Mahiou

Hidden Markov Random Fields and Direct SearchMethods for Medical Image Segmentation

LMCS Laboratory, ESI, Algeria & LE2I Laboratory, UB, France

1 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

1 Introduction

2 HMRF

3 Direct Search MethodsNelder-Mead methodTorczon method

4 Experimental Results

5 Conclusion

2 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Problematic

1 Huge number of medical images

1 MRI - Magnetic Resonance Imaging2 CT - Computed Tomography3 Radiography4 Digital mammography5 . . .etc

2 The manual analysis and interpretation is a difficult task

3 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Solution

The automatic extraction of meaningful information is one among thesegmentation challenges

The goal of image segmentation ?

Simplify the representation of an image to items meaningful and easierto analyze

4 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

The segmentation, Howto ?

There are several techniques to perform the segmentation

1 Active contour

2 Edge detection

3 Thresholding

4 Region growing

5 HMRF - Hidden Markov Random Field

6 . . .etc

Our way to perform the segmentation relies on HMRF

5 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Hidden Markov Random Field

The image to segment into K classesy = {ys}s∈S is seen as a realization ofa random field Y = {Ys}s∈S

1 Each ys is a realization of arandom variable Ys

2 Each ys ∈ [0 . . .255]

The segmented image x = {xs}s∈S isseen as a realization of a random fieldX = {Xs}s∈S

1 Each xs is a realization of arandom variable Xs

2 Each xs ∈ {1, . . . ,K}

An example of segmentation with K= 4

6 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Hidden Markov Random Field

1 This elegant model leads to the optimization of an energyfunction Ψ(x ,y)

2 Our way to look for the minimization of Ψ(x ,y) is to look for theminimization Ψ(µ), µ = (µ1, . . . ,µK ) where µi are means of grayvalues of class i

3 The main idea is instead to work directly on the pixels adjustmentof x , to work on the means adjustment first.

7 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Hidden Markov Random Field

Ψ(µ) = ∑Kj=1 ∑

s∈Sj

[ln(σj) +(ys−µj)

2

2σ2j

] + β

T ∑c2={s,t} (1−2δ(xs,xt))

µ∗ = (µ∗1, . . . ,µ∗j , . . . ,µ

∗K ) = argµ∈[0...255]K min{Ψ(µ)}

µj = 1|Sj | ∑s∈Sj

ys

σj =√

1|Sj | ∑s∈Sj

(ys−µj)2

Sj = {s | xs = j}

8 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Nelder-Mead method

Nelder-Mead method

1 Proposed by John Nelder and Roger Mead (1965)

2 To minimize Ψ(µ) of K unknowns, we need K + 1 vertices ∈ RK

form non degenerate simplex (i.e., non flat)

3 Based on the comparison of Ψ(µ) values at K + 1 vertices

4 Each time a new vertex is generated relatively to the gravitycenter of K best vertices by the operations :

1 Reflection2 Expansion3 Contraction

5 The vertex with the worse function value is replaced with the newvertex if its value is better. Otherwise the simplex is shrunk

9 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Nelder-Mead method

1- Evaluate

1 Compute Ψi := Ψ(Vi)

2 Determine the indices h, s, l :1 Ψh := max

i(Ψi )

2 Ψs := maxi 6=h

(Ψi )

3 Ψl := mini

(Ψi )

3 Compute V̄ := 1K ∑

i 6=hVi

Example in R2

FIGURE : Gravity center

10 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Nelder-Mead method

2- Reflect

1 Compute the reflection vertex Vr

from : Vr := 2V̄ −Vh

2 Evaluate Ψr := Ψ(Vr )

3 If Ψl ≤Ψr < Ψs

1 Replace Vh by Vr

2 Terminate the iteration

Example in R2

FIGURE : Reflection

11 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Nelder-Mead method

3- Expand

1 If Ψr < Ψl

1 Compute the expansion vertex Ve

from : Ve := 3V̄ −2Vh

2 Evaluate Ψe := Ψ(Ve)3 If Ψe < Ψr

1 Replace Vh by Ve2 Terminate the iteration

4 Otherwise (if Ψe ≥Ψr )1 Replace Vh by Vr2 Terminate the iteration

Example in R2

FIGURE : Expansion

12 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Nelder-Mead method

4- Contract

1 If Ψr ≥Ψs and If Ψr < Ψh

1 Compute an outside contraction Vc

from : Vc := 32 V̄ − 1

2 Vh

2 Evaluate Ψc := Ψ(Vc)3 If Ψc < Ψr

1 Replace Vh by Vc2 Terminate the iteration

4 Otherwise ( If Ψc ≥Ψr )1 Go to the step 5 (shrink)

Example in R2

FIGURE : Outside contraction

13 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Nelder-Mead method

4- Contract

1 If Ψh ≤Ψr

1 Compute an inside contraction Vc

from : Vc := 12 (Vh + V̄ )

2 Evaluate Ψc := Ψ(Vc)3 If Ψc < Ψh

1 Replace Vh by Vc2 Terminate the iteration

4 Otherwise ( If Ψc ≥Ψh )1 Go to the step 5 (shrink)

Example in R2

FIGURE : Inside contraction

14 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Nelder-Mead method

5- Shrink

Replace all vertices according to thefollowing formula : Vi := 1

2 (Vi + Vl)

Example in R2

FIGURE : Shrink

15 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Torczon method

Torczon method

1 Torczon method is an improvement of Nelder-Mead method2 The differences are :

1 All the vertices are concerned by the operations (reflect, expandand contract)

2 All simplexes in Torczon method are homothetic to the first one3 No degeneracy (i.e., flat simplex) can occur in Torczon method

16 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Torczon method

1- Evaluate

1 Compute Ψi := Ψ(Vi)

2 Determine the index l from Ψl := mini

(Ψi)

17 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Torczon method

2- Reflect

1 Compute the reflected verticesV r

i := 2Vl −Vi

2 Evaluate Ψri := Ψ(V r

i )

3 If mini{Ψr

i }< Ψl go to step 3

4 Otherwise, go to the step 4

Example in R2

FIGURE : Reflection

18 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Torczon method

3- Expand

1 Compute the expanded verticesV e

i = 3Vl −2Vi

2 Evaluate Ψei := Ψ(V e

i )

3 If mini{Ψe

i }< mini{Ψr

i }1 Replace all vertices Vi by the

expanded vertices V ei

4 Otherwise1 Replace all vertices Vi by the

reflected vertices V ri

5 Terminate the iteration.

Example in R2

FIGURE : Expansion

19 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Torczon method

4- Contract

1 Compute the contracted verticesV c

i = 12 (Vi + Vl)

2 Replace all vertices Vi by thecontracted vertices V c

i

Example in R2

FIGURE : Contraction.

20 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

DC - The Dice Coefficient

The Dice coefficient measures how muchthe segmentation result is close to theground truth

DC =2|A∩B||A∪B|

1 DC equals 1 in the best case

2 DC equals 0 in the worst case FIGURE : The Dice Coefficient

21 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Results - DC

TABLE : The Mean Kappa Index Values

MethodsKappa Index

GM WM CSF MeanClassical-MRF 0.763 0.723 0.780 0.756MRF-ACO 0.770 0.729 0.785 0.762MRF-ACO-Gossiping 0.770 0.729 0.786 0.762HMRF-Nelder-Mead 0.952 0.975 0.939 0.955HMRF-Torczon 0.975 0.985 0.956 0.973

22 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Results - Time

TABLE : The Mean Segmentation Time

Methods Time (s)Classical-MRF 3318MRF-ACO 418MRF-ACO-Gossiping 238HMRF-Nelder-Mead 12.24HMRF-Torczon 5.55

23 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Results - Visual

Original image Ground truth HMRF-Nelder-Mead HMRF-Torczon

FIGURE : Segmentation result of HMRF-Nelder-Mead and HMRF-Torczonmethods on a slice of BrainWeb database

24 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Conclusion

1 We have described two methods :HMRF-Nelder-Mead and HMRF-Torczon

2 Performance evaluation relies on Brainweb database

3 From the tests we have conducted that the results are verypromising on : time and quality of the segmentation

4 Nevertheless, the opinion of specialists must be considered in theevaluation

25 / 26

Introduction HMRF Direct Search Methods Experimental Results Conclusion

Thank youfor your attention

26 / 26