![Page 1: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/1.jpg)
Boundary Extraction in Natural Images Using Ultrametric Contour Maps
Pablo Arbeláez Université Paris Dauphine
Presented byDerek Hoiem
![Page 2: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/2.jpg)
What is segmentation?
![Page 3: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/3.jpg)
What is segmentation?
• Segmentation is a result
![Page 4: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/4.jpg)
What is segmentation?
• Segmentation is a result
• Segmentation is a process
Woman
Face
![Page 5: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/5.jpg)
What is segmentation?
• Segmentation is a result
• Segmentation is a process
• Segmentation is a guide
![Page 6: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/6.jpg)
Segmentation as a Guide
• Multiple Segmentations
![Page 7: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/7.jpg)
Segmentation as a Guide
• Multiple Segmentations
• Hierarchy of Segmentations
![Page 8: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/8.jpg)
Key Concepts/Contributions
• Hierarchical segmentation by iterative merging
• Ultrametric dissimilarities
• Thorough evaluation on BSDS
![Page 9: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/9.jpg)
Hierarchical Segmentation
λ
3 Region Image Dendrogram
Contour Image
![Page 10: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/10.jpg)
Ultrametric Contour Map
• Ultrametric– Definition: D(x,y) <= max{ D(x,z), D(z,y) }
The union R12 of two regions R1 and R2 must have >= distance to adjacent region R3 than either R1 or R2
λ
![Page 11: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/11.jpg)
Ultrametric Contour Map
![Page 12: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/12.jpg)
Region Dissimilarity
1. Dc(R1, R2): mean boundary contrast– contrast(x) = max L*a*b* diff within radius of x
2. Dg(R1, R2): mean boundary gradient– gradient(x) = Pb(x)
3. Da(R1): Area + α3 Scatter (in color space)
D(R1, R2) = [Dc(R1, R2) + α1 Dg(R1, R2)] · min{ Da(R1) , Da(R2) }α2
Learned Parameters: xi = 4.5 α1 = 5 α2 = 0.2 α3 = 0
![Page 13: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/13.jpg)
Examples
Contrast
Contrast + Gradient
Contrast + Gradient + Region
![Page 14: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/14.jpg)
Algorithm Summary
• Create Initial Contours:– Extrema in gray channel form regions– Assign pixels to regions based on above
ultrametric
• Iteratively merge regions– Keep adjacency/distance matrix
![Page 15: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/15.jpg)
Comparison
• Martin et al. (Pb)• Canny edge detector• Hierarchical watersheds (using MFM for gradient)
[Najman and Schmitt 1996]• Variational (global energy minimization)
![Page 16: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/16.jpg)
Pb
No Boundary
Boundary
[Martin Fowlkes Malik 2004]
Oriented Edges
Brightness Gradient
Color Gradient
Texture Gradient
![Page 17: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/17.jpg)
Pb
![Page 18: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/18.jpg)
Variational Method
[Koepfler Lopez Morel 1994]
Originally Wavelet-based Textons
![Page 19: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/19.jpg)
Comparison• MFM: Martin et al. (Pb)• Canny: Canny edge detector• WS: Hierarchical watersheds (using MFM for gradient) [Najman and Schmitt 1996]• MS: Variational (global energy minimization)
Edge-Based Region-Based
![Page 20: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/20.jpg)
Comparison
![Page 21: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/21.jpg)
Results
![Page 22: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/22.jpg)
Results
![Page 23: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/23.jpg)
Best Results
http://www.ceremade.dauphine.fr/~arbelaez/results-UCM/main.html
![Page 24: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/24.jpg)
Best Results
http://www.ceremade.dauphine.fr/~arbelaez/results-UCM/main.html
![Page 25: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/25.jpg)
Best Results
http://www.ceremade.dauphine.fr/~arbelaez/results-UCM/main.html
![Page 26: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/26.jpg)
Best Results
http://www.ceremade.dauphine.fr/~arbelaez/results-UCM/main.html
![Page 27: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/27.jpg)
Median Results
![Page 28: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/28.jpg)
Median Results
![Page 29: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/29.jpg)
Median Results
![Page 30: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/30.jpg)
Median Results
![Page 31: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/31.jpg)
Worst Results
![Page 32: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/32.jpg)
Worst Results
![Page 33: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/33.jpg)
Worst Results
![Page 34: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/34.jpg)
Worst Results
![Page 35: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/35.jpg)
Hierarchies vs. Multiple Segmentations
![Page 36: Boundary Extraction in Natural Images Using Ultrametric Contour Maps](https://reader036.vdocuments.mx/reader036/viewer/2022062500/56815b1d550346895dc8d2cc/html5/thumbnails/36.jpg)
Revising Segmentation