multi-model estimation with j-linkage jeongkyun lee
TRANSCRIPT
![Page 1: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/1.jpg)
Multi-model Estimation with J-linkage
Jeongkyun Lee
![Page 2: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/2.jpg)
2
How do we find parameters of a model that contains outliers?
Application in vision: geometric figure fitting, planar surface detection, mo-tion segmentation, etc.
Motivation
![Page 3: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/3.jpg)
3
Least Squares Least Median of Squares (LMedS) Random Sample Consensus (RANSAC) M-SAC MLESAC PROSAC Etc.
Single-model Estimation
![Page 4: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/4.jpg)
4
Least Squares
Calculate parameters of model function Overdetermined data set Minimized sum of squared residuals
with a matrix form,
![Page 5: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/5.jpg)
5
Least Squares
With outliersWithout outliers
![Page 6: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/6.jpg)
6
Iterative method Non-deterministic Robust fitting in the presence of outliers Simple algorithm
RANSAC
M. A. Fischler, R. C. Bolles. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Comm. of the ACM, Vol 24, pp 381-395, 1981.
1. selects N data items at random 2. estimates parameter 3. finds how many data items (of M) fit the model with parameter vector
within a user given tolerance. Call this K. 4. if K is big enough, accept fit and exit with success. 5. repeat 1..4 L times 6. fail if you get here
Algorithm
![Page 7: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/7.jpg)
7
RANSAC
![Page 8: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/8.jpg)
8
Residual histogram analysis (RHA) Sequential RANSAC Multi-RANSAC J-linkage Kernel fitting (KF) Mean-shift (MS) Etc.
Multi-model Estimation
![Page 9: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/9.jpg)
9
Fit multiple structures simultaneously Require no initial parameters: # of models, model
parameters
Multi-model Estimation with J-Linkage
Algorithm
Given N points,
1. Generate M model hypothesis (Random sampling)2. Build a N x M matrix, comprised of Preference Sets of points3. J-linkage clustering
![Page 10: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/10.jpg)
10
Multi-model Estimation with J-Linkage
Preference Set
![Page 11: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/11.jpg)
11
Random Sampling– A minimal sample set (MSS) is constructed in a way that
neighbouring points are selected with higher probability.
1. One sample is selected with uniform probability
2. If a point is given, then has the following probability:
Multi-model Estimation with J-Linkage
Z is a normalized constant, is chosen heuristically.
![Page 12: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/12.jpg)
12
J-linkage Clustering– Starting from all singletons– Each sweep of the algorithm merges the two clusters
with the smallest distance
Multi-model Estimation with J-Linkage
Measure the degree of overlap of the two sets and ranges from 0 (identical sets) to 1 (disjoint sets)
![Page 13: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/13.jpg)
13
J-linkage Clustering
Multi-model Estimation with J-Linkage
Algorithm
Assumption
One-to-one matching between a point and a model
![Page 14: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/14.jpg)
14
Example
Multi-model Estimation with J-Linkage
1
2
3
4
![Page 15: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/15.jpg)
15
Results
Multi-model Estimation with J-Linkage
![Page 16: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/16.jpg)
16
Results
Multi-model Estimation with J-Linkage
![Page 17: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/17.jpg)
17
Results
Multi-model Estimation with J-Linkage
![Page 18: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/18.jpg)
18
Results
Multi-model Estimation with J-Linkage
![Page 19: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/19.jpg)
19
Other Results 1
Multi-model Estimation with J-Linkage
David F. Fouhey, “Multi-model Estimation in the Presence of Outliers”
![Page 20: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/20.jpg)
20
Other Results 1
Multi-model Estimation with J-Linkage
David F. Fouhey, “Multi-model Estimation in the Presence of Outliers”
![Page 21: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/21.jpg)
21
Other Results 2
Multi-model Estimation with J-Linkage
Hanzi Wang, “Robust Multi-Structure Fitting”, A tutorial in ACCV 2012.
![Page 22: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/22.jpg)
22
Other Results 2
Multi-model Estimation with J-Linkage
Hanzi Wang, “Robust Multi-Structure Fitting”, A tutorial in ACCV 2012.
![Page 23: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/23.jpg)
23
Reference David F. Fouhey, “Multi-model Estimation in the Presence of Out-
liers” Stefano Branco, “RANSAC/MLESAC, Estimating parameters of
models with outliers” Hanzi Wang, “Robust Multi-Structure Fitting”, A tutorial in ACCV
2012.
![Page 24: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/24.jpg)
24
Thank you!
![Page 25: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/25.jpg)
25
Appendix
![Page 26: Multi-model Estimation with J-linkage Jeongkyun Lee](https://reader036.vdocuments.mx/reader036/viewer/2022062320/56649d095503460f949dbe3c/html5/thumbnails/26.jpg)
26
Appendix