![Page 1: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/1.jpg)
Interest Point Detectors & RANSAC
Instructor - Simon Lucey
16-423 - Designing Computer Vision Apps
![Page 2: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/2.jpg)
Today
• Image Gradients.
• Interest Point Detectors
• Matching Regions.
• RANSAC.
![Page 3: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/3.jpg)
![Page 4: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/4.jpg)
I(x
,y)
I(x + 1, y + 1)
I
Simoncelli & Olshausen 2001
![Page 5: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/5.jpg)
I(x
,y)
I
I(x + 8, y + 8) Simoncelli & Olshausen 2001
![Page 6: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/6.jpg)
I(x
,y)
I
I(x + 16, y + 16) Simoncelli & Olshausen 2001
![Page 7: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/7.jpg)
I(x
,y)
I
I(x + 50, y + 50) Simoncelli & Olshausen 2001
![Page 8: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/8.jpg)
I(x
,y)
I
I(x + 50, y + 50) Simoncelli & Olshausen 2001
![Page 9: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/9.jpg)
Pixel Coherence
• The pixel coherence assumption demonstrates that pixels within natural images are heavily correlated with one another within a local neighborhood (e.g., +/- 5 pixels).
• For example,
5
N
CS143 Intro to Computer VisionSept, 2007 ©Michael J. Black
Image Filtering
3 4 3
2 ? 5
5 4 2
3
What assumptions are you
making to infer the center value?
![Page 10: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/10.jpg)
Pixel Coherence
• The pixel coherence assumption demonstrates that pixels within natural images are heavily correlated with one another within a local neighborhood (e.g., +/- 5 pixels).
• For example,
5
N
CS143 Intro to Computer VisionSept, 2007 ©Michael J. Black
Image Filtering
3 4 3
2 ? 5
5 4 2
3
What assumptions are you
making to infer the center value?
“Typically assume that pixels within +/- 3, 5 or 7 pixels are highly correlated.”
![Page 11: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/11.jpg)
!"#$%&'()*+&)+&!+,-.)/*&0121+("/-)3&4556 7819:;/<&=>&?<;9@
',;A/2&;2&B.(9)1+(2
C ',;A/2&;*/&;&D129*/)/<E&2;,-</D&
*/-*/2/();)1+(&+F&;&9+()1(.+.2&21A(;<
IGxH
x
Estimating Gradients
6
• Images are a discretely sampled representation of a continuous signal,
(Black)
![Page 12: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/12.jpg)
!"#$%&'()*+&)+&!+,-.)/*&0121+("/-)3&4556 7819:;/<&=>&?<;9@
',;A/2&;2&B.(9)1+(2
C ',;A/2&;*/&;&D129*/)/<E&2;,-</D&
*/-*/2/();)1+(&+F&;&9+()1(.+.2&21A(;<
IGxH
x
Estimating Gradients
7
• Images are a discretely sampled representation of a continuous signal,
!"#$%&'()*+&)+&!+,-.)/*&0121+("/-)3&4556 7819:;/<&=>&?<;9@
',;A/2&;2&B.(9)1+(2
C ',;A/2&;*/&;&D129*/)/<E&2;,-</D&
*/-*/2/();)1+(&+F&;&9+()1(.+.2&21A(;<
IGxH
x
(Black)
![Page 13: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/13.jpg)
• What if I want to know given that I have only the appearance at and ?I(x0 + �x)
Estimating Gradients
8
(Black)
�x
!"#$%&'()*+&)+&!+,-.)/*&0121+("/-)3&4556 7819:;/<&=>&?<;9@
',;A/2&;2&B.(9)1+(2
C ',;A/2&;*/&;&D129*/)/<E&2;,-</D&
*/-*/2/();)1+(&+F&;&9+()1(.+.2&21A(;<
IGxH
x
!"#$%&'()*+&)+&!+,-.)/*&0121+("/-)3&4556 7819:;/<&=>&?<;9@
',;A/2&;2&B.(9)1+(2
C:;)&1D&'&E;()&)+&@(+E&IFx0GdxH&D+*&2,;<<&
dx<#I
IFxH
xx0
I(x0)
I(x0 + �x)I(x0)
![Page 14: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/14.jpg)
• Again, simply take the Taylor series approximation?
Estimating Gradients
9
(Black)
!"#$%&'()*+&)+&!+,-.)/*&0121+("/-)3&4556 7819:;/<&=>&?<;9@
',;A/2&;2&B.(9)1+(2
C ',;A/2&;*/&;&D129*/)/<E&2;,-</D&
*/-*/2/();)1+(&+F&;&9+()1(.+.2&21A(;<
IGxH
x
!"#$%&'()*+&)+&!+,-.)/*&0121+("/-)3&4556 7819:;/<&=>&?<;9@
',;A/2&;2&B.(9)1+(2
C:;)&1D&'&E;()&)+&@(+E&IFx0GdxH&D+*&2,;<<&
dx<#I
IFxH
xx0
I(x0 + �x)I(x0)
I(x0 + �x) � I(x0) +�I(x0)
�x
T
�x
![Page 15: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/15.jpg)
• Again, simply take the Taylor series approximation?
Estimating Gradients
9
(Black)
!"#$%&'()*+&)+&!+,-.)/*&0121+("/-)3&4556 7819:;/<&=>&?<;9@
',;A/2&;2&B.(9)1+(2
C ',;A/2&;*/&;&D129*/)/<E&2;,-</D&
*/-*/2/();)1+(&+F&;&9+()1(.+.2&21A(;<
IGxH
x
!"#$%&'()*+&)+&!+,-.)/*&0121+("/-)3&4556 7819:;/<&=>&?<;9@
',;A/2&;2&B.(9)1+(2
C:;)&1D&'&E;()&)+&@(+E&IFx0GdxH&D+*&2,;<<&
dx<#I
IFxH
xx0
I(x0 + �x)I(x0)
I(x0 + �x) � I(x0) +�I(x0)
�x
T
�x
�I(x0)�x
![Page 16: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/16.jpg)
• Traditional method for calculating gradients in vision is through the use of edge filters. (e.g., Sobel, Prewitt).
• where,
�
�
Gradients through Filters
10
“Horizontal”
“Vertical”
⇥I(x)⇥x
= [�Ix(x),�Iy(x)]T
�Iy
�Ix
I
![Page 17: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/17.jpg)
• Traditional method for calculating gradients in vision is through the use of edge filters. (e.g., Sobel, Prewitt).
• where,
�
�
Gradients through Filters
10
“Horizontal”
“Vertical”
⇥I(x)⇥x
= [�Ix(x),�Iy(x)]T
�Iy
�Ix
I
“Often have to apply a smoothing filter as well.”
![Page 18: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/18.jpg)
Today
• Natural Image Statistics.
• Interest Point Detectors.
• Matching Regions.
• RANSAC.
![Page 19: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/19.jpg)
Interest Point Detectors
![Page 20: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/20.jpg)
Interest Point Detectors
• Interest point detectors, in general, detect corners. • A dense approach (using all pixels) will be far too slow. • Matching lines suffers from the “aperture problem” (i.e. has
the line moved along itself?). • Corners are:-
• relatively sparse • well-localized • good for matching
• reasonably cheap to compute • appear quite robustly • useful for geometry.
![Page 21: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/21.jpg)
A(�x,�y) =X
(xk,yk)2N (x,y)
||I(xk
, y
k
)� I(xk
+ �x, y
k
+ �y)||2
N
(�x,�y)
Interest Point Detectors
• Approach is based on concept of auto-correlation,
14
![Page 22: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/22.jpg)
N (x)
Interest Point Detectors
• Approach is based on concept of auto-correlation,
15
“in vector form”
“local neighborhood”
A(�x) =X
xk2N (x)
||I(xk)� I(xk + �x)||2
![Page 23: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/23.jpg)
A(�x)
5 10 15 20 25
5
10
15
20
25
5 10 15 20 25
5
10
15
20
25
Interest Point Detectors
• Which patches match the auto-correlation responses?
16
A(�x) =X
xk2N (x)
||I(xk)� I(xk + �x)||2
![Page 24: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/24.jpg)
A(�x)
5 10 15 20 25
5
10
15
20
25
5 10 15 20 25
5
10
15
20
25
Interest Point Detectors
• Which patches match the auto-correlation responses?
16
A(�x) =X
xk2N (x)
||I(xk)� I(xk + �x)||2
![Page 25: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/25.jpg)
Harris Detector
• Harris & Stephens (1988) proposed,
17
![Page 26: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/26.jpg)
⇡X
i2N||I(xi)� I(xi)�
@I(xi)@x
T
�x||2
⇡ �xT H�x
H =X
i2N
@I(xi)@x
@I(xi)@x
T
Harris Detector
• How can one characterize these three situations?
A(�x) =X
xk2N (x)
||I(xk)� I(xk + �x)||2
• We can simplify this through a linear approximation,
• where,
![Page 27: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/27.jpg)
Harris Corner Detector
Make decision based on image structure tensor
H =X
i2N
@I(xi)@x
@I(xi)@x
T
![Page 28: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/28.jpg)
Harris Detector
20
![Page 29: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/29.jpg)
Effects of Scale
• Consider a single row or column of the image – Plotting intensity as a function of position gives a signal
Source: S. Seitz
![Page 30: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/30.jpg)
Effects of Scale
• Consider a single row or column of the image – Plotting intensity as a function of position gives a signal
• Where is the edge? Source: S. Seitz
![Page 31: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/31.jpg)
Search Multiple Scales
f
Source: S. Seitz
![Page 32: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/32.jpg)
Search Multiple Scales
f
g
Source: S. Seitz
![Page 33: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/33.jpg)
Search Multiple Scales
f
g
f * g
Source: S. Seitz
![Page 34: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/34.jpg)
Search Multiple Scales
f
g
f * g
Source: S. Seitz
![Page 35: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/35.jpg)
Search Multiple Scales
• To find edges, look for peaks in
f
g
f * g
Source: S. Seitz
![Page 36: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/36.jpg)
SIFT Detector
• Filter with difference of Gaussian filters at increasing scales• Build image stack (scale space)• Find extrema in this 3D volume
![Page 37: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/37.jpg)
Coarse to Fine
24
Scale & Affine Invariant Interest Point Detectors 67
scale estimates the characteristic length of the corre-sponding image structures, in a similar manner as thenotion of characteristic length is used in physics. Theselected scale is characteristic in the quantitative sense,since it measures the scale at which there is maximumsimilarity between the feature detection operator andthe local image structures. This scale estimate will (fora given image operator) obey perfect scale invarianceunder rescaling of the image pattern.
Given a point in an image and a scale selection op-erator we compute the operator responses for a setof scales σn (Fig. 1). The characteristic scale corre-sponds to the local extremum of the responses. Notethat there might be several maxima or minima, thatis several characteristic scales corresponding to differ-ent local structures centered on this point. The char-acteristic scale is relatively independent of the imageresolution. It is related to the structure and not to theresolution at which the structure is represented. Theratio of the scales at which the extrema are found forcorresponding points is the actual scale factor betweenthe point neighborhoods. In Mikolajczyk and Schmid(2001) we compared several differential operators andwe noticed that the scale-adapted Harris measure rarelyattains maxima over scales in a scale-space representa-tion. If too few interest points are detected, the imagecontent is not reliably represented. Furthermore, theexperiments showed that Laplacian-of-Gaussians findsthe highest percentage of correct characteristic scales
Figure 1. Example of characteristic scales. The top row shows two images taken with different focal lengths. The bottom row shows theresponse Fnorm(x, σn) over scales where Fnorm is the normalized LoG (cf. Eq. (3)). The characteristic scales are 10.1 and 3.89 for the left andright image, respectively. The ratio of scales corresponds to the scale factor (2.5) between the two images. The radius of displayed regions inthe top row is equal to 3 times the characteristic scale.
to be found.
|LoG(x, σn)| = σ 2n |Lxx (x, σn) + L yy(x, σn)| (3)
When the size of the LoG kernel matches with thesize of a blob-like structure the response attains an ex-tremum. The LoG kernel can therefore be interpretedas a matching filter (Duda and Hart, 1973). The LoG iswell adapted to blob detection due to its circular sym-metry, but it also provides a good estimation of thecharacteristic scale for other local structures such ascorners, edges, ridges and multi-junctions. Many pre-vious results confirm the usefulness of the Laplacianfunction for scale selection (Chomat et al., 2000;Lindeberg, 1993, 1998; Lowe, 1999).
2.2. Harris-Laplace Detector
In the following we explain in detail our scale invariantfeature detection algorithm. The Harris-Laplace detec-tor uses the scale-adapted Harris function (Eq. (2)) tolocalize points in scale-space. It then selects the pointsfor which the Laplacian-of-Gaussian, Eq. (3), attainsa maximum over scale. We propose two algorithms.The first one is an iterative algorithm which detectssimultaneously the location and the scale of character-istic regions. The second one is a simplified algorithm,which is less accurate but more efficient.
![Page 38: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/38.jpg)
SIFT Detector
Identified Corners Remove those on edges
Remove those where contrast
is low
![Page 39: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/39.jpg)
Today
• Natural Image Statistics.
• Interest Point Detectors.
• Matching Regions.
• RANSAC.
![Page 40: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/40.jpg)
• Once we have detected local regions, we must then match them.
Matching Regions
27
image 1 image 2
SSD : sum of square difference
Small difference values ! similar patches
X
[�x,�y]T2N
||I1(x1 +�x, y1 +�y)� I2(x2 +�x, y2 +�y)||22
(x1, y1)(x2, y2)
![Page 41: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/41.jpg)
Problems with SSD
• SSD measures are
sensitive to both,
• geometric and,
• photometric variation.
• Common practice to
use descriptors.
28
I1
I2
![Page 42: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/42.jpg)
Planar Affine Patch Assumption
29
“View 1” “View 2”
• A number of technique have been proposed to detect affine covariant regions (Schmid et al. 2004).
![Page 43: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/43.jpg)
Rotation Invariance
• Estimation of the dominant orientation – extract gradient orientation – histogram over gradient orientation – peak in this histogram
• Rotate patch in dominant direction
![Page 44: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/44.jpg)
SIFT Descriptor
1. Compute image gradients 2. Pool into local histograms3. Concatenate histograms4. Normalize histograms
More on this in future lectures.
![Page 45: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/45.jpg)
Why Pool?
![Page 46: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/46.jpg)
Why Pool?
![Page 47: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/47.jpg)
Why Pool?
“average”
![Page 48: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/48.jpg)
Why Pool?
⇤ “histogram”“pooling”“blurring”
![Page 49: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/49.jpg)
Why Pool?
⇤ “histogram”“pooling”“blurring”
![Page 50: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/50.jpg)
MATLAB Example
• Example in MATLAB,
>> h = fspecial(‘gaussian’,[25,25],3); >> resp = imfilter(im, h);
⇤h resp
![Page 51: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/51.jpg)
MATLAB Example
• Example in MATLAB,
>> h = fspecial(‘gaussian’,[25,25],3); >> resp = imfilter(im, h);
⇤h resp
![Page 52: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/52.jpg)
Other Descriptors
• Since SIFT, a plethora of other descriptors have been proposed.
• SIFT is sometimes problematic to use in practice as it is • protected under existing patents.
• In OpenCV alone there are, • SURF - (patent protected) • BRIEF • PHREAK
• See following link for tutorial in OpenCV.
• ORB • BRISK • FAST
![Page 53: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/53.jpg)
Other Descriptors
• Since SIFT, a plethora of other descriptors have been proposed.
• SIFT is sometimes problematic to use in practice as it is • protected under existing patents.
• In OpenCV alone there are, • SURF - (patent protected) • BRIEF • PHREAK
• See following link for tutorial in OpenCV.
• ORB • BRISK • FAST
![Page 54: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/54.jpg)
Today
• Natural Image Statistics.
• Interest Point Detectors.
• Matching Regions.
• RANSAC.
![Page 55: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/55.jpg)
Robust Estimation
• Least squares criterion is not robust to outliers
• For example, the two outliers here cause the fitted line to be quite wrong.
• One approach to fitting under these circumstances is to use RANSAC – “Random sampling by consensus”
![Page 56: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/56.jpg)
RANSAC
![Page 57: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/57.jpg)
RANSAC
![Page 58: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/58.jpg)
Fitting a homography with RANSAC
Original images Initial matches Inliers from RANSAC
![Page 59: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/59.jpg)
Things to try in iOS - GPUImage
See - https://github.com/BradLarson/GPUImage for more details.
![Page 60: Lecture 10 - Interest Point Detectors & RANSAC](https://reader030.vdocuments.mx/reader030/viewer/2022012614/619c61a879d6ab4d871884d8/html5/thumbnails/60.jpg)
More to read…
• Prince et al. • Chapter 13, Sections 2-3.
• Corke et al. • Chapter 13, Section 3.
• E. Rublee et al. “ORB: an efficient alternative to SIFT or SURF”, ICCV 2011.