1 feature sets based similarity measures for image retrieval asis&t annual meeting, charlotte,...
TRANSCRIPT
![Page 1: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/1.jpg)
1
Feature Sets Based Similarity Measures for Image Retrieval
ASIS&T Annual Meeting, Charlotte, NCOctober 28 – November 2, 2005
Abebe Rorissa
College of Computing and Information, University at Albany,
State University of New York (SUNY)
![Page 2: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/2.jpg)
2
Outline
BackgroundSimilarity and similarity measures in information retrieval
Feature sets based similarity measures
Boolean & Extended BooleanFuzzy sets modelA similarity measure based on Tversky’s Contrast Model
Concluding remarks
![Page 3: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/3.jpg)
3
Background
Similarity is a construct that plays significant roles in:
Cognitive psychology
Linguistics & language studies
Sociology & anthropology
Ecology & biology
Library & information science
![Page 4: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/4.jpg)
4
Background: Similarity Measures and Information Retrieval
![Page 5: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/5.jpg)
5
Background: Similarity Measures and Image Retrieval
Zachary & Iyengar (2001)
![Page 6: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/6.jpg)
6
Background: Similarity Measures based on Geometric models
The general form of the distance (called the Minkowski metric) between two points representing stimuli a and b on an n-dimensional space is given by:
r
n
i
r
ii babaD
1
),(
Where ai and bi are corresponding coordinates of
stimuli a and b on the ith dimension and r is a parameter that determines the type of metric
![Page 7: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/7.jpg)
7
Background: Similarity Measures and Image Retrieval
Rubner (1999)
![Page 8: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/8.jpg)
8
Background: Geometric models and Metric Space
Dim 1
Dim 2
Symmetry: D(a,b)=D(b,a)????
Triangle inequality: D(a,b)+ D(b,c) D(a,c)????
a
bc
![Page 9: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/9.jpg)
9
Background: The Contrast Model
A-B B-A
A B
AB
S(a,b)=f(AB) - f(A-B) - f(B-A)
Distinctive features of a
Distinctive features of b
Common features of a & b
![Page 10: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/10.jpg)
10
Background: The Contrast Model Results of a Study
Independent Variable B Beta t
Common Features (method1) 1.196 .486 9.505**
Distinctive Features of a (method1) -.033 -.197 -4.311**
Distinctive Features of b (method1)
-.016 -.090 -2.181*
R2=.45, F(3,431)=116.101**
Common Features (method2) .252 .469 11.136**
Distinctive Features of a (method2) -.042 -.163 -3.865**
Distinctive Features of b (method2)
-.020 -.089 -2.210*
R2=.30, F(3,431)=60.423**Note. *p < .05, **p < .01
R2 = .55
![Page 11: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/11.jpg)
11
Feature Sets based Similarity Measures
Applied in the following retrieval models:
Boolean model
Extended Boolean model
Fuzzy sets model
![Page 12: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/12.jpg)
12
Feature Sets based Similarity Measures – Generalized Contrast
Model
A)-f(BB)-f(AB)f(AB)f(A
b)S(a,
Where & are non-negative (≥ 0)
The values of S(a,b) range from 0 to 1
![Page 13: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/13.jpg)
13
Summary & Concluding Remarks
Similarity matching/measure is a key component of information retrievalA similarity measure based on the Contrast Model offers an alternativeIt gives more weight to common features than distinctive featuresIt takes into account any definition of a feature set and could be applied to any type of document (text, 2D, 3D, moving, etc.)It matches perceptual similarity, which is important if we are to bridge the gap between IR systems and users
![Page 14: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/14.jpg)
14
Looking Ahead
Image organization and retrieval research not coordinated
Need for a common test collection and a retrieval evaluation conference along the lines of the TREC video track
ASIS&T is an appropriate forum
Current initiatives http://ir.shef.ac.uk/imageclef/
![Page 15: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/15.jpg)
15
References
Rubner, Y. (1999). Perceptual metrics for image database navigation. Unpublished doctoral dissertation, Stanford University, Stanford, CA.
Tversky, A. (1977). Features of similarity. Psychological Review, 84(4), 327-352.
Zachary, J., & Iyengar, S.S. (2001). Information theoretic similarity measures for content based image retrieval. Journal of the American Society for Information Science and Technology, 52, 856-867.
![Page 16: 1 Feature Sets Based Similarity Measures for Image Retrieval ASIS&T Annual Meeting, Charlotte, NC October 28 – November 2, 2005 Abebe Rorissa (arorissa@albany.edu)](https://reader036.vdocuments.mx/reader036/viewer/2022062511/5514c82b550346935c8b49b4/html5/thumbnails/16.jpg)
16
Thank You!
Questions?