a flexible image browsing interface tester - asis.org · a flexible image browsing interface tester...
TRANSCRIPT
![Page 1: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/1.jpg)
©2004 Florida State University
A Flexible Image Browsing Interface
testerPeter JörgensenSchool of Information StudiesFlorida State University
ASIST ’04November 15, 2004
![Page 2: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/2.jpg)
©2004 Florida State University
Warning
![Page 3: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/3.jpg)
©2004 Florida State University
General communication
![Page 4: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/4.jpg)
©2004 Florida State University
Wayfinding
![Page 5: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/5.jpg)
©2004 Florida State University
living
![Page 6: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/6.jpg)
©2004 Florida State University
Instructions
![Page 7: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/7.jpg)
©2004 Florida State University
Finding the image
Keyword searching
CBIR
![Page 8: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/8.jpg)
©2004 Florida State University
keyword queries
![Page 9: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/9.jpg)
©2004 Florida State University
CBIR
![Page 10: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/10.jpg)
©2004 Florida State University
Browsing final candidates
![Page 11: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/11.jpg)
©2004 Florida State University
![Page 12: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/12.jpg)
©2004 Florida State University
![Page 13: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/13.jpg)
©2004 Florida State University
![Page 14: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/14.jpg)
©2004 Florida State University
Slide Show
![Page 15: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/15.jpg)
©2004 Florida State University
Story Board
![Page 16: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/16.jpg)
©2004 Florida State University
![Page 17: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/17.jpg)
©2004 Florida State University
![Page 18: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/18.jpg)
©2004 Florida State University
![Page 19: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/19.jpg)
©2004 Florida State University
![Page 20: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/20.jpg)
©2004 Florida State University
![Page 21: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/21.jpg)
©2004 Florida State University
![Page 22: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/22.jpg)
©2004 Florida State University
![Page 23: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/23.jpg)
©2004 Florida State University
![Page 24: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/24.jpg)
©2004 Florida State University
![Page 25: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/25.jpg)
©2004 Florida State University
![Page 26: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/26.jpg)
©2004 Florida State University
![Page 27: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/27.jpg)
©2004 Florida State University
![Page 28: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/28.jpg)
©2004 Florida State University
![Page 29: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/29.jpg)
©2004 Florida State University
Browsing limitations
System speeds
bandwidth
refresh rate
compression
Human factors
![Page 30: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/30.jpg)
©2004 Florida State University
Human Factors
Images per second (minute)
size
bit depth
task
![Page 31: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/31.jpg)
©2004 Florida State University
Previous ResearchVideo surrogates
Cinque et al 1998
Video keyframes
Komlodi & Marchionini, 1998
Tse et al 1998
Lee et al 2000
Geisler, 2003
![Page 32: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/32.jpg)
©2004 Florida State University
Potter & Levy (1969)
Potter, M. C., & Levy, E. I. (1969). Recognition Memory for a Rapid Sequence of Pictures. Journal of Experimental Psychology, 81(1), 10-15.
![Page 33: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/33.jpg)
©2004 Florida State University
A third approach
Slide Show
Storyboard
Multiple Scrolling Thumbnails
![Page 34: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/34.jpg)
©2004 Florida State University
Multiple Scrolling Thumbnails
ASIST 2001 - Yang, Geisler, et al (2003)
Storyboard layout
Slide show animation
![Page 35: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/35.jpg)
©2004 Florida State University
![Page 36: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/36.jpg)
©2004 Florida State University
Instrument development
ibi
Image Browsing Interface
AppleScript Studio under Xtools (now Xcode)
800 MHz iMac running OS X
![Page 37: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/37.jpg)
©2004 Florida State University
ibi specifications
Three Modes
Single image
Slide Show
Multiple Scrolling Images
![Page 38: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/38.jpg)
©2004 Florida State University
ibi - parameters
Single images
Frames per second
image size
image set source movie
![Page 39: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/39.jpg)
©2004 Florida State University
ibi – parameters
Multiple Images
Number of columns
Number of rows
Max. 12 images
![Page 40: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/40.jpg)
©2004 Florida State University
ibi – data logText file, tab delimited
Date and time
Mode & frame rate
# rows and columns
Image set movie file
Number of images viewed
![Page 41: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/41.jpg)
©2004 Florida State University
Subjects
26 volunteers from School
students
faculty
![Page 42: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/42.jpg)
©2004 Florida State University
Tasks
2 face recognition
2 subject recognition
![Page 43: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/43.jpg)
©2004 Florida State University
Images used
Face Set
AR Faces Database (Martinez & Benavente, 1998)
General Set
(Jörgensen & Jörgensen, 2002)
![Page 44: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/44.jpg)
©2004 Florida State University
Target Images
![Page 45: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/45.jpg)
©2004 Florida State University
Alternate Targets
![Page 46: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/46.jpg)
©2004 Florida State University
Results
Hits
< 3 seconds after target presentation
Near hit
< 3 seconds after alternate target presentation
![Page 47: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/47.jpg)
©2004 Florida State University
Data
Combined faces data
similarity
threw out arches data
too many similar
two identical
![Page 48: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/48.jpg)
©2004 Florida State University
ResultsSuccess Rate vs Frame Rate
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
1 2 4 8 12 16Frames per second
HitsTotal Hits
![Page 49: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/49.jpg)
©2004 Florida State University
ConclusionSupports Potter & Levy (8 fps is practical maximum for untrained browsers.)
Much more testing needs to be done
Size
color vs grayscale
Modes
![Page 50: A Flexible Image Browsing Interface tester - asis.org · A Flexible Image Browsing Interface tester ... CBIR ©2004 Florida State University keyword queries ... Slide show animation](https://reader033.vdocuments.mx/reader033/viewer/2022051601/5ad501497f8b9aff228c9279/html5/thumbnails/50.jpg)
©2004 Florida State University
Questions?Funded by FSU First Year Assistant Professor Award,Information Institute of the School of Information Studiesand the Dean of the School of Information Studies
http://faculty35.lis.fsu.edu/~peter/asist04_pej.pdfhttp://faculty35.lis.fsu.edu/~peter/jorgensen2004_ibi.pdf