ipcv ‘06 august 21 – september 1 budapest jussi parkkinen markku hauta-kasari department of...
TRANSCRIPT
![Page 1: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/1.jpg)
IPCV ‘06August 21 – September 1
Budapest
Jussi ParkkinenMarkku Hauta-Kasari
Department of Computer ScienceUniversity of Joensuu, Finland
http://spectral.joensuu.fi/
![Page 2: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/2.jpg)
![Page 3: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/3.jpg)
![Page 4: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/4.jpg)
Introduction to spectral color
![Page 5: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/5.jpg)
COLOR ANALYSIS
![Page 6: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/6.jpg)
![Page 7: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/7.jpg)
![Page 8: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/8.jpg)
![Page 9: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/9.jpg)
![Page 10: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/10.jpg)
Eriväristen lehtien spektrejä
![Page 11: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/11.jpg)
Spectral images from real and artificial indoor plants Kanae Miyazawa
![Page 12: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/12.jpg)
Display characterictics
![Page 13: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/13.jpg)
Principle of color detection
Light source
Colored object
Detection system•biological•artificial
![Page 14: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/14.jpg)
Color image formation in human eye
![Page 15: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/15.jpg)
CIE Illum inations D65, A and C
0
50
100
150
200
250
300
300 350 400 450 500 550 600 650 700 750 800
Wavelength (nm)
D65
A
C
![Page 16: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/16.jpg)
![Page 17: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/17.jpg)
![Page 18: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/18.jpg)
![Page 19: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/19.jpg)
![Page 20: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/20.jpg)
![Page 21: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/21.jpg)
![Page 22: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/22.jpg)
![Page 23: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/23.jpg)
RGB vs. Spectrum
• Is the spectrum needed?
• RGB is just a 3D projection of a spectrum
• RGB can produce nice colors on display, but not correct colors
![Page 24: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/24.jpg)
![Page 25: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/25.jpg)
![Page 26: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/26.jpg)
![Page 27: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/27.jpg)
![Page 28: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/28.jpg)
Spectral approach to color
• In spectral approach, color is represented by color signal. This causes the color sensation
• The signal is part of electromagnetic spectrum
- in human color vision the range is 380-780 nm
• In spectral approach, we are not limited into this human visual range
![Page 29: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/29.jpg)
What should be the spectralresolution, i.e.
the sampling rate in wavelenths?
![Page 30: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/30.jpg)
Spectral dependence on sampling
![Page 31: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/31.jpg)
Color dependence on sampling
![Page 32: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/32.jpg)
Change of RGB-values due to sampling
![Page 33: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/33.jpg)
Can we reproduce a spectrum from the RGB-values?
![Page 34: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/34.jpg)
Data• 1494 color samples in 200 color images
– Munsell colors, Color checker, natural colors, wall paint
– cameras: Fuji FinePix and Canon Powershot
– illuminants: A and D65
![Page 35: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/35.jpg)
Methods
1. Polynomial model (R, G, B, R2, G2, B2, ..)
2. Kernel models
Evaluation
• delta E and RMSE (for spectra)– average, std, maximum
![Page 36: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/36.jpg)
Spectra with largest delta E polynomial model
![Page 37: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/37.jpg)
Some preliminary tests with mobile phones cameras
![Page 38: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/38.jpg)
Some preliminary tests with mobile phones cameras
![Page 39: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/39.jpg)
Spektrikuvan kanavakuvia
![Page 40: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/40.jpg)
Spectral Face Image
![Page 41: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/41.jpg)
![Page 42: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/42.jpg)
![Page 43: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/43.jpg)
![Page 44: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/44.jpg)
![Page 45: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/45.jpg)
Spectral Image
![Page 46: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/46.jpg)
Image Types
TYPE SPECTRAL CHANNELS---------------------------------------• Gray-scale• Trichromatic• Spectral
– Hyperspectral• Real-time spectral
• Single• Three• >3• Numerous• Numerous
![Page 47: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/47.jpg)
MEMORY REQUIREMENTS OF IMAGES
Image size 256x256 512x512
gray-level image 65 kB 262 kB
color (RGB-) image 196 kB 786 kB
spectral, 20 nm resol. 1 MB 4 MB
spectral, 5 nm resol. 3 MB 15 MB
![Page 48: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/48.jpg)
Pixels in color image are vectors
• What is the order of color?
• What means the average color?
• How to compute distance in spectral space?
• What is the structure of spectral color space?
![Page 49: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/49.jpg)
Statistical Analysis of Natural Images
![Page 50: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/50.jpg)
Statistical Analysis of Natural Images
![Page 51: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/51.jpg)
Munsell system for color representation
![Page 52: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/52.jpg)
Spectrum and Hue, Saturation, and Value
(a) (b) (c)
400 500 600 7000
20
40
60
80
100
Wavelength(nm)
Reflec
tance
(%)
400 500 600 7000
20
40
60
80
100
Wavelength(nm)
Reflec
tance
(%)
400 500 600 7000
20
40
60
80
100
Wavelength(nm)
Reflec
tance
(%)
![Page 53: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/53.jpg)
Motivation for spectral color
• Not to loose important color information
• To define optimal color sensors
• To develop better color vision models
• To develop novel instruments
• To develop spectral color classifiers and optical implementations for them
![Page 54: IPCV ‘06 August 21 – September 1 Budapest Jussi Parkkinen Markku Hauta-Kasari Department of Computer Science University of Joensuu, Finland](https://reader036.vdocuments.mx/reader036/viewer/2022062409/5697c02c1a28abf838cd94e2/html5/thumbnails/54.jpg)
What is color?
”Color is more than light” ”Computer cannot describe color correctly”
”Color is a perception (of human beings)”• => Color cannot been measured!• => Is this fair to animals?
• In spectral approach, color is represented by color signal. This causes the color sensation
• In spectral approach, we are not limited into this human visual range