using eigencolor normalization for illumination-invariant color object recognition
DESCRIPTION
Using eigencolor normalization for illumination-invariant color object recognition. Zhenyong Lin, Junxian Wang, Kai- Kuang Ma Pattern Recognition 35 (2002) 2629 – 2642. Speaker: 鄭雅勻 Date:2010/12/30. Outline. Introduction Related Work Implementation Results Conclusion. - PowerPoint PPT PresentationTRANSCRIPT
Using eigencolor normalization for illumination-invariantcolor object recognition
Speaker:鄭雅勻Date:2010/12/30
Zhenyong Lin, Junxian Wang, Kai-Kuang Ma
Pattern Recognition 35 (2002) 2629 – 2642
Outline
• Introduction• Related Work• Implementation• Results• Conclusion
Introduction• Color is one of salient features for color object recognition, however, the
colors of object images sensitively depend on scene illumination.
• Color indexing, a histogram intersection algorithm to compare an observed histogram with those established from database.
• A color histogram is independent of common imaging conditions, such as orientation of a scene, absence or occlusion of colors but not the color of scene illumination changes.
• To overcome the lighting dependency problem, a color constancy or color normalization method can be used as a pre-processing step.
Introduction• Color constancy process attempts to estimate the illumination, and the
image colors are then corrected based on the estimated illumination to remove color bias and only the inherent colors are used for recognition.
• Calculate color-invariant features from images and use these features for indexing.
Related Work• The failure of the color constancy method implies that the actual illumination of the
scene might be different from the measured illumination. ----- B.V. Funt, L. Martin[1998]
• An approach called color constant color indexing, to demonstrate that the ratio of adjacent colors is relatively insensitive to illumination changes. ----- Funt and Finlayson [1995]• Healey and Slater [1994] derived the functions of color distribution moments that are
invariant to illumination changes.
• This approach does not attempt to recover the true colors of objects, but extracts the color-invariant features.
• To retain the image representation while keeping good indexing, a method called comprehensive color image normalization.
----- G.D. Finlayson, G.Y. Tian[1999]
Objective• We present a new illumination-invariant color normalization algorithm, called
eigencolor normalization. △ moments of color distributions [4] G. Healey, D. Slater, △ the normalization algorithm for planar patterns [6,7] J.G. Leu, S.C. Pei, C.N. Lin,
• The normalized color histograms of an object under different illuminations will become very similar to each other after the normalization process.
• The color object recognition can be performed more accurately by the color indexing on the normalized histograms.
Implementation
• The compact color image• It is well-known that the colors of the same object under different illuminations are
affine transformations to each other [4,5]. We can establish their affine-transformation relation as follows:
Let and denote two n-dimensional histograms that represent the distributions of all color values and respectively.
• Let H(R; G; B) be a color histogram; and the R,G and B values are quantized into 8 bits each (i.e.;0-255 discrete levels)
The probability density function h(R; G; B) can be formed as
Implementation
• For the color histogram H(R; G; B), the central moment with order of k + r + l is denoted by and defined as
Implementation
Implementation
If we can find the affinetransformation matrices
transform
Two histogram second-order
central moment matrices
the same object under two different illuminations
direct histogram intersection matching
X not good result
Then, the affine-transformed Histograms will less correlated and more compact.
O improved matching results
• shape compacting technique that has been used for 2-D planar shape object normalization to compact 3-D color image. [6,7] The resulted image is called compact color image.
Implementation
‧ it shows that a color image can be compacted by changing its coordinate system.
the compact color image is variant to other non-affined transforms ex: skew transformationwhich is often caused by uneven lighting condition or curved object surface.
• To make the color image more illumination-invariant, we need to further normalize the compact color image.
Implementation
matrix Q is orthogonal (proof)
If Q is orthogonal then that is
Matrix Q is orthogonal
From Eq.(14)
From Eq.(9)
From Eq.(8)
(9)
• Corollary 1. If the affine matrix is orthogonal; then .
In this case, the compact color image is the same as the normalized color
image. Proof. If the affine matrix is orthogonal
Implementation
the compact color image is the same as the normalized color image
• Since every 3×3 orthogonal matrix is a rotation matrix in 3-D space [8], the normalized color image can be obtained by rotating the color of the compact color image.
Implementation
is the norm of the plane containing the main diagonal vector of the 3-D color space and the principal axis of the color distribution of the compact color image.
‧Given the rotation axis and the rotation angle (according to the Rodrigues formula [8]), the rigid body rotation matrix can be estimated by :
Rodrigues rotation formula Rodrigues’ rotation formula is an efficient algorithm for rotating a vector in space, given an axis and angle of rotation. By extension, this can be used to transform all three basis vectors to compute a rotation matrix from an axis-angle representation. the Rodrigues formula is:
Implementation
Implementation
By selecting Q = in our proposed eigencolor normalization algorithm, the new color coordinate system, called
Result• A demonstration of eigencolor normalized histogram
Here compare the histograms of a simple color image before and after exploiting the proposed eigencolor normalization processing.
Sony DXC-950 3CCD color video camera under a white light source and interfaced to a Matrox Meter frame grabber card.
Fig. 2. Color histograms before (from (a) to (c)) and after (from (d) to (f)) applying our eigencolor normalization processing.
a,b,c original R,G,Bd,e,f normalized R,G,B
According to the algorithm, size of 45 × 45 is about 2 seconds on a Pentium III 500 Hz PC.
Result• Color object recognition tests without illumination
The color image database contains66 model images with size of128 × 128 each
Fig. 3 the monochrome version of model images
The recognition or matching performance of each algorithm is the histogram distance.
ResultAll test images except T17 are correctly recognized as the best match. Further note that test image T17 is a muchzoom-in and rotation version of model image 40 in Fig. 3.
Result‧Color object recognition tests with illumination changes
a color image was captured by the same hardware but under different illuminations, white, red, green and blue.
Result‧Color object recognition performance comparison
Sony DXC-930 3-CDD video camera was used with gamma correction of and color temperature being set at 3200 K.
region-of-interestimage patch40 × 40 each under four different illuminations
Fig. 8. Histograms of two color images (a) and (d) are original histograms (b) and (c) are compact histograms (c) and (f) are eigencolor histograms These color images were taken under four different illuminations (from top to bottom in each sub-figure)Macbeth 5000 tube ,Sylvania cool-white fluorescent tube, Phillips ultralume fluorescent tube, Sylvania 75 halogen bulb
Result
two phases, an off-line training phase -> the eigencolor normalized histograms of the database images are generatedan on-line matching phase-> the histogram of the eigencolor normalized image of a test object is first obtained
‧On-line color object recognition under illumination changes
syl-cwf -> Sylvania cool-white fluorescent tube
ph-ulm -> Philips ultralume fluorescent tube halogen ->Sylvania 75 W halogen tube
Result
Conclusions
• In this paper, we present an effective way to normalize color images for correcting illumination changes, and consequently, improving color object recognition accuracy.
• The normalized color space, called eigencolor space, is aimed to be more invariant to various illumination changes, which mathematically corresponds to affine transformations as well as non-affine transformation from the original images.
• Results clearly show that our eigencolor representation approach outperforms in facilitating more accurate recognition of color objects under various illuminations.