iterated denoising for image recovery
DESCRIPTION
Presentation given at DCC 02. Iterated Denoising for Image Recovery. Onur G. Guleryuz [email protected]. To see the animations and movies please use full-screen mode. Clicking on pictures to the left of PSNR curves should start the movies. There are also reminder notes for some slides. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/1.jpg)
Iterated Denoising for Image Recovery
Onur G. [email protected]
To see the animations and movies please use full-screen mode.Clicking on pictures to the left of PSNR curves should start the movies.
There are also reminder notes for some slides.
Presentation given at DCC 02.
![Page 2: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/2.jpg)
Overview•Problem definition.
•Main Algorithm.
•Rationale.
•Choice of transforms.
•Many simulation examples, movies, etc.
•Brought code. Can run for other images, for your images, etc.If interested, please find me during breaks or evenings.
•Errata for manuscript.
Notices:
![Page 3: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/3.jpg)
Problem Statement
Image
LostBlock
Use surrounding spatial information to recover lost block via overcomplete denoising with
hard-thresholding.*
Generalizations: Irregularly shaped blocks, partial information, ...
Pretend “Image + Noise”
Applications: Error concealment, damaged images, ...
![Page 4: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/4.jpg)
What is Overcomplete Denoising with Hard-thresholding?
x
y
DCT (MxM) tilings
Image
Hard threshold coefficients with T
Partially denoised result
1Hard threshold
coefficients with TPartially
denoised result 2.
.
.
Average partially denoised resultsfor final denoised image.
Utilized transform will be very important!
![Page 5: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/5.jpg)
Examples(Figure 1 in the paper)
+9.37 dB
+8.02 dB
+11.10 dB
+3.65 dB
![Page 6: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/6.jpg)
Main Algorithm IDenoising with hard-thresholding using overcomplete transforms
Recover layer P by mainly using information from layers 0,…,P-1
(Figure 2 in the paper)
![Page 7: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/7.jpg)
Main Algorithm II• Assign initial values to layer pixels.
for i=1: number_of_layers
recover layer i by overcomplete denoising with threshold T
end
T=T- dT
• T=T0
• while ( T > T )F
•end
![Page 8: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/8.jpg)
thk DCT block
*Main Algorithm III
x
y
DCT (MxM) tiling 1
Outer border of layer P
Image
Lost block o (k)y
o (k)x
Hard threshold block k coefficients if
o (k) < M/2y
o (k) < M/2x
OR
(Figure 3 in the paper)
![Page 9: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/9.jpg)
(Figure 4 in the paper)Example DCT Tilings and
Selective Hard Thresholding
![Page 10: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/10.jpg)
Rationale: Denoising and Recovery
Main intuition: Keep coefficients of high SNR, zero out coefficients of low SNR.
ecc ˆoriginal transform coefficient
error
Assume that the transform yields a sparse image representation:
ec ec ~ˆ
Hard thresholding removes more noise than signal.c
![Page 11: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/11.jpg)
Rationale: Other AnalogiesBand limited reconstructions via POCS:
Set of bandlimited (low pass) signals
Set of possible signals given the available
information.
.
.
.
Assumes low frequency Fourier coefficients are important and zeros out high frequencies coefficients.
This work: Adaptively change sets at each iteration. Let data determine the important coefficients and
which coefficients to zero out.
Best subspaces to zero-out in a POCS setting. Optimal linear estimators. Sparse transforms.
![Page 12: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/12.jpg)
Properties of Desired Transforms
•Periodic, approximately periodic regions:
Transform should “see” the period
Example: Minimum period 8 at least 8x8 DCT, ~ 3 level wavelet packets.
•Edge regions (sparsity may not be enough):
Transform should “see” the slope of the edge.
k
kNngns )()(
![Page 13: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/13.jpg)
Periodic Example(Figure 1 in the paper)
DCT 9x9
+11.10 dB
![Page 14: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/14.jpg)
Periodic Example
(period=8)
(Figure 5 in the paper)
DCT 8x8
Perf. Rec.
![Page 15: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/15.jpg)
Periodic Example(Figure 6 in the paper)
DCT 16x16
+3.65 dB
![Page 16: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/16.jpg)
Periodic Example
DCT 24x24
+5.91 dB
![Page 17: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/17.jpg)
“Periodic” Example
DCT 16x16
+7.2 dB
![Page 18: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/18.jpg)
“Periodic” Example
DCT 24x24
+10.97 dB
![Page 19: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/19.jpg)
Edge Example
DCT 8x8
+25.51 dB
![Page 20: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/20.jpg)
Edge Example(Figure 6 in the paper)
Complex wavelets
+9.37 dB
![Page 21: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/21.jpg)
Edge Example(Figure 6 in the paper)
Complex wavelets
+16.72 dB
![Page 22: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/22.jpg)
Edge Example(Figure 6 in the paper)
DCT 24x24
+9.26 dB
![Page 23: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/23.jpg)
Edge Example(Figure 1 in the paper)
Complex wavelets
+8.02 dB
![Page 24: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/24.jpg)
Unsuccessful Recovery Example(Figure 7 in the paper)
DCT 16x16
-1.00 dB
![Page 25: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/25.jpg)
Partially Successful Recovery Example
(Figure 7 in the paper)
DCT 16x16
+4.11 dB
![Page 26: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/26.jpg)
Edges and “Small Transforms”
DCT 4x4
-1.06 dB
![Page 27: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/27.jpg)
Edges and “Small Transforms”
+5.56 dB
DCT 4x4
![Page 28: Iterated Denoising for Image Recovery](https://reader036.vdocuments.mx/reader036/viewer/2022062408/568139e9550346895da1a220/html5/thumbnails/28.jpg)
Edge Example(Figure 6 in the paper)
DCT 24x24
+9.26 dB