super-resolving a single blurry image through blind deblurring · pdf file ·...
TRANSCRIPT
![Page 1: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/1.jpg)
Super-resolving a Single Blurry ImageThrough Blind Deblurring Using ADMM
Xiangrong Zeng, Yan Liu, Jun Fan, Qizi Huangpeng, Jing Feng,Jinlun Zhou, Maojun Zhang
1
College of Information System and Management
National University of Defense Technology
![Page 2: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/2.jpg)
Single image super-resolution (SISR)
2
aims to recover a high-resolution (HR) image
from a low-resolution (LR) input image
The SISR problem is typically severely ill-posed!
![Page 3: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/3.jpg)
Single image super-resolution (SISR)
3
Gaussian blur [Begin and Ferrie, 2004]
Bicubic interpolation (BI) [Glasner, et al., 2009; Yang, et al., 2010]
Gaussian blur followed by BI [Freeman and Liu, 2011]
Simple pixel averaging [Fattal, 2007]
……
![Page 4: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/4.jpg)
Two important works
4
An accurate blur model is critical to the success of SISRalgorithms[Efrat et al., 2013]
The PSF of camera is the wrong blur kernel from the LRimage [Michaeli and Irani, 2013]
Both seek accurate blur kernels based on existing SISRalgorithms, thus their complexisties are even morethan those of the SISR ones.
![Page 5: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/5.jpg)
Single blind image super-resolution (SBISR)
5
Only a few works dedicated to the SBISR problem, haverestrictive assumptions on the blur kernel:
A parametric Gaussian model with unknown width[Begin and Ferrie, 2004; Qiao, et al., 2006; Wang, et al., 2005]
Multiple parametric models [He, et al., 2009]
A nonparametric model assuming the kernel has asingle peak [He, et al., 2009]
![Page 6: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/6.jpg)
In this paper
6
We address the SBISR problem via a blind image deblurring (BID)
method, bridge the gap between SBISR and BID, benefit from
that some BID methods are arguably faster and easier to
understand, than state-of-the-art SISR/SBISR methods, and
reach competitive speed and restoration quality.
![Page 7: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/7.jpg)
SBISR and BID
7
recover a HR image from a LR imageSBISR:
BID:recover a sharp image from a blurry image
![Page 8: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/8.jpg)
SBISR and BID
8
SBISR:
BID:
we can solve the SBISR problem in an easier way via reformulatingit into a BID problem.
![Page 9: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/9.jpg)
Reformulating SBISR into BID
9
SBISR:
The resulting BID :
![Page 10: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/10.jpg)
The resulting BID problem
10
The regularization problem
![Page 11: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/11.jpg)
The algorithmic framework
11
Can be efficientlysolved by alternatingdirection method ofmultipliers (ADMM)
![Page 12: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/12.jpg)
The alternating direction method of multipliers (ADMM)[Gabay and Mercier, 1976; Boyd et al., 2011; Almeida and Figueiredo, 2013]
12
ADMM has been as a popular tool to solving imaging inverse problems
![Page 13: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/13.jpg)
13
![Page 14: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/14.jpg)
14
![Page 15: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/15.jpg)
15
![Page 16: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/16.jpg)
16
![Page 17: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/17.jpg)
17
![Page 18: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/18.jpg)
18
![Page 19: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan](https://reader031.vdocuments.mx/reader031/viewer/2022030423/5aaa98ea7f8b9a6c188e6d13/html5/thumbnails/19.jpg)
Conclusions
19
• Have proposed a new approach for single blind image super-resolution (SBISR) via a blind image deblurring (BID) method,bridging the gap between SBISR and BID, benefitting from thatsome BID methods are arguably faster and easier to understand,than state-of-the-art SISR/SBISR methods, and reachingcompetitive speed and restoration quality.
• Experiments on synthetic and real images show that theeffectiveness and competitiveness of the proposed method.
Thanks for your attention!