Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-lj6df Total loading time: 0 Render date: 2024-11-05T06:45:48.839Z Has data issue: false hasContentIssue false

1 - Mathematical models and practical solvers for uniform motion deblurring

Published online by Cambridge University Press:  05 June 2014

Jiaya Jia
Affiliation:
The Chinese University of Hong Kong
A. N. Rajagopalan
Affiliation:
Indian Institute of Technology, Madras
Rama Chellappa
Affiliation:
University of Maryland, College Park
Get access

Summary

Recovering an un-blurred image from a single motion-blurred picture has long been a fundamental research problem. If one assumes that the blur kernel – or point spread function (PSF) – is shift invariant, the problem reduces to that of image deconvolution. Image deconvolution can be further categorized as non-blind and blind.

In non-blind deconvolution, the motion blur kernel is assumed to be known or computed elsewhere; the task is to estimate the un-blurred latent image. The general problems to address in non-blind deconvolution include reducing possible unpleasant ringing artifacts that appear near strong edges, suppressing noise, and saving computation. Traditional methods such as Wiener deconvolution (Wiener 1949) and the Richardson–Lucy (RL) method (Richardson 1972, Lucy 1974) were proposed decades ago and find many variants thanks to their simplicity and efficiency. Recent developments involve new models with sparse regularization and the proposal of effective linear and non-linear optimization to improve result quality and further reduce running time.

Blind deconvolution is a much more challenging problem, since both the blur kernel and the latent image are unknown. One can regard non-blind deconvolution as an inevitable step in blind deconvolution during the course of PSF estimation or after the PSF has been computed. Both blind and non-blind deconvolution are practically very useful; they are studied and employed in a variety of disciplines including, but not limited to, image processing, computer vision, medical and astronomic imaging, and digital communication.

Type
Chapter
Information
Motion Deblurring
Algorithms and Systems
, pp. 1 - 30
Publisher: Cambridge University Press
Print publication year: 2014

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Andrews, H. & Hunt, B. (1977). Digital Image Restoration, Prentice-Hall Signal Processing Series. Englewood Cliffs: Prentice-Hall.
Ayers, G. & Dainty, J. (1988). Iterative blind deconvolution method and its applications. Optics Letters, 13(7), 547–9.Google Scholar
Chan, T. & Wong, C. (1998). Total variation blind deconvolution. IEEE Transactions on Image Processing, 7(3), 370–5.Google Scholar
Cho, S. & Lee, S. (2009). Fast motion deblurring. ACM Transactions on Graphics, 28(5), 145:1–8.Google Scholar
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T. & Freeman, W. T. (2006). Removing camera shake from a single photograph. ACM Transactions on Graphics, 25(3), 787–94.Google Scholar
Fish, D., Brinicombe, A., Pike, E. & Walker, J. (1995). Blind deconvolution by means of the Richardson-Lucy algorithm. Journal of the Optical Society of America, 12(1), 58-65.Google Scholar
Geman, D. & Reynolds, G. (1992). Constrained restoration and the recovery of discontinuities. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(3), 367–83.Google Scholar
Geman, D. & Yang, C. (1995). Nonlinear image recovery with half-quadratic regularization. IEEE Transactions on Image Processing, 4(7), 932–46.Google Scholar
Hunt, B. (1973). The application of constrained least squares estimation to image restoration by digital computer. IEEE Transactions on Computers, 100(9), 805–12.Google Scholar
Jia, J. (2007). Single image motion deblurring using transparency. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8.
Jordan, M., Ghahramani, Z., Jaakkola, T. & Saul, L. (1999). An introduction to variational methods for graphical models. Machine Learning, 37(2), 183–233.Google Scholar
Joshi, N., Szeliski, R. & Kriegman, D. J. (2008). PSF estimation using sharp edge prediction. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8.
Kim, S.-J., Koh, K., Lustig, M. & Boyd, S. P. (2007). An efficient method for compressed sensing. In IEEE International Conference on Image Processing, pp. 117–20.
Krishnan, D. & Fergus, R. (2009). Fast image deconvolution using hyper-Laplacian priors. In Neural Information Processing Systems Conference, pp. 1033–41.
Krishnan, D., Tay, T. & Fergus, R. (2011). Blind deconvolution using a normalized sparsity measure. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 233–40.
Levin, A., Fergus, R., Durand, F. & Freeman, W. T. (2007). Image and depth from a conventional camera with a coded aperture. ACM Transactions on Graphics, 26(3), 70:1–10.Google Scholar
Levin, A., Weiss, Y., Durand, F. & Freeman, W. T. (2009). Understanding and evaluating blind deconvolution algorithms. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 1964–71.
Levin, A., Weiss, Y., Durand, F. & Freeman, W. T. (2011). Efficient marginal likelihood optimizationinblind deconvolution. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 2657–64.
Lucy, L. (1974). An iterative technique for the rectification of observed distributions. Journal of Astronomy, 79, 745.Google Scholar
Miller, K. (1970). Least squares methods for ill-posed problems with a prescribed bound. SIAM Journal on Mathematical Analysis, 1, 52.Google Scholar
Miskin, J. & MacKay, D. (2000). Ensemble learning for blind image separation and deconvolution. Advances in Independent Component Analysis, pp. 123–41.
Money, J. & Kang, S. (2008). Total variation minimizing blind deconvolution with shock filter reference. Image and Vision Computing, 26(2), 302–14.Google Scholar
Osher, S. & Rudin, L. I. (1990). Feature-oriented image enhancement using shock filters. SIAM Journal on Numerical Analysis, 27(4), 919–40.Google Scholar
Richardson, W. (1972). Bayesian-based iterative method of image restoration. Journal of the Optical Society of America, 62(1), 55–9.Google Scholar
Shan, Q., Jia, J. & Agarwala, A. (2008). High-quality motion deblurring from a single image. ACM Transactions on Graphics, 27(3), 73:1–10.Google Scholar
Tikhonov, A.N. & Arsenin, V. Y. (1977). Solutions of Ill Posed Problems. V. H. Winston and Sons.
van Cittert, P. (1931). Zum einfluß der spaltbreite auf die intensitätsverteilung in spektrallinien. ii. Zeitschrift für Physik A Hadrons and Nuclei, 69(5), 298–308.Google Scholar
Wang, Y., Yang, J., Yin, W. & Zhang, Y. (2008). A new alternating minimization algorithm for total variation image reconstruction. SIAM Journal on Imaging Sciences, 1(3), 248–72.Google Scholar
Wang, Y. & Yin, W. (2009). Compressed Sensing via Iterative Support Detection, CAAM Technical Report TR09-30.
Wiener, N. (1949). Extrapolation, interpolation, and smoothing of stationary time series: with engineering applications. Journal of the American Statistical Association, 47(258).Google Scholar
Woods, J. & Ingle, V. (1981). Kalman filtering in two dimensions: Further results. IEEE Transactions on Acoustics, Speech and Signal Processing, 29(2), 188–97.Google Scholar
Xu, L. & Jia, J. (2010). Two-phase kernel estimation for robust motion deblurring. In European Conference on Computer Vision, pp. 157–70.
Xu, L., Yan, Q., Xia, Y. & Jia, J. (2012). Structure extraction from texture via relative total variation. ACM Transactions on Graphics, 31(6), 139:1–10.Google Scholar
Xu, L., Zheng, S. & Jia, J. (2013). Unnatural l0 sparse representation for natural image deblurring. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 1107–14.
Yang, J., Zhang, Y. & Yin, W. (2009). An efficient TVL1 algorithm for deblurring multichannel images corrupted by impulsive noise. SIAM Journal on Scientific Computing, 31(4), 2842–65.Google Scholar
Yuan, L., Sun, J., Quan, L. & Shum, H.-Y. (2008). Progressive inter-scale and intra-scale nonblind image deconvolution. ACM Transactions on Graphics, 27(3), 74:1–10.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×