Adaptive Optimized Discriminative Learning based Image Deblurring using Deep CNN
Article Sidebar
Main Article Content
Abstract
Image degradation plays a major problem in many image processing applications. Due to blurring, the quality of an image is degraded and there will be a reduction in bandwidth. Blur in an image is due to variations in atmospheric turbulence, focal length, camera settings, etc. Various types of blurs include Gaussian blur, Motion blur, Out-of-focus blur. The effect of noise along with blur further corrupts the captured image. Many techniques have evolved to deblur the degraded image. The leading approach to solve various degraded images are either based on discriminative learning models or on optimization models. Each method has its own advantages and disadvantages. Learning by discriminative methods is faster but restricted to a specific task whereas optimization models handle flexibly but consume more time. Integrating optimization models suitably by learning with discriminative manner results in effective image restoration. In this paper, a set of effective and fast Convolutional Neural Networks (CNNs) are employed to deblur the Gaussian, motion and out-of-focus blurred images that integrate with optimization models to further avoid noise effects. The proposed methods work more efficiently for applications with low-level vision.
Article Details
References
H. C. Andrews and B. R. Hunt. Digital image restoration. Prentice-Hall Signal Processing Series, Englewood Cliffs:Prentice-Hall, 1977, 1, 1977.
K. Zhang, W. Zuo, Y. Chen, D. Meng, and L. Zhang. Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE Transactions on Image Processing, 2017.
P. Campisi and K. Egiazarian. Blind image deconvolution: theory and applications. CRC press, 2016.
P. Milanfar, “A tour of modern image filtering: New insights and methods, both practical and theoretical,” IEEE Signal Process. Mag., vol. 30, no. 1, pp. 106–128, Jan. 2013
T. S. Cho, C. L. Zitnick, N. Joshi, S. B. Kang, R. Szeliski, and W. T. Freeman, “Image restoration by matching gradient distributions,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 683–694, Apr. 2012.
W. Dong, L. Zhang, G. Shi, and X. Li. Nonlocally centralized sparse representation for image restoration. IEEE Transactions on Image Processing, 22(4):1620–1630, 2013.
H. C. Burger, C. J. Schuler, and S. Harmeling. Image denoising: Can plain neural networks compete with BM3D? In IEEE Conference on Computer Vision and Pattern Recognition, pages 2392–2399, 2012.
Yadav, S. S. ., Maan, M. K. ., Kumar, M. S. ., J., K. ., Pund, S. S. ., & Rathod, M. . (2023). A Secure IoT Smart Network Model for the Contributory Broadcast Encryption for the Text Policy Management Scheme. International Journal of Intelligent Systems and Applications in Engineering, 11(3s), 42–48. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2530
C. Dong, C. C. Loy, K. He, and X. Tang. Image super-resolution using deep convolutional networks. IEEE transactions on Pattern Analysis and Machine Intelligence, 38(2):295–307, 2016.
L. Xu, J. S. Ren, C. Liu, and J. Jia. Deep convolutional neural network for image deconvolution. In Advances in Neural Information Processing Systems, pages 1790–1798, 2014.
S. Gu, L. Zhang, W. Zuo, and X. Feng. Weighted nuclear norm minimization with application to image denoising. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2862–2869, 2014.
Janardhana Rao, B., Chakrapani, Y., & Srinivas Kumar, S. (2022). Video Inpainting Using Advanced Homography-based Registration Method. Journal of Mathematical Imaging and Vision, 64(9), 1029-1039.
Janardhana Rao, B., Chakrapani, Y., & Srinivas Kumar, S. (2022). MABC?EPF: Video in?painting technique with enhanced priority function and optimal patch search algorithm. Concurrency and Computation: Practice and Experience, 34(11), e6840.
Rao, B. J., Chakrapani, Y., & Kumar, S. S. (2022). An enhanced video inpainting technique with grey wolf optimization for object removal application. Journal of Mobile Multimedia, 561-582.
Janardhana Rao, B., Chakrapani, Y., & Srinivas Kumar, S. (2022). Hybridized cuckoo search with multi-verse optimization-based patch matching and deep learning concept for enhancing video inpainting. The Computer Journal, 65(9), 2315-2338.
A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, pages 1097–1105, 2012.
S, D. A. (2021). CCT Analysis and Effectiveness in e-Business Environment. International Journal of New Practices in Management and Engineering, 10(01), 16–18. https://doi.org/10.17762/ijnpme.v10i01.97
D. Kingma and J. Ba. Adam: A method for stochastic optimization. In International Conference for Learning Representations, 2015.
S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International Conference on Machine Learning, pages 448–456, 2015.
F. Yu and V. Koltun. Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:1511.07122, 2015.
D. Yang and S. Qin, "Restoration of Partial Blurred Image Based on Blur Detection and Classification," Journal of Electrical and Computer Engineering, 2016.
J. Shi and J. Jia, "Discriminative Blur Detection Features," IEEE international conference on computer vision and pattern recognition, pp. 2965-2972, 2014.
R. Wang and W. Wang, "Spatially Variant Defocus Blur Map Estimation and Deblurring from a Single Image," Journal of Visual Communication and Image Representation, vol. 35, pp. 257-264, 2016.
G. S. Trani, T. P. Nghieml, N. Quang, A. Drogoul, and L. C. Mai, "Fast Parallel Blur Detection of Digital Images," IEEE Research, Innovation and vision for the future International Conference on Computing & Communication Technologies, pp. 147-152, 2016.
S. Pendyala, P. Ramesha, A. V. Bns, and D. Arora, "Blur Detection and Fast Blind Image Deblurring," IEEE Annual Conference in India, pp. 1-4, 2015.
S. Pendyala, P. Ramesha, A. V. Bns, and D. Arora, "Blur Detection and Fast Blind Image Deblurring," IEEE Annual Conference in India, pp. 1-4, 2015.
Q. Shan, J. Jia, and A. Agarwala, "High-quality Motion Deblurring from a Single Image," in ACM Transactions on Graphics, 2008, vol. 27, no. 3.
G. Air, M. Indaco, D. Rolfo, L. O. Russo, P. Trotta, and P. Torino, "Evaluation of image deblurring algorithms for real-time applications," IEEE 9th conference on Design & Technology of Integrated System, pp. 1-6, 2014.
X. Xu, H. Liu, Y. Li, and Z. Yi, "Image Deblurring with Blur Kernel Estimation in RGB Channels," IEEE International Conference on Digital Signal Processing, pp. 681-684, 2016.
R. Chokshi, D. Israni, and N. Chavda, "An Efficient Deconvolution Technique by Identification and Estimation of Blur," IEEE international Conference on Electronics Information and Communications Technology, pp. 17-23, 2016.
R. Wang and W. Wang, "Spatially Variant Defocus Blur Map Estimation and Deblurring from a Single Image," Journal of Visual Communication and Image Representation, vol. 35, pp. 257-264, 2016.
S. Tiwari, V. P. Shukla, A. K. Singh, and B. S.R, "Review of Motion Blur Estimation Techniques," Journal of Image and Graphics, vol. 1, no. 4, pp. 176-184, 2013.
Robert Roberts, Daniel Taylor, Juan Herrera, Juan Castro, Mette Christensen. Leveraging Machine Learning for Educational Data Mining. Kuwait Journal of Machine Learning, 2(1). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/176
L. Wang, S. Luo, and Z. Wang, "Image Deblur with Regularized Backward Heat Diffusion," 17th IEEE International Conference on Image Processing, pp. 1141-1144, 2010.
K. Thongkor, P. Supasirisun, and T. Amornraksa, "Digital Image Watermarking based on Regularized Filter," 14th International Association of Pattern Recognition International Conference on Machine Vision Applications, pp. 493-496, 2015.
L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Image Deblurring with Blurred and Noisy Image Pairs," ACM Transactions on Graphics, vol. 26, no. 3, pp. 1-10, 2007.
N. Kumar, R. Nallamothu, and A. Sethi, "Neural Network Based Image Deblurring," 11th IEEE Symposium on Neural Network Applications in Electrical Engineering, pp. 219-222, 2012.
K. Thongkor, P. Supasirisun, and T. Amornraksa, "Digital Image Watermarking based on Regularized Filter," 14th International Association of Pattern Recognition International Conference on Machine Vision Applications, pp. 493-496, 2015.
Z. Al-ameen, G. Sulong, and G. Johar, "A Comprehensive Study on Fast image Deblurring Techniques," International Journal of Advanced Science and Technology, vol. 44, pp. 1-10, 2012.
Gong, D., Yang, J., Liu, L., Zhang, Y., Reid, I., Shen, C., Van Den Hengel, A., Shi, Q.: From motion blur to motion ow: a deep learning solution for removing heterogeneous motion blur. In: IEEE Conference on Computer Vision and Pattern Recognition (2017)
Sun, J., Cao, W., Xu, Z., Ponce, J.: Learning a convolutional neural network for non-uniform motion blur removal. In: IEEE Conference on Computer Vision and Pattern Recognition (2015)
Zhang, J., Pan, J., Ren, J., Song, Y., Bao, L., Lau, R.W., Yang, M.H.: Dynamic scene deblurring using spatially variant recurrent neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition (2018).
D. Zoran and Y. Weiss. From learning models of natural image patches to whole image restoration. In IEEE International Conference on Computer Vision, pages 479–486, 2011.
A. Chambolle. An algorithm for total variation minimization and applications. Journal of Mathematical imaging and vision, 20(1-2):89–97, 2004.
A. Buades, B. Coll, and J.-M. Morel. A non-local algorithm for image denoising. In IEEE Conference on Computer Vision and Pattern Recognition, volume 2, pages 60–65, 2005.
K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Transactions on Image Processing, 16(8):2080–2095, 2007.
M. Elad and M. Aharon. Image denoising via sparse and redundant representations over learned dictionaries. IEEE Transactions on Image processing, 15(12):3736–3745, 2006.
P. Hema Sree, An Iterative Graph-based Image Restoration using Data-Adaptive Objective Function, CVR journal of Science and Technology, volume 14, pp 16-21, June 2018.
K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. In International Conference for Learning Representations, 2015.
K. Zhang, W. Zuo, Y. Chen, D. Meng, and L. Zhang. Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE Transactions on Image Processing, 2017.
Kai Zhang1;2, Wangmeng Zuo1, Shuhang Gu2, Lei Zhang, Learning Deep CNN Denoiser Prior for Image Restoration, Computer vision and Pattern Recognition, April 2017.
P. A. Knight and D. Ruiz, “A fast algorithm for matrix balancing,” IMA J. Numer. Anal., vol. 33, pp. 1029–1047, 2013.
Q. Shan, J. Jia, and A. Agarwala, “High- quality motion deblurring from a single image,” ACM Trans. Graph., vol. 27, no. 3, pp. 1–10, Aug. 2008, Art. ID 73.