Gray image super-resolution reconstruction based on improved RDN method
-
摘要:
针对残差算法的残差网络超分辨率重建问题，提出了改进的残差计算的深度复合残差网络模型。在此研究实验中，改进了原有的残差块，能够充分利用到残差块内部的所有卷积层特征信息，提高生成图像的质量；设置了双层复合结构，加深了模型结构的深度，能够强化模型对图像的特征提取，可以提取更多的图像特征；采用迁移学习的方法，在深度网络结构中通过迁移学习增强图像特征信息，使得该模型性能更稳定。通过天宫一号灰度图像的应用实验表明，该研究提出的改进的深度密集残差网络在天宫一号灰度图像超分辨率重建中表现良好，在卫星图像领域具有应用价值和研究意义。
Abstract:Aiming at the problem of residual network super-resolution reconstruction by residual algorithm, an improved deep composite residual network model for residual calculation was proposed. In this research, the original residual block was improved, which could make full use of all the convolutional layer feature information inside the residual block to improve the quality of the generated image; a double-layer composite structure was set to deepen the depth of the model structure, it could enhance the feature extraction of the image by the model and could extract more image features; the image feature information was enhanced using the method of transfer learning through transfer learning in the deep network structure, making the performance of the model more stable. The application experiment of the Tiangong-1 grayscale image show that the improved deep residual dense network proposed in this study performs well in the Tiangong-1 grayscale image super-resolution reconstruction, and has application value and research significance in the field of satellite imagery.
-
[1] Su Heng, Zhou Jie, Zhang Zhihao. Survey of super-resolution image reconstruction methods[J]. Acta Automatica Sinica, 2013, 39(8):1202-1213. (in Chinese)苏衡, 周杰, 张志浩. 超分辨率图像重建方法综述[J]. 自动化学报, 2013, 39(8):1202-1213. [2] Liu Yuefeng, Yang Hanxi, Cai Shuang, et al. Single image super-resolution reconstruction method based on improved convolutional neural network[J]. Journal of Computer Applications, 2019, 39(5):1440-1447. (in Chinese)刘月峰, 杨涵晰, 蔡爽, 等. 基于改进卷积神经网络的单幅图像超分辨率重建方法[J]. 计算机应用, 2019, 39(5):1440-1447. [3] Liu Na, Li Cuihua. Single image super-resolution reconstruction via deep convolutional neural network[J]. China Sciencepaper, 2015, 10(2):201-206. (in Chinese)刘娜, 李翠华. 基于多层卷积神经网络学习的单帧图像超分辨率重建方法[J]. 中国科技论文, 2015, 10(2):201-206. [4] Lim B, Son S, Kim H, et al. Enhanced deep residual networks for single image super-resolution[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017:1132-1140. [5] Bevilacqua M, Roumy A, Guilletmot C, et al. Super-resolution using neighbor embedding of back projection residuals[C]//18th International Conference on Digital Signal Processing, IEEE, 2013:1-8. [6] Huang J B, Singh A, Ahuja N. Single image super-resolution using transformed self-exemplars[C]//2015 IEEE Conference on Computer Vision and Pattern Recognition, 2015:5197-5206. [7] Sun Xu, Li Xiaoguang, Li Jiafeng, et al. Review on deep learning based image super-resolution restoration algorithm[J]. Acta Automatica Sinica, 2017, 43(5):697-709. (in Chinese)孙旭, 李晓光, 李嘉锋, 等.基于深度学习的图像超分辨率复原研究进展[J]. 自动化学报, 2017, 43(5):697-709. [8] Lu T, Wang J M, Zhang Y D, et al. Satellite image super-resolution via multi-scale residual deep neural network[J]. Remote Sensing, 2019, 11(13):1588. [9] Khan A, Sohail A, Zahoora U, et al. A survey of the recent architectures of deep convolutional neural Networks[J/OL]. 2019, arXiv:1901.06032, https://arxiv.org/abs/1901.06032. [10] Li Fangbiao, He Xin, Wei Zhonghui, et al. Multiframe infrared image super-resolution reconstruction using generative adversarial networks[J]. Infrared and Laser Engineering, 2018, 47(2):0203003. (in Chinese)李方彪, 何昕, 魏仲慧, 等. 生成式对抗神经网络的多帧红外图像超分辨率重建[J]. 红外与激光工程, 2018, 47(2):0203003. [11] Liu Yongfeng, Wang Nian, Wang Feng, et al. Hyperspectral image super-resolution algorithm via sparse representation based on spectral similarity[J]. Infrared and Laser Engineering, 2019, 48(S1):S128003. (in Chinese)刘永峰, 王年, 王峰, 等. 基于谱间相似性的高光谱图像稀疏超分辨率算法[J]. 红外与激光工程, 2019, 48(S1):S128003. [12] Harris J L. Diffraction and resolving power[J]. Journal of the Optical Society of America, 1964, 54(7):931-933. [13] Bleha W P. Application of the liquid crystal light valve to real-time optical data processing[J]. Opt Eng, 1978, 17(4):174371. [14] Hou H, Andrews H. Cubic spline for image interpolation and digital filtering[J]. IEEE Transaction on Signal Pressing, 1978, 26(6):508-517. [15] Hou H, Andrews H. Cubic splines for image interpolation and digital filtering[J]. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1978, 26(6):508-517. [16] Battiato S, Gallo G, Stanco F. A locally adaptive zooming algorithm for digital images[J]. Image Vision and Computing, 2002, 20(11):805-812. [17] Yang Jianchao, Wright J, Huang T S, et al. Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing, 2010, 19(11):2861-2873. [18] Yang Jianchao, Wright J, Huang T S, et al. Image super-resolution as sparse representation of raw image patches[C]//IEEE Conference on Computer Vision and Pattern Recognition, 2008:1-8. [19] Timofte R, De Smet V, Van Gool L. A+:Adjusted anchored neighborhood regression for fast super-resolution[C]//Asian Conference on Computer Vision, 2014:111-126. [20] Yang J, Wright J, Huang T S, et al. Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing, 2010, 19(11):2861-2873. [21] Dong C, Loy C C, He K, et al. Learning a deep convolutional network for image super-resolution[C]//European Conference on Computer Vision, 2014:184-199. [22] Dong C, Loy C C, He K, et al. Image super-resolution using deep convolutional networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(2):295-307. [23] Dong C, Loy C C, Tang X. Accelerating the super-resolution convolutional neural network[C]//European Conference on Computer Vision Amsterdam, 2016:391-407. [24] He K, Zhang X, Ren S, et al. Deep residual learning for image recognition[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016:770-778. [25] Kim J, Lee J K, Lee K M. Accurate image super-resolution using very deep convolutional networks[C]//IEEE Conference on Computer Vision and Pattern Recognition, 2016:1646-1654. [26] Zhang Y, Tian Y, Kong Y, et al. Residual dense network for image super-resolution[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018:2472-2481. -
点击查看大图
计量
- 文章访问数: 320
- HTML全文浏览量: 43
- 被引次数: 0
下载:
