• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

计算机工程与科学 ›› 2023, Vol. 45 ›› Issue (03): 478-488.

• 图形与图像 • 上一篇    下一篇

基于可逆神经网络的图像超分辨率重建算法

王平1,李彬1,张彤1,王佳2   

  1. (1.国防科技大学电子科学学院,湖南 长沙 410073;2.长沙学院电子信息与电气工程学院,湖南 长沙 410022)
  • 收稿日期:2021-05-06 修回日期:2021-10-22 接受日期:2023-03-25 出版日期:2023-03-25 发布日期:2023-03-23
  • 基金资助:
    国家自然科学基金(62201092)

An image super-resolution reconstruction algorithm based on invertible neural network

WANG Ping1,LI Bin1,ZHANG Tong1,WANG Jia2   

  1. (1.College of Electronic Science,National University of Defense Technology,Changsha 410073;
    2.School of Electronic Information & Electronic Engineering,Changsha University,Changsha 410022,China)
  • Received:2021-05-06 Revised:2021-10-22 Accepted:2023-03-25 Online:2023-03-25 Published:2023-03-23

摘要: 近年来,卷积神经网络在单幅图像超分辨率重建SISR任务中展现出良好的效果,已成为该领域内应用最广泛的算法,但该算法未能有效弱化一对多的病态问题和减小重建图像解空间范围,因此对图像重建质量提升的效果越来越有限,目前已面临瓶颈问题,很难有较大的性能提升。为有效减小重建图像的解空间,提升重建图像性能,提出了基于可逆神经网络的图像超分辨率重建算法,通过模型设计,将图像退化和重建过程设计为一个可逆变换过程,有效约束了图像解空间,可逆卷积结构的应用使算法获得最合适的通道排布规则,从而有效提升了模型性能。在主流数据集上的实验结果表明,提出的算法相对于现有的SISR算法在图像重建精度上有了极大的提升,获得了最佳的PSNR和SSIM。

关键词: 超分辨重建, 可逆流模型, 像素重排, 可逆耦合

Abstract:  In recent years, convolutional neural network has shown good results in single image super-resolution reconstruction task, and has become the most widely used algorithm in this field. However, this algorithm fails to effectively weaken the one-to-many ill-conditioned problem and reduce the solution space range of the reconstructed image, so the effect of this algorithm in improving the image reconstruction quality is becoming more and more limited. At present, it faces the bottleneck problem, and it is difficult to improve the performance greatly. In order to effectively reduce the solution space of reconstructed images and improve the performance of reconstructed images, this paper propose an image super-resolution reconstruction algorithm based on invertible neural network. Through model design, the image degradation and reconstruction process is designed as a reversible transformation process, which effectively constrains the image solution space. The application of invertible convolution structure makes the algorithm obtain the most suitable channel arrangement rules, thus effectively improving the model performance. Experimental results on mainstream data sets show that the proposed algorithm greatly improves the accuracy of image reconstruction compared with the existing SISR algorithm, and achieves the best PSNR and SSIM performance.

Key words: super-resolution reconstruction, countercurrent model, pixel rearrangement, invertible coupling