• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2024, Vol. 46 ›› Issue (10): 1843-1851.

• Graphics and Images • Previous Articles     Next Articles

Hybrid U-shaped network and Transformer for image deblurring

CHEN Qing-jiang,SHAO Fei,WANG Xuan-jun   

  1. (College of Science,Xi’an University of Architecture and Technology,Xi’an 710055,China)
  • Received:2023-08-12 Revised:2023-12-21 Accepted:2024-10-25 Online:2024-10-25 Published:2024-10-30

Abstract: To address the problem that existing deblurring methods cannot effectively restore fine details of images, an image deblurring method combining a U-shaped network and Transformer is proposed. Firstly, a multi-scale feature extraction module is used to extract shallow feature information from the image. Then, a hierarchical nested U-shaped subnet with a stepwise feature enhancement module is employed to obtain deep feature information while preserving image detail information. Next, a local-global residual refinement module is constructed, which fully extracts global and local information through information interaction between convolutional neural networks and Swin Transformer, and further refines the feature information. Finally, a 1×1 convolutional layer is used for feature reconstruction. The proposed method achieves a peak signal-to-noise ratio (PSNR) of 32.92 and a structural similarity index mean (SSIM) of 0.964 on the GoPro dataset, both outperforming other comparative methods. Experimental results demonstrate that the proposed method can effectively remove blur and reconstruct a potentially clear image with rich details.

Key words: image deblurring, detailed information, hierarchical nested U-shaped subnet, Transformer, multi-scale feature