• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2020, Vol. 42 ›› Issue (11): 2042-2049.

Previous Articles     Next Articles

Multi-source image fusion with  SPCNN and SR based on image features

ZHANG Lixia1,2,ZENG Guangping2,XUAN Zhaocheng1#br#

#br#
  

  1. (1.School of Information Technology Engineering,Tianjin University of Technology and Education,Tianjin 300222;

    2.School of Computer & Communication Engineering,University of Science and Technology Beijing,Beijing 100083,China)

  • Received:2019-08-16 Revised:2020-03-10 Accepted:2020-11-25 Online:2020-11-25 Published:2020-11-30

Abstract: In order to highlight the different features of different input images, a SPCNN model with automaticsetting parameter based on features is proposed, which is combined with sparse representation to fuse the multisource images. The fusion process has four steps. Firstly, the source images are decomposed into high frequency coefficients and low frequency coefficient by NSST. Each high frequency coefficient is fired by the SPCNN model with automaticset parameters based on the inherent characteristics, and the fused image is completed according to the total number of firing and the weighted fusion strategy. The low frequency coefficients are fused by a sparse representation. Finally, the fused image is reconstructed by inverse NSST. The experimental results show that the proposed method is superior to the other five classical methods and the fused image conforms to the human visual perception system, with clear structure and obvious details.

Key words: adaptiveparameters SPCNN, sparse representation, NSST, image fusion