• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science

Previous Articles     Next Articles

Pixel attention based siamese convolution
neural network for stereo matching

SANG Hai-wei1,3,XU Hai2,XIONG Wei-cheng1,ZUO Yu1,ZHAO Yong1,2   

  1. (1.School of Mathematics and Big Data,Guizhou Education University,Guiyang 550018;
    2.School of Electronic and Computer Engineering,Shenzhen Graduate School,Peking University,Shenzhen 518055;
    3.College of Computer Science and Technology,Guizhou University,Guiyang 550025,China)

     
  • Received:2019-09-02 Revised:2019-11-01 Online:2020-05-25 Published:2020-05-25

Abstract:

Aiming at the problem that the existing stereo matching algorithm has high mismatch rate in ill-posed regions such as weak texture, repeated texture and reflective surface, a new pixel attention siamese neural network is proposed. Our method consists of siamese attention hourglass subnetwork and attention U-shaped subnetwork . Firstly, the feature map of the input image is extracted by the siamese attention hourglass subnetwork. Secondly, the cost matrix of the feature graph is obtained through the correlation layer. Finally, the cost matrix is aggregated by the attention U-shaped subnetwork, and the disparity map is output. Experiments on the KITTI dataset demonstrate that the proposed algorithm can effectively solve the ill-posed problem and improve the stereo matching accuracy.
 

Key words: stereo matching, pixel attention, hourglass subnet, U-shaped subnet, siamese