• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2023, Vol. 45 ›› Issue (01): 127-135.

• Graphics and Images • Previous Articles     Next Articles

An image recognition model for minor and irregular damage on metal surface based on attention mechanism and deformable convolution

DENG Zhong-gang,DAI Gang,WU Xiang-ning,DENG Yu-jiao,WANG Wen,CHEN Miao,TU Yu,ZHANG Feng,FANG Heng   

  1. (School of Computer Science,China University of Geosciences(Wuhan),Wuhan 430078,China)
  • Received:2021-08-12 Revised:2021-11-16 Accepted:2023-01-25 Online:2023-01-25 Published:2023-01-25

Abstract: For the detection of minor damages on metal surface, the generalization ability of traditional target recognition algorithms is weak, the general detection algorithms using deep convolution neural network is easy to lose the characteristics of small targets, and the traditional square structure convolution used by these algorithms is not suitable for dealing with irregular damages such as long strips. To solve the above problems, a cascade neural network target detection model based on attention mechanism and deformable convolution, called ADC-Mask R-CNN, is proposed. The model embeds channel domain attention and spatial domain attention in ResNet101 backbone network to enhance the detection effect of minor damage targets, and uses deformable convolution and deformable region of interest pooling technology to improve the detection effect of irregular damages. In addition, the detection results are further optimized by cascaded networks. Comparative experiments on metal surface damage data sets show that the ADC-Mask R-CNN model can improve the detection performance of minor irre- gular damages on metal surface.

Key words: minor damage, irregular damage, attention mechanism, deformable convolution, cascade neural network