• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2023, Vol. 45 ›› Issue (01): 95-103.

• Graphics and Images • Previous Articles     Next Articles

A tennis action recognition and evaluation method based on PoseC3D

ZHOU Sheng-ru,CHEN Zhi-gang,DENG Yi-qin   

  1. (School of Computer Science and Engineering,Central South University,Changsha 410083,China)
  • Received:2022-09-19 Revised:2022-10-25 Accepted:2023-01-25 Online:2023-01-25 Published:2023-01-25

Abstract: To accurately recognize and evaluate tennis actions, by combining computer vision with tennis related knowledge, this paper proposes a tennis action recognition and evaluation method based on PoseC3D. Firstly, a pose estimation model based on resnet-50 is used to detect human targets in tennis video and extract bone key points. Secondly, the PoseC3D model is trained through the video data set collected in the professional tennis court, so that it can classify the sub actions of tennis. Thirdly, the dynamic time warping algorithm is used to evaluate the classified actions. Finally, based on the collected video data set, a large number of experiments are carried out. The results show that the Top1 accuracy of the proposed tennis action recognition method based on PoseC3D can reach 90.8%. Compared with the methods based on graph convolution network, such as AGCN and ST-GCN, it has stronger generalization ability. Moreover, the proposed scoring algorithm based on dynamic time warping can give real-time and accurate evaluation scores for corresponding actions after action classification, reducing the work intensity of tennis teachers and effectively improving the quality of tennis teaching.

Key words: pattern recognition, pose estimation, action recognition, convolutional neural network, dynamic time warping