关键词: 三维人体姿态估计, 语义图卷积, MLP-Mixer模型, 自注意力机制

Abstract: Aiming at the problem that it is difficult to capture the global characteristics of human joint sequences and the estimation accuracy is not high, a 3D human pose estimation method combining semantic graph convolutional network and self-attention mechanism is proposed. Firstly, in order to improve the feature extraction effect in the process of mapping from two-dimensional human pose sequence to three-dimensional human pose sequence, self-attention mechanism is integrated into semantic graph convolutional network to carry out spatial feature extraction based on the integration of local features and global features. Secondly, the channel-mixing module of the MLP-Mixer network is improved by introducing a semantic graph convolutional network and a U-shaped MLP structure for temporal feature extraction. Finally, 3D human pose estimation is performed based on the fused features from 2D human images and the extracted temporal features.  Experimental evaluations on the Human3.6M dataset for 3D human pose estimation demonstrate that, compared with current mainstream 3D human pose estimation methods, the proposed method reduces the average error metrics MPJPE and PA-MPJPE by approximately 4.5 mm and 0.2 mm compared with the suboptimal method, respectively. The experimental results validate the effectiveness of the proposed method.

Key words: 3D human pose estimation;semantic graph convolutional network;MLP-Mixer model;self-attention , mechanism