• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2023, Vol. 45 ›› Issue (05): 849-858.

• Software Engineering • Previous Articles     Next Articles

Facial expression recognition fusing local dynamic features

LIU Nan-yan,WEI Hong-fei,MA Sheng-xiang   

  1. (College of Computer Science & Technology,Xi’an University of Science and Technology,Xi’an  710699,China)
  • Received:2021-12-17 Revised:2022-01-20 Accepted:2023-05-25 Online:2023-05-25 Published:2023-05-16

Abstract: Facial expressions are one of the most important ways for humans to express emotions. Because facial expression changes are affected by the movement of multiple facial organs and facial muscles, in order to effectively extract local dynamic features and solve the problem of partial occlusion of facial expressions, a simple and effective deep learning network that integrates local dynamic features is proposed. By introducing the attention network and using the monitored key points of the face, the network is guided to focus on the unobstructed facial area. In the key frame with time sequence, the dynamic information and spatiotemporal information of key areas such as eyes and mouth are extracted to strengthen the connection between different expression features, so as to obtain effective local dynamic features. Finally, local dynamic features are added as a supplement to the overall network. The accuracy of the fusion network on the CK+, Oulu-CASIA, RAF-DB and AffectNet datasets are 98.08%, 90.59%, 86.02% and 61.28%, respectively, which is higher than other methods. 

Key words: dynamic feature, facial occlusion, guide attention network, time series