• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2021, Vol. 43 ›› Issue (02): 370-380.

Previous Articles    

Research advances on deep learning recommendation based on attention mechanism

CHEN Hai-han,WU Guo-dong,LI Jing-xia,WANG Jing-ya,TAO Hong   

  1. (School of Information & Computer,Anhui Agricultural University,Hefei 230036,China)
  • Received:2020-04-03 Revised:2020-05-26 Accepted:2021-02-25 Online:2021-02-25 Published:2021-02-24

Abstract: In recent years, Attention Mechanism (AM) has been widely used in natural language processing tasks based on deep learning. Deep learning recommendation based on attention mechanism has become a new direction in the research of recommendation system. This paper discusses the structure and classification standard of attention mechanism, and analyzes the main progress and shortcomings of the existing deep learning recommendation researches based on attention mechanism from four aspects: DNN recommendation, CNN recommendation, RNN recommendation and GNN recommendation. The main difficulties in the research are illustrated. Finally, the paper points out the future direction of deep learning recommendation including multi-feature interaction attention mechanism recommendation, multi-modal attention mechanism recommendation, hybrid recommendation for multiple deep neural networks based on attention mechanism, and group recommendation based on attention mechanism.



Key words: attention mechanism, deep learning, recommendation system