• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

计算机工程与科学 ›› 2021, Vol. 43 ›› Issue (02): 370-380.

• 图形与图像 • 上一篇    

基于注意力机制的深度学习推荐研究进展

陈海涵,吴国栋,李景霞,王静雅,陶鸿   

  1. (安徽农业大学信息与计算机学院,安徽 合肥 230036)
  • 收稿日期:2020-04-03 修回日期:2020-05-26 接受日期:2021-02-25 出版日期:2021-02-25 发布日期:2021-02-24
  • 基金资助:
    国家自然科学基金(31671589);安徽省重点研发计划(201904a06020056);智慧农业技术与装备安徽省重点实验室开放基金(APKLSATE2019X003)

Research advances on deep learning recommendation based on attention mechanism

CHEN Hai-han,WU Guo-dong,LI Jing-xia,WANG Jing-ya,TAO Hong   

  1. (School of Information & Computer,Anhui Agricultural University,Hefei 230036,China)
  • Received:2020-04-03 Revised:2020-05-26 Accepted:2021-02-25 Online:2021-02-25 Published:2021-02-24

摘要: 近年来,注意力机制AM被广泛应用到基于深度学习的自然语言处理任务中,基于注意力机制的深度学习推荐也成为推荐系统研究的一个新方向。探讨了注意力机制的结构和分类标准,从基于注意力机制的DNN推荐、CNN推荐、RNN推荐、GNN推荐4个方面分析了现有融合注意力机制的深度学习推荐研究的主要进展和不足,阐明了其中的主要难点,最后指出了多特征交互的注意力机制推荐、多模态注意力机制深度学习推荐、融入注意力机制的多种深度神经网络混合推荐和注意力机制的群组推荐等基于注意力机制的深度学习推荐未来的主要研究方向。


关键词: 注意力机制;深度学习;推荐系统 

Abstract: In recent years, Attention Mechanism (AM) has been widely used in natural language processing tasks based on deep learning. Deep learning recommendation based on attention mechanism has become a new direction in the research of recommendation system. This paper discusses the structure and classification standard of attention mechanism, and analyzes the main progress and shortcomings of the existing deep learning recommendation researches based on attention mechanism from four aspects: DNN recommendation, CNN recommendation, RNN recommendation and GNN recommendation. The main difficulties in the research are illustrated. Finally, the paper points out the future direction of deep learning recommendation including multi-feature interaction attention mechanism recommendation, multi-modal attention mechanism recommendation, hybrid recommendation for multiple deep neural networks based on attention mechanism, and group recommendation based on attention mechanism.



Key words: attention mechanism, deep learning, recommendation system