• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

计算机工程与科学 ›› 2023, Vol. 45 ›› Issue (02): 363-369.

• 人工智能与数据挖掘 • 上一篇    下一篇

面向鲁棒性增强的多任务机器阅读理解

谭红叶,行覃杰   

  1. (山西大学计算机与信息技术学院,山西 太原 030006)

  • 收稿日期:2021-06-15 修回日期:2021-11-09 接受日期:2023-02-25 出版日期:2023-02-25 发布日期:2023-02-16
  • 基金资助:
    国家自然科学基金(62076155)

Robustness enhancement oriented multi task machine reading comprehension

TAN Hong-ye,XING Qin-jie   

  1. (School of Computer and Information Technology,Shanxi University,Taiyuan 030006,China) 
  • Received:2021-06-15 Revised:2021-11-09 Accepted:2023-02-25 Online:2023-02-25 Published:2023-02-16

摘要: 目前抽取式机器阅读理解已经取得了很好的成果。然而,许多研究工作表明,机器阅读理解模型在过敏感性、过稳定性等方面的鲁棒性还有待提高。为了解决该问题,提出了一种面向鲁棒性增强的多任务抽取式阅读理解模型,加强模型在篇章和问题2方面的理解能力。通过多任务学习方式,将答案抽取作为主要任务,证据句判断和问题分类作为辅助任务,实现编码器之间的信息共享。在鲁棒性测试集上的实验结果表明,所提模型对比基线模型有明显的性能提升。

关键词: 鲁棒, 多任务学习, 机器阅读理解

Abstract: At present, Machine Reading Comprehension (MRC) has achieved good success. However, many researches show that MRC models still have some problems in the robustness in terms of over-sensitivity and over-stability. In order to solve these problems, a multi-task MRC model oriented to robustness enhancement is proposed to strengthen the model's ability to understand the passage and the problem. Specifically, in the multi-task learning method, answer extraction is the main task, and the judgment of evidence sentences and the classification of question are auxiliary tasks, which realizes information sharing between these tasks. The experimental results on the robustness test sets show that the proposed model's performance has a significant improvement compared with the baseline models.

Key words: robustness, multi-task learning, machine reading comprehension