• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

Computer Engineering & Science ›› 2024, Vol. 46 ›› Issue (02): 316-324.

• Artificial Intelligence and Data Mining • Previous Articles     Next Articles

Distant supervision relation extraction based on type attention and GCN

ZHANG Huan1,2,LI Wei-jiang1,2   

  1. (1.Faculty of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650500;
    2.Yunnan Key Laboratory of Artificial Intelligence,Kunming University of Science and Technology,Kunming 650500,China)
  • Received:2022-05-06 Revised:2022-08-10 Accepted:2024-02-25 Online:2024-01-25 Published:2024-02-24

Abstract: Distant supervision relation extraction uses the automatic alignment of natural language texts and knowledge bases to generate labeled training datasets, solving the problem of manual sample labeling. In the current research, most distant supervision does not pay attention to the long-tail data, so most of the sentence bags obtained by distant supervision contain too few sentences. These sentence bags cannot truly and comprehensively express the data itself. This paper proposes a distant supervised relation extraction model (PG+PTATT) based on position-type attention mechanism and graph convolutional network. According to the similarity between sentence bags, Graph Convolutional Networks (GCN) aggregate the implicit high-level features of similar sentence bags to optimize the sentence bags and obtain more prosperous and more comprehensive feature information of the sentence bags. At the same time, an attention mechanism, Position-Type Attention (PTATT) is constructed, which can solve the problem of wrong labels in distant supervision relation extraction: using the position relationships between entity words and non-entity words and type relationships are modeled to reduce the impact of noisy words. The proposed model is experimentally verified on the dataset New York Times (NYT), and the experimental results show that the proposed model can effectively solve the problems existing in distant supervision relation extraction; and it can effectively improve the accuracy of relation extraction.

Key words: distant supervision, relation extraction, graph convolutional network, attention mechanism, type relationship, sentence bag