Abstract: Commonly used neural networks such as Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) have shown very good results in relation extraction tasks. However, CNN is good at capturing local features, but it is not suitable for processing sequence features. Traditional RNN can effectively extract features between long-distance words, but it is easy to cause gradient disappearance or gradient explosion. To solve these problems, a hybrid neural network model, called BiLSTM-CNN-Attention, is proposed. The combination of BiLSTM and CNN makes them complement each other, and the introduction of Attention can highlight the importance of inter entity relation words in the whole sentence. In addition, the mosaic word vector is used in the word embedding layer to overcome the problem of single word vector representation. The experimental results show that, compared with word2vec word vector, mosaic word vector can obtain more semantic word vector and enhance the robustness of word vector.  Compared with BiLSTM-CNN, CNN-Attention and BiLSTM-Attention models, BiLSTM-CNN-Attention improves the accuracy and F1 value.

Key words: relation extraction, convolutional neural network, recurrent neural network, attention mechanism, hybrid model, mo