关键词: 蒙古语, 语音翻译；知识蒸馏；多任务学习

Abstract: End-to-end speech translation technology aims to realize the automatic conversion from source-language speech to target language, and has achieved significant progress in multiple fields in recent years. However, its performance in Mongolian speech translation still needs improvement. This challenge mainly stems from the scarcity of Mongolian-Chinese speech translation datasets, which leads to poor performance of existing models in handling Mongolian speech translation tasks. To overcome these difficulties, this study adopts the following measures: Firstly, a large-scale Mongolian-Chinese parallel speech translation dataset is collected and constructed to support the training of translation models. Secondly, a joint learning strategy is introduced; through parameter sharing between the encoder and decoder, knowledge transfer between speech translation and machine translation tasks is promoted. In addition, to narrow the modal gap between speech and text, a cross-attention regularization method is adopted to enhance the model's ability to understand and utilize inputs of different modalities. Through knowledge distillation technology, the machine translation model is dynamically updated, which further improves the performance of the speech translation model. Finally, a speech synthesis module is integrated to realize speech-to-speech translation. Experimental results show that the method proposed in this study achieves a significant improvement in translation accuracy: compared with the directly trained speech translation model, its BLEU score almost increased by 2.00.

Key words: Mongolian, speech translation；knowledge distillation, multi-task learning