arXiv:2503.12152cs.CL2025-03被引 2

通过融合摘要与实体翻译,提升大模型文档级翻译效果

Improving LLM-based Document-level Machine Translation with Multi-Knowledge Fusion

  • 引入文档摘要和实体翻译作为额外知识源
  • 在8个任务上平均提升0.8~0.4的COMET得分
  • 适合需要高质量长文本翻译的研究者使用

近期基于大模型的文档级机器翻译研究主要依赖将源文档平铺为长序列来捕捉句间上下文。然而,仅依赖句子顺序可能限制大模型在复杂文档上的表现。本文提出一种多知识融合方法,通过大模型生成文档摘要和实体翻译作为额外知识,分别与原文融合生成两版译文,并采用多知识融合策略对译文进行精炼与排序,以优化最终结果。在八个文档级翻译任务上的实验表明,该方法在LLaMA3-8B-Instruct、Mistral-Nemo-Instruct和GPT-4o-mini上相比基线分别实现0.8、0.6和0.4的COMET分数提升。

原文摘要 · Abstract (English)

Recent studies in prompting large language model (LLM) for document-level machine translation (DMT) primarily focus on the inter-sentence context by flatting the source document into a long sequence. This approach relies solely on the sequence of sentences within the document. However, the complexity of document-level sequences is greater than that of shorter sentence-level sequences, which may limit LLM's ability in DMT when only this single-source knowledge is used. In this paper, we propose an enhanced approach by incorporating multiple sources of knowledge, including both the document summarization and entity translation, to enhance the performance of LLM-based DMT. Given a source document, we first obtain its summarization and translation of entities via LLM as the additional knowledge. We then utilize LLMs to generate two translations of the source document by fusing these two single knowledge sources, respectively. Finally, recognizing that different sources of knowledge may aid or hinder the translation of different sentences, we refine and rank the translations by leveraging a multi-knowledge fusion strategy to ensure the best results. Experimental results in eight document-level translation tasks show that our approach achieves an average improvement of 0.8, 0.6, and 0.4 COMET scores over the baseline without extra knowledge for LLaMA3-8B-Instruct, Mistral-Nemo-Instruct, and GPT-4o-mini, respectively.

文档翻译多知识融合大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。