arXiv:2410.02631cs.CL2024-10EMNLP被引 20

用思维链方法让大模型跨领域翻译更准,效果提升明显。

Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning

  • 通过引导模型识别源文领域信息,用思维链增强跨域理解。
  • 小数据微调下,平均翻译准确率提升1.53个BLEU值。
  • 适合需要多领域稳定翻译的场景,如全球化内容生成。

跨领域机器翻译保持高质量仍是重大挑战,主要因各领域平行语料有限且分布不均。尽管大语言模型具备强大理解与生成能力,其在多领域翻译中的潜力尚未充分探索。本文构建了涵盖15个领域的25个德语↔英语和22个中文↔英语测试集,形成全面的多领域翻译基准。对主流LLM的评估显示,其性能明显落后于传统翻译系统,存在领域过拟合与微调后灾难性遗忘问题。为此,我们提出领域思维链(CoT)微调方法,利用大模型内在的多领域智能,引导其从源文感知领域信息,作为翻译过程的提示。该方法仅在四个领域的小规模数据上训练,却在超过20个德语→英语的域外测试中实现平均1.53 BLEU的显著提升,优于传统微调,有效增强了翻译准确性和领域鲁棒性。

原文摘要 · Abstract (English)

Achieving consistent high-quality machine translation (MT) across diverse domains remains a significant challenge, primarily due to the limited and imbalanced parallel training data available in various domains. While large language models (LLMs) have demonstrated impressive general understanding and generation abilities, their potential in multi-domain MT is under-explored. We establish a comprehensive benchmark for multi-domain translation, featuring 25 German$\Leftrightarrow$English and 22 Chinese$\Leftrightarrow$English test sets respectively covering 15 domains. Our evaluation of prominent LLMs reveals a discernible performance gap against traditional MT systems, highlighting domain overfitting and catastrophic forgetting issues after fine-tuning on domain-limited corpora. To mitigate this, we propose a domain Chain of Thought (CoT) fine-tuning technique that utilizes the intrinsic multi-domain intelligence of LLMs to improve translation performance. This method inspires the LLM to perceive domain information from the source text, which then serves as a helpful hint to guide the translation process. Despite being trained on a small dataset of four domains, our CoT fine-tune approach achieves notable enhancements in translation accuracy and domain robustness than traditional fine-tuning, as evidenced by an average 1.53 BLEU score increase in over 20 German$\rightarrow$English distinct out-of-domain tests.

多领域翻译大模型微调思维链跨域鲁棒

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。