让翻译模型学会根据上下文灵活选择用句内还是文档级信息
Cross-Preference Learning for Sentence-Level and Context-Aware Machine Translation
- 通过偏好学习显式建模句内与上下文翻译的互补优势
- 在多个大模型上实现翻译质量与鲁棒性同步提升
- 无需修改结构,适合想提升翻译适应性的研究者
上下文感知机器翻译利用文档级信息,但并未始终优于句级翻译,因上下文信号对不同句子的增益不均。现有训练目标未显式建模这种差异性,限制了模型自适应利用上下文的能力。本文提出交叉偏好学习(CPL),一种基于偏好的训练框架,显式捕捉句内与上下文翻译的互补收益。CPL通过将句内与跨条件偏好整合进偏好优化目标,提供何时及如何利用上下文提升翻译质量的明确监督。我们在多个公开上下文感知翻译任务上验证该方法,使用Qwen3-4B、Qwen3-8B和Llama-3-8B等多模型进行实验,结果表明,在不修改架构的前提下,模型在两种输入条件下均实现了翻译质量与鲁棒性的持续提升。
原文摘要 · Abstract (English)
Context-aware machine translation (MT) leverages document-level information, yet it does not consistently outperform sentence-level MT, as contextual signals are unevenly beneficial across sentences. Existing training objectives do not explicitly model this variability, limiting a model's ability to adaptively exploit context. In this paper, we propose Cross-Preference Learning (CPL), a preference-based training framework that explicitly captures the complementary benefits of sentence-level and context-aware MT. CPL achieves this by integrating both intra- and cross-condition preferences into the preference optimization objective. The introduction of intra- and cross-condition preferences provides explicit supervision on when and how contextual information improves translation quality. We validate the proposed approach on several public context-aware MT tasks using multiple models, including Qwen3-4B, Qwen3-8B, and Llama-3-8B. Experimental results demonstrate consistent improvements in translation quality and robustness across both input conditions, achieved without any architectural modifications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。