arXiv:2502.00634cs.CLcs.AI2025-02ICLR被引 10

让机器翻译更懂人:同时优化速度与质量,提升实时翻译体验

SimulPL: Aligning Human Preferences in Simultaneous Machine Translation

  • 构建五维人类偏好框架,涵盖准确度、流畅性、关键信息保留等
  • 用大模型生成偏好数据,使翻译策略在不同延迟下更符合用户期待
  • 首次将延迟偏好融入训练目标,优化读写时机选择机制

同步机器翻译(SiMT)在接收流式源语言输入时生成译文,需学习读写策略以决定何时翻译、何时等待。大量语言学研究表明,用户对SiMT有明确偏好:高准确性、简单句式、无冗余延迟。但当前方法未充分考虑这些偏好。现有技术仅优化输出内容,忽略延迟与读写策略的偏好优化。为此,本文提出面向同步翻译的偏好学习框架SimulPL,将人类偏好分为五类:翻译质量、单调性、关键点、简洁性和延迟偏好。利用前四类偏好构造提示,驱动GPT-4/4o生成高质量偏好数据。在偏好优化阶段,将延迟偏好纳入目标函数,使模型能优化读写策略,更贴近真实用户需求。实验表明,无论何种延迟水平,SimulPL在中→英、德→英和英→中任务上均优于基线,显著提升与人类偏好的对齐度。代码与数据将在https://github.com/EurekaForNLP/SimulPL公开。

原文摘要 · Abstract (English)

Simultaneous Machine Translation (SiMT) generates translations while receiving streaming source inputs. This requires the SiMT model to learn a read/write policy, deciding when to translate and when to wait for more source input. Numerous linguistic studies indicate that audiences in SiMT scenarios have distinct preferences, such as accurate translations, simpler syntax, and no unnecessary latency. Aligning SiMT models with these human preferences is crucial to improve their performances. However, this issue still remains unexplored. Additionally, preference optimization for SiMT task is also challenging. Existing methods focus solely on optimizing the generated responses, ignoring human preferences related to latency and the optimization of read/write policy during the preference optimization phase. To address these challenges, we propose Simultaneous Preference Learning (SimulPL), a preference learning framework tailored for the SiMT task. In the SimulPL framework, we categorize SiMT human preferences into five aspects: \textbf{translation quality preference}, \textbf{monotonicity preference}, \textbf{key point preference}, \textbf{simplicity preference}, and \textbf{latency preference}. By leveraging the first four preferences, we construct human preference prompts to efficiently guide GPT-4/4o in generating preference data for the SiMT task. In the preference optimization phase, SimulPL integrates \textbf{latency preference} into the optimization objective and enables SiMT models to improve the read/write policy, thereby aligning with human preferences more effectively. Experimental results indicate that SimulPL exhibits better alignment with human preferences across all latency levels in Zh$\rightarrow$En, De$\rightarrow$En and En$\rightarrow$Zh SiMT tasks. Our data and code will be available at https://github.com/EurekaForNLP/SimulPL.

同步翻译偏好学习大模型应用人机对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。