arXiv:2607.19181cs.CLcs.AI2026-07

用结构化推理提升法律翻译质量,小模型经强化学习后接近大模型表现。

Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning

  • 在法律翻译前加入结构化推理,增强小模型理解力。
  • 强化学习+可验证奖励使翻译质量超越监督微调,接近顶尖推理模型。
  • 小模型经重训练后效果显著,但模型越大收益越低。

法律领域的神经机器翻译(NMT)因语言复杂性和高精度要求而极具挑战性。近期具备推理能力的语言模型为解决此类问题提供了新可能,结合此前的监督微调和强化学习等方法,进一步提升翻译质量。本文对比了多种技术方案,重点评估了Qwen3.5 4B、Qwen3.5 9B与Gemma 3 12B等小型模型在不同再训练范式下的表现,并与前沿推理模型进行比较。研究聚焦瑞士多语种法律体系,其复杂的法规环境为推理增强模型提供了严苛测试场景。实验表明,小规模基础模型经优化后性能显著提升;基于可验证奖励的强化学习优于监督微调;增强后的小型模型表现接近当前最优推理模型,但仍略逊一筹。此外,随着模型规模扩大,再训练策略的边际收益递减。代码与模型已公开于https://github.com/aixiuxiuxiu/Legal-MT-SFT-RL。

原文摘要 · Abstract (English)

Neural machine translation (NMT) in the legal domain is a linguistically and conceptually demanding task, primarily due to the complexity of legal language and the high level of precision it requires. The recent emergence of reasoning-capable language models opens new possibilities for tackling such challenges. They add to a set of other previously proposed techniques to enhance the translation quality, which includes supervised fine-tuning and reinforcement learning. In this work, we perform a comparison between these various approaches. More particularly, we evaluate small language models such as Qwen3.5 4B, Qwen3.5 9B, and Gemma 3 12B enhanced with various re-training paradigms and compare their performances against frontier reasoning models. We focus on the Swiss legal system, which -- with its unique multilingual statutes -- offers a particularly challenging testbed for reasoning-augmented models. Our results show that the quality of small ``base'' models can be greatly enhanced, and that reinforcement learning with verifiable rewards can be applied to NMT in the legal domain and surpasses the translation quality of supervised fine-tuning. The performance of enhanced small models is close to the one of state-of-the-art reasoning models yet remains inferior. We also note that re-training paradigms yield diminishing returns as model size increase. The code and models are publicly available at https://github.com/aixiuxiuxiu/Legal-MT-SFT-RL.

法律翻译推理增强强化学习小模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。