开源翻译模型TranslateGemma,用两阶段训练提升多语言翻译质量。
TranslateGemma Technical Report
- 两阶段微调:先用合成与人工数据,再用强化学习优化。
- 小模型性能媲美大模型,55个语对自动评测全面领先。
- 保留多模态能力,图像翻译任务表现更优,适合研究与应用。
我们提出TranslateGemma,一套基于Gemma 3基础模型的开源机器翻译模型。为增强Gemma 3固有的多语言翻译能力,采用两阶段微调:首先使用高质量大规模合成平行数据(由先进模型生成)和人工翻译数据进行监督微调;随后通过强化学习,利用包括MetricX-QE和AutoMQM在内的集成奖励模型优化翻译质量。我们在WMT25测试集上对10个语对进行了人工评估,并在55个语对的WMT24++基准上进行了自动评估。自动指标显示,所有尺寸的TranslateGemma模型均显著优于基线Gemma 3模型。值得注意的是,较小的TranslateGemma模型常达到与更大基线模型相当的性能,兼具更高效率。此外,这些模型仍保持强大的多模态能力,在Vistra图像翻译基准上表现更佳。TranslateGemma的发布旨在为研究社区提供强大且可扩展的机器翻译工具。
原文摘要 · Abstract (English)
We present TranslateGemma, a suite of open machine translation models based on the Gemma 3 foundation models. To enhance the inherent multilingual capabilities of Gemma 3 for the translation task, we employ a two-stage fine-tuning process. First, supervised fine-tuning is performed using a rich mixture of high-quality large-scale synthetic parallel data generated via state-of-the-art models and human-translated parallel data. This is followed by a reinforcement learning phase, where we optimize translation quality using an ensemble of reward models, including MetricX-QE and AutoMQM, targeting translation quality. We demonstrate the effectiveness of TranslateGemma with human evaluation on the WMT25 test set across 10 language pairs and with automatic evaluation on the WMT24++ benchmark across 55 language pairs. Automatic metrics show consistent and substantial gains over the baseline Gemma 3 models across all sizes. Notably, smaller TranslateGemma models often achieve performance comparable to larger baseline models, offering improved efficiency. We also show that TranslateGemma models retain strong multimodal capabilities, with enhanced performance on the Vistra image translation benchmark. The release of the open TranslateGemma models aims to provide the research community with powerful and adaptable tools for machine translation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。