arXiv:2511.07010cs.CLcs.CV2025-11中稿 · The 12th Workshop …

用图像辅助自动修正翻译数据,提升多语言翻译质量

A Picture is Worth a Thousand (Correct) Captions: A Vision-Guided Judge-Corrector System for Multimodal Machine Translation

  • 构建视觉引导的判别-修正管道,自动识别并修复翻译错误
  • 修正后数据使英印语翻译的BLEU分数最高提升1.30分
  • 适合关注低资源语言翻译与数据清洗的研究者

本文介绍我们团队在WAT 2025英语到印地语多模态翻译任务中的系统。我们参与了英语-印地语、英语-孟加拉语、英语-马拉雅拉姆语和英语-奥里亚语四组纯文本翻译任务。提出一种两阶段方法:先通过自动化错误检测与修正解决训练数据质量问题,再进行参数高效微调。方法引入视觉增强的判别-修正流水线,利用多模态语言模型系统性识别并修正训练数据中的翻译错误。判别组件将翻译分为三类:正确、需图像上下文的模糊项、质量差的误译。错误样本被送至专用修正器:GPT-4o-mini重写需视觉澄清的条目,IndicTrans2重译纯翻译质量问题。该流程处理了四语言共28,928个训练样本,平均每语言修正17.1%的字幕。随后使用低秩适应(LoRA)对IndicTrans2 en-indic 200M蒸馏模型在原始与修正数据集上进行微调。在修正数据上训练带来一致提升:英-孟加拉语在评测集上提升+1.30(42.00 → 43.30),挑战集+0.70(44.90 → 45.60);英-奥里亚语评测集+0.60(41.00 → 41.60);英-印地语挑战集+0.10(53.90 → 54.00)。

原文摘要 · Abstract (English)

In this paper, we describe our system under the team name BLEU Monday for the English-to-Indic Multimodal Translation Task at WAT 2025. We participate in the text-only translation tasks for English-Hindi, English-Bengali, English-Malayalam, and English-Odia language pairs. We present a two-stage approach that addresses quality issues in the training data through automated error detection and correction, followed by parameter-efficient model fine-tuning. Our methodology introduces a vision-augmented judge-corrector pipeline that leverages multimodal language models to systematically identify and correct translation errors in the training data. The judge component classifies translations into three categories: correct, visually ambiguous (requiring image context), or mistranslated (poor translation quality). Identified errors are routed to specialized correctors: GPT-4o-mini regenerates captions requiring visual disambiguation, while IndicTrans2 retranslates cases with pure translation quality issues. This automated pipeline processes 28,928 training examples across four languages, correcting an average of 17.1% of captions per language. We then apply Low-Rank Adaptation (LoRA) to fine-tune the IndicTrans2 en-indic 200M distilled model on both original and corrected datasets. Training on corrected data yields consistent improvements, with BLEU score gains of +1.30 for English-Bengali on the evaluation set (42.00 -> 43.30) and +0.70 on the challenge set (44.90 -> 45.60), +0.60 for English-Odia on the evaluation set (41.00 -> 41.60), and +0.10 for English-Hindi on the challenge set (53.90 -> 54.00).

多模态翻译数据清洗低秩微调印地语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。