让机器翻译像人一样深入思考,提升隐喻类文本的翻译质量。
DRT: Deep Reasoning Translation via Long Chain-of-Thought
- 用多智能体框架模拟长链推理,逐轮优化翻译。
- 在文学隐喻翻译上超越普通模型,提升语义保留率。
- 适合需要精准传达文化意象的翻译任务,如文学、影视字幕。
近期,类似O1的模型展示了长链思维(CoT)在数学与编程任务中的有效性。本文提出DRT,旨在将长链思维的成功应用于神经机器翻译(MT)。针对文学作品中常出现的隐喻与比喻,因文化差异导致直译难以传递原意,甚至专业译者也需反复推敲。为模拟大模型的长思维能力,我们从现有文学书籍中挖掘含隐喻或比喻的句子,并构建多智能体框架进行翻译:由翻译者在顾问建议下迭代翻译,评估者每轮量化翻译质量。由此生成数万条长思维翻译数据,用于训练DRT模型。以Qwen2.5和LLama-3.1为骨干网络,DRT能学习翻译过程中的思维路径,在隐喻翻译上优于基线模型及仅通过成对句子微调的模型,验证其有效性。代码与模型已开源。
原文摘要 · Abstract (English)
Recently, O1-like models have emerged as representative examples, illustrating the effectiveness of long chain-of-thought (CoT) in reasoning tasks such as math and coding tasks. In this paper, we introduce DRT, an attempt to bring the success of long CoT to neural machine translation (MT). Specifically, in view of the literature books that might involve similes and metaphors, translating these texts to a target language is very difficult in practice due to cultural differences. In such cases, literal translation often fails to convey the intended meaning effectively. Even for professional human translators, considerable thought must be given to preserving semantics throughout the translation process. To simulate LLMs' long thought ability in MT, we first mine sentences containing similes or metaphors from existing literature books, and then develop a multi-agent framework to translate these sentences via long thought. In the multi-agent framework, a translator is used to iteratively translate the source sentence under the suggestions provided by an advisor. To ensure the effectiveness of the long thoughts, an evaluator is also employed to quantify the translation quality in each round. In this way, we collect tens of thousands of long-thought MT data, which is used to train our DRT. Using Qwen2.5 and LLama-3.1 as the backbones, DRT models can learn the thought process during machine translation, and outperform vanilla LLMs as well as LLMs which are simply fine-tuning on the paired sentences without long thought, showing its effectiveness. The synthesized data and model checkpoints are released at https://github.com/krystalan/DRT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。