用语法推理链提升低资源翻译,推理步骤越清晰效果越好
Reasoning over Grammar: Can Synthetic Linguistic Reasoning Traces Enhance Low-Resource Machine Translation?
- 自动生成语法分析步骤,作为翻译时的推理引导
- 在上下文学习中使用推理链,翻译准确率显著提升
- 适合研究低资源语言翻译与大模型推理能力的学者
大型语言模型(LLMs)通过上下文学习引入语言资源,为极低资源语言翻译提供了新路径。然而,模型在翻译中常无法有效利用语法信息。受思维链推理启发,我们提出一种自动从通用依存树库、词典和语法规则库生成分步语法推理链的流程。在锡伯语和钦唐语上评估了三种设置:上下文学习(ICL)、监督微调(SFT)和强化微调(RFT)。结果表明,语法推理链在推理阶段作为指导最为有效:在ICL中,可靠的推理链显著提升多种模型、语言和指标下的翻译性能;而将其作为训练数据时,收益较小且不一致,因模型虽学会格式,但生成内容易出错。这说明,当提供可靠语法分析时,LLMs可有效利用语法信息进行低资源翻译,但自主生成此类分析仍是主要瓶颈。
原文摘要 · Abstract (English)
Large language models (LLMs) offer a promising approach to machine translation (MT) for extremely low-resource languages by incorporating linguistic resources through in-context learning. However, LLMs often struggle to apply grammatical information effectively during translation. Inspired by recent progress in chain-of-thought reasoning, we investigate whether low-resource MT can benefit from structured intermediate steps of linguistic analysis and grammatical reasoning. We propose a pipeline for automatically generating step-by-step linguistic reasoning traces from Universal Dependencies treebanks, dictionaries, and grammar-rule banks. We evaluate these traces in three settings: in-context learning (ICL), supervised fine-tuning (SFT), and reinforcement fine-tuning (RFT), on Xibe and Chintang as test cases. Our results show that linguistic reasoning traces are most effective as inference-time guidance: in ICL, reliable linguistic reasoning traces substantially improve translation performance across models, languages, and metrics. In contrast, using these traces as training data yields smaller and less consistent gains, as models learn the format but often generate error-prone content. These findings suggest that LLMs can leverage grammatical information for low-resource MT when given reliable linguistic analyses, while learning to generate such analyses remains a major bottleneck.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。