arXiv:2608.28496cs.CL2026-08中稿 · EMNLP

对比测试时扩展方法,发现顺序采样在小预算下翻译更优且更自然。

Ladders in Chaos: When, How, (and Perhaps Why) Does Test-Time Scaling Improve LLM Machine Translation

论文配图:Ladders in Chaos: When, How, (and Perhaps Why) Does Test-Time Scaling Improve LLM Machine Translation
图 1 · 摘自论文原文
  • 采用顺序采样生成多轮候选,提升翻译多样性与质量。
  • 小预算下顺序采样性能更高,大预算时准确率可能下降。
  • 机制在于模型获得更大目标侧上下文,适合优化翻译流畅性。

大型语言模型(LLM)的两种测试时扩展方法——顺序采样(后续尝试依赖前序结果)和并行采样(如独立同分布采样后重排序)——已成为主流。本研究在机器翻译任务中考察二者表现。结果表明:顺序采样具有更高性能上限,在较小采样预算下能生成更丰富有效的候选集;人工分析显示,其显著提升翻译流畅度与自然度,但在大推理预算下可能损害准确性。进一步控制实验表明,顺序自提升的成功部分归因于模型获得更大目标侧上下文。消融实验揭示顺序采样对采样温度较鲁棒,但对上下文构建敏感,提示未来改进方向。

原文摘要 · Abstract (English)

Two forms of test-time scaling for Large Language Models (LLMs) have emerged as effective and widely adopted paradigms: sequential, in which later answer attempts depend on earlier ones, and parallel, such as i.i.d. sampling with reranking. In this study, we investigate their properties in translation. First, our study shows that sequential sampling has a higher performance ceiling, providing a more diverse and effective pool of samples, particularly under smaller sampling budgets. Second, we interrogate the nature of test-time scaling through a multidimensional manual analysis. Human analysis of the Best-of-N translations demonstrates that sequential sampling substantially improves translation fluency and naturalness, but can degrade accuracy when inference budgets are large. Finally, we suggest an explanation of the mechanism through which sequential scaling improves machine translation. Our controlled analysis partially attributes the success of sequential self-improvement to the model's access to a larger target-side context. Ablation experiments on sequential sampling demonstrate its robustness across different sampling temperatures, while also revealing sensitivity to context construction, suggesting directions for future improvement.

机器翻译测试时扩展大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。