arXiv:2607.28576cs.CLcs.AI2026-07

重复采样比自我反思更高效,大模型下优势更明显

Sample More, Reflect Less: Self-Refine and Reflexion Lose to Repeated Sampling at Equal Token Cost, from 1.5B to 7B

  • 用多次采样取众数答案,比自我纠错、反思等复杂流程更有效
  • 在1.5B到7B模型上,所有自检方法均不如重复采样,尤其7B时差距缩小
  • 适合追求效率的开发者,尤其在资源受限场景下替代复杂推理

现有语言模型的自我反思、自我修正、多轮辩论等方法普遍生成大量文本,而单纯增加生成量本身就能提升准确率。王等人(2024)提出,仅对同一问题重复采样并保留最常见答案的简单基线,在预算相当的情况下常能胜出,但未提供置信区间或显著性检验。本研究设计对照实验:使用1.5B、3B、7B参数的开源模型,在两个数学基准上各测试150个问题,严格统计每个生成的词元数,包括批评、反思、辩论和验证消耗的开销,将每种方法与同等成本下的重复采样进行配对比较。36次对比中无一方法显著优于重复采样,其中10种反而更差,且所有自检类方法表现均差。随着模型增大,选择机制效果减弱:Best-of-N在1.5B下优于人工选择8.0和11.3分,但在7B下仅优2.0和1.3分,已不显著。自我修正与强制反思在7B下仍落后3.6至10.1分。原版反思从未在最小模型上触发重试,始终视为正确,实为单链思维。代码、提示、所有生成结果及验证脚本均已公开。

原文摘要 · Abstract (English)

Methods that make a language model plan, criticise and rewrite its own answer, reflect on mistakes, pick the best of several attempts, or debate with copies of itself nearly all make it generate far more text than a single chain of thought. Because generating more text raises accuracy by itself, a gain over one chain of thought does not show the method's idea is what helped. Wang et al. (2024) reported that a simple baseline, sampling the same question repeatedly and keeping the most common answer, often wins once budgets are comparable, but gave point estimates with no confidence intervals or significance tests. We rerun that comparison as a designed experiment: seven methods, open models of 1.5B, 3B and 7B parameters, two mathematics benchmarks, 150 questions each. We count every generated token, including those spent on critiques, reflections, debate turns and checking, and compare each method against repeated sampling at its own measured cost. All 36 comparisons are paired by question, with bootstrap intervals and multiplicity correction. No method is reliably better than repeated sampling at equal cost anywhere. Ten are reliably worse, all of them methods where the model inspects its own output, and all 18 self-inspection comparisons are negative. The two kinds of self-inspection part company as models grow. Choosing stops hurting: taking Best-of-N's eight samples and just counting the most common answer beats letting the model pick by 8.0 and 11.3 points at 1.5B, but only 2.0 and 1.3 at 7B, no longer distinguishable from zero. Rewriting does not recover: Self-Refine and a forced Reflexion stay 3.6 to 10.1 points below baseline at 7B. Reflexion as published never triggered its own retry on the smallest model. It judged itself correct every time and silently became a single chain of thought. We release code, prompts, all generations, and our verification scripts.

大模型推理效率重复采样自我反思

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。