arXiv:2605.14163cs.AI2026-05被引 2

弱模型协作可逼近强模型表现,关键在高效筛选正确解。

Agentic Systems as Boosting Weak Reasoning Models

  • 用多个弱模型生成候选解,通过验证器与比较器筛选最优路径。
  • 同一弱模型经优化后达76.4%准确率,接近强模型性能上限79.0%。
  • 适合想低成本提升推理模型性能的研究者与开发者使用。

能否通过弱推理模型的集体调用达到强模型的性能?本文研究基于验证器的委员会搜索作为推理时增强方法。机制并非简单‘人多力量大’:样本需暴露潜在正确解,而评判者与比较者必须在无隐藏验证器信息下还原这些解。我们通过分离提案覆盖、局部可识别性、进展与多样性来形式化该视角。证明覆盖可通过重复采样放大,但无法单独生成可靠评判者;真正可靠的放大需额外局部一致性信号,如执行、证明校验、类型检查、测试或约束求解。给出基于排名的边界,揭示局部选择错误如何累积成可靠轨迹,并刻画提案端的上限:仅当提案系统对任务片段赋予非零有效概率时,最佳-第k次(oracle best-of-k)才能收敛至其质量分布。实验显示,在 SWE-bench Verified 上,单个 exttt{GPT-5.4 nano} 提案解决67.0%的任务;采用相同 nano 模型,经评判-比较器协同,使用8个提案达76.4%,媲美 exttt{Gemini 3 Pro} 与 exttt{Claude Opus 4.5} Thinking 的独立表现,并逼近79.0%的最优-第8次上界。表明大量正确解已存在于弱模型提案池中,核心挑战在于精准筛选。剩余失败主要源于提案覆盖不足,说明存在共通盲区,仅靠更强筛选无法弥补。

原文摘要 · Abstract (English)

Can a committee of weak reasoning-model calls reach the performance of much stronger models? We study verifier-backed committee search as inference-time boosting for reasoning language models. The mechanism is not simply that ``more agents help'': samples expose latent correct solutions, while critics and comparators must recover them without access to the hidden verifier. We formalize this view by separating proposal coverage, local identifiability, progress, and diversity. We prove that coverage can be amplified by repeated sampling, but cannot by itself create useful critics or comparators; reliable amplification requires an additional local soundness signal, such as execution, proof checking, type checking, tests, or constraint solving. We give rank-based bounds showing when local selection errors compose into reliable trajectories, and characterize the proposer-side ceiling: oracle best-of-\(k\) converges only to the mass of task slices on which the proposal system assigns nonzero useful probability. Empirically, on SWE-bench Verified, a single \texttt{GPT-5.4 nano} proposal solves \(67.0\%\) of tasks. Using the same nano model, our critic--comparator orchestration reaches \(76.4\%\) with \(k=8\) proposals, matching the standalone performance of \texttt{Gemini 3 Pro} and \texttt{Claude Opus 4.5} Thinking and approaching the \(79.0\%\) oracle best-of-\(8\) upper bound. Thus, many correct patches are already present in weak-model proposal pools; the main challenge is selecting them. The remaining failures are mostly proposal-coverage failures, indicating shared blind spots that stronger selection alone cannot close.

推理增强模型协作弱模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。