当所有候选答案都错时,直接重算比依赖候选更准。
Selection, Recombination, or a Fresh Solve? A Candidate-Free Control for Single-Pass Test-Time Aggregation
- 不依赖候选答案,直接重新求解更可靠。
- 全错候选时,使用候选反而降低准确率0.123。
- 适合数学推理任务中追求高精度的场景。
当所有候选答案均错误时,正确答案的生成可能源于重组或重新求解。为提升测试时推理效率,关键问题是候选上下文是否在额外生成轮次之外带来价值。本文在相同最大输出标记数约束下引入缺失候选控制,并按正确候选数量分层分析。在AIME-2025和HMMT-2025上,使用Qwen3-4B模型发现:当存在多个正确候选时,候选条件可提升准确率0.290;当所有候选均错误时,准确率下降0.123;单个正确候选情形结果未定。该结论经保守校正后仍成立。反事实分析表明,在此规模下,全错池的条件化会降低准确率,胜过直接重算。原始格式匹配与安慰剂实验描述了失败现象,但未揭示机制。结构化干预显示,显式答案字段可因果引导输出,但掩码处理无显著提升,且未验证与原格式等价。证据限于一个Qwen3-4B系列模型、两个数学基准、首答截断的候选片段及单次提示聚合。
原文摘要 · Abstract (English)
When every candidate is wrong, correct-candidate selection is unavailable, yet the aggregation call can still solve the problem afresh. A correct aggregate answer may therefore reflect recombination, fresh solving, or both. For efficient test-time reasoning, the relevant question is whether candidate context adds value beyond the additional generation pass. We introduce the missing candidate-free control under the same maximum output-token allowance and stratify by the number of correct candidates. Across AIME-2025 and HMMT-2025 with Qwen3-4B, candidate conditioning improves accuracy when multiple candidates are correct ($Δ_{\mathrm{cand}}$(c2+) = +0.290), lowers accuracy when every candidate is wrong ($Δ_{\mathrm{cand}}$(c0) = -0.123), and remains unresolved in the one-correct regime. The c2+ and c0 conclusions survive a conservative correction for the adaptive two-benchmark procedure. Under this counterfactual, the interpretation of all-wrong recovery reverses at this scale: conditioning on an all-wrong candidate pool lowers accuracy relative to a fresh solve. Original-format matching and placebo results characterize the failures descriptively but leave their mechanism unresolved. Within a separate structured intervention, explicit answer fields causally steer outputs toward their values; masking yields no measurable accuracy improvement, and equivalence with the original format was not established. The evidence is limited to one Qwen3-4B family, two mathematics benchmarks, first-answer-truncated candidate fragments, and single-pass prompted aggregation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。