通过分阶段并行推理,让小模型也能达到大模型的解题效果。
A2R: An Asymmetric Two-Stage Reasoning Framework for Parallel Reasoning
- 先用小模型并行生成多个解题思路,再用大模型整合优化。
- 小模型+大模型组合比单个32B大模型性能更好,成本低30%。
- 无需改造原模型,可直接提升复杂问题求解能力。
近期大型推理模型通过在推理阶段增加计算量,采用“思考更久”策略,在复杂任务求解上取得显著进展。然而,模型单次尝试的表现与其潜在能力之间仍存在明显差距,这种差距往往只有在多次尝试路径后才能显现。为此,我们提出A2R——一种非对称两阶段推理框架,旨在显式弥合模型实际表现与潜能之间的鸿沟。该框架首先由一个‘探索者’模型通过重复采样并行生成多个潜在解法;随后由一个‘合成者’模型对这些解法进行整合,开展更精细的第二阶段推理。这一两阶段流程使计算规模可独立于传统串行方法进行扩展。我们的工作包含两项关键创新:第一,提出A2R作为即插即用的并行推理框架,显著增强模型在复杂问题上的能力;例如,使用该框架后,Qwen3-8B-distill模型相较自一致性基线性能提升75%。第二,通过对探索者与合成者角色的系统分析,发现一种高效的非对称缩放范式,由此衍生出A2R-Efficient——将Qwen3-4B探索者与Qwen3-8B合成者结合,其平均性能超越单体Qwen3-32B模型,且成本降低近30%。综合来看,A2R不仅是性能提升框架,更是高效实用的现实应用解决方案。
原文摘要 · Abstract (English)
Recent Large Reasoning Models have achieved significant improvements in complex task-solving capabilities by allocating more computation at the inference stage with a "thinking longer" paradigm. Even as the foundational reasoning capabilities of models advance rapidly, the persistent gap between a model's performance in a single attempt and its latent potential, often revealed only across multiple solution paths, starkly highlights the disparity between its realized and inherent capabilities. To address this, we present A2R, an Asymmetric Two-Stage Reasoning framework designed to explicitly bridge the gap between a model's potential and its actual performance. In this framework, an "explorer" model first generates potential solutions in parallel through repeated sampling. Subsequently,a "synthesizer" model integrates these references for a more refined, second stage of reasoning. This two-stage process allows computation to be scaled orthogonally to existing sequential methods. Our work makes two key innovations: First, we present A2R as a plug-and-play parallel reasoning framework that explicitly enhances a model's capabilities on complex questions. For example, using our framework, the Qwen3-8B-distill model achieves a 75% performance improvement compared to its self-consistency baseline. Second, through a systematic analysis of the explorer and synthesizer roles, we identify an effective asymmetric scaling paradigm. This insight leads to A2R-Efficient, a "small-to-big" variant that combines a Qwen3-4B explorer with a Qwen3-8B synthesizer. This configuration surpasses the average performance of a monolithic Qwen3-32B model at a nearly 30% lower cost. Collectively, these results show that A2R is not only a performance-boosting framework but also an efficient and practical solution for real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。