让大模型推理并行化,提速近1.7倍且保持高准确率
Parason: Revealing Subtask and Trial Parallelism in LLM Reasoning

- 通过识别子任务与试错两种并行方式,重构推理流程
- 在难任务中试错并行占65.5%计算量,显著提升加速潜力
- 适合追求低延迟推理的部署场景,如实时问答系统
扩展推理时长显著提升了大语言模型(LLMs)的问题求解能力,但标准自回归解码仍逐序列执行长推理链,导致复杂任务延迟极高(可达数天至数周)。并行推理是自然解决方案。以往系统主要关注子任务并行性,即模型将高阶任务分解为可独立求解的子任务。本文揭示另一普遍存在形式:试错并行性,即多个假设并行探索、验证与聚合。我们提出Parason,可同时发现并学习这两种并行性。分析显示,在DeepSeek-V4的推理步骤中,试错并行性占总可并行计算的65.5%(在HLE数据集上),且在难题中占比更高。基于此分类,Parason使用无上下文语法将串行推理轨迹转为结构化并行路径,并采用平行感知组相对策略优化(PA-GRPO)训练模型,其奖励函数联合平衡准确率、延迟及两类并行比例。推理阶段通过工具调用执行学习到的并行结构,实现理论加速落地。在AIME24和AIME25等数学推理基准测试中,平均加速达1.7×,且保持竞争力准确率。
原文摘要 · Abstract (English)
Scaling test-time reasoning has substantially improved the problem-solving ability of large language models (LLMs), but standard autoregressive decoding still executes long reasoning traces sequentially, creating severe latency for difficult tasks (up to days and weeks). Parallel reasoning offers a natural remedy. However, prior systems primarily focus on Subtask Parallelism, where the model learns to decompose a high-level task into smaller chunks that can be solved independently. This approach overlooks another pervasive form of parallelism: Trial Parallelism, where multiple speculative attempts explore, verify, and aggregate competing hypotheses in parallel. In this paper, we introduce Parason, which reveals and learns both forms of parallelism in LLM reasoning. Our analysis identifies Trial Parallelism as the majority of parallelizable reasoning computation (65.5% in DeepSeek-V4's reasoning steps in HLE), and it becomes increasingly dominant on hard problems. Guided by this taxonomy, Parason converts sequential reasoning traces into structured parallel trajectories with a context-free grammar, then trains models with Parallelism-Aware Group Relative Policy Optimization (PA-GRPO), whose reward jointly balances accuracy, latency, and the two parallelism ratios. At inference time, Parason executes the learned parallel structure through tool calls, translating theoretical savings to real-world wall-clock acceleration. Experiments on mathematical reasoning benchmarks including AIME24 and AIME25 show that Parason achieves an average acceleration about 1.7$\times$ while maintaining competitive accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。