arXiv:2602.06527cs.AI2026-02被引 1

通过动态调控推理路径,让大模型在有限算力下更准更快地思考。

HyPER: Bridging Exploration and Exploitation for Scalable LLM Reasoning with Hypothesis Path Expansion and Reduction

  • 用在线控制器动态调整探索与利用的平衡,随推理进展自动切换策略。
  • 在多个基准上提升8%~10%准确率,同时减少25%~40%的计算量。
  • 无需训练,适用于各类专家混合模型,适合追求高效推理的研究者。

通过多路径思维链扩展测试时算力可提升大语言模型的推理准确性,但其效果高度依赖于探索与利用的权衡。现有方法处理该权衡方式僵化:树状搜索硬编码探索规则,干扰预训练推理;并行推理过度重复生成路径,且答案选择能力弱。我们观察到最优平衡具有阶段依赖性,且正确与错误路径常在后期才分化,因此将测试时扩展重新建模为对假设池的动态扩展-缩减控制问题。提出HyPER,一种面向混合专家模型的无训练在线控制策略,基于轻量路径统计在固定预算下重分配计算资源。HyPER包含:随假设池演化从探索转向利用的在线控制器;生成阶段无需完整重采样的词级别优化机制;以及结合长度与置信度的答案聚合策略。在四个混合专家语言模型上跨多样推理基准的实验表明,HyPER始终实现更优的准确率-算力权衡,准确率提升8%~10%,令牌使用量降低25%~40%。

原文摘要 · Abstract (English)

Scaling test-time compute with multi-path chain-of-thought improves reasoning accuracy, but its effectiveness depends critically on the exploration-exploitation trade-off. Existing approaches address this trade-off in rigid ways: tree-structured search hard-codes exploration through brittle expansion rules that interfere with post-trained reasoning, while parallel reasoning over-explores redundant hypothesis paths and relies on weak answer selection. Motivated by the observation that the optimal balance is phase-dependent and that correct and incorrect reasoning paths often diverge only at late stages, we reformulate test-time scaling as a dynamic expand-reduce control problem over a pool of hypotheses. We propose HyPER, a training-free online control policy for multi-path decoding in mixture-of-experts models that reallocates computation under a fixed budget using lightweight path statistics. HyPER consists of an online controller that transitions from exploration to exploitation as the hypothesis pool evolves, a token-level refinement mechanism that enables efficient generation-time exploitation without full-path resampling, and a length- and confidence-aware aggregation strategy for reliable answer-time exploitation. Experiments on four mixture-of-experts language models across diverse reasoning benchmarks show that HyPER consistently achieves a superior accuracy-compute trade-off, improving accuracy by 8 to 10 percent while reducing token usage by 25 to 40 percent.

推理优化混合专家动态控制高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。