arXiv:2608.03961cs.AI2026-08

根据题目难易动态分配计算资源,让大模型推理更高效透明

Interpretable Adaptive Sampling for LLM Test-Time Scaling

论文配图:Interpretable Adaptive Sampling for LLM Test-Time Scaling
图 1 · 摘自论文原文
  • 用模糊控制器根据题目难度和模型自信度动态分配采样数量
  • 在多个任务上以更少采样次数达到接近全预算的准确率
  • 适合追求高效推理且重视计算过程可解释性的研究者

测试时扩展通过生成并聚合多个候选答案来提升大语言模型的推理能力,但现有方法多采用固定采样预算,对简单和复杂问题均投入相同计算量。这种固定预算难以解释,无法说明为何某题获得特定采样数。本文提出一种轻量级模糊控制器,将题目复杂度和模型置信度等可解释信号映射为每题的采样预算:对简单或高置信度题目减少采样,对困难或低置信度题目增加采样,使推理阶段的计算分配变得可解释而非固定或黑箱。在公平对齐协议下,使用一致解码设置与受控答案选择策略,在问答与数学推理任务上与 best-of-$N$、计算感知缩放及基于自认证的基线对比。结果表明,该方法在多种模型与数据集上优于多个标准基线,且在接近选定最优预算的全预算表现的同时,显著降低平均采样数。这表明可解释的自适应采样是提升大模型测试时推理效率的可行方向。

原文摘要 · Abstract (English)

Test-time scaling improves LLM reasoning by generating and aggregating multiple candidate answers, yet many pipelines use fixed per-query budgets that spend the same compute on easy and difficult prompts. These fixed budgets are also difficult to inspect because they do not explain why a given prompt receives a particular number of samples. We propose adaptive} test-time scaling with a lightweight fuzzy controller that maps interpretable signals, including estimated prompt complexity and model confidence, to a per-query sampling budget. The controller assigns fewer samples to easier or more confident prompts and more samples to harder or less certain prompts, making inference-time compute inspectable rather than fixed or opaque. We evaluate under a fair-alignment protocol with matched decoding settings and controlled answer selection, and compare against best-of-$N$, compute-aware scaling, and self-certainty-based baselines on question-answering and mathematical reasoning tasks. Across models and datasets, adaptive fuzzy control improves over several standard baselines and remains close to a selector-matched full-budget control while reducing the average number of samples. These findings suggest that interpretable adaptive sampling is a practical direction for more efficient test-time reasoning in large language models.

大模型推理自适应采样可解释性测试时扩展

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。