arXiv:2602.02443cs.LG2026-02被引 3

通过分离专家选择中的确定与不确定部分,实现高效且稳定的测试时扩展。

Certain Head, Uncertain Tail: Expert-Sample for Test-Time Scaling in Fine-Grained MoE

  • 保留高置信度专家选择,仅对低置信度候选注入可控随机性。
  • 在数学、代码等任务上,32样本并行生成时通过率提升至91.9%。
  • 无需训练,适用于各类细粒度MoE模型,尤其适合追求稳定多样性的场景。

测试时扩展通过生成多个候选解提升大模型性能,但逐标记采样需调温度,导致多样性与稳定性难以兼顾。细粒度MoE每层拥有数百个训练良好的专家,且每个标记激活多个专家,其丰富的路由空间提供了新思路。我们实证分析发现:路由器得分呈现前段高置信度专家(确定头)与后段低置信度候选(不确定尾)的模式。单次贪婪选择在少专家激活下保持稳定,但多样本的pass@n显著下降,表明确定头主导核心推理能力,不确定尾关联推理多样性。基于此,我们提出Expert-Sample——一种无需训练的方法,保留高置信度选择,仅对不确定尾注入控制随机性,实现无损多样化生成。在多个细粒度MoE模型上评估,涵盖数学、知识推理和代码任务,Expert-Sample持续提升pass@n与验证后准确率。在Qwen3-30B-A3B-Instruct上,于GPQA-Diamond任务中使用32个并行样本,pass@32从85.4%升至91.9%,验证准确率从59.1%提升至62.6%。

原文摘要 · Abstract (English)

Test-time scaling improves LLM performance by generating multiple candidate solutions, yet token-level sampling requires temperature tuning that trades off diversity against stability. Fine-grained MoE, featuring hundreds of well-trained experts per layer and multi-expert activation per token, offers an unexplored alternative through its rich routing space. We empirically characterize fine-grained MoE routing and uncover an informative pattern: router scores exhibit a certain head of high-confidence experts followed by an uncertain tail of low-confidence candidates. While single-run greedy accuracy remains stable when fewer experts are activated, multi-sample pass@n degrades significantly-suggesting that the certain head governs core reasoning capability while the uncertain tail correlates with reasoning diversity. Motivated by these findings, we propose Expert-Sample, a training-free method that preserves high-confidence selections while injecting controlled stochasticity into the uncertain tail, enabling diverse generation without destabilizing outputs. Evaluated on multiple fine-grained MoE models across math, knowledge reasoning, and code tasks, Expert-Sample consistently improves pass@n and verification-based accuracy. On Qwen3-30B-A3B-Instruct evaluated on GPQA-Diamond with 32 parallel samples, pass@32 rises from 85.4% to 91.9%, and accuracy improves from 59.1% to 62.6% with Best-of-N verification.

MoE测试时扩展推理优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。