arXiv:2602.05805cs.AI2026-02被引 2

无需标注数据,通过神经元激活模式自动筛选最优推理路径。

NEX: Neuron Explore-Exploit Scoring for Label-Free Chain-of-Thought Selection and Model Ranking

  • 基于神经元激活变化检测探索与利用阶段,识别有效推理节点。
  • 在多个推理基准上,其得分可准确预测模型性能并选出更优版本。
  • 适用于无监督场景下的模型评估与融合方案优化,适合算法研发者。

大型语言模型在推理时越来越依赖对多条思维链的采样或对合并检查点的搜索,使选择环节成为新瓶颈,且常缺乏目标分布的监督信号。我们发现基于熵的探索代理呈倒U型与准确率关系,表明过度探索会冗余并导致过度思考。为此提出NEX——一种白盒、无标签、无监督的评分框架,将推理过程视为交替的探索(E)与利用(X)阶段。NEX通过稀疏激活缓存中每标记新增激活的MLP神经元数量来检测E阶段,再用粘性双状态隐马尔可夫模型推断E-X阶段,并根据后续X段是否重用这些神经元来赋予其权重。该机制生成可解释的神经元权重与单一‘优质分数’,用于无任务答案情况下对候选响应和合并变体进行排序。在多个推理基准与Qwen3合并系列中,仅基于少量未标注激活数据计算的NEX得分即可预测下游准确率并识别更优变体;我们进一步通过人工标注验证了E-X信号,并通过‘有效-冗余’神经元迁移提供了因果证据。

原文摘要 · Abstract (English)

Large language models increasingly spend inference compute sampling multiple chain-of-thought traces or searching over merged checkpoints. This shifts the bottleneck from generation to selection, often without supervision on the target distribution. We show entropy-based exploration proxies follow an inverted-U with accuracy, suggesting extra exploration can become redundant and induce overthinking. We propose NEX, a white-box label-free unsupervised scoring framework that views reasoning as alternating E-phase (exploration) and X-phase (exploitation). NEX detects E-phase as spikes in newly activated MLP neurons per token from sparse activation caches, then uses a sticky two-state HMM to infer E-X phases and credits E-introduced neurons by whether they are reused in the following X span. These signals yield interpretable neuron weights and a single Good-Mass Fraction score to rank candidate responses and merged variants without task answers. Across reasoning benchmarks and Qwen3 merge families, NEX computed on a small unlabeled activation set predicts downstream accuracy and identifies better variants; we further validate the E-X signal with human annotations and provide causal evidence via "Effective-vs-Redundant" neuron transfer.

模型评估无监督学习推理优化神经元分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。