arXiv:2605.06339cs.AI2026-05

为大模型决策选择控制器类别提供理论依据,避免盲目追求复杂度。

A Regime Theory of Controller Class Selection for LLM Action Decisions

论文配图:A Regime Theory of Controller Class Selection for LLM Action Decisions
图 1 · 摘自论文原文
  • 按复杂度将控制器分为四类,构建可量化评估的分级体系。
  • 在多个数据集上验证,理论预测的最优控制器类别与实际表现一致。
  • 适合研究大模型推理策略、系统设计与评估方法的从业者。

部署的语言和视觉-语言模型必须在每个输入上决定是直接回答、检索证据、转给更强模型,还是放弃。与普遍认为的表达力越强越好的直觉相反,在有限样本下,更高的逐例表达力并非总是有益:在相同严格交叉验证下,不同基准偏好不同的控制器类别。这反映出实例级不确定性信号在有限样本下的分布依赖性耗尽问题。我们将控制器组织成一个嵌套的四类层级结构:固定动作、分段路由、实例级控制器和先验门控控制器,按复杂度递增。我们提出一种制度理论,将三个可估计的数据瓶颈转化为类别选择标准:超越最佳固定动作可能带来的提升、实例级控制器能否可靠决策所需的样本量、当实例级信号不可靠时粗粒度分段路由能恢复多少性能。由此得到的伯恩斯坦紧致阈值具有匹配的信息论下界,且严格嵌套交叉验证可保证选择近最优类别。在SMS-Spam、HallusionBench、A-OKVQA和FOLIO上,预测类别与实证优胜者一致;在TextVQA中,当OCR token提供无标签预测时,先验门控控制器胜出。代码已公开于https://github.com/Anonymous-Awesome-Submissions/Regime-Theory。

原文摘要 · Abstract (English)

Deployed language and vision-language models must decide, on each input, whether to answer directly, retrieve evidence, defer to a stronger model, or abstain. Contrary to the common monotonicity intuition, greater per-input expressivity is not uniformly beneficial in finite samples: under identical strict cross-validation, different benchmarks prefer different controller classes. This reflects a finite-sample limitation of instance-level uncertainty signals, which can be exhausted at a distribution-dependent scale. We organize controllers into a nested lattice of four classes: fixed actions, partition routers, instance-level controllers, and prior-gated controllers, ordered by complexity. We prove a regime theory that turns three data-estimable bottlenecks into a class choice: how much improvement is possible beyond the best fixed action, whether there are enough samples for instance-level controllers to make reliable decisions, and how much improvement a coarse partition router can recover when instance-level signal is unreliable. The resulting Bernstein-tight threshold has a matching information-theoretic lower bound, and strict nested cross-validation provably selects a near-best class. Across SMS-Spam, HallusionBench, A-OKVQA, and FOLIO, the predicted class matches the empirical winner; the prior-gated controller wins on TextVQA when OCR tokens supply a label-free prediction-time prior. Code is available at https://github.com/Anonymous-Awesome-Submissions/Regime-Theory.

大模型决策控制器选择理论分析评估方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。