arXiv:2604.12513cs.LG2026-04

用内部不确定性实现语言模型的自主调控,提升可控性与效率。

Agentic Control in Variational Language Models

  • 将不确定性作为主动信号,动态调节训练与推理过程。
  • 在语言建模任务中优于确定性模型,且不确定性更丰富可用。
  • 支持闭环控制,适合需要自主决策的生成系统研究者。

我们研究变分语言模型是否能基于自身内部证据实现最小且可测量的自主控制。模型结合局部变分隐藏计算(EVE)、稳态潜变量调节器、结构感知检查点保留机制,以及基于保留模型的校准不确定性控制器。不同于将不确定性视为预测后的被动诊断,本文将其作为可操作信号,用于调节训练、支持检查点保留,并引导推理时干预。结果表明,该框架具备明确闭环控制能力,使结构与预测信号成为可执行指令。实证显示,变分主干模型在语言建模任务上优于对应确定性基准,同时展现出更丰富且可用的不确定性特征;在此基础上,校准控制器持续活跃,在完整代理评估中使用多种动作,实现了正向的质量-成本权衡。这些结果支持一个精确论断:内部不确定性不仅可描述变分语言模型,还可作为调控、检查点保留和最小自主路由的实际控制接口。

原文摘要 · Abstract (English)

We study whether a variational language model can support a minimal and measurable form of agentic control grounded in its own internal evidence. Our model combines local variational hidden computation (EVE), a homeostatic latent regulator, structurally aware checkpoint retention and a calibrated uncertainty-aware controller operating on top of the retained model. Rather than treating uncertainty as a passive diagnostic measured after prediction, we treat it as an operational signal that can regulate training, support checkpoint retention and guide inference-time intervention. The resulting framework is deliberately focused. It studies a closed-loop form of internal control in which structural and predictive signals become actionable. Empirically, the variational backbone improves over a matched deterministic reference on the language-modeling task while also exhibiting a richer and more usable uncertainty profile. On top of this backbone, the calibrated controller remains active, uses multiple actions under a full agentic evaluation and yields a positive quality-cost trade-off. These results support a precise claim: internal uncertainty can serve not only as a descriptive property of a variational language model, but also as a practical control interface for regulation, checkpoint retention and minimal agentic routing.

变分模型自主控制不确定性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。