arXiv:2607.14277cs.CL2026-07

用模型内部隐状态直接判断是否该继续、求助或调工具,提升智能体决策效率。

Multi-Head Latent Control: A Unified Interface for LLM Agent Decision Making

论文配图:Multi-Head Latent Control: A Unified Interface for LLM Agent Decision Making
图 1 · 摘自论文原文
  • 从冻结大模型的隐状态中提取控制信号,无需修改主模型
  • 可减少90.7%的大模型使用量,同时保持近似性能
  • 适合需要低成本高效决策的多模型协作系统

大型语言模型越来越多地被用作智能体,但可靠的代理行为不仅依赖于下一个词的预测。推理时,智能体应能决定是否继续当前推理、转至更强模型、请求额外信息、调用外部工具,或在不确定时放弃。现有方法通过提示路由、外部编排或任务特定微调实现,主要依赖输入端信号,成本高且难维护。本文提出多头隐状态控制(Multi-Head Latent Control),一种轻量级层,从冻结的LLM或VLM的隐藏状态轨迹中生成部署时的控制信号。能力头预测当前模型能否解决任务,或应转至更强合作方;解析头预测合适的行动:澄清、工具使用、放弃或直接回答。两头仅在同一批冻结模型的隐状态轨迹上训练,实现无需修改模型的后期适配。在语言与视觉语言场景中,该方法持续优化多模型系统的质量-成本权衡,支持早期移交部分生成,提升干预决策精度。在小+大模型路由执行中,安卓世界数据集上大模型使用量减少达90.7%,跨基准平均减少27%-53%,同时保留大部分大模型性能。此外,学习到的控制信号显著提升工具使用决策质量,相对得分最高提升158%,漏调工具调用减少65.5%。

原文摘要 · Abstract (English)

Large language models are increasingly deployed as agents, but reliable agentic behavior requires more than next-token prediction. At inference time, it is preferred that an agent can decide whether to proceed with its current reasoning, defer to a stronger model, request additional information, invoke external tools, or abstain under the given setup. Existing approaches address these decisions through prompt-level routing, external orchestration, or task-specific fine-tuning, which primarily rely on input-side signals, and are often costly and difficult to maintain as model backbones evolve. We ask whether such control decisions can be inferred directly from a model's latent generation process. We introduce Multi-Head Latent Control, a lightweight layer that reads hidden-state trajectories from a frozen LLM or VLM to produce deployment-time control signals. A Capability Head predicts whether the current model can solve the instance or should defer to a stronger collaborator, while a Resolution Head predicts appropriate resolution decision Clarification, Tool Use, Abstention, or Direct Answering. Both heads are trained only on latent traces from the same frozen LLM backbone, enabling post hoc adaptation without modifying the model. Across language and vision-language settings, Multi-Head Latent Control consistently improves the quality-cost tradeoff of multi-model systems, enabling early handoff from partial generations and more accurate intervention decisions. In routed execution (small + large model), it reduces large-model usage by up to 90.7 percent on AndroidWorld and 27-53 percent on average across benchmarks, while retaining most of large-model performance. Additionally, the learned control signals improve tool-use decision quality, yielding up to +158 percent relative score gain and 65.5 percent fewer missed-required tool calls.

智能体决策隐状态控制多模型协同工具调用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。