arXiv:2608.25198cs.AI2026-08

通过调整模型内部一个方向,可精准控制大模型调用工具的频率。

Tunable Tool-Call Rates in LLM Agents via Representation Steering

论文配图:Tunable Tool-Call Rates in LLM Agents via Representation Steering
图 1 · 摘自论文原文
  • 发现模型残差流中存在单一线性方向可调控工具调用率。
  • 调节强度α可使调用率从0%升至90%,准确率从0.29提升至0.56。
  • 无需训练即可跨模型、跨工具通用,适合需要灵活控制推理成本的场景。

决定是否调用工具是大模型智能体的核心能力,但错误判断代价高昂:冗余调用增加延迟与成本,漏调则导致模型自信出错。现有方法如微调和提示工程成本高且难以在推理时调整。本文发现,指令微调模型的工具调用行为可通过其残差流中的单一线性方向进行控制,该方向无需训练即可从模型自身工具使用偏好信号中提取,并在推理时无须更改提示实现干预。调节强度α可使调用率单调地从接近0%增至超过90%,同时保持调用质量。该方法双向有效:降低可抑制调用,提高可诱导新调用,且精准落在模型知识无法回答的问题上。该方向对未见工具也具泛化能力,性能接近各工具专属方向,不偏袒特定工具选择。结合实时工具执行,一次扫描即可绘制成本/准确率帕累托前沿,近似将开放域问答准确率从0.29提升至0.56;该方法适用于密集、MoE及多模态等多种架构,无需训练。代码已开源。

原文摘要 · Abstract (English)

Deciding whether to call a tool is a core competence of an LLM agent, and a costly one to get wrong: needless calls add latency, accrue cost, and may trigger irreversible side effects, while missing calls leave the model confidently wrong on questions it could only answer through tool-calls. Models manage this balance poorly, both over-using and under-using tools. Existing methods such as post-training and prompt engineering are expensive and difficult to modify at inference time. We show that whether an instruction-tuned model calls a tool can be controlled by a single linear direction in its residual stream, extracted without any training from the model's own tool-use preference signal and turned into an inference-time intervention with no prompt change. Adding the direction with strength $α$ moves the call rate monotonically from near $0\% $ to over $90\%$ while keeping calls well-formed. The steering works in both directions: dialing it down suppresses calls, and dialing it up induces new calls that land precisely on the questions the model cannot answer from its own knowledge. We also show that the direction generalizes to unseen tools with strength comparable to each tool's own direction and without favoring any specific tool choice. With live tool execution, a single sweep of the steering traces a cost/accuracy Pareto frontier and nearly doubles open-domain QA accuracy ($0.29 \! \rightarrow \! 0.56$); the same recipe transfers across a diverse range of models spanning dense, MoE, and multimodal architectures, without any training. Our code is publicly available at https://github.com/YuqiChen4188/Steering-Tool-Use-Propensity.

工具调用模型控制推理优化无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。