分离状态与动作,让大模型更可靠地使用工具完成多轮任务
From State to Action: OODA-Tool for Reliable Multi-Turn Tool Use

- 采用观察-调整-决策-执行闭环,分阶段处理任务状态与动作
- 在不同规模模型上均提升成功率,小模型和复杂任务收益更大
- 适合需要长期记忆和多步推理的智能体应用
可靠的多轮工具使用要求智能体持续维护任务状态,并确保每一步动作与当前状态一致。然而,直接函数调用和ReAct类策略将状态追踪与动作生成耦合在同一个自回归过程中,导致状态-动作竞争:生成下一步调用的压力可能覆盖或忽略早期积累的信息。受博伊德的观察-调整-决策-执行(OODA)循环启发,我们提出OODA-Tool,一种带类型的闭环策略,通过分离状态保持与动作实现来缓解该竞争。并非直接从交互历史生成动作,而是将每个决策经由控制器验证的中间状态传递,确保最终输出始终基于当前任务状态。具体包括:观察重构任务状态,调整判断是否执行,决策形成可接受的动作结构,执行生成外部输出。我们在Qwen3系列模型(0.6B至14B)上评估了OODA-Tool,涵盖多轮、多工具及不完备信息场景。结果表明,其在所有模型尺寸下均显著提升任务成功率,尤其在小模型和依赖跨轮信息的任务中表现更优。控制实验、阶段消融及迁移测试进一步验证了改进的鲁棒性。
原文摘要 · Abstract (English)
Reliable multi-turn tool use requires an agent to preserve an evolving task state and ensure that each action remains consistent with it. However, direct function-calling and ReAct-style policies learn state tracking and action generation within the same autoregressive trajectory. This coupling creates state-action competition: the pressure to produce the next call can overwrite or ignore information accumulated earlier in the interaction. Inspired by Boyd's Observe-Orient-Decide-Act cycle, we introduce OODA-Tool, a typed closed-loop policy designed to mitigate this competition by separating state preservation from action realization. Rather than generating an action directly from the interaction history, OODA-Tool routes each decision through controller-checked intermediate states, ensuring that the final output remains grounded in the current task state. Specifically, Observe reconstructs the task state, Orient determines whether execution is warranted, Decide forms an admissible action structure, and Act realizes the external output. We evaluate OODA-Tool against direct function-calling and ReAct policies using Qwen3 models ranging from 0.6B to 14B across multi-turn, multi-tool, and incomplete-information settings. OODA-Tool consistently improves task success across model sizes, with larger gains on smaller models and on tasks whose actions depend strongly on information accumulated across turns and prior tool results. Controlled variants, stage-level ablations, and transfer evaluations further demonstrate the robustness of these improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。