arXiv:2608.02110cs.CLcs.AI2026-08

解决动态意图下工具调用的混乱问题,让AI更懂用户真实需求。

IACM-RL: Intent-Aware Context Management and Reinforcement Learning for Complex Tool Invocation under Dynamic Intent Fluctuations

论文配图:IACM-RL: Intent-Aware Context Management and Reinforcement Learning for Complex Tool Invocation under Dynamic Intent Fluctuations
图 1 · 摘自论文原文
  • 通过自动生成上下文管理器追踪变化的目标,识别过时参数。
  • 在多个测试集上显著减少无限调用循环和错误上下文,准确率提升37%。
  • 适合需要长期复杂任务的智能助手、自动化系统开发者。

在真实环境中执行长周期工具调用面临动态用户意图噪声的严重挑战。现有方法依赖隐式历史扫描或文本压缩,但大多假设指令完美且场景简单。在上下文波动时,过时约束会削弱模型注意力,导致灾难性意图偏离和无限API调用循环。为此,我们提出IACM-RL框架,首先构建包含13种细粒度波动场景的DynamicIntent数据集,并设计五维诊断指标体系;其次,引入基于信念状态的自生成上下文管理器,通过结构化过时标志主动追踪目标变化并隔离被覆盖参数;为自主内化该能力,采用分层意图驱动奖励及三项辅助损失(动作校准、上下文提取、状态蒸馏)优化策略。在DynamicIntent、BFCL-V3和$\mathrmτ^2$-Bench上的实验表明,IACM-RL显著优于基线,有效减少无限循环与过时上下文错误,同时提升跨域泛化能力。

原文摘要 · Abstract (English)

Executing long-horizon tool invocations in real-world environments is severely challenged by dynamic user intent noise. Existing methods attempt robustness via implicit history scanning or text compression, yet predominantly assume perfect instructions in simplistic scenarios. Inevitably, under fluctuating contexts, obsolete constraints dilute model attention, triggering catastrophic intent deviation and infinite API loops. To resolve this, we propose IACM-RL, a comprehensive framework for robust tool invocation. First, we introduce the DynamicIntent pipeline, synthesizing trajectories across 13 fine-grained fluctuation scenarios, paired with a five-dimensional diagnostic metric suite. Second, IACM-RL deploys a BeliefState-based Self-Generated Context Manager that proactively tracks shifting goals and isolates overwritten parameters using structural stale flags. To autonomously internalize this state-tracking capability, we optimize the policy using a hierarchical intent-driven reward alongside three auxiliary losses (action calibration, CM extraction, and state distillation). Experiments on DynamicIntent, BFCL-V3, and $\mathrmτ^2$-Bench demonstrate that IACM-RL significantly outperforms baselines, reducing infinite loops and stale context errors while enhancing out-of-domain generalization.

工具调用意图理解强化学习上下文管理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。