arXiv:2601.15120cs.AI2026-01

通过虚拟轨迹生成解决工具型智能体意图偏移问题

Emerging from Ground: Addressing Intent Deviation in Tool-Using Agents via Deriving Real Calls into Virtual Trajectories

  • 将真实工具操作转化为虚拟轨迹,动态生成负样本
  • 在8项指标上提升任务完成率35.28%,意图对齐率23.27%
  • 适合需要高可靠性工具调用的智能体开发与评估场景

大语言模型已推动工具型智能体在真实场景中的应用,但常出现意外行为或结果。除明显失败外,'意图偏移'这一细微问题严重阻碍可靠评估与性能优化。现有后训练方法依赖真实系统样本或LLM模拟的虚拟数据,前者需手工构造用户请求成本高,后者存在分布偏移问题。且二者均缺乏针对意图偏移的负样本,影响偏好学习效果。本文提出RISE,一种'真实到虚拟'的方法:基于验证过的工具原子操作,通过关键参数变异合成虚拟轨迹并生成多样负样本。利用合成数据,采用两阶段训练对基础LLM进行意图对齐微调。实验表明,RISE合成数据在8个指标上表现优异;集成训练后,任务完成率(Acctask)平均提升35.28%,意图对齐率(Accintent)提升23.27%,优于最先进基线1.20%–42.09%和1.17%–54.93%。

原文摘要 · Abstract (English)

LLMs have advanced tool-using agents for real-world applications, yet they often lead to unexpected behaviors or results. Beyond obvious failures, the subtle issue of "intent deviation" severely hinders reliable evaluation and performance improvement. Existing post-training methods generally leverage either real system samples or virtual data simulated by LLMs. However, the former is costly due to reliance on hand-crafted user requests, while the latter suffers from distribution shift from the real tools in the wild. Additionally, both methods lack negative samples tailored to intent deviation scenarios, hindering effective guidance on preference learning. We introduce RISE, a "Real-to-Virtual" method designed to mitigate intent deviation. Anchoring on verified tool primitives, RISE synthesizes virtual trajectories and generates diverse negative samples through mutation on critical parameters. With synthetic data, RISE fine-tunes backbone LLMs via the two-stage training for intent alignment. Evaluation results demonstrate that data synthesized by RISE achieve promising results in eight metrics covering user requires, execution trajectories and agent responses. Integrating with training, RISE achieves an average 35.28% improvement in Acctask (task completion) and 23.27% in Accintent (intent alignment), outperforming SOTA baselines by 1.20--42.09% and 1.17--54.93% respectively.

智能体意图对齐虚拟数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。