提出四类非协作用户行为模拟器,提升工具代理真实场景鲁棒性。
Non-Collaborative User Simulators for Tool Agents
- 构建四类非协作行为模拟框架:请求不可用服务、跑题、不耐烦、话不完整。
- 实测主流工具代理在非协作用户下性能大幅下降,出现幻觉与对话中断。
- 开源可扩展框架,助力开发者在真实场景下测试代理能力。
工具代理通过多轮对话完成任务,现有用户模拟器多为友好型,仅表现合作行为,无法训练和测试代理应对真实世界中的非协作用户。本文提出新型用户模拟架构,可模拟四类非协作行为:请求不可用服务、偏离主题、表达不耐烦、提供不完整话语。该模拟器在保持任务意图与信息完整传递的同时,能生成具有挑战性且自然的非协作行为。在MultiWOZ和τ-bench上的实验显示,当前最先进工具代理在面对非协作用户时性能显著下降,各类非协作情境下均暴露出幻觉加剧、对话崩溃等弱点。研究结果表明需发展更鲁棒的代理方法以应对部署中多样化的用户行为。我们开源了可扩展的模拟框架,支持社区在自定义服务领域内进行真实场景下的代理开发与压力测试。代码已公开于https://github.com/holi-lab/NCUser。
原文摘要 · Abstract (English)
Tool agents interact with users through multi-turn dialogues to accomplish various tasks. Recent studies have adopted user simulation methods to develop these agents in multi-turn settings. However, existing user simulators tend to be agent-friendly, exhibiting only cooperative behaviors, failing to train and test agents against non-collaborative users in the real world. We propose a novel user simulator architecture that simulates four categories of non-collaborative behaviors: requesting unavailable services, digressing into tangential conversations, expressing impatience, and providing incomplete utterances. Our user simulator can simulate challenging and natural non-collaborative behaviors while reliably delivering all intents and information necessary to accomplish the task. Our experiments on MultiWOZ and τ-bench reveal significant performance degradation in state-of-the-art tool agents when encountering non-collaborative users, as well as agent weaknesses under each non-collaborative condition such as escalated hallucinations and dialogue breakdowns. Our findings point to the need for methods that can improve agent robustness to the wide range of user behaviors encountered in deployment. We release the extensible simulation framework to help the community develop and stress-test tool agents under realistic conditions within their own service domains. Our code is available at https://github.com/holi-lab/NCUser.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。