用四角色大模型循环生成带状态追踪的工具增强型对话数据,解决标注难、幻觉多问题。
State-Grounded Multi-Agent Synthetic Data Generation for Tool-Augmented LLMs
- 四角色大模型闭环生成,通过状态管理器确保工具调用真实一致
- 在三组生产数据上工具调用幻觉得分达9.66/10,显著降低错误率
- 支持角色属性可调、层级代理协作,适合训练真实场景的智能体
训练工具增强型大模型智能体需要大量多轮、工具关联的对话数据,但这类数据人工标注成本高、生产环境受隐私限制,且公开数据集稀缺。我们提出StateGen,一个合成数据生成平台,通过四角色大模型循环(人格化用户模拟器、待测智能体、状态驱动工具模拟器、多维度大模型评估者)生成带评分、富含推理痕迹的训练对话。核心创新是权威状态管理器,在多轮对话中维护结构化世界状态对象,强制后端为真原则,从构造上消除主流的工具调用幻觉。StateGen可通过将子智能体声明为工具,自然扩展至层级多智能体设置,所有智能体共享同一状态对象。我们在三个生产数据集上评估了64,698条对话:工具调用幻觉得分达9.66/10;通过23维特质向量实现人格化变化;训练集与黄金测试集清晰分离,经逐项指标分析确认数据未被记忆。与八种外部系统对比显示,无一公开平台同时具备多轮生成、状态驱动工具模拟、层级多智能体支持和内置评分机制。
原文摘要 · Abstract (English)
Training tool-augmented LLM agents requires large corpora of multi-turn, tool-grounded conversational data that is expensive to annotate, privacy-constrained in production settings, and largely absent from public datasets. We present StateGen, a synthetic data generation platform that produces scored, reasoning-trace-rich training conversations by orchestrating a four-role LLM loop: a persona-conditioned user simulator, an agent under test, a state-grounded tool simulator, and a multi-axis LLM judge. The key architectural contribution is an authoritative state manager that maintains a structured world-state object across turns, enforcing a backend-is-truth invariant that eliminates the dominant class of tool-call hallucinations by construction. StateGen extends naturally to hierarchical multi-agent settings by declaring sub-agents as tools, all sharing a single state object. We report results on 64,698 evaluated conversations across three production corpora: tool-call hallucination scores reach 9.66/10, the system supports persona-driven variation via a 23-dimensional trait vector, and a cleanly separated train and golden evaluation set split confirms the data is not memorization bait (per-criterion gap analysis). Comparison with eight external systems shows that no single publicly available platform combines multi-turn generation, state-grounded tool simulation, hierarchical multi-agent support, and built-in judge scoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。