用大模型自动生成智能体交互数据,省去人工标注。
FABRIC: Framework for Agent-Based Realistic Intelligence Creation
- 纯用大模型生成包含工具调用与执行轨迹的完整交互记录。
- 支持多任务、多轮对话,数据符合严格语法语义约束。
- 适合训练能可靠使用工具的智能体系统,无需人工标注。
大型语言模型(LLMs)正被越来越多地用作智能体,在动态环境中需分解目标、调用工具并验证结果。实现这些能力需要结构化的智能体数据,包括用户意图与工具定义、基于证据的调用以及可验证的执行轨迹。然而,从人工标注者收集此类数据成本高、耗时长且难以扩展。本文提出一个统一框架,仅使用大模型即可合成智能体数据,无需任何人工监督。该框架将生成过程分解为模块化流水线,生成涵盖任务规范、工具定义、策略伪代码、自然语言交互和执行轨迹的完整交互记录。记录符合严格的语法与语义约束,确保机器可解析且输入、输出与工具调用对齐。框架支持单任务、多任务及多轮交互,可构建反映全谱工具使用能力的数据集。通过引入受限生成格式、JSON-schema校验和判别器过滤机制,保障数据质量与一致性。本文正式定义了智能体记录的结构,阐述引导生成的提示设计原则,并提出可扩展的高质量合成数据流水线。该方法提供了一种可复现的、仅依赖大模型的替代方案,推动具备稳健工具使用能力的智能体大模型的发展。
原文摘要 · Abstract (English)
Large language models (LLMs) are increasingly deployed as agents, expected to decompose goals, invoke tools, and verify results in dynamic environments. Realizing these capabilities requires access to agentic data-structured interaction records that couple user intents with tool specifications, argument-grounded calls, and verifiable execution traces. However, collecting such data from human annotators is costly, time-consuming, and difficult to scale. We present a unified framework for synthesizing agentic data using only LLMs, without any human-in-the-loop supervision. This framework decomposes generation into modular pipelines that produce complete interaction records spanning task specifications, tool definitions, policy pseudocode, natural language exchanges, and execution traces. Records conform to strict syntactic and semantic constraints, ensuring machine-parseability and faithful alignment across inputs, outputs, and tool calls. Beyond single tasks, there is support for both multi-task and multi-turn agent interactions, enabling the construction of datasets that reflect the full spectrum of tool-use competencies. To ensure quality and consistency, the framework integrates constrained generation formats, JSON-schema validation, and judge-based filtering. This paper formalizes the schema for agentic records, details the prompt design principles that guide generation, and introduces scalable pipelines for high-quality synthetic data. By providing a reproducible, LLM-only alternative to manual collection, hence advancing the development of agentic LLMs capable of robust tool use.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。