构建可扩展的用户导向对话生成框架,实现真实人类协作般的多轮工具调用对话。
User-Oriented Multi-Turn Dialogue Generation with Tool Use at scale
- 用大模型模拟用户行为,动态生成任务与交互,打破固定工具集限制。
- 生成高密度、长回合对话数据,单条轨迹可完成多个任务,更贴近真实场景。
- 模块化设计支持任意状态启动,适合研究复杂人机协作与多轮交互建模。
大型推理模型(LRM)作为自主智能体的兴起,推动了对复杂多轮工具调用能力的需求。然而现有数据集和生成方法受限于静态预设工具集,难以适应开放的人机协作场景。为此,我们提出一种基于LRM模拟器的规模化任务导向多轮对话生成框架,动态生成领域特定工具以解决指定任务。但发现纯任务导向设计易导致对话过短,缺乏真实交互性。因此,我们转向用户导向模拟范式:将任务生成与独立用户模拟器解耦,后者模拟人类逐步请求、逐轮反馈等行为规则,从而生成更自然、更持久的多轮对话。生成流程具备高度可扩展性,可从任意状态启动,支持单个对话中完成多个任务,产出高密度数据,更真实反映现实人机交互的多重需求。
原文摘要 · Abstract (English)
The recent paradigm shift toward large reasoning models (LRMs) as autonomous agents has intensified the demand for sophisticated, multi-turn tool-use capabilities. Yet, existing datasets and data-generation approaches are limited by static, predefined toolsets that cannot scale to the complexity of open-ended human-agent collaboration. To address this, we initially developed a framework for automated task-oriented multi-turn dialogue generation at scale, utilizing an LRM-based simulator to dynamically generate high-value, domain-specific tools to solve specified tasks. However, we observe that a purely task-oriented design often results in "solely task-solving" trajectories, where the agent completes the objective with minimal interaction, failing to generate the high turn-count conversations seen in realistic scenarios. To bridge this gap, we shift toward a user-oriented simulation paradigm. By decoupling task generation from a dedicated user simulator that mimics human behavioral rules - such as incremental request-making and turn-by-turn feedback - we facilitate more authentic, extended multi-turn dialogues that reflect the iterative nature of real-world problem solving. Our generation pipeline operates as a versatile, plug-and-play module capable of initiating generation from any state, ensuring high scalability in producing extended tool-use data. Furthermore, by facilitating multiple task completions within a single trajectory, it yields a high-density dataset that reflects the multifaceted demands of real-world human-agent interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。