一个模型同时搞定多轮对话和工具调用,性能超越专用模型。
Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language Model
- 用多任务数据融合多轮推理与复杂工具调用,训练统一模型。
- 在三个基准上均超越GPT-4o等顶尖专用模型,最高提升12.3%。
- 适合需要兼顾对话连贯性与智能工具使用的场景开发者。
具备API调用能力的大语言模型推动了语言智能体(LA)的发展,也革新了传统任务导向对话(TOD)范式。但现有方法面临困境:TOD系统仅针对有限API训练,新增服务需重新标注数据;而语言智能体缺乏多轮对话中用户意图的持续保持能力。为此,我们在MultiWOZ 2.4(TOD)、BFCL V3(LA)和API-Bank(LA)三个基准上评估二者能力,发现专用模型在各自领域表现优异,但在另一领域明显不足。为弥合差距,我们提出统一框架CoALM(Conversational Agentic Language Model),构建了精心设计的多任务数据集CoALM-IT,将多轮ReAct推理与复杂API使用交错训练。基于此,我们训练了CoALM 8B、70B和405B三款模型,在所有基准上均超越当前最优领域专用模型,包括GPT-4o。结果表明,单一模型实现TOD与LA双重能力可行,为对话智能体树立新标准。
原文摘要 · Abstract (English)
Large Language Models (LLMs) with API-calling capabilities enabled building effective Language Agents (LA), while also revolutionizing the conventional task-oriented dialogue (TOD) paradigm. However, current approaches face a critical dilemma: TOD systems are often trained on a limited set of target APIs, requiring new data to maintain their quality when interfacing with new services, while LAs are not trained to maintain user intent over multi-turn conversations. Because both robust multi-turn management and advanced function calling are crucial for effective conversational agents, we evaluate these skills on three popular benchmarks: MultiWOZ 2.4 (TOD), BFCL V3 (LA), and API-Bank (LA), and our analyses reveal that specialized approaches excel in one domain but underperform in the other. To bridge this chasm, we introduce CoALM (Conversational Agentic Language Model), a unified approach that integrates both conversational and agentic capabilities. We created CoALM-IT, a carefully constructed multi-task dataset that interleave multi-turn ReAct reasoning with complex API usage. Using CoALM-IT, we train three models CoALM 8B, CoALM 70B, and CoALM 405B, which outperform top domain-specific models, including GPT-4o, across all three benchmarks. This demonstrates the feasibility of a single model approach for both TOD and LA, setting a new standard for conversational agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。