arXiv:2604.25135cs.CL2026-04ACL被引 2

针对开源大模型在对话工具使用中易出错的问题,提出故障感知的代理框架提升可靠性。

FAMA: Failure-Aware Meta-Agentic Framework for Open-Source LLMs in Interactive Tool Use Environments

论文配图:FAMA: Failure-Aware Meta-Agentic Framework for Open-Source LLMs in Interactive Tool Use Environments
图 1 · 摘自论文原文
  • 通过分析失败轨迹,识别常见错误并动态调用专用代理应对
  • 在多个开源模型上实现最高27%的性能提升
  • 适合构建需要多轮交互与工具调用的可靠智能体

大型语言模型正被广泛部署为自主代理的核心决策系统,可作用于外部环境。然而,在模拟真实客户问题解决场景的对话基准中,这些代理常因错误决策的级联效应而失败。这一问题在参数量较小、上下文窗口有限、推理预算受限的开源LLM中尤为突出,导致错误累积加剧。为此,我们提出故障感知的元代理框架(FAMA)。FAMA分两阶段运行:首先分析基线代理的失败轨迹,识别最常见错误;其次通过编排机制,在决策前向工具使用代理注入针对性上下文,激活最小化专用代理以应对特定故障。在多个开源LLM上的实验表明,该框架在不同评估模式下性能提升最高达27%。结果表明,通过专用代理精准优化上下文以应对常见失败,是构建可靠、多轮工具使用型LLM代理的重要设计原则。

原文摘要 · Abstract (English)

Large Language Models are being increasingly deployed as the decision-making core of autonomous agents capable of effecting change in external environments. Yet, in conversational benchmarks, which simulate real-world customer-centric issue resolution scenarios, these agents frequently fail due to the cascading effects of incorrect decision-making. These challenges are particularly pronounced for open-source LLMs with smaller parameter sizes, limited context windows, and constrained inference budgets, which contribute to increased error accumulation in agentic settings. To tackle these challenges, we present the Failure-Aware Meta-Agentic (FAMA) framework. FAMA operates in two stages: first, it analyzes failure trajectories from baseline agents to identify the most prevalent errors; second, it employs an orchestration mechanism that activates a minimal subset of specialized agents tailored to address these failures by injecting a targeted context for the tool-use agent before the decision-making step. Experiments across open-source LLMs demonstrate performance gains up to 27% across evaluation modes over standard baselines. These results highlight that targeted curation of context through specialized agents to address common failures is a valuable design principle for building reliable, multi-turn tool-use LLM agents that simulate real-world conversational scenarios.

大模型代理工具使用故障修复开源LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。