让小模型子代理学会合理拒绝,提升大系统可靠性
EARS: Explanatory Abstention for Reliable Sub-Agent Modeling in Large-scale Multi-Agent Systems

- 把子代理拒绝请求变成有解释的通信协议
- 生产环境测试中响应成功率从68.5%升至78.9%
- 适合构建可靠多智能体系统的工程师和研究员
在大规模企业场景中,中心化多智能体系统(MAS)日益普及,由协调器将用户请求分配给轻量级、领域专精的子代理。该架构虽提升模块化与可扩展性,但可靠性依赖于精准路由及子代理对自身能力限制的校准。尤其是基于较小微调模型的子代理常因校准不足,在模糊、不完整、错配或无支持的请求下过度回应,产生幻觉输出而非可操作反馈。为此,本文提出EARS(Explanatory Abstention for Reliable Sub-Agent Modeling),一个面向生产的框架,将子代理的拒绝行为重构为跨代理通信协议:子代理不仅拒绝,还向协调器暴露可操作的失败状态。EARS通过集成校准过的LLM-as-a-Judge模型,收集人机交互数据,生成结构化拒绝标签与理由,涵盖子代理失败模式的分类体系。这些数据用于微调子代理,使其能检测失败条件并返回理由,供协调器进行澄清、重路由或备选处理。我们在支持企业级商业智能工作流的大规模生产电商助手上评估EARS,结果显示整体响应通过率从68.5%提升至78.9%,证明子代理端的解释性拒绝显著提升了多智能体系统可靠性。
原文摘要 · Abstract (English)
In large-scale enterprise settings, centralized multi-agent systems (MAS) are increasingly adopted, in which a coordinator delegates user requests to lightweight, domain-specialized sub-agents. While this architecture improves modularity, scalability, and cost efficiency, its reliability depends not only on accurate routing but also on sub-agents' ability to calibrate their responses to capability constraints. In particular, sub-agents built on smaller fine-tuned models often struggle with such calibration, leading them to over-answer ambiguous, underspecified, misrouted, or unsupported requests and produce hallucinated outputs instead of actionable feedback. To address this challenge, we present EARS (Explanatory Abstention for Reliable Sub-Agent Modeling), a production-oriented framework that reframes sub-agent abstention as an inter-agent communication protocol: a sub-agent does not merely abstain, but exposes an actionable failure state to the coordinator. EARS curates human-agent interaction data using an ensemble of calibrated LLM-as-a-Judge models, producing structured abstention labels and rationales under a taxonomy of sub-agent failure modes. These data are used to fine-tune sub-agents to detect failure conditions and return rationales for coordinator-level clarification, rerouting, or fallback. We evaluate EARS in a large-scale production e-commerce assistant supporting enterprise business intelligence workflows. EARS improves the overall response pass rate from 68.5% to 78.9%, demonstrating that sub-agent-side explanatory abstention improves MAS reliability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。