arXiv:2605.17292cs.AIcs.MA2026-05被引 1

让AI团队自我评估能力,智能分工提升任务准确率

MetaCogAgent: A Metacognitive Multi-Agent LLM Framework with Self-Aware Task Delegation

  • 每个AI agent自带能力自评模块,判断能否胜任任务
  • 在700个任务上准确率达82.4%,比最佳基线高8.7%
  • 适合需要可靠协作的复杂任务系统,如智能客服、科研助手

多智能体大模型系统通过协作解决复杂任务展现出潜力。但现有框架按预设角色分配任务,忽视智能体对自身能力边界的认知,导致超出专长的任务仍盲目执行。受认知科学中元认知理论启发,我们提出MetaCogAgent,一种配备元认知自评估单元的多智能体框架,可在执行前评估任务与能力的匹配度。该框架包含三项贡献:(1)通过结合口语化不确定性与历史能力记录,估算每项任务的置信度;(2)通过跨智能体评估,将低置信度任务动态转给更合适者;(3)通过控制反馈机制,迭代优化各智能体的能力模型。在自建的MetaCog-Eval基准(5个认知维度共700个任务)上的实验表明,MetaCogAgent实现82.4%的任务准确率——比最优路由基线高出8.7%,同时比AutoGen少用5%接口调用,比集成投票少34%。消融实验证明每个元认知组件均对整体性能有贡献。

原文摘要 · Abstract (English)

Multi-agent large language model (LLM) systems have shown promise for solving complex tasks through agent collaboration. However, existing frameworks assign tasks based on predefined roles without considering whether an agent can accurately assess its own competence boundaries, leading to overconfident execution on tasks beyond its expertise. Inspired by metacognition theory from cognitive science, we propose MetaCogAgent, a multi-agent LLM framework where each agent is equipped with a Metacognitive Self-Assessment Unit that evaluates task-capability alignment before execution. The framework introduces three contributions: (1) a self-assessment mechanism that estimates per-task confidence by combining verbalized uncertainty with historical capability profiles; (2) an adaptive delegation protocol that routes low-confidence tasks to better-suited agents through cross-agent evaluation; and (3) a capability boundary learning module that iteratively refines each agent's competence model via cybernetic feedback. Experiments on our constructed MetaCog-Eval benchmark (700 tasks across 5 cognitive dimensions) demonstrate that MetaCogAgent achieves 82.4% task accuracy -- 8.7% above the best routing baseline -- while using 5% fewer API calls than AutoGen and 34% fewer than ensemble voting. Ablation studies confirm that each metacognitive component contributes to overall system performance.

多智能体元认知任务分配LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。