arXiv:2607.23678cs.AI2026-07

让多智能体系统自动聚焦关键任务,节省计算资源。

Focus Is All You Need: Adaptive Goal-aware Attention Orchestration for Multi-Agent Graph Systems

论文配图:Focus Is All You Need: Adaptive Goal-aware Attention Orchestration for Multi-Agent Graph Systems
图 1 · 摘自论文原文
  • 根据目标、结构和资源动态分配注意力,决定哪些智能体该执行。
  • 实验显示任务成功率提升,计算量、延迟和令牌消耗均减少。
  • 适合需要高效协调多个智能体的复杂任务系统使用。

大型语言模型(LLMs)使智能体具备推理、规划和工具使用能力。近期系统越来越多地将这些智能体组织为由专门节点组成的图结构。尽管基于图的调度支持灵活的任务分解与协作,但带来了关键挑战:注意力分配。随着工作流扩展,现有方法常对所有组件进行均匀执行,导致在无关或低影响任务上浪费资源。本文提出注意力编排范式,将Transformer式的注意力从文本标记层面扩展至工作流级的智能体协调。提出的自适应目标感知注意力编排(AGAO)框架,基于用户目标、图依赖关系和计算约束,动态评估智能体重要性。AGAO包含三个组件:(1) 目标感知注意力,衡量用户目标与智能体能力间的语义相关性;(2) 拓扑感知注意力,建模智能体图中的结构依赖;(3) 资源感知注意力,跨异构智能体分配预算与执行优先级。三者协同将静态智能体图转化为可自适应的系统,聚焦于目标关键推理路径。在多种多智能体工作负载上的实验表明,相较于现有图执行策略,AGAO在提升任务有效性的同时,显著降低了不必要的计算、延迟和令牌消耗。本工作确立了‘注意力工程’作为构建可扩展、智能多智能体系统的新方向。代码见:https://github.com/MingzhouFan97/AGAO。

原文摘要 · Abstract (English)

Large language models (LLMs) enable autonomous agents for reasoning, planning, and tool use. Recent systems increasingly organize these agents as graphs of specialized, interconnected nodes. Although graph-based orchestration supports flexible decomposition and coordination, it creates a key challenge: \textbf{attention allocation}. As workflows grow, existing approaches often execute graph components uniformly, wasting resources on irrelevant or low-impact tasks. We introduce \textbf{Attention Orchestration}, a paradigm that extends Transformer-style attention from token representations to workflow-level agent coordination. Our framework, \textbf{Adaptive Goal-aware Attention Orchestration (AGAO)}, dynamically estimates agent importance based on user objectives, graph dependencies, and computational constraints. AGAO combines three components: (1) goal-aware attention, measuring semantic relevance between user goals and agent capabilities; (2) topology-aware attention, modeling structural dependencies in agent graphs; and (3) resource-aware attention, allocating budgets and execution priorities across heterogeneous agents. Together, these mechanisms transform static agent graphs into adaptive systems that focus computation on goal-critical reasoning paths. Experiments across diverse multi-agent workloads show that AGAO improves task effectiveness while reducing unnecessary computation, latency, and token consumption compared with existing graph-based execution strategies. Our work establishes \textbf{Attention Engineering} as a direction for scalable, intelligent multi-agent systems. Code: https://github.com/MingzhouFan97/AGAO.

多智能体注意力机制图神经网络智能调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。