arXiv:2608.26683cs.AIcs.LG2026-08

通过结构化分组提升多智能体在噪声观测下的协作鲁棒性

SIGMA: Structured Noise-Effect-Aware Grouped Multi-Agent Aggregation

论文配图:SIGMA: Structured Noise-Effect-Aware Grouped Multi-Agent Aggregation
图 1 · 摘自论文原文
  • 基于密度聚类将智能体分组,组内共识聚合保留任务相关特征
  • 跨组注意力机制融合异构贡献,保持全局协调性
  • 在星际争霸II噪声任务中显著提升鲁棒性,零噪声下性能不降

协同多智能体强化学习(MARL)在噪声观测下面临严重协调挑战。尽管观测扰动通常独立作用于各智能体,但其对协同决策的下游影响会通过潜在合作结构呈现结构性特征,即噪声引发的决策偏差在任务相关性强的智能体间具有局部相关性,而在不同局部结构间则呈现全局异质性。现有鲁棒MARL方法很少显式建模或利用这种依赖结构的噪声效应。为此,本文提出SIGMA,一种层次化协作框架,通过利用合作结构学习噪声下的鲁棒表示。SIGMA首先基于密度聚类将智能体自适应划分为局部结构,并在组内执行共识聚合,以保留共享的任务相关信息并平滑个体表示偏差;随后通过跨组注意力机制自适应整合不同组的信息,既保持全局协调,又容纳其异质性贡献。在星际争霸II的噪声观测任务上的实验验证了结构化噪声效应的存在,并表明SIGMA在噪声环境下持续提升鲁棒性,同时在无噪声环境中保持竞争性表现。

原文摘要 · Abstract (English)

Cooperative multi-agent reinforcement learning (MARL) faces significant challenges in maintaining robust coordination under noisy observations. Although observation disturbances are often introduced independently across agents, their downstream effects on cooperative decision-making can become structured through underlying cooperation structures. We characterize this phenomenon as structured noise effects, where noise-induced decision effects exhibit local correlation among agents with stronger task-related dependencies while remaining globally heterogeneous across different agents and local structures. Existing robust MARL methods, however, rarely explicitly characterize or exploit such structure-dependent noise effects. To address this limitation, we propose SIGMA, a hierarchical collaboration framework that exploits cooperation structures to learn robust representations under noisy observations. SIGMA first organizes agents into adaptive local structures through density-based grouping and performs intra-group consensus aggregation to preserve shared task-relevant information while smoothing agent-specific representation deviations. Inter-group attention then adaptively integrates information across different groups to preserve global coordination while accommodating their heterogeneous contributions. Experiments on noisy-observation tasks in StarCraft II empirically validate the structured noise effects and demonstrate that SIGMA consistently improves robustness under observation noise while maintaining competitive performance in noise-free environments.

多智能体鲁棒学习结构化噪声协作机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。